The present invention relates generally to display systems and, in particular, display systems having improved power profiles.
High Dynamic Range (HDR) display systems have extended the performance of image rendering to accommodate the human eye's dynamic range—resulting in a demonstrably better visual experience for the viewer. However, in some embodiments of such HDR display systems, this is brought about by the effective local modulation of arrays of individual light emitters, such as LEDs. Power usage of these displays (e.g. monitors, laptop displays, mobile displays, television, etc.) has become a concern.
As a result, reducing the overall—as well as instantaneous—power demands of such displays may be desired.
In several embodiments of the present invention, techniques are provided to provide various pulse width modulation (PWM) schemes to embodiments of dual modulator display systems. Dual modulator display systems comprise a backlight of individually addressable and controllable light emitters. The backlight provides illumination to a light modulator, e.g. an LCD, for further conditioning of the light to be presented to a viewer. In one embodiment, the backlight is striped and each stripe is assigned a PWM scheme that effectively increases the bit depth of the controller for each stripe. In another embodiment, the display system may allow a better matching of PWM periods to LCD frame rates to reduce visual artifacts. In another embodiment, the display system may detect a small bright feature to be rendered in the image data and, with a pre-assignment of light emitters to different partitions, the backlight controller may drive a subset of the light emitters according to the partitions—as opposed to driving the subset according to the PWM scheme.
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
Example possible embodiments, which relate to image processing techniques, are described herein. In the following description, for the purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are not described in exhaustive detail, in order to avoid unnecessarily occluding, obscuring, or obfuscating the present invention.
In some such displays, the backlight includes multiple light emitting devices, such as LEDs, for illuminating regions of the spatial light modulator. Such light emitting devices or groups of such light emitting devices may be separately controllable so that the intensity of light emitted by the backlight can be made to vary in a desired way over the spatial light modulator. Such displays are referred to herein as dual-modulation displays. Some examples of dual modulation displays are described in co-owned patents and patent applications: (1) U.S. Pat. No. 6,891,672 (“the '672 patent”) and entitled “HIGH DYNAMIC RANGE DISPLAY DEVICES”, (2) U.S. Pat. No. 7,403,332 (“the '332 patent”) and entitled “HIGH DYNAMIC RANGE DISPLAY DEVICES”, and (3) United States Patent Application Publication No. 2008/0180466 (“the '466 application”) and entitled “RAPID IMAGE RENDERING ON DUAL-MODULATOR DISPLAYS”, all of which are hereby incorporated herein by reference in their entirety.
In addition, in co-owned patent applications: (1) WO/2011/011548 (“the '548 application”) entitled “REDUCED POWER DISPLAYS” and (2) WO/2011/011446 (“the '446 application”) entitled “CONTROL OF ARRAY OF TWO-DIMENSIONAL IMAGING ELEMENTS IN LIGHT MODULATING DISPLAYS” (both of which are herein incorporated by reference in their entirety), there are described display systems comprising an array of independently controllable backlights (e.g., LEDs, OLEDs, electroluminescent panels (ELPs), CCFLs, incandescent lamps, quantum dots and/or other controllable emitters or the like) and a light modulator (e.g. LCD or the like). These display systems have demonstrably better dynamic range performance than other display systems commonly in use—primarily through the combined effects of separately modulating the backlight in a local manner (typically dependent upon image data meant to be rendered in substantially real time) and convolving with the light modulator.
As some embodiments of these display systems may employ a reasonably large number of emitters in their backlight, overall power consumption of these systems is a concern. In particular, the '446 application describes a number of techniques, systems and methods meant to reduce the total power consumption of such unique display configurations. By application of various Pulse Width Modulation (PWM) schemes, the techniques of the '446 application help to reduce the overall power consumption. PWM typically involves controlling the brightness of light emitters on a backlight. A light emitting device such as an LED may be switched between an ON state at 100% brightness and an OFF state at 0% brightness by switching on and off a suitable fixed electrical current through the device. PWM operates by pulsing each light emitter to its ON state for some percentage of a repeating time period. If the time period is sufficiently short (e.g. 1 millisecond) the human visual system does not detect the light emitter cycling between ON and OFF states. An observer merely perceives the average emitted light intensity, which is proportional to the percentage of the PWM period that the device is in the ON state. This percentage is referred to as the duty cycle of the PWM signal. For example, a light emitter driven by a PWM signal with a duty cycle of 75% is switched on for 75% of each PWM period and appears to an observer as if it were steadily emitting light having a brightness of 75% of its maximum brightness. Further improvements (as described herein) to these PWM schemes may allow for even greater improvements of the overall power consumption.
For one conventional example of PWM,
The waveform Ptotal in
A drawback to PWM when used with multiple light emitters is that the light emitters are all turned on simultaneously for some duration during the beginning of each PWM cycle (for any non-zero brightness setting). The result is that the power supply for the display must be able to deliver enough power to fully drive all of the light emitters for at least a short time and to provide this power almost instantaneously, regardless of the display's effective brightness level. This requirement increases the cost and complexity of the display's power supply, particularly for backlights having large numbers of light emitters. Some backlights may have dozens, hundreds or thousands of individual light emitters. This problem is particularly acute in the case that the display has the capability of displaying very bright images as is the case, for example, in some high dynamic range (HDR) displays. Such displays may be capable of displaying images having local light intensities of 2000 cd/m2 or more. In such displays, light emitting elements may be of types that consume significant electrical power in their ON states.
In some embodiments, such transient power requirements are reduced by dividing the light emitters of a backlight into several groups and staggering the start times of PWM cycles for different ones of the groups over time. The light emitters can be divided into groups in any convenient manner.
The waveform Ptotal of
For example, assuming for the sake of simplicity that each PWM signal I1′-I4′ drives a light emitter consuming power of (Ion) (Von) when in an ON state, Ptotal′ steps up incrementally by (Ion) (Von) at times t0, t1 and t2 to a maximum Pmax′ of 3(Ion)(Von). Thus, the maximum power Pmax′ is 75% of the equivalent maximum power Pmax of 4(Ion)(Von) required when the PWM signals are in phase as illustrated in
This concept may be extended to provide embodiments having any number of groups of light emitters having any suitable relative phase shift between their PWM signals. For example, in some embodiments light emitters are divided into N groups wherein PWM signals of each group are phase-shifted by 360 /N relative to one another. The power requirements of a backlight will vary depending on a number of factors including the number of light emitters and the duty cycles and phase offsets of the PWM signals applied to each light emitter. The duty cycles (and hence the brightness levels) of the light emitters may be independently controllable as mentioned above. In some embodiments, advantages obtained by phase-shifting PWM signals may include the advantage that total power ramps up more gradually, is distributed more evenly and is held to a lower maximum value than if the same PWM signals were applied in phase.
PWM signals for a given image may cycle without change for as long as that image is being displayed. When a new image is displayed, the PWM driving signals may be updated to reflect image data for the new image. During the first PWM cycle of each new image, the total power may be required to ramp up from zero to a maximum value determined by the updated PWM signals. As described above, this initial ramp-up time may be extended by configuring groups of PWM signals to be out of phase with one another. During subsequent PWM cycles of the same image the total power may remain constant at this maximum value (as in the example illustrated in
For video images, image data and corresponding PWM driving signals may be updated at the start of each video frame. The PWM period may be much shorter than the video frame period such that multiple PWM cycles occur within a single video frame. For example, in some embodiments video frame periods are in the range of 3 to 16.7 milliseconds while PWM periods are in the range of 0.1 to 2 milliseconds. Example waveforms representing frame periods and PWM periods are illustrated in
According to another embodiment, the duration of the first PWM cycle after an image update is extended in time relative to subsequent PWM cycle periods of the same image. The image may be a video frame or a still image. Since power fluctuation or surges tend to be greatest during the first PWM cycle (as power ramps up from zero to a maximum value as illustrated in
Waveform 54 of
Decreasing the ramp-up rate, magnitude and frequency of power variations of a backlight as described above may in turn decrease the complexity and cost of the power supply needed to power the backlight. For example, various parameters of a power supply such as surge capacity, load regulation and transient response may be eased where PWM signals are offset as illustrated in
Furthermore, the efficiency and reliability of the power supply may be increased where PWM signals are offset as illustrated in
A display incorporating backlight 60 may also comprise a controller 66 that generates brightness signals 68 according to input image data 70. Brightness signals 68 may be analog or digital signals representing the desired brightness level for one or more light emitters 64. Backlight 60 may also comprise one or more PWM controllers 72 for converting brightness signals 68 into PWM driving signals 74, which may directly control the brightness of light emitters 64. In some embodiments, backlight 60 comprises multiple PWM controllers 72, each controlling multiple light emitters 64 such as LEDs. In some embodiments, each tile 62 comprises one or more PWM controllers 72 for controlling light emitters 64 on that tile. For example, tiles 62 comprise PCBs having PWM controllers 72 integrated therein for controlling light emitters 64 on that PCB. Controller 66 and PWM controller 72 may be separate physical devices or may be combined within the same physical device.
PWM driving signals 74 may be waveforms comprising a sequence of cycles having a given duration, duty cycle and phase offset. PWM driving signals 74 may operate to switch on and off a fixed electrical current through a light emitter 64. In some embodiments, PWM driving signals 74 of one tile are phase shifted relative to PWM driving signals 74 of another tile (as illustrated for example in
In the illustrated embodiment, PWM controller 72 outputs multiple PWM driving signals 74 that each controls a separate tile 62. In some embodiments, all light emitters 64 on a tile 62 are controlled by a common PWM driving signal 74 generated for that tile. In other embodiments, duty cycles of PWM driving signals 74 for each light emitter 64 are independently controllable by one or more PWM controllers 72.
In some embodiments a controller chip or circuit individually controls multiple light emitters. In some embodiments the PWM controller chip or circuit is configured so that start times of the PWM signals generated for the light emitters are staggered relative to one another. In a backlight constructed using such PWM controller chip or circuits the times at which different groups of light emitters are turned ON are automatically staggered.
Backlight 60 also comprises a power supply 76 for providing electrical power to light emitters 64 on the backlight. Power supply 76 may be configured to satisfy particular power requirements necessary to generate the desired range of brightness of light emitters 64. Such power requirements may include load regulation, transient response and/or surge capacity for example. If the start time of groups of PWM signals are staggered as illustrated in
Similarly, in some embodiments power supply 76 is capable of a maximum output surge current (out-rush current) that is less than the total in-rush current that would be required by light emitters 64 if all light emitters 64 were switched on at the same time. For example, if backlight 60 comprises N light emitters and each light emitter requires an in-rush current of Irush when switched on, then power supply 76 may have a maximum out-rush current of less than N(Irush) while being capable of supplying the average current required. In some embodiments, power supply 76 has a maximum out-rush current less than 0.75(N)(Irush). In some embodiments, power supply 76 has a maximum out-rush current less than 0.5(N)(Irush).
Power supply 76 may be configured to have the capacity to supply a continuous output current sufficient to sustain a desired average brightness of backlight 60. In some embodiments, power supply 76 is capable of generating a maximum average light intensity over the entire backlight 60 that is less than localized light intensities it may generate over portions of backlight 60. For example, power supply 76 may be capable of generating localized light intensities of 2000 cd/m2 or more over portions of backlight 60 while only capable of generating a maximum average light intensity of 400 cd/m2 over the entire backlight 60.
In the '548 application, there is described a method (labeled method 100 in
At block 102 of method 100 involves determining brightness values for all light emitters on a backlight of a display based on image data representing an image to be displayed. In that method, the light emitters are divided into a plurality of groups. The brightness values may be determined independently for each separate light emitter or for each separate group so that the intensity of light emitted by the backlight and incident on a spatial light modulator can be made to vary in a desired way over the spatial light modulator. The brightness values may be represented by electronic analog or digital signals, for example.
At block 104 of method 100, PWM duty cycles are determined for the light emitters of each group based on the brightness values determined at block 102. The duty cycles may be expressed for example as the percentage or ratio of each PWM period that the light emitter should be in an ON state to produce the desired brightness level.
At block 106 of method 100, PWM driving signals having the duty cycle determined at block 104 and a phase offset predetermined for each group are generated and applied to each light emitter. The phase offsets applied for each group differ from one another so as to stagger the start times of PWM cycles of different groups (as illustrated in
At block 108, the duration of each PWM cycle is set such that a first PWM cycle of the image is longer than duration of subsequent PWM cycles for the given image (as is illustrated in
It is not necessary that a PWM cycle always comprise a contiguous on-time portion followed by a contiguous off-time portion. For a given duty cycle, the pattern of on-time and off-time may varied so long as the overall ratio of on-time to off-time within the cycle is maintained. For example, the order of on-time and off-time within a cycle may be reversed such that a light emitter remains off for some first portion of the cycle and then turns on for the remaining portion of the cycle. In this case, light emitters having different brightness levels may turn on at different times within the same PWM cycle (and switch off at the same time at the end of the cycle).
As another example, on-time may also be centered within a PWM cycle such that different power levels rise and fall at different times. On-time and off-time may be interspersed within a PWM cycle in any other chosen manner so long as the overall proportion of on-time to off-time within the cycle remains the same. Where a discrete number of brightness levels are defined for light emitters of the display (for example 2n brightness levels where n is a number of bits defining brightness), each cycle may be divided into that number of segments (for example 2n segments) during which a light emitter may be set ON or OFF. Each brightness level may correspond to a particular pattern of ON/OFF segments within a PWM cycle. Different groups of light emitters may employ different sets of ON/OFF patterns for each brightness level such that on-times between groups are staggered even if set to the same brightness level. The total power requirements may thus be distributed more evenly across PWM cycles.
Variations in the distribution of on-time and off-time within PWM cycles may be combined with variations in phase offsets for groups of PWM signals as described above. For example, the start times of individual light emitters within a group having a common phase offset may be staggered by measuring duty cycles from the end of each PWM cycle. If the duration of the first cycle of each new image is made longer than a default PWM period, the initial ramp-up time required may be correspondingly extended as well.
In some embodiments, each clock signal 124 may be switched between a first clock signal used for the first PWM cycle of a displayed image and a second clock signal used for subsequent PWM cycles of the same image. The first clock signal may have a longer period than the corresponding second clock signal (for example a period of 2T compared to T), but the same phase offset. The first clock signal may thus be used to extend the duration of the first PWM cycle of each displayed image relative to the duration of subsequent PWM cycles of the same image. In alternative embodiments the frequency of a clock signal may be changed such that a period of a first PWM cycle is longer than that of subsequent PWM cycles.
Now it will be described additional embodiments of phasing relationships and display systems. Some embodiments herein described may affect: (1) reduced instantaneous power demands, (2) increase backlighting precision with increased bit-depth of PWM drivers and/or controllers, (3) better matching the backlighting to images being rendered and (4) provide better text readability by providing backlight blanking at desired times.
One embodiment of a display system with such a phasing relationship will now be described with particular referenced specifications. It will be appreciated that the specifications described herein are exemplary and not limiting to the scope of the present application.
In one embodiment, the system may take a single frame and divided it into multiple PWM cycles. These PWM cycles may be individually controlled and can be reloaded per PWM period, thereby allowing the system to reload values given a single deep bit PWM value for that frame. The system may then further optimize this to distribute the start times in phases. This may be affected by splitting the PWM periods into phases and distributing the values of that PWM period to that phase. Such a system may not require as much instantaneous power because while a low value PWM LED shuts down on the later phases, the other LEDs may begin to turn ON. This allows an effective distribution of the overlap of LED PWM's being ON—thus simultaneously increasing the lifetime of the supply and easing the requirements of the power supply.
As the PWM controller works at a comparatively faster frame rate (e.g., 3.6 Khz) then this PWM frame rate may be compared with the video frame operating the light modulator (e.g. 60-120 hz), it is possible to have approximately 60 PWM frames within a given video frame. In addition, with a 12-bit PWM controller, there are a possible 4096 steps to be employed for a given duty cycle.
In order to reduce maximum peak current loads in a PWM based LED drive system, a phasing concept may be set which sets a limit on the number of LEDs that may be turned on at any one time. For one example, this number may be defined as being a fraction of the total number of LEDs in the system. For example, if the system is designed for n phases, then no more than N/n LEDs may be on at any one time, where N is the total number of LEDs. In this case there is no overlapping of phases. Thus, in one embodiment, the backlight of the display system may be striped to save overall power demand.
Beyond peak current limitation where the number of LEDs are limited that may be turned on at any one time, a further refinement is possible by adding additional phases which may overlap. By staggering the startup of PWM cycles of each LED, the current load impulse is spread over time (as is shown in
In another embodiment, if the LED is turning on at a temporal offset from the beginning of the PWM cycle and the LED may not cross a PWM cycle boundary, then the system might design a PWM limitation whereby PWM(max)=100%−PWM(offset). As an alternate method, it may be possible to move any overlap due to an offset back into the beginning of the PWM cycle. For example if an LED temporal PWM offset is 25% into the PWM cycle and the PWM value is 80%, then the LED turn on time may be broken into two pieces—(1) 5% ON time from a 0% offset of the PWM cycle then (2) 75% ON time from the 25% offset.
One embodiment of the present system comprises a design that takes a lower bit depth PWM LED driver controller and increases the bit depth per video frame to allow for more control over the light emitted during that frame. Currently, some commercial drivers use only 12 bit PWM control. With these commercial drivers, one issue is that, as the LED was to be controlled at lower and lower luminances, the LEDs may have had a problem to control the color mix, as there may not be enough control at the bottom end. The human visual system is, however, sensitive to light at these lower levels.
For one example, if it is desired to make a very low white light that is adjusted very slightly cooler blue—and it is possible to get down to PWM controls to be with PWM value of 1—then if it is possible to have the Blue LED ON with PWM=1, while red and green are PWM=0, then the system may only get Blue and not white at this lower level. Alternatively, the system may have PWM=1 for all three R,G,B; but then the system must render whatever mix these three give me at this level.
Thus, in one embodiment, the system may determine what is the lowest the system can go without ever going to PWM=0, while keep true to the ratios—i.e. if the Red needs to go down to PWM=1 and Green and Blue are higher values to keep the mix of white, such a setting helps to define the system's lowest luminance level of the back light. Thus, it is possible to allow more control at the lower levels which, in turn, allows the system to render better blacks and more accurate gray scale tracking.
When the particular PWM frame rate is greater than the video frame rate, then matching these rates may allow for the capability of increasing the bit-depth of PWM control. For example, in one embodiment, as shown in
In one embodiment, with the capability of increasing the PWM bits by repeating the driver cycles multiple times to get more bits, it is possible to have more bits for R,G,B—thereby allowing the system to have a much lower black level. This is possible because the black may not be represented by all RGB values being all zero. The reason for this is because the next level up will be a huge jump in light since the RGB mix will not be 1,1,1 but more like 1,3,5 to have it be white. So with the extended bits PWM scheme, a 1 representation of any LED is much dimmer than a lower-bit PWM scheme with a 1 representation. Thus, additional levels of low luminance white light—or truer and blacker black levels—may be rendered when the display system is controlled by use of these extended bits PWM schemes.
With an improved phasing scheme, it is also possible to improve the picture quality by matching the LCD response time to the LED phasing scheme.
For one embodiment, it is possible to have the ability of rolling the backlights to match the timing of the LCD in segments—particularly if the stripes of the backlights are spatially matched to the LCD segments (as in
In addition, with given response times, it is possible to black out (e.g. turn OFF) each LED stripe advantageously. In one embodiment, a LED stripe may be blacked out a fraction of the time of the frame to avoid the viewing of the update-twist time of the LCD. This scheme would help to avoid noticeable LCD blur.
In one embodiment, because PWM controllers (comprising a first update period) can be updated multiple times in a video frame, this PWM updating can be advantageously matched to the LCD response time (a first response time period). For example, when the LCD is switching from black to white from one frame to another frame, this takes some time and it may be a significant fraction of the time of a frame. This fraction of the time may be matched with a PWM cycle of the LED driver. For example, if the display is going from a LCD value of 0 to 255 (e.g. from full OFF to Full ON), the PWMs in a frame may proceed as 0, 64, 256, 512, 2048, 4095, 4095, 4095—as opposed to just displaying 4095, 4095, 4095, 4095, 4095, 4095, repeatedly. Thus, the PWM signals are increased gradually over several update periods.
In other embodiments, the maximum brightness of the display system may be defined differently. In fact, maximum brightness may be defined several ways: (1) maximum brightness over the full screen and (2) maximum brightness of a small bright feature. In the first instance, the maximum brightness could be defined as a fully open LCD at 100% PWM on the LEDs. In such a case, it is possible to set the drive current such that only one phase is required and the di/dt improvement may still be realized.
However, it is possible to improve the effective dynamic range of the display system with the concept of Small Bright Features (SBFs). SBFs may occur from time to time in an image—and may be accommodated if some headroom is designed into the display system to increase the LED dynamic range. SBFs may be detected in an image frame buffer—as image data is read into the buffer. Such a buffer may be affected in light source controller 12 and/or light modulator controller 15 of
A SBF is defined by an arbitrary group of LEDs that may ignore the phasing rules from time to time and be turned on for 100% of a PWM cycle. For example, an explosion at night may require a mostly dark screen with a small bright area, for example, 20% of the total area of the screen. As long as the maximum total current limitation is not exceeded, than the LED required to backlight the explosion could be given an exception to the rules set by the phasing limitations.
In order to allow this exception, the system may monitor predicted power for any given scene and allow (or partially allow) the SBF, accordingly, by either by allowing 100% of the desired PWM value or scaling it down in order to meet the system peak current and/or di/dt limitations.
A detailed description of one or more embodiments of the invention, read along with accompanying figures, that illustrate the principles of the invention has now been given. It is to be appreciated that the invention is described in connection with such embodiments, but the invention is not limited to any embodiment. The scope of the invention is limited only by the claims and the invention encompasses numerous alternatives, modifications and equivalents. Numerous specific details have been set forth in this description in order to provide a thorough understanding of the invention. These details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of these specific details. For the purpose of clarity, technical material that is known in the technical fields related to the invention has not been described in detail so that the invention is not unnecessarily obscured.
This application claims priority to U.S. Provisional Application No. 61/558,654 filed 11 Nov. 2011, which is hereby incorporated by reference in its entirety.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2012/063955 | 11/7/2012 | WO | 00 | 5/8/2014 |
Number | Date | Country | |
---|---|---|---|
61558654 | Nov 2011 | US |