This disclosure relates to methods for improving front-of-screen performance by providing fine-grained arbitrary presentation time to an electronic display.
A summary of certain embodiments disclosed herein is set forth below. It should be understood that these aspects are presented to provide the reader with a brief summary of these certain embodiments and that these aspects are not intended to limit the scope of this disclosure.
Electronic displays may be found in numerous electronic devices, from mobile phones to computers, televisions, automobile dashboards, and augmented reality or virtual reality glasses, to name just a few. Electronic displays with self-emissive display pixels produce their own light. Self-emissive display pixels may include any suitable light-emissive elements, including light-emitting diodes (LEDs) such as organic light-emitting diodes (OLEDs) or micro-light-emitting diodes (μLEDs). By causing different display pixels to emit different amounts of light, individual display pixels of an electronic display may collectively produce images.
Some electronic displays may display frames of image data using an arbitrary presentation time (APT) scheme, in which the frames of image data may be presented on the electronic display at an arbitrary frame rate. The electronic display may initiate the display of the image frames according to defined quanta of time, such that a single image frame may span an arbitrary integer number of quanta. The quanta may represent the highest frame rate that could be displayed on the electronic display. For example, when the highest frame rate of the electronic display is 240 Hertz (Hz), the frame quanta of the electronic display may be 240 Hz (4.167 milliseconds (ms)). Such an electronic display may support any arbitrary frame rate that is an integer divisor of the highest frame rate.
Image frames may be generated by processing circuitry and provided to the electronic display. Although the processing circuitry may generate (e.g., render) image frames with a particular frame rate, some image frames may take more time to generate than others. As a result, in certain cases an image frame may take too long to generate, and consequently may not reach the electronic display in time to be displayed within the quanta corresponding to the particular frame rate. This may result in the frame being dropped (e.g., not displayed) or delayed (e.g., displayed later than expected or intended) in favor of a subsequent image frame. As a consequence, a viewer may perceive undesirable front-of-screen image artifacts such as judder or flickering, which may negatively impact user experience.
To reduce or prevent dropped or delayed frames and subsequent front-of-screen image artifacts such as judder or flickering, a display driver of the electronic display may program display pixels of the display panel to display the image frame over a series of subframes having time quanta that is finer-grained than the maximum frame rate of the electronic display. For example, the frame quanta of the electronic display may occur at 960 Hz (every 1.042 ms), while the maximum frame rate may be lower. Consequently, even if a frame arrives later than a target frame rate, the frame may still be displayed or at least partially displayed on the electronic display. This reduces or eliminates dropped and delayed frames, which may improve user experience.
Various aspects of this disclosure may be better understood upon reading the following detailed description and upon reference to the drawings described below in which like numerals refer to like parts.
One or more specific embodiments will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
When introducing elements of various embodiments of the present disclosure, the articles “a,” “an,” and “the” are intended to mean that there are one or more of the elements. The terms “including” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements. Additionally, it should be understood that references to “some embodiments,” “embodiments,” “one embodiment,” or “an embodiment” of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Furthermore, the phrase A “based on” B is intended to mean that A is at least partially based on B. Moreover, the term “or” is intended to be inclusive (e.g., logical OR) and not exclusive (e.g., logical XOR). In other words, the phrase A “or” B is intended to mean A, B, or both A and B.
Some electronic displays may display frames of image data using an arbitrary presentation time (APT) scheme, in which the frames of image data may be presented on the electronic display at an arbitrary frame rate. The electronic display may initiate the display of the image frames according to defined quanta of time, such that a single image frame may span an arbitrary integer number of quanta. In contrast to certain previous electronic displays, in which the quanta may represent the highest frame rate that could be displayed on the electronic display (e.g., when the highest frame rate of the electronic display is 240 Hertz (Hz), the frame quanta of the electronic display may be 240 Hz), it has been discovered that using quanta that are higher than (e.g., 1.5×, 2×, 3×, 4× or more) the maximum frame rate may provide better front-of-screen performance. Indeed, image artifacts such as flicker or judder due to delayed or dropped image frames may be reduced or eliminated.
Image frames may be generated by processing circuitry and provided to the electronic display. Although the processing circuitry may generate (e.g., render) image frames with a particular frame rate, some image frames may take more time to generate than others. As a result, in certain cases an image frame may take too long to generate, and consequently may not reach the electronic display in time to be displayed within the quanta when the quanta correspond exactly to that particular frame rate. This may result in the frame being delayed (e.g., presented later) or dropped (e.g., not displayed) in favor of a subsequent image frame. As a consequence, a viewer may perceive undesirable front-of-screen image artifacts such as judder or flickering, which may negatively impact user experience.
To reduce or prevent delayed or dropped frames and subsequent front-of-screen image artifacts such as judder or flickering, a display driver of the electronic display may program display pixels of the display panel to display the image frame over a series of subframes having time quanta that is finer-grained than the maximum frame rate of the electronic display. For example, the frame quanta of the electronic display may occur at 960 Hz (every 1.042 ms), while the maximum frame rate may be lower (e.g., 80 Hz, 240 Hz, 480 Hz, and so on). Consequently, even if a frame arrives later than a target frame rate, the frame may still be displayed or at least partially displayed on the electronic display. This reduces or eliminates delayed frames and dropped frames, which may improve user experience. It should be noted that, in some embodiments, it may be desirable and beneficial to match the quanta frequency to the emission frequency and/or anode reset frequency. For example, the quanta frequency may be equal to the emission frequency and/or anode reset frequency, or may be a divisor or multiple of the emission frequency and/or anode reset frequency.
However, increasing the frame quanta to such a high frequency may have associated drawbacks that, in some cases may prohibit such an increase in the frame quanta. In some cases, increasing the frame quanta may result in greater power consumption (e.g., due to increased toggling), emission duty cycle reduction and loss of luminance due to higher emission frequency, increased voltage-to-luminance sensitivity, and so on. In embodiments of the present disclosure, the increased power consumption may be mitigated or offset by adjusting (e.g., reducing and/or merging) at least a portion of anode reset and/or emission toggling. To prevent the adjusted anode reset and/or emission toggling from affecting the front-of-screen, the toggling may be adjusted during a non-programming frame. In other embodiments, to mitigate or prevent the duty cycle reduction, the emission-off time of emission pulses may be reduced, such that the duty cycle is increased and any low-luminance front-of-screen issues are reduced or eliminated. In yet other embodiments, the increased voltage-to-luminance sensitivity may be mitigated or offset by adjusting anode reset voltages at higher anode reset/emission frequencies.
With this in mind, an example of an electronic device 10, which includes an electronic display 12 that may benefit from these features, is shown in
In addition to the electronic display 12, as depicted, the electronic device 10 includes one or more input devices 14, one or more input/output (I/O) ports 16, a processor core complex 18 having one or more processors or processor cores and/or image processing circuitry, memory 20, one or more storage devices 22, a network interface 24, and a power supply 26. The various components described in
The processor core complex 18 is operably coupled with the memory 20 and the storage device 22. As such, the processor core complex 18 may execute instructions stored in memory 20 and/or a storage device 22 to perform operations, such as generating or processing image data. The processor core complex 18 may include one or more microprocessors, one or more application specific processors (ASICs), one or more field programmable logic arrays (FPGAs), or any combination thereof.
In addition to instructions, the memory 20 and/or the storage device 22 may store data, such as image data. Thus, the memory 20 and/or the storage device 22 may include one or more tangible, non-transitory, computer-readable media that store instructions executable by processing circuitry, such as the processor core complex 18, and/or data to be processed by the processing circuitry. For example, the memory 20 may include random access memory (RAM) and the storage device 22 may include read only memory (ROM), rewritable non-volatile memory, such as flash memory, hard drives, optical discs, and/or the like.
The network interface 24 may enable the electronic device 10 to communicate with a communication network and/or another electronic device 10. For example, the network interface 24 may connect the electronic device 10 to a personal area network (PAN), such as a Bluetooth network, a local area network (LAN), such as an 802.11x Wi-Fi network, and/or a wide area network (WAN), such as a fourth-generation wireless network (4G), LTE, or fifth-generation wireless network (5G), or the like. In other words, the network interface 24 may enable the electronic device 10 to transmit data (e.g., image data) to a communication network and/or receive data from the communication network.
The power supply 26 may provide electrical power to operate the processor core complex 18 and/or other components in the electronic device 10, for example, via one or more power supply rails. Thus, the power supply 26 may include any suitable source of electrical power, such as a rechargeable lithium polymer (Li-poly) battery and/or an alternating current (AC) power converter. A power management integrated circuit (PMIC) may control the provision and generation of electrical power to the various components of the electronic device 10.
The I/O ports 16 may enable the electronic device 10 to interface with another electronic device 10. For example, a portable storage device may be connected to an I/O port 16, thereby enabling the electronic device 10 to communicate data, such as image data, with the portable storage device.
The input devices 14 may enable a user to interact with the electronic device 10. For example, the input devices 14 may include one or more buttons, one or more keyboards, one or more mice, one or more trackpads, and/or the like. Additionally, the input devices 14 may include touch sensing components implemented in the electronic display 12, as described further herein. The touch sensing components may receive user inputs by detecting occurrence and/or position of an object contacting the display surface of the electronic display 12.
In addition to enabling user inputs, the electronic display 12 may provide visual representations of information by displaying one or more images (e.g., image frames or pictures). For example, the electronic display 12 may display a graphical user interface (GUI) of an operating system, an application interface, text, a still image, or video content. To facilitate displaying images, the electronic display 12 may include a display panel with one or more display pixels. The display pixels may represent sub-pixels that each control a luminance of one color component (e.g., red, green, or blue for a red-green-blue (RGB) pixel arrangement).
The electronic display 12 may display an image by controlling the luminance of its display pixels based at least in part image data associated with corresponding image pixels in image data. In some embodiments, the image data may be generated by an image source, such as the processor core complex 18, a graphics processing unit (GPU), an image sensor, and/or memory 20 or storage devices 22. Additionally, in some embodiments, image data may be received from another electronic device 10, for example, via the network interface 24 and/or an I/O port 16.
One example of the electronic device 10, specifically a handheld device 10A, is shown in
The handheld device 10A includes an enclosure 30 (e.g., housing). The enclosure 30 may protect interior components from physical damage and/or shield them from electromagnetic interference. In the depicted embodiment, the electronic display 12 is displaying a graphical user interface (GUI) 32 having an array of icons 34. By way of example, when an icon 34 is selected either by an input device 14 or a touch sensing component of the electronic display 12, an application program may launch.
Input devices 14 may be provided through the enclosure 30. As described above, the input devices 14 may enable a user to interact with the handheld device 10A. For example, the input devices 14 may enable the user to activate or deactivate the handheld device 10A, navigate a user interface to a home screen, navigate a user interface to a user-configurable application screen, activate a voice-recognition feature, provide volume control, and/or toggle between vibrate and ring modes. The I/O ports 16 also open through the enclosure 30. The I/O ports 16 may include, for example, a Lightning® or Universal Serial Bus (USB) port.
The electronic device 10 may take the form of a tablet device 10B, as shown in
Describing now the display pixel array 50,
The electronic display 12 may receive compensated image data 74 for presentation on the electronic display 12. The electronic display 12 includes display driver circuitry that includes scan driver circuitry 76 and data driver circuitry 78. The display driver circuitry controls programming the compensated image data 74 into the display pixels 54 for presentation of an image frame via light emitted according to each respective bit of compensated image data 74 programmed into one or more of the display pixels 54.
The display pixels 54 may each include one or more self-emissive elements, such as a light-emitting diodes (LEDs) (e.g., organic light emitting diodes (OLEDs) or micro-LEDs (μLEDs)), however other pixels may be used with the systems and methods described herein including but not limited to liquid-crystal devices (LCDs), digital mirror devices (DMD), or the like, and include use of displays that use different driving methods than those described herein, including partial image frame presentation modes, variable refresh rate modes, or the like.
Different display pixels 54 may emit different colors. For example, some of the display pixels 54 may emit red light, some may emit green light, and some may emit blue light. Thus, the display pixels 54 may be driven to emit light at different brightness levels to cause a user viewing the electronic display 12 to perceive an image formed from different colors of light. The display pixels 54 may also correspond to hue and/or luminance levels of a color to be emitted and/or to alternative color combinations, such as combinations that use red (R), green (G), blue (B), or others.
The scan driver circuitry 76 may provide scan signals (e.g., pixel reset, data enable, on-bias stress) on scan lines 80 to control the display pixels 54 by row. For example, the scan driver circuitry 76 may cause a row of the display pixels 54 to become enabled to receive a portion of the compensated image data 74 from data lines 82 from the data driver circuitry 78. In this way, an image frame of the compensated image data 74 may be programmed onto the display pixels 54 row by row. Other examples of the electronic display 12 may program the display pixels 54 in groups other than by row.
The display 12 may display frames of image data using an arbitrary presentation time (APT) scheme, in which the frames of image data may be presented on the display 12 at an arbitrary frame rate. The display 12 may initiate the display of the image frames according to defined quanta of time, such that a single image frame may span an arbitrary integer number of quanta. For example, the image frame may be presented within one quantum, within two quanta, within 10 quanta, and so on. The quanta may represent the highest frame rate that could be displayed on the display 12. For example, when the highest frame rate of the display 12 is 240 Hertz (Hz), the quanta of the display 12 may be 240 Hz. The display 12 may support any arbitrary frame rate that is an integer divisor of the highest frame rate. In the following description below, quanta may be referred to interchangeably as presentation time quanta, frame quanta, or simply as quanta. The frames of the image data may be displayed on the display 12 via display driver circuitry or a timing controller (TCON) that programs the display pixels 54 of the display panel to display the image frame over the series of subframes having the time quanta.
As previously mentioned, image frames may be generated by processing circuitry (e.g., the processor core complex 18) and provided to the display 12. Although the processing circuitry may generate (e.g., render) image frames with a particular frame rate, some image frames may take more time to generate than others. As a result, in certain cases an image frame may take too long to generate, and consequently may not reach the display 12 in time to be displayed within the quanta corresponding to the particular frame rate. This may result in the frame being dropped (e.g., not displayed) in favor of a subsequent image frame or delayed (e.g., displayed later than expected or intended). As a consequence, a viewer may perceive undesirable front-of-screen image artifacts such as judder or flickering, which may negatively impact user experience.
Front-of-screen issues such as those discussed above may be reduced or avoided by decreasing the duration of the individual quanta 110.
It may be appreciated from
For example, the increased quanta frequency, emission frequency, and/or anode reset frequency may result in greater power consumption due to greater toggling frequency, reduced emission duty cycle, loss of luminance, and/or increased voltage-to-luminance sensitivity.
To offset the greater power consumption due to the greater toggling frequency, anode reset toggling and/or emission toggling may be reduced and merged, as will be described in
The timing diagram 222 includes various emission profiles including off emissions 228 and on emissions 230. To offset the duty cycle reduction and loss of luminance, the off emissions 228 may be reduced (e.g., the on emissions 230 may be increased). To ensure that the emission adjustments do not cause additional front-of-screen issues, multiple asymmetrical emission adjustments may be made during the non-programming frame 226. The emissions adjustments may be asymmetrical to prevent additional front-of-screen issues from some subframes being consistently lighter or consistently darker than other subframes. Emission profile 232 represents a baseline (e.g., unadjusted) emission profile. Without applying other emissions profiles, the emission profile 232 may cause the display 12 to display with a lower luminance than desired due to the reduced emission signal duty cycle at higher frequencies.
Emission profile 234 illustrates an adjusted emission profile wherein the off emissions 228 in the non-programming frame 226 are reduced to cause an overall increase in the duty cycle of the non-programming frame 226. Emission profile 236 illustrates an adjusted emission profile wherein every other off emission 228 is reduced. Emission profile 238 illustrates an adjusted emission profile wherein every third off emission 228 is reduced. Emission profile 240 illustrates an adjusted emission profile wherein every fourth off emission 228 is reduced. Emission profile 242 illustrates an adjusted emission profile wherein a randomized selection of off emissions 228 are selected to be reduced. With respect to the emission profile 242, the randomly selected off emissions 228 may be selected via a weighted random selection. The emissions profiles 234-242 may be applied to different rows of the display pixels 54 for a single frame, or a single emission profile may be deployed for all display pixels 54 involved in displaying a frame, and each subsequent emission profile may be sequentially deployed to all display pixels 54 for each subsequent image frame. In either case, the emission profiles 234-242 may increase the luminance of the display 12 while averaging out the luminance increase across the display 12 to reduce or eliminate front-of-screen issues.
As previously mentioned, the increased quanta frequency, emission frequency, and/or anode reset frequency may result in increased voltage-to-luminance sensitivity. That is, the display pixels 54 may exhibit a greater luminance error for the same given amount of voltage noise and distortion at greater quanta frequency, emission frequency, and/or anode reset frequency.
As may be observed from the curves 306A (e.g., representing anode reset frequency of 3840 Hz), 306B (e.g., representing anode reset frequency of 1920 Hz), 306C (e.g., representing anode reset frequency of 960 Hz), 306D (e.g., representing anode reset frequency of 480 Hz), 306E (e.g., representing anode reset frequency of 240 Hz), 306F (e.g., representing anode reset frequency of 120 Hz), and 306G (e.g., e.g., representing a reference anode reset frequency) of the plot 300, the luminance instability increases as the anode reset frequency increases. That is, the luminance fluctuates more significantly for the curve 306A than it fluctuates for the curve 306F. To offset this increase in luminance fluctuations at higher frequencies, the anode reset voltage may be adjusted (e.g., increased) or varied correspondingly to the increased anode reset frequency, as may be observed from the plot 310, which illustrates current-voltage level (IVL) improvement as a function of increased anode reset voltage (VAR). The plot incudes an x-axis 312 representing luminance in nits and a y-axis 314 representing IVL in % per millivolt (%/mV). The plot 310 shows a desired reduction in IVL at a relatively high frequency (e.g., 1920 Hz) as the anode reset voltage is increased. Accordingly, the anode reset voltage may increase as the anode reset frequency increases. For example, the anode reset voltage may increase proportionally to the anode reset frequency, or the anode reset voltage may increase asymmetrically. The anode reset voltage increase may include an increase of 0.1 V, 0.2 V, 0.4 V, 0.6 V, 0.8 V, and 1.0 V above a baseline anode reset voltage. It should be noted that while 0.1 V-1.0 V are shown, the voltage increase may include any appropriate voltage increase, such a 0.25 V or more, 0.75 V or more, 1.2 V or more, 2.0 V or more, 5.0 V or more, and so on. Accordingly, at lesser anode reset frequencies, a smaller anode reset voltage adjustment may be provided, while at greater anode reset frequencies, a greater anode reset voltage adjustment may be provided.
The specific embodiments described above have been shown by way of example, and it should be understood that these embodiments may be susceptible to various modifications and alternative forms. It should be further understood that the claims are not intended to be limited to the particular forms disclosed, but rather to cover all modifications, equivalents, and alternatives falling within the spirit and scope of this disclosure.
The techniques presented and claimed herein are referenced and applied to material objects and concrete examples of a practical nature that demonstrably improve the present technical field and, as such, are not abstract, intangible or purely theoretical. Further, if any claims appended to the end of this specification contain one or more elements designated as “means for [perform]ing [a function] . . . ” or “step for [perform]ing [a function] . . . ,” it is intended that such elements are to be interpreted under 35 U.S.C. 112(f). However, for any claims containing elements designated in any other manner, it is intended that such elements are not to be interpreted under 35 U.S.C. 112(f).
It is well understood that the use of personally identifiable information should follow privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy of users. In particular, personally identifiable information data should be managed and handled so as to minimize risks of unintentional or unauthorized access or use, and the nature of authorized use should be clearly indicated to users.
This application claims priority to U.S. Provisional Application No. 63/515,833, filed Jul. 26, 2023, which is incorporated herein by reference in its entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
63515833 | Jul 2023 | US |