This disclosure relates to compensating for pixel distortion to prevent undesirable image artifacts on an electronic display of an electronic device.
Numerous electronic devices—including televisions, portable phones, computers, wearable devices, vehicle dashboards, virtual-reality glasses, and more—display images on an electronic display. Electronic displays with self-emissive display pixels produce their own light. Self-emissive display pixels may include any suitable light-emissive elements, including light-emitting diodes (LEDs) such as organic light-emitting diodes (OLEDs) or micro-light-emitting diodes (μLEDs). By causing different display pixels to emit different amounts of light, individual display pixels of an electronic display may collectively produce images.
In certain electronic displays (e.g., a μLEDs display), a microdriver may drive a row of pixels in succession over a period of time. As subsequent pixels in the row are driven, inherent electrical resistance in the pixels and conductors coupling the pixels may cause a current droop or a current rise in the subsequent pixels in the row. Consequently, each subsequent pixel may emit less light than the prior pixel. The current droop may produce various visible image artifacts (e.g., banding) on the electronic display. The artifacts may be exacerbated by a touch sensor subsystem.
Additionally, as image data is written to a pixel (e.g., via the microdriver) in the row of pixels, capacitive coupling at the microdriver may lead to distortion on the microdriver. In particular, the capacitive coupling may cause distortion at a storage capacitor, which may lead to current droop or current rise at the pixel. Moreover, the distortion may increase at each subsequent pixel in the row of pixels, which may lead to greater distortion, and consequently greater current droop or current rise on the pixels, with pixels in the last row of the pixels experiencing the greatest current droop or the greatest current rise. As a result of the increasing current droop or the increasing current rise, the pixels further along the row may emit less light than the prior pixel. The current droop or rise may produce various visible image artifacts (e.g., banding) on the electronic display.
In an embodiment, the current droop or rise may be reduced or eliminated in each pixel by performing pixel compensation. Pixel compensation (e.g., which may, in some cases, be referred to as in-pixel compensation (IPC)), may include refreshing a storage capacitor by updating the storage voltage on the storage capacitor. In this way, pixel compensation may reduce or eliminate the distortion experienced at the microdriver for a period of time caused by the current droop or the current rise. While using pixel compensation may reduce or eliminate current droop or current rise each time it is performed, performing pixel compensation on each pixel in the electronic display may result in excessive power consumption.
In another embodiment, pixel compensation may be performed on different pixels in a row of pixels for different subframes to prevent adjacent pixels of the row from consistently emitting less light than the prior pixel of the row. The pattern of the pixel compensation may be selected such that, over a number of subframes, an average amount of light is the same or similar to what would be emitted had pixel compensation been performed on each pixel in each subframe. For example, pixel compensation may be performed on every third pixel of the row in a first subframe, and then the pixels on which pixel compensation may be performed may be shifted by a number of pixels in the row. In another example the pixel compensation may be performed on every seventh pixel of a row of eight pixels, such that the first pixel of the row and the eighth pixel are corrected via pixel compensation in a first subframe, the seventh pixel is corrected in a second subframe, the sixth pixel is corrected in a third subframe, and so on. The aforementioned shuffling pattern and/or other shuffling patterns may further reduce an appearance of image artifacts by taking into account an intra-frame pause during a touch sensor operation. While performing pixel compensation may be discussed as reducing or eliminating current droop, it should be noted that the same principles may apply to reducing or eliminating current rise.
Various refinements of the features noted above may exist in relation to various aspects of the present disclosure. Further features may also be incorporated in these various aspects as well. These refinements and additional features may exist individually or in any combination. For instance, various features discussed below in relation to one or more of the illustrated embodiments may be incorporated into any of the above-described aspects of the present disclosure alone or in any combination. The brief summary presented above is intended only to familiarize the reader with certain aspects and contexts of embodiments of the present disclosure without limitation to the claimed subject matter.
Various aspects of this disclosure may be better understood upon reading the following detailed description and upon reference to the drawings in which:
One or more specific embodiments of the present disclosure will be described below. These described embodiments are only examples of the presently disclosed techniques. Additionally, in an effort to provide a concise description of these embodiments, all features of an actual implementation may not be described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but may nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
When introducing elements of various embodiments of the present disclosure, the articles “a,” “an,” and “the” are intended to mean that there are one or more of the elements. The terms “comprising,” “including,” and “having” are intended to be inclusive and mean that there may be additional elements other than the listed elements. Additionally, it should be understood that references to “one embodiment” or “an embodiment” of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features. Furthermore, the phrase A “based on” B is intended to mean that A is at least partially based on B. Moreover, the term “or” is intended to be inclusive (e.g., logical OR) and not exclusive (e.g., logical XOR). In other words, the phrase A “or” B is intended to mean A, B, or both A and B.
As image data is written to a pixel (e.g., via a microdriver) in a row of pixels, capacitive coupling at the microdriver may lead to distortion on the microdriver. In particular, the capacitive coupling may cause distortion at a storage capacitor, which may lead to current droop at the pixel. Moreover, the distortion may increase over time such that distortion grows at each subsequent pixel in the row of pixels, which may lead to greater distortion, and consequently greater current droop on the pixels, with pixels in the last row of the pixels experiencing the greatest current droop. As a result of the increasing current droop, the pixels further along the row may emit less light than the prior pixel. Consistent current droop across rows may produce various visible image artifacts (e.g., banding) on the electronic display.
In an embodiment, the current droop may be reduced or eliminated in each pixel by performing pixel compensation. Pixel compensation, as defined herein, may be performed at the microdriver include refreshing a storage capacitor by updating the storage voltage on the storage capacitor. In this way, pixel compensation may reduce or eliminate the distortion experienced at the microdriver for a period of time. While using pixel compensation may reduce or eliminate current droop, performing pixel compensation on each pixel in the electronic display may result in excessive power consumption.
In another embodiment, pixel compensation may be performed on different pixels in a row of pixels for different subframes to prevent adjacent pixels of the row from consistently emitting less light than the prior pixel of the row. The pattern of the pixel compensation may be selected such that, over a number of subframes, an average amount of light is the same or similar to what would be emitted had pixel compensation been performed on each pixel in each subframe. For example, pixel compensation may be performed on every third pixel of the row in a first subframe, and then the pixels on which pixel compensation may be performed may be shifted by a number of pixels in the row. In another example the pixel compensation may be performed on every seventh pixel of a row of eight pixels, such that the first pixel of the row and the eighth pixel are corrected via pixel compensation in a first subframe, the seventh pixel is corrected in a second subframe, the sixth pixel is corrected in a third subframe, and so on. The aforementioned shuffling pattern and/or other shuffling patterns may further reduce an appearance of image artifacts by taking into account an intra-frame pause during a touch sensor operation.
With the preceding in mind, an electronic device 10 including an electronic display 12 is shown in
The electronic device 10 includes the electronic display 12, one or more input devices 14, one or more input/output (I/O) ports 16, a processor core complex 18 having one or more processing circuitry(s) or processing circuitry cores, local memory 20, a main memory storage device 22, a network interface 24, and a power source 26 (e.g., power supply). The various components described in
The processor core complex 18 is operably coupled with local memory 20 and the main memory storage device 22. Thus, the processor core complex 18 may execute instructions stored in local memory 20 or the main memory storage device 22 to perform operations, such as generating or transmitting image data to display on the electronic display 12. As such, the processor core complex 18 may include one or more general purpose microprocessors, one or more application specific integrated circuits (ASICs), one or more field-programmable gate arrays (FPGAs), or any combination thereof.
In addition to program instructions, the local memory 20 or the main memory storage device 22 may store data to be processed by the processor core complex 18. Thus, the local memory 20 and/or the main memory storage device 22 may include one or more tangible, non-transitory, computer-readable media. For example, the local memory 20 may include random access memory (RAM) and the main memory storage device 22 may include read-only memory (ROM), rewritable non-volatile memory such as flash memory, hard drives, optical discs, or the like.
The network interface 24 may communicate data with another electronic device or a network. For example, the network interface 24 (e.g., a radio frequency system) may enable the electronic device 10 to communicatively couple to a personal area network (PAN), such as a Bluetooth network, a local area network (LAN), such as an 802.11x Wi-Fi network, or a wide area network (WAN), such as a 4G, Long-Term Evolution (LTE), or 5G cellular network. The power source 26 may provide electrical power to one or more components in the electronic device 10, such as the processor core complex 18 or the electronic display 12. Thus, the power source 26 may include any suitable source of energy, such as a rechargeable lithium polymer (Li-poly) battery or an alternating current (AC) power converter. The I/O ports 16 may enable the electronic device 10 to interface with other electronic devices. For example, when a portable storage device is connected, the I/O port 16 may enable the processor core complex 18 to communicate data with the portable storage device.
The input devices 14 may enable user interaction with the electronic device 10, for example, by receiving user inputs via a button, a keyboard, a mouse, a trackpad, or the like. The input device 14 may include touch-sensing components in the electronic display 12. The touch sensing components may receive user inputs by detecting occurrence or position of an object touching the surface of the electronic display 12.
In addition to enabling user inputs, the electronic display 12 may include a display panel with one or more display pixels. The electronic display 12 may control light emission from the display pixels to present visual representations of information, such as a graphical user interface (GUI) of an operating system, an application interface, a still image, or video content, by displaying frames of image data. To display images, the electronic display 12 may include display pixels implemented on the display panel. The display pixels may represent sub-pixels that each control a luminance value of one color component (e.g., red, green, or blue for an RGB pixel arrangement or red, green, blue, or white for an RGBW arrangement).
The electronic display 12 may display an image by controlling light emission from its display pixels based on pixel or image data associated with corresponding image pixels (e.g., points) in the image. In some embodiments, pixel or image data may be generated by an image source, such as the processor core complex 18, a graphics processing unit (GPU), or an image sensor. Additionally, in some embodiments, image data may be received from another electronic device 10, for example, via the network interface 24 and/or an I/O port 16. Similarly, the electronic display 12 may display frames based on pixel or image data generated by the processor core complex 18, or the electronic display 12 may display frames based on pixel or image data received via the network interface 24, an input device, or an I/O port 16.
The electronic device 10 may be any suitable electronic device. To help illustrate, an example of the electronic device 10, a handheld device 10A, is shown in
The handheld device 10A includes an enclosure 30 (e.g., housing). The enclosure 30 may protect interior components from physical damage or shield them from electromagnetic interference, such as by surrounding the electronic display 12. The electronic display 12 may display a graphical user interface (GUI) 32 having an array of icons. When an icon 34 is selected either by an input device 14 or a touch-sensing component of the electronic display 12, an application program may launch.
The input devices 14 may be accessed through openings in the enclosure 30. The input devices 14 may enable a user to interact with the handheld device 10A. For example, the input devices 14 may enable the user to activate or deactivate the handheld device 10A, navigate a user interface to a home screen, navigate a user interface to a user-configurable application screen, activate a voice-recognition feature, provide volume control, or toggle between vibrate and ring modes.
Another example of a suitable electronic device 10, specifically a tablet device 10B, is shown in
Turning to
The display panel 60 may include microdrivers 78. The microdrivers 78 are arranged in an array 79. Each microdriver 78 drives a number of display pixels 77. Different display pixels (e.g., display sub-pixel) 77 may include different colored micro-LEDs (e.g., a red micro-LED, a green micro-LED, or a blue micro-LED) to represent the image data 64 in RGB format. Although one of the microdrivers 78 of
A power supply 84 may provide a reference voltage (VREF) 86 to drive the micro-LEDs, a digital power signal 88, and an analog power signal 90. In some cases, the power supply 84 may provide more than one reference voltage (VREF) 86 signal. Namely, display pixels 77 of different colors may be driven using different reference voltages. As such, the power supply 84 may provide more than one reference voltage (VREF) 86. Additionally or alternatively, other circuitry on the display panel 60 may step the reference voltage (VREF) 86 up or down to obtain different reference voltages to drive different colors of micro-LED.
A block diagram shown in
When the pixel data buffer(s) 100 has received and stored the image data 70, the microdriver 78 may provide the emission clock signal (EM_CLK). A counter 102 may receive the emission clock signal (EM_CLK) as an input. The pixel data buffer(s) 100 may output enough of the stored image data 70 to output a digital data signal 104 represent a desired gray level for a particular display pixel 77 that is to be driven by the microdriver 78. The counter 102 may also output a digital counter signal 106 indicative of the number of edges (only rising, only falling, or both rising and falling edges) of the emission clock signal (EM_CLK) 98. The signals 104 and 106 may enter a comparator 108 that outputs an emission control signal 110 in an “on” state when the signal 106 does not exceed the signal 104, and an “off” state otherwise. The emission control signal 110 may be routed to driving circuitry (not shown) for the display pixel 77 being driven, which may cause light emission 112 from the selected display pixel 77 to be on or off. The longer the selected display pixel 77 is driven “on” by the emission control signal 110, the greater the amount of light that will be perceived by the human eye as originating from the display pixel 77.
A timing diagram 120, shown in
It should be noted that the steps between gray levels are reflected by the steps between emission clock signal (EM_CLK) edges. That is, based on the way humans perceive light, to notice the difference between lower gray levels, the difference between the amounts of light emitted between two lower gray levels may be relatively small. To notice the difference between higher gray levels, however, the difference between the amounts of light emitted between two higher gray levels may be comparatively much greater. The emission clock signal (EM_CLK) therefore may use relatively short time intervals between clock edges at first. To account for the increase in the difference between light emitted as gray levels increase, the differences between edges (e.g., periods) of the emission clock signal (EM_CLK) may gradually lengthen. The particular pattern of the emission clock signal (EM_CLK), as generated by the emission TCON, may have increasingly longer differences between edges (e.g., periods) so as to provide a gamma encoding of the gray level of the display pixel 77 being driven.
With the preceding in mind,
In some cases, as the control switches 1208 are opened and closed, capacitive coupling may form at the series capacitors 1204 and/or the parallel capacitors 1206, which may cause distortion in the microdriver 78 driving the pixels 77. This distortion may cause current droop across the pixels 77. Moreover, as previously stated, the current droop may increase in each subsequent pixel 77 in a row of pixels, which may cause each subsequent pixel 77 in a row of pixels to emit less light than the preceding pixel in the row of pixels. For example, the pixel 77A may experience distortion due to the capacitive coupling on the series capacitor 1204 and/or the parallel capacitor 1206, and if the distortion at the 77A is not addressed (e.g., an action is not taken at the pixel 77 to compensate for the current droop at the pixel 77), additional distortion may accrue at the subpixel 77B. Without compensating for the distortion and current droop, the distortion will continue to accumulate to the pixel 77C and the current droop caused by the distortion may be significant enough that the light emitted from the pixel 77C may be noticeably less than the light at the pixel 77A and the pixel 77B, which may result in display image artifacts (e.g., front-of-screen (FOS) artifacts).
The current droop at the pixels 77 may be reduced or eliminated by performing pixel compensation. Pixel compensation may refresh the charge on the series capacitors 1204 and/or the parallel capacitors 1206, thus removing the distortion from the series capacitors 1204 and/or the parallel capacitors 1206 caused by the capacitive coupling of the control switches 1208. In some embodiments, pixel compensation may be performed at each row of the pixels 77 in each subframe of an image frame, thus reducing or eliminating the distortion and reducing or eliminating the current droop across the pixels 77. However, performing pixel compensation on all rows in each subframe may consume a prohibitive amount of power. In other embodiments, pixel compensation may be performed on every Nth row of pixels. For example, if pixel compensation is performed on every 8th row of pixels, the accumulated current droop across the electronic display 12 may be reduced without consuming excessive power. However, performing pixel compensation in such a pattern may lead to image artifacts (e.g., banding), as will be discussed in greater detail below.
As previously discussed, the current droop may accumulate for each row proportional to the length of time that a certain row emits a pulse and the compensated row (e.g., row 0 in the table 1300) emits a pulse. For example, in the table 1300 of
As such, the luminance difference increases for each subsequent row in a subframe of the table 1300 until pixel compensation is again performed on a given row. An average luminance difference 1304 may be determined based on the luminance difference for a given row across all subframes (e.g., 16 subframes, as shown in the table 1300).
Moreover, the total luminance difference across all rows for the entire frame may be calculated by multiplying an estimated current droop across the image frame by the difference between the maximum average luminance for the frame and the minimum average luminance for the frame divided by the number of rows emitting in the frame. That is, the total luminance difference for a particular row across the frame in the table 1300 can be represented by the equation
In the equation, idroop is the estimated output current droop across each subframe, LMAX is the maximum average luminance difference for the image frame, LMIN is the minimum average luminance difference for the image frame, and N is the number of rows in the image frame. For example, the estimated current droop across the image frame (independent of whether the frame is displaying at 480 Hertz (Hz), 960 Hz, or another appropriate frequency) may be equal to approximately 3.3% (e.g., for a nominal current of 0.3 microamps). As such, the total luminance difference for the pixel compensation pattern illustrated in table 1300 of
As stated above, while performing the pixel compensation may reduce or eliminate the current droop at a row, certain pixel compensation patterns may lead to an image artifact, as is illustrated in
As may be observed, the pixel compensation pattern for the table 1500 may include performing pixel compensation whenever the row number is equal to the subframe number for subframes 1-8. For example, at subframe 6, the pixel compensation is performed at row 6. For subframes 9-16, the pixel compensation may be performed when the row counter is equal to the difference between 17 and the subframe number. For example, for subframe 10, the pixel compensation may be performed at row 7. The average luminance difference 1304 for each row across all 16 subframes (i.e., across one frame) may also be stored in the table 1500. As may be observed, due to the pixel compensation pattern illustrated in the table 1500, the average luminance difference 1304 for the rows in the table 1500 are much closer than the average luminance differences 1304 in the table 1300 in
Due to the similarity in the average luminance difference for each row, the rows may output similar brightness levels, and the banding issue illustrated in
As such, the pixel compensation pattern in
As may be observed from the average luminance difference 1304, IFP 1602 may increase the average luminance difference 1304 for each row across the frame, and thus may increase the total average luminance difference across the entire image frame. Using the formula for total luminance difference across all rows for the image frame as discussed above, the total luminance difference for the image frame illustrated by the table 1600 may be calculated accordingly:
As such, it may be appreciated that, while the IFP 1602 may cause additional luminance difference across the image frame, the applied pixel compensation pattern may still effectuate a greater reduction in luminance difference than other pixel compensation patterns (e.g., the pixel compensation pattern discussed in
In certain embodiments, a shuffling pattern may be applied to the emission timing for the pixels 77 of the electronic display 12. The pixel compensation patterns discussed previously may not average out the luminance difference across the electronic display 12 when applied to an electronic display 12 having a shuffled emission pattern (e.g., such that the pixel compensation may not prevent an image artifact from occurring on the electronic display 12). As such, using a shuffled emission pattern may cause greater luminance difference across the image frame even when pixel compensation patterns (e.g., the pixel compensation patterns illustrated in
The shuffled emission pattern 1700 may increase the luminance difference across the rows of the electronic display 12. By applying the equation described above, luminance difference for the shuffled emission pattern 1700, even accounting for the pixel compensation patterns 1702 and 1704 may be represented accordingly:
As such, it may be desirable to apply one or more pixel compensation patterns that may account for shuffled emission pattern schemes.
By performing pixel compensation on every 7th row, every 5th row, or every 3rd row, the total luminance difference across the frame may be reduced or eliminated. Applying the total luminance difference equation to the table 1802, the total luminance difference across the frame may be determined as follows:
Applying the equation to the table 1804, the total luminance difference across the frame may be determined as follows:
Applying the equation to the table 1806, the total luminance difference across the frame may be determined as follows:
As such, by performing pixel compensation on every 7th row, 5th row, or 3rd row, the total luminance difference across an image frame may be kept at or below approximately 0.3% while consuming less power than would be consumed if pixel compensation were to be performed on each row across each subframe.
By performing pixel compensation on every 71 row, every 5th row, or every 3rd row, the total luminance difference across the frame may be reduced or eliminated. Applying the equation described above to the table 1902, the total luminance difference across the frame may be determined as follows:
Applying the equation to the table 1804, the total luminance difference across the frame may be determined as follows:
Applying the equation to the table 1806, the total luminance difference across the frame may be determined as follows:
As such, by performing pixel compensation on every 7th row, 5th row, or 3rd row, the total luminance difference across an image frame may be kept at or below approximately 0.75% while consuming less power than would be consumed if pixel compensation were to be performed on each row across each subframe.
By performing pixel compensation on every 7th row, every 5th row, or every 3rd row, the total luminance difference across the frame may be reduced or eliminated. Applying the equation to the table 1902, the total luminance difference across the frame may be determined as follows:
Applying the equation to the table 1804, the total luminance difference across the frame may be determined as follows:
Applying the equation to the table 1806, the total luminance difference across the frame may be determined as follows:
As such, by performing pixel compensation on every 7th row, 5th row, or 3rd row, the total luminance difference across an image frame may be kept at or below approximately 0.50% while consuming less power than would be consumed if pixel compensation were to be performed on each row across each subframe.
As may be appreciated, by applying pixel compensation to each 7th row, 5th row, or 3rd row, total luminance difference across the frame (and thus FOS artifacts on the electronic display 12) may be reduced without consuming excessive power and may reduce luminance difference across the frame when accounting for additional luminance difference due to IFP 1602 and/or various emission patterns. While performing pixel compensation on every 7th, 5th and 3rd row in the frame is shown and discussed in
The specific embodiments described above have been shown by way of example, and it should be understood that these embodiments may be susceptible to various modifications and alternative forms. It should be further understood that the claims are not intended to be limited to the particular forms disclosed, but rather to cover all modifications, equivalents, and alternatives falling within the spirit and scope of this disclosure.
The techniques presented and claimed herein are referenced and applied to material objects and concrete examples of a practical nature that demonstrably improve the present technical field and, as such, are not abstract, intangible or purely theoretical. Further, if any claims appended to the end of this specification contain one or more elements designated as “means for [perform]ing [a function] . . . ” or “step for [perform]ing [a function] . . . ”, it is intended that such elements are to be interpreted under 35 U.S.C. 112(f). However, for any claims containing elements designated in any other manner, it is intended that such elements are not to be interpreted under 35 U.S.C. 112(f).
It is well understood that the use of personally identifiable information should follow privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy of users. In particular, personally identifiable information data should be managed and handled so as to minimize risks of unintentional or unauthorized access or use, and the nature of authorized use should be clearly indicated to users.
This application claims priority to U.S. Provisional Application No. 63/357,496 filed Jun. 30, 2022, entitled “In-Pixel Compensation for Current Droop and In-Pixel Compensation Timing,” the disclosure of which is incorporated by reference in its entirety for all purposes.
Number | Date | Country | |
---|---|---|---|
63357496 | Jun 2022 | US |