The present disclosure relates generally to techniques to sensing non-uniformity in a display. More specifically, the present disclosure relates generally to techniques for sensing non-uniformity in a display in a non-disruptive way, such as during an off state when the display is not actively displaying content.
This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure, which are described and/or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it should be understood that these statements are to be read in this light, and not as admissions of prior art.
Electronic display panels are used in a plethora of electronic devices. These display panels typically include multiple pixels that emit light. The pixels may be formed using self-emissive units (e.g., light emitting diode) or pixels that utilize units that are backlit (e.g., liquid crystal diode). The displays may be compensated for non-uniformity to reduce noise at each pixel of the display. However, sensing for non-uniformity may be affected by content-dependent noise that gives incomplete and/or incorrect compensation.
A summary of certain embodiments disclosed herein is set forth below. It should be understood that these aspects are presented merely to provide the reader with a brief summary of these certain embodiments and that these aspects are not intended to limit the scope of this disclosure. Indeed, this disclosure may encompass a variety of aspects that may not be set forth below.
Display panel uniformity may be negatively impacted by various parameters (e.g., aging) of the display panel. The display panel uniformity may be improved by sensing for non-uniformity (e.g., aging effects) in a display during an off time of the display to avoid content-based changes to compensation results from the non-uniformity sensing. Furthermore, off-time sensing may reduce battery life of some devices. Thus, a first threshold may be used for determining when to perform off-time sensing during battery-powered conditions, and a second threshold may be set to perform off-time sensing during externally powered conditions. Furthermore, in some embodiments, off-time sensing may be reserved for externally powered conditions.
Moreover, non-uniformity sensing may be divided into thin-film transistor (TFT) sensing and emissive element (e.g., organic light emitting diode—OLED) sensing. Since TFTs exhibit aging effects more quickly, TFT sensing may be performed more frequently than emissive element sensing. To avoid overuse of battery power, when TFT sensing and emissive element sensing are to occur within a same time period (e.g., 1 day), the sensing with the lower frequency (e.g., emissive element sensing) of sensing may be delayed until a next period (e.g., next day).
Sensing noise reduction may utilize multiple scans of each display pixel. Some displays (e.g., mobile phone) may also be switched on and off more frequently than other displays (e.g., television, computer monitors, etc.) In a frequently switched display, the interruption of off-time sensing may cause some data to be lost when only a portion of the pixels of the display are scanned or may cause the sensing to include disadvantageous temporal variations. Instead of scanning each pixel consecutively before moving on to other pixels, some embodiments may include scanning an entire frame before moving to a next frame. Furthermore, if a frame completes, the results of the frame may be saved (even if the scanning process is not fully completed). Only frames that have not completed are discarded since spatial continuity in each frame is preserved at an approximately consistent time. In other words, pixels in the same frame are likely under similar temporal conditions, but pixels before and after an interruption may have quite different temporal conditions. Thus, a frame may be used to group pixels sensing values in approximately consistent temporal conditions.
Some display devices (e.g., desktop monitors, mobile phones) may not experience off-times that are long enough to complete non-uniformity scanning. Thus, in some embodiments, compensation may be predicted/estimated while the display is on between off-time sensing processes. Furthermore, the prediction of the changes (e.g., due to panel aging) may be corrected/fine-tuned based on predicted changes versus measured changes after a scan has been completed. Furthermore, in some embodiments, at least some sensing may overlap at least a portion of other operations (e.g., active panel conditioning) during the off time for the display panel.
Various aspects of this disclosure may be better understood upon reading the following detailed description and upon reference to the drawings in which:
One or more specific embodiments will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.
Display panel uniformity can be improved by sensing for non-uniformity in a display during an off time of the display to avoid content-based changes to compensation results from the non-uniformity sensing. Furthermore, off-time sensing may reduce battery life of mobile devices. Thus, a first threshold may be used for determining when to perform off-time sensing during battery-powered conditions, and a second threshold may be set to perform off-time sensing during externally powered conditions. Furthermore, in some embodiments, off-time sensing may be reserved for externally powered conditions.
Moreover, non-uniformity sensing may be divided into thin-film transistor (TFT) sensing and emissive element (e.g., organic light emitting diode—OLED) sensing. Since TFTs experience change more quickly, TFT sensing may be performed more frequently than emissive element sensing. To avoid overuse of battery power, when TFT sensing and emissive element sensing are to occur within a same time period (e.g., 1 day), the sensing with the lower frequency (e.g., emissive element sensing) of sensing may be delayed until a next period (e.g., next day).
Sensing noise reduction may utilize multiple scans of each display pixel. Some displays (e.g., mobile phone) may also be switched on and off more frequently than other displays (e.g., television, computer monitors, etc.), In a frequent switching display, the interruption of off-time may cause some data to be lost when only a portion of the pixels of the display are scanned. Instead of scanning each pixel consecutively before moving on to other pixels, some embodiments may include scanning an entire frame before moving to a next frame. Furthermore, if a frame completes, the results of the frame may be saved (even if the scanning process is not fully completed). Only frames that have not completed are discarded since spatial continuity in each frame is preserved. In other words, pixels in the same frame are likely under similar temporal conditions, but pixels before and after an interruption may have quite different temporal conditions. Thus, a frame may be used to group pixels sensing values in approximately consistent temporal conditions.
Some display devices (e.g., desktop monitors, mobile phones) may not experience off-times that are long enough to complete non-uniformity scanning. Thus, in some embodiments, compensation may be predicted/estimated while the display is on between off-time sensing processes. Furthermore, the prediction of the changes (e.g., due to panel aging) may be corrected/fine-tuned based on predicted changes versus measured changes after a scan has been completed.
With the foregoing in mind and referring first to
In the electronic device 10 of
In certain embodiments, the display 18 may be a liquid crystal display (e.g., LCD), which may allow users to view images generated on the electronic device 10. In some embodiments, the display 18 may include a touch screen, which may allow users to interact with a user interface of the electronic device 10. Furthermore, it should be appreciated that, in some embodiments, the display 18 may include one or more light emitting diode (e.g., LED) displays, or some combination of LCD panels and LED panels. The display 18 may include sensing circuitry 19 that is used to sense non-uniformity of the display 18 by sensing changes in voltage/current through thin-film transistors (TFTs) and/or emissive elements in the display 18.
The input structures 20 of the electronic device 10 may enable a user to interact with the electronic device 10 (e.g., pressing a button to increase or decrease a volume level, a camera to record video or capture images). The I/O interface 22 may enable the electronic device 10 to interface with various other electronic devices. Additionally or alternatively, the I/O interface 22 may include various types of ports that may be connected to cabling. These ports may include standardized and/or proprietary ports, such as USB, RS232, APPLE'S LIGHTNING® connector, as well as one or more ports for a conducted RF link.
As further illustrated, the electronic device 10 may include the power source 24. The power source 24 may include any suitable source of power, such as a rechargeable lithium polymer (e.g., Li-poly) battery and/or an alternating current (e.g., AC) power converter. The power source 24 may be removable, such as a replaceable battery cell.
The interface(s) 26 enable the electronic device 10 to connect to one or more network types. The interface(s) 26 may also include, for example, interfaces for a personal area network (e.g., PAN), such as a BLUETOOTH network, for a local area network (e.g., LAN) or wireless local area network (e.g., WLAN), such as an 802.11 Wi-Fi network or an 802.15.4 network, and/or for a wide area network (e.g., WAN), such as a 3rd generation (e.g., 3G) cellular network, 4th generation (e.g., 4G) cellular network, or long term evolution (e.g., LTE) cellular network. The interface(s) 26 may also include interfaces for, for example, broadband fixed wireless access networks (e.g., WiMAX), mobile broadband Wireless networks (e.g., mobile WiMAX), and so forth.
By way of example, the electronic device 10 may represent a block diagram of the notebook computer depicted in
In certain embodiments, the electronic device 10 may take the form of a computer, a portable electronic device, a wearable electronic device, or other type of electronic device. Such computers may include computers that are generally portable (e.g., such as laptop, notebook, and tablet computers) as well as computers that are generally used in one place (e.g., such as conventional desktop computers, workstations and/or servers). In certain embodiments, the electronic device 10 in the form of a computer may be a model of a MACBOOK®, MACBOOK® Pro, MACBOOK AIR®, IMAC®, MAC® mini, or MAC PRO® available from APPLE INC. By way of example, the electronic device 10, taking the form of a notebook computer 30A, is illustrated in
The handheld device 30B may include an enclosure 32 to protect interior components from physical damage and to shield them from electromagnetic interference. The enclosure 32 may surround the display 18, which may display indicator icons. The indicator icons may indicate, among other things, a cellular signal strength, BLUETOOTH connection, and/or battery life. The I/O interfaces 22 may open through the enclosure 32 and may include, for example, an I/O port for a hard-wired connection for charging and/or content manipulation using a connector and protocol, such as the Lightning connector provided by APPLE INC., a universal serial bus (e.g., USB), one or more conducted RF connectors, or other connectors and protocols.
The illustrated embodiments of the input structures 20, in combination with the display 18, may allow a user to control the handheld device 30B. For example, a first input structure 20 may activate or deactivate the handheld device 30B, one of the input structures 20 may navigate user interface to a home screen, a user-configurable application screen, and/or activate a voice-recognition feature of the handheld device 30B, while other of the input structures 20 may provide volume control, or may toggle between vibrate and ring modes. Additional input structures 20 may also include a microphone that may obtain a user's voice for various voice-related features, and a speaker to allow for audio playback and/or certain phone capabilities. The input structures 20 may also include a headphone input (not illustrated) to provide a connection to external speakers and/or headphones and/or other output structures.
Turning to
Similarly,
Although the following discusses sensing current through an OLED as a pixel, some embodiments may include measuring other parameters suitable for other pixel types. For example, LED voltage may be sensed at LED pixels in the display.
As previously noted, non-uniformity sensing for some displays may be unsuitable for other displays. For example, sensing schemes used on devices that are always powered by external power may be unconcerned with available power. Thus, such schemes may not be suitable for displays that use an internal power source (e.g., battery). Instead, in displays that utilize limited power (e.g., battery), prioritization of sensing based on thresholds and available power may be used.
In addition to the first threshold, the sensing circuitry 19 may utilize a second threshold. The first threshold may correspond to a high number (e.g., a long period of use) relative to the second threshold. The second threshold may be utilized to cause sensing when more power is available. For example, the second threshold may be used to provide sensing when AC power is connected to the electronic device 10 before the first threshold causes sensing regardless of external power availability.
The sensing circuitry 19 determines whether the display usage time counter 122 has surpassed the second threshold (block 130). If the display usage time counter 122 has surpassed the second threshold, the sensing circuitry 19 determines whether the display 18 is off (block 132). If the display 18 is off, the sensing circuitry 19 determines whether the electronic device 10 is plugged into an external power supply (block 134). For example, the electronic device may be powered using an external AC adapter in addition to or alternative to battery power. If external power is provided to the electronic device 10, the sensing circuitry 19 performs the sensing scan, as previously discussed (block 136). However, if the sensing circuitry determines that the display usage time counter 122 has not surpassed second threshold, the display is on, and/or the electronic device is not plugged into external power, the sensing circuitry 19 delays sensing until a next round sensing. In some embodiments, the first and second thresholds may be evaluated in a different order. For example, in certain embodiments, the second threshold may be evaluated before the first threshold is evaluated to prefer evaluating whether a plugged sensing threshold should be used before determining whether a non-plugged sensing threshold should be used. Additionally or alternatively, in some embodiments, a determination may be made to determine whether the display is receiving external power before using a threshold. In certain such embodiments, only a single threshold may be used with the first threshold used when external power is not connected and the second threshold used when external power is connected.
As previously discussed, sensing may include various sensing types. For example, a first sensing type may be used to sense aging in TFTs and a second sensing type may be used to sense aging of emissive elements. Since TFTs and emissive elements may reflect aging changes at different rates, these sensing processes may occur at different intervals. Thus, the two sensing types may be scheduled to occur at different times, but, in some embodiments, these schedules may conflict (e.g., occur at the same time). When both sensing types are to occur at the same time and/or within a same duration, drain on an internal power supply (e.g., battery) may be excessive.
Thus, the sensing circuitry 19 may utilize some conflict resolution between the two sensing process types.
If both sensing types do not occur within the threshold time, the sensing circuitry 19 may perform both sensing types at the indicated corresponding times (block 158). However, both sensing types are to occur within the threshold time, the sensing circuitry 19 may delay the first sensing type to a later time (block 160). The sensing type to be delayed may be selected based on which sensing type has a longer interval between sensing occurrences. For example, a sensing type that occurs less frequently may be delayed because the underlying sensed parameter may reflect aging changes less frequently. For instance, aging of the emissive elements may be less severe in appearance than the changes caused by aging of TFTs. Thus, in some embodiments, sensing of emissive elements may be delayed until later time while the second sensing type may still be performed by the sensing circuitry 19 (block 162).
Once the TFT flag is set, the sensing circuitry 19 performs TFT sensing (block 198). Once TFT sensing has been performed, the sensing circuitry 19 resets the counter and may begin the process 190 over again.
Similar to the process 190, the sensing circuitry 19 utilizes process 200 to control OLED sensing 176. The sensing circuitry 19 reset an OLED aging counter (202). Using the reset OLED aging counter, the sensing circuitry 19 tracks usage of the display 18 using OLED aging counting (block 204). The sensing circuitry 19 then determines whether the OLED flag has been set and the TFT flag has not been set (block 206). Similar to setting of the TFT flag, the sensing circuitry 19 may determine whether the OLED aging counter has surpassed the first and/or second threshold as discussed in
As previously discussed, a sensing scan may use more than a single pass of pixels of the display 18. However, the display 18 may be turned on during scans. Accordingly, data gathered in an incomplete sensing may not be completely useful for compensating for non-uniformity since an incomplete scan of the display 18 with subsequent completion may capture different display parameters under disparate conditions. For example, temperature and/or aging variations may cause the pixels of the display 18 to behave differently due to scans being run at different times. Instead, at least a portion of the incomplete scans may be discarded. Specifically, if a scan includes scanning each pixel more than once before moving on to a next pixel, the scan may be more likely to cause discarding of a relatively high number of pixel data. Instead, a scan may include one or more frames where each pixel is scanned before moving on to a next state. Thus, a first pass of the sensing circuitry 19 may be kept even if later frames are not completed.
When no user interrupt has been detected, the sensing circuitry 19 and/or the processor(s) 12 determines whether the frame is finished (block 228). If the frame has not been completed, the sensing circuitry 19 continues sensing the frame. Once the frame has been completed, the sensing circuitry 19 and/or the processor(s) 12 store frame data to be used for compensating operation of the display 18 (block 230). The frame data may be stored in the memory 14. The sensing circuitry 19 may indicate that the sensing operation has update compensation values (block 232). The processor(s) 12 then use the updated compensation values from memory 14 to compensate for non-uniformity in the display 18 (block 234).
If the sensing circuitry 19 and/or the processor(s) 12 determine that a user interrupt has occurred before the currently scanned frame has been completed, the sensing circuitry 19 and/or the processor(s) 12 abandon current frame data (block 236). For example, the sensing circuitry 19 and/or the processor(s) 12 may delete the frame data from volatile memory prior to storing compensation values in non-volatile memory. Additionally or alternatively, frame data may be stored in non-volatile memory during a scan, but the signal to indicate that the frame has not completed is suppressed. Furthermore, the frame data in the non-volatile memory may be deleted. Moreover, in some embodiments, the frame data may be deleted if a threshold of time has elapsed since a frame has begun without completing the frame. Once frame data has been discarded, the sensing circuitry 19 looks for a next sensing opportunity (block 238). For example, the sensing circuitry 19 may wait until the display 18 is turned off to start a new frame scan. In some embodiments, the sensing circuitry 19 may wait until a threshold of time has elapsed from the last on state during the current off-time before attempting to scan a new frame again.
Since sensing frames are performed during an off-state, the compensation values for the display 18 may not be updated while the display 18 is on. In some situations, the display 18 may remain on for an extended duration. During this duration, the display 18 uniformity may decrease without adjusted compensation being applied. To address this situation, the processor(s) 12 may estimate compensation while the display 18 is on.
Furthermore, the aging prediction 256 is used to fine tune previous on time compensations since the aging prediction 256 is a difference between Off-time sensing 254 and a previous on time compensation. Similarly, the on time compensation 260 may be used in future compensations. For example, during a subsequent off state 262, the sensing circuitry 19 performs Off-time sensing 264. The results of this sensing scan are subtracted from the previous on time compensation 260 to calculate the aging prediction 266. In other words, the aging prediction 266 is based on how far off the on time compensation 260 is from the values determined during the Off-time sensing 264. During the on state of the display 18, the aging prediction 266 is added to the results of the Off-time sensing 264 to generate the on time compensation 270.
Running compensation 272 illustrates how the past values are used to predict future aging compensation. The running compensation 272 receives real-time content 274 into an accumulator 276 that tracks on time for the display 18 and the usage of the display 18 based on the real-time content 274 since a previous Off-time sensing. Real-time content 274 may include content as it is being displayed. Additionally or alternatively, the real-time content 274 may include any data since a last Off-time sensing within a period of time small enough that the aging effects on the display may be small and/or unnoticeable to a user. The accumulator 276 also receives temperature information 278 and brightness level 280 that are both relevant to usage and/or aging. The real-time content 274 since the last Off-time sensing is accumulated and passed to conversion circuitry 282 that maps grayscale levels in the real-time content to a correction voltage based on the temperature information 278, the brightness level 280, and difference between a previous prediction and a present sensing 284. In other words, the conversion circuitry 282 may calculate a correction voltage that is used to offset predicted aging in the display 18 due to the real-time content 274 displayed at a temperature indicated in the temperature information 278 at the brightness level 280. This correction voltage is also fine-tuned by indicating how much the previous prediction using the calculation varied from the sensed correction voltage level.
The processor(s) 12 receive an indication that the display 18 has entered into a subsequent off state (block 308). During the subsequent off state, the sensing circuitry 19 re-senses the display 18 (block 310). The processor(s) 12 and/or the sensing circuitry 19 adjust prediction of aging during subsequent on states of the display 18 based at least in part on a difference between re-sense aging values and the predicted aging (block 312). The prediction of aging during subsequent on states may also be based at least in part on real-time content since the off-time sensing, brightness level for the display 18, and/or temperature information.
Since the TFTs and related circuitry (e.g., capacitors) in the display 18 may include some hysteresis, the processor(s) 12 may utilize active panel conditioning to toggle the TFTs to reduce previous content's impact to TFT characteristics during the TFT sensing.
In some embodiments, to reduce an overall sensing duration in the off state 334, the APC 336 and the emissive element sensing 338 may occur with at least some overlap (e.g., may be performed concurrently).
The APC diagram 374 illustrates that a signal 384 is injected into the TFT 386 to reduce previous content's impact to TFT characteristics during the TFT sensing. The APC diagram 374 illustrates that the signal 384 does not induce any current through the emissive element 382 because switch 388 does not allow current to flow through the TFT 386. Thus, since the signal 384 does not induce current through the emissive element 382 the current 380 may be used to sense the emissive element 382 while signal 384 is used to perform ADC.
The specific embodiments described above have been shown by way of example, and it should be understood that these embodiments may be susceptible to various modifications and alternative forms. It should be further understood that the claims are not intended to be limited to the particular forms disclosed, but rather to cover all modifications, equivalents, and alternatives falling within the spirit and scope of this disclosure. Furthermore, it should be further understood that each of the embodiments disclosed above may be used with any and all of the other embodiments disclosed herein. The techniques presented and claimed herein are referenced and applied to material objects and concrete examples of a practical nature that demonstrably improve the present technical field and, as such, are not abstract, intangible or purely theoretical. Further, if any claims appended to the end of this specification contain one or more elements designated as “means for [perform]ing [a function] . . . ” or “step for [perform]ing [a function] . . . ”, it is intended that such elements are to be interpreted under 35 U.S.C. 112(f). However, for any claims containing elements designated in any other manner, it is intended that such elements are not to be interpreted under 35 U.S.C. 112(f).
This application is a national stage filing of PCT Application No. PCT/US2018/049193, filed Aug. 31, 2018, and entitled “Display Off-Time Sensing,” which is a continuation of and claims priority to U.S. Non-Provisional application Ser. No. 15/870,125, filed Jan. 12, 2018, and entitled “Display Off-Time Sensing,” which claims priority to and the benefit of U.S. Provisional Application No. 62/562,915, filed Sep. 25, 2017, and entitled “Display Off-Time Sensing,” the disclosures of which are hereby incorporated by reference in their entireties.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2018/049193 | 8/31/2018 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2019/060127 | 3/28/2019 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20070252785 | Nakano | Nov 2007 | A1 |
20080150839 | Kawabe | Jun 2008 | A1 |
20170032723 | Kim et al. | Feb 2017 | A1 |
Entry |
---|
PCT Search Report and Written Opinion for PCT/US2018/049193; dated Jan. 9, 2019, pp. 1-25. |
Vincent Tech, “LG OLED55E6 4K HDR OLED TV Review,” HDTVtest, Apr. 27, 2016, http://www.hdtvtest.co.uk/news/oled55e6-201604274285.htm, pp. 1-16. |
Number | Date | Country | |
---|---|---|---|
20210150950 A1 | May 2021 | US |
Number | Date | Country | |
---|---|---|---|
62562915 | Sep 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15870125 | Jan 2018 | US |
Child | 16644932 | US |