This relates generally to electronic devices, and more particularly, to electronic devices with displays.
Electronic devices often include displays. For example, cellular telephones and portable computers often include displays for presenting information to a user.
Liquid crystal displays contain a layer of liquid crystal material. Pixels in a liquid crystal display contain thin-film transistors and pixel electrodes for applying electric fields to the liquid crystal material. The strength of the electric field in a pixel controls the polarization state of the liquid crystal material and thereby adjusts the brightness of the pixel.
There is a potential for ions in a liquid crystal display to move in response to applied electric fields. This can lead to charge accumulation on the pixels. Another cause of charge accumulation is dielectric polarization. Charge accumulation effects can produce visible artifacts on a display such as undesired flickering.
To minimize charge accumulation in a liquid crystal display, the polarity of the electric field applied to the pixels may be periodically reversed. For example, alternating positive polarity and negative polarity frames of image data may be displayed on the pixels of a liquid crystal display to prevent excess positive or negative charge accumulation. Although periodic polarity reversal can help reduce charge accumulation, charge accumulation issues may still arise in liquid crystal displays. Charge accumulation may arise, for example, in situations in which a software application or other content generator creates negative and positive frames of image data with unbalanced gray levels. The risk of undesired charge accumulation may be exacerbated in displays with a variable refresh rate.
It would therefore be desirable to be able to provide displays with enhanced charge accumulation mitigation capabilities.
An electronic device may generate content that is to be displayed on a display. The display may be a liquid crystal display have an array of liquid crystal display pixels. Display driver circuitry in the display may display image frames on the array of pixels.
A charge accumulation tracker may analyze the image frames to determine when there is a risk of excess charge accumulation in the pixels of the array. The charge accumulation tracker may implement a physically derived circuit model of the pixels. Parameters for the model such as a charge accumulation input response matrix and charge accumulation state response matrix may be stored in look-up table circuitry and used in updating a current charge accumulation state based on current pixel voltage information and previous state information. The impact of temperature, backlight illumination level, frame duration, and other factors may be taken into account in evaluating the current charge accumulation state. The current charge accumulation state may be compared to a threshold to determine when remedial action should be taken due to excess charge accumulation.
Electronic devices may include displays. The displays may be used to display images to a user. Illustrative electronic devices that may be provided with displays are shown in
The illustrative configurations for device 10 that are shown in
Housing 12 of device 10, which is sometimes referred to as a case, may be formed of materials such as plastic, glass, ceramics, carbon-fiber composites and other fiber-based composites, metal (e.g., machined aluminum, stainless steel, or other metals), other materials, or a combination of these materials. Device 10 may be formed using a unibody construction in which most or all of housing 12 is formed from a single structural element (e.g., a piece of machined metal or a piece of molded plastic) or may be formed from multiple housing structures (e.g., outer housing structures that have been mounted to internal frame elements or other internal housing structures).
Display 14 may be a touch sensitive display that includes a touch sensor or may be insensitive to touch. Touch sensors for display 14 may be formed from an array of capacitive touch sensor electrodes, a resistive touch array, touch sensor structures based on acoustic touch, optical touch, or force-based touch technologies, or other suitable touch sensor components.
Display 14 for device 10 may include pixels formed from liquid crystal display (LCD) components. A display cover layer may cover the surface of display 14 or a display layer such as a color filter layer or other portion of a display may be used as the outermost (or nearly outermost) layer in display 14. The outermost display layer may be formed from a transparent glass sheet, a clear plastic layer, or other transparent member.
A cross-sectional side view of an illustrative configuration for display 14 of device 10 (e.g., for display 14 of the devices of
Display layers 46 may be mounted in chassis structures such as a plastic chassis structure and/or a metal chassis structure to form a display module for mounting in housing 12 or display layers 46 may be mounted directly in housing 12 (e.g., by stacking display layers 46 into a recessed portion in housing 12). Display layers 46 may form a liquid crystal display or may be used in forming displays of other types.
Display layers 46 may include a liquid crystal layer such a liquid crystal layer 52. Liquid crystal layer 52 may be sandwiched between display layers such as display layers 58 and 56. Layers 56 and 58 may be interposed between lower polarizer layer 60 and upper polarizer layer 54.
Layers 58 and 56 may be formed from transparent substrate layers such as clear layers of glass or plastic. Layers 58 and 56 may be layers such as a thin-film transistor layer and/or a color filter layer. Conductive traces, color filter elements, transistors, and other circuits and structures may be formed on the substrates of layers 58 and 56 (e.g., to form a thin-film transistor layer and/or a color filter layer). Touch sensor electrodes may also be incorporated into layers such as layers 58 and 56 and/or touch sensor electrodes may be formed on other substrates.
With one illustrative configuration, layer 58 may be a thin-film transistor layer that includes an array of pixel circuits based on thin-film transistors and associated electrodes (pixel electrodes) for applying electric fields to liquid crystal layer 52 and thereby displaying images on display 14. Layer 56 may be a color filter layer that includes an array of color filter elements for providing display 14 with the ability to display color images. If desired, layer 58 may be a color filter layer and layer 56 may be a thin-film transistor layer. Configurations in which color filter elements are combined with thin-film transistor structures on a common substrate layer in the upper or lower portion of display 14 may also be used.
During operation of display 14 in device 10, control circuitry (e.g., one or more integrated circuits on a printed circuit) may be used to generate information to be displayed on display 14 (e.g., display data). The information to be displayed may be conveyed to display driver circuitry (e.g., a display driver integrated circuit such as circuit 62A or 62B) using a signal path such as a signal path formed from conductive metal traces in a rigid or flexible printed circuit such as printed circuit 64 (as an example).
Backlight structures 42 may include a light guide layer such as light guide layer 78. Light guide layer 78 may be formed from a transparent material such as clear glass or plastic. For example, light guide layer 78 may be a molded plastic light guide plate or a thin flexible plastic light guide film. During operation of backlight structures 42, a light source such as light source 72 may generate light 74. Light source 72 may be, for example, an array of light-emitting diodes.
Light 74 from light source 72 may be coupled into edge surface 76 of light guide layer 78 and may be distributed in dimensions X and Y throughout light guide layer 78 due to the principal of total internal reflection. Light guide layer 78 may include light-scattering features such as pits or bumps. The light-scattering features may be located on an upper surface and/or on an opposing lower surface of light guide layer 78. Light source 72 may be located at the left of light guide layer 78 as shown in
Light 74 that scatters upwards in direction Z from light guide layer 78 may serve as backlight 44 for display 14. Light 74 that scatters downwards may be reflected back in the upwards direction by reflector 80. Reflector 80 may be formed from a reflective material such as a layer of plastic covered with a dielectric mirror thin-film coating.
To enhance backlight performance for backlight structures 42, backlight structures 42 may include optical films 70. Optical films 70 may include diffuser layers for helping to homogenize backlight 44 and thereby reduce hotspots, compensation films for enhancing off-axis viewing, and brightness enhancement films (also sometimes referred to as turning films) for collimating backlight 44. Optical films 70 may overlap the other structures in backlight unit 42 such as light guide layer 78 and reflector 80. For example, if light guide layer 78 has a rectangular footprint in the X-Y plane of
As shown in
During operation of device 10, control circuitry in device 10 such as memory circuits, microprocessors, and other storage and processing circuitry may provide data to the display driver circuitry. The display driver circuitry may convert the data into signals for controlling pixels 90 of pixel array 92.
Pixel array 92 may contain rows and columns of pixels 90. The circuitry of pixel array 92 (i.e., the rows and columns of pixel circuits for pixels 90) may be controlled using signals such as data line signals on data lines D and gate line signals on gate lines G. Data lines D and gate lines G are orthogonal. For example, data lines D may extend vertically and gate lines G may extend horizontally (i.e., perpendicular to data lines D).
Pixels 90 in pixel array 92 may contain thin-film transistor circuitry (e.g., polysilicon transistor circuitry, amorphous silicon transistor circuitry, semiconducting-oxide transistor circuitry such as indium gallium zinc oxide transistor circuitry, other silicon or semiconducting-oxide transistor circuitry, etc.) and associated structures for producing electric fields across liquid crystal layer 52 in display 14. Each liquid crystal display pixel may have one or more thin-film transistors. For example, each pixel may have a respective thin-film transistor such as thin-film transistor 94 to control the application of electric fields to a respective pixel-sized portion 52′ of liquid crystal layer 52.
The thin-film transistor structures that are used in forming pixels 90 may be located on a thin-film transistor substrate such as a layer of glass. The thin-film transistor substrate and the structures of display pixels 90 that are formed on the surface of the thin-film transistor substrate collectively form thin-film transistor layer 58 (
Gate driver circuitry may be used to generate gate signals on gate lines G. The gate driver circuitry may be formed from thin-film transistors on the thin-film transistor layer or may be implemented in separate integrated circuits. The data line signals on data lines D in pixel array 92 carry analog image data (e.g., voltages with magnitudes representing pixel brightness levels). During the process of displaying images on display 14, a display driver integrated circuit or other circuitry may receive digital data from control circuitry and may produce corresponding analog data signals. The analog data signals may be demultiplexed and provided to data lines D.
The data line signals on data lines D are distributed to the columns of display pixels 90 in pixel array 92. Gate line signals on gate lines G are provided to the rows of pixels 90 in pixel array 92 by associated gate driver circuitry.
The circuitry of display 14 may be formed from conductive structures (e.g., metal lines and/or structures formed from transparent conductive materials such as indium tin oxide) and may include transistors such as transistor 94 of
As shown in
Pixel 90 may have a signal storage element such as capacitor 102 or other charge storage elements. Storage capacitor 102 may be used to help store signal Vp in pixel 90 between frames (i.e., in the period of time between the assertion of successive gate signals). Pixel voltage Vp may sometimes be referred to as the input voltage or data voltage for pixel 90.
Display 14 may have a common electrode coupled to node 104. The common electrode (which is sometimes referred to as the common voltage electrode, Vcom electrode, or Vcom terminal) may be used to distribute a common electrode voltage such as common electrode voltage Vcom to nodes such as node 104 in each pixel 90 of array 92. As shown by illustrative electrode pattern 104′ of
In each pixel 90, capacitor 102 may be coupled between nodes 100 and 104. A parallel capacitance arises across nodes 100 and 104 due to electrode structures in pixel 90 that are used in controlling the electric field through the liquid crystal material of the pixel (liquid crystal material 52′). As shown in
The electric field that is produced across liquid crystal material 52′ causes a change in the orientations of the liquid crystals in liquid crystal material 52′. This changes the polarization of light passing through liquid crystal material 52′. The change in polarization may, in conjunction with polarizers 60 and 54 of
Charge accumulation issues may arise from repeated application of electric fields across liquid crystal material 52′ using applied voltages Vp-Vcom of a single polarity. Accordingly, the polarity of the electric field may be periodically alternated. As an example, in odd frames a positive voltage Vp-Vcom may be applied across material 52′, whereas in even frames a negative voltage Vp-Vcom may be applied across material 52′. To ensure that charge accumulation effects are not present (even when periodically reversing the polarity of the image frames), device 10 can incorporate charge accumulation monitoring functionality. For example, a charge accumulation tracker can be implemented in device 10 that monitors display 14 for excessive charge accumulation conditions. If suitable criteria are satisfied (i.e., if a calculated charge accumulation level exceeds a predetermined charge accumulation threshold for all or part of display 14), appropriate remedial actions may be taken.
Charge accumulation effects arise when non-black content is displayed. Black content and other content with low gray levels does not involve application of large electric fields to display 14 and therefore does not give rise to significant charge accumulation. Content with large gray levels (e.g., white content), however, is associated with large electric fields across layer 52 and therefore has the potential to lead to charge accumulation. In addition to being dependent on the gray level of displayed image frames, charge accumulation effects are also dependent on the amount of time that white content (high gray level content) is displayed for each polarity. Other factors that can affect charge accumulation include the operating temperature of display 14 and the amount of light 44 being produced by backlight unit 42 (which can affect the resistance of insulating structures in pixels 90).
Charge accumulation can become excessive when the images that are displayed on display 14 do not contain content that is evenly divided between positive and negative frames. For example, excessive charge accumulation conditions may arise when more white content is displayed during positive frames than during negative frames. The likelihood that excessive charge accumulation conditions will arise may be exacerbated in displays that implement variable refresh rate schemes. With a variable refresh rate scheme, display 14 is sometimes operated with a relatively high frame rate and is sometimes operated with a relatively low frame rate. The high frame rate may be used to display rapidly moving content. The low frame rate may be used to conserve power when content is changing less rapidly.
A graph in which frame rate FR has been plotted as a function of time in an illustrative configuration in which display 14 has variable refresh rate capabilities is shown in
The reduced frame rates that are involved in operating a display with variable refresh rate capabilities are associated with frames of potentially long duration (e.g., 1 s, etc.). Particularly in scenarios in which display 14 is operating with long frames, there is a potential for an undesirable interplay between the pattern of content being displayed on display 14 and the polarities of the frames that can lead to excessive charge accumulation.
To ensure that device 10 and display 14 operate satisfactorily, a charge accumulation tracker may be implemented that monitors for the occurrence of conditions that are likely associated with excess charge accumulation. When charge accumulation is detected, remedial actions may be taken. For example, in a display with variable refresh rate capabilities, variable refresh operations can be suspended (e.g., by returning device 10 to high refresh rate FRH for a given period of time or by at least elevating the frame rate for display 14 above desired low rate FRL for a given period of time). As another example, the polarity of the frames of image data being displayed on display 14 can be flipped (e.g., by inserting an extra positive frame between a positive frame and a negative frame).
The charge accumulation tracker can be spatially sensitive. For example, display 14 may be divided into multiple subregions (e.g., rectangular blocks), each of which may be monitored separately to determine whether excessive charge accumulation is present. The charge accumulation tracker may also take into account the gray level of displayed content, weighting higher gray levels (whiter content) more heavily than lower gray levels (darker content). The duration of positive and negative frames (which affects how long the content is displayed with each polarity) can also be taken into account as can the current temperature and setting of backlight unit 42. This information can be processed using look-up tables or other data structures implemented in device 10. A charge accumulation model such as a physically derived circuit model of pixels 90 may be used to determine appropriate entries for the look-up tables and appropriate equations to use in calculating charge accumulation states. The charge accumulation model may be implemented by the charge accumulation tracker using matrices having values stored in the look-up tables.
The charge accumulation model may represent the circuit behavior of pixels 90 as a function of time under various changing conditions (gray levels, temperatures, frame durations, backlight levels, previous pixel voltage states, etc.). A cross-sectional side view of an illustrative pixel 90 that may be electrically modeled using a physically derived charge accumulation circuit model is shown in
Electric fields are established between electrodes 106 (at voltage Vin) and layer 104′ (at Vcom). These electric fields include fields that travel along paths such as illustrative paths P1, P2, and P3. Voltages may be established at the interfaces between the layers of pixel 90. For example, voltages V1, V2, and V3 may be established at the interfaces between layers 132, 52′, and 130 along path P3, as shown in
In path P1 of
Input response matrix [IR] represents the response of a pixel to a given input voltage. Input response matrix [IR] of
State response matrix [SR] has elements that quantify the response of the pixel (e.g., the circuit of
The values of [IR] and [SR] may be determined by applying circuit simulation models to the circuit network of
Illustrative circuitry of the type that may be used by device 10 to control display 14 while monitoring charge accumulation is shown in
Control circuitry 110 may include a graphics processing unit such as graphics processing unit 116. Graphics processing unit 116 may receive image frames for frame buffer 120 (e.g., frame buffer 120A) from content generator 114. Content generator 114 may be an application running on control circuitry 110 such as a game, a media playback application, an application that presents text to a user, an operating system function, or other code running on control circuitry 110 that generates image data to be displayed on display 14. While displaying content on display 14, control circuitry 110 may adjust the output level of backlight unit 42, thereby controlling the amount of backlight 44 that passes through display 14 and the associated brightness level of images being displayed on display 14.
Control circuitry 110 may be coupled to input-output circuitry such as input-output devices 112. Input-output devices 112 may be used to allow data to be supplied to device 10 and to allow data to be provided from device 10 to external devices. Input-output devices 112 may include buttons, joysticks, scrolling wheels, touch pads, key pads, keyboards, microphones, speakers, tone generators, vibrators, cameras, sensors, light-emitting diodes and other status indicators, data ports, etc. A user can control the operation of device 10 by supplying commands through input-output devices 112 and may receive status information and other output from device 10 using the output resources of input-output devices 112. Input-output devices 112 may include a temperature sensor such as temperature sensor 140 to gather information on the current operating temperature of display 14.
Control circuitry 110 may be used to run software on device 10 such as operating system code and applications. During operation of device 10, the software running on control circuitry 110 (e.g., content generator 114) may display images on display 14 using pixels 90 of pixel array 92. Display 14 may include display driver circuitry such as display driver circuitry 122 (see, e.g., circuitry 62A and 62B of
Image frames to be displayed on array 92 by the display driver circuitry may be stored in frame buffer 120 (e.g., frame buffer 120B). Look-up table circuitry 142 such as look-up table 142A and/or look-up table 142B may be used to store information for modeling the charge accumulation behavior of display 14 (e.g., information for matrices [SR] and [IR] and other information for implementing a charge accumulation tracker based on a physically derived circuit model of pixels 90 such as charge accumulation tracker 118).
Charge accumulation tracker 118 may be implemented using resources in graphics processing unit 116 (see, e.g., charge accumulation tracker 118A) and/or using resources in display driver circuitry of display 14 (see, e.g., charge accumulation tracker 118B). Charge accumulation tracker 118 may use the circuit behavior of pixels 90 that is represented by the circuit of
Illustrative steps involved in using charge accumulation tracker 118 to monitor charge accumulation conditions in display 14 are shown in
At step 150, charge accumulation tracker 118 may obtain information on the current operating temperature of device 10 and display 14 from temperature sensor 140. The current gray level of the pixel or pixels being evaluated for charge accumulation may be obtained from frame buffer 120. Information on the current backlight level of backlight unit 42 may be obtained from control circuitry 110 and/or other circuitry in device 10 (e.g., graphics processing unit 116, display driver circuitry 122, etc.).
At step 152, gray-level-to-voltage mapping information that is stored in device 10 may be used to determine the voltage Vinlk (Vin of
At step 154, charge accumulation tracker 118 may compute the product of input response matrix [IR] and voltage Vinlk. The computations of step 154 and the other computations performed by charge accumulation tracker 118 may be performed once per frame, once per block in a frame composed of multiple regions (blocks), one per pixel, once per all negative polarity pixels (or subset of negative polarity pixels), once per all positive polarity pixels (or subset of positive polarity pixels), etc.
At step 156, the product of state response matrix [SR] and previous state matrix [PR] may be computed. (Initially, previous state matrix [PR] may be set to default initial values.)
At step 158, charge accumulation tracker 118 can compute the current charge accumulation state [CS] for the pixels of interest, using the equation of
The values of [IR] and [SR] that are used at steps 154 and 156 to compute charge accumulation state [CS] of
After computing the current charge accumulation state [CS] of the array of pixels in display 14 (e.g., a region of pixels covering part of display 14 or all of display 14), charge accumulation tracker 118 may analyze the current charge accumulation state (i.e., the values of matrix [CS]) to determine whether to take action to compensate for charge accumulation. Charge accumulation tracker 118 may, for example, compare the current charge accumulation state of display 14 to a predetermined threshold. If insufficient charge accumulation is present (in all or part of display 14), no action is required and processing may loop back to step 150, as indicated by line 164. If, however, there is excess charge accumulation present in display 14 (e.g., in all of display 14 or in any of the regions of display 14 that are being separately evaluated), compensating actions can be taken at step 162 (e.g., the frame rate of display 14 may be adjusted, additional frames of one or both polarities may be inserted into the frames being displayed on display 14, the polarity of the frame of data being displayed may be reversed, or other actions may be taken to reduce the accumulated charge.
To reduce the amount of memory consumed in implementing look-up table 142, charge accumulation tracker 118 may maintain only one set (or other small number of sets) of matrix entries for a known frame duration (e.g., 4 ms) or set of representative frame durations (e.g., 4 ms, 64 ms, etc.).
In situations in which the time that has elapsed since the last update to the current state exceeds that known duration, charge accumulation tracker 118 may loop through the current state [CS] update operation by an appropriately scaled number of times. As an example, if the amount of elapsed time since the last current state update is 40 ms and if the look-up table contains only entries corresponding to a 4 ms frame duration, tracker 118 can loop through the current state update operations of
If desired, a range of representative sets of look-up table entries for [IR] and [SR] may be stored (e.g., one for 4 ms of frame duration, one for 64 ms of frame duration, etc.). An appropriate number of computational loops may then be used for each of these sets of data to update [CS]. For example, if a frame duration of 72 ms is encountered, charge accumulation tracker 118 may apply the 4 ms data twice and the 64 ms data once (because 64 ms+2*4 ms is 72 ms).
The foregoing is merely illustrative and various modifications can be made by those skilled in the art without departing from the scope and spirit of the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
Number | Name | Date | Kind |
---|---|---|---|
5926162 | Wood | Jul 1999 | A |
6014035 | Taniguchi | Jan 2000 | A |
7633474 | Lee | Dec 2009 | B2 |
8134151 | Imai | Mar 2012 | B2 |
8175447 | Yakaiwa | May 2012 | B2 |
8405690 | Goetz et al. | Mar 2013 | B2 |
8816999 | Dallas | Aug 2014 | B2 |
8908071 | Panicacci | Dec 2014 | B2 |
8928787 | Takane | Jan 2015 | B2 |
20030107546 | Ham | Jun 2003 | A1 |
20030156092 | Suzuki | Aug 2003 | A1 |
20030179175 | Shigeta | Sep 2003 | A1 |
20040189837 | Kido | Sep 2004 | A1 |
20040201564 | Sugino | Oct 2004 | A1 |
20040263450 | Lee | Dec 2004 | A1 |
20060050038 | Cheon | Mar 2006 | A1 |
20060145978 | Takatori | Jul 2006 | A1 |
20090321163 | Suzui | Dec 2009 | A1 |
20100013953 | Niikura | Jan 2010 | A1 |
20100090092 | Yamashita | Apr 2010 | A1 |
20110221723 | Kurokawa | Sep 2011 | A1 |
20130222754 | Kohtoku | Aug 2013 | A1 |
20140176614 | Rosenberg | Jun 2014 | A1 |
20150243234 | Bloks | Aug 2015 | A1 |
20150312459 | Nakagawara | Oct 2015 | A1 |
Number | Date | Country | |
---|---|---|---|
20160343318 A1 | Nov 2016 | US |