This relates generally to electronic devices, and more particularly, to electronic devices with displays.
Electronic devices often include displays. For example, cellular telephones and portable computers often include displays for presenting information to a user.
Displays contain arrays of pixels for presenting images to a user. The active area may be rectangular and may be bordered by an inactive area that does not include pixels. Data lines provide data signals from a display driver integrated circuit mounted outside of the active area to the pixels in the array.
Difficulties may arise in attempting to display images on displays that do not have uniformly rectangular shapes (e.g., displays having rounded corners and/or inactive areas that extend into the active area to form an inactive notch). For example, data lines may be provided with data signals corresponding to pixels that would exist in a uniformly rectangular display, but that do not exist due to the presence of rounded corner portions or a notch-shaped inactive area. These data signals may be adjusted so that the image can be displayed. If care is not taken, however, adjusting the display data signals may cause undesirable visual artifacts on the display.
A display may have an active area that includes display pixels. The display may include an inactive notch region that extends into the active area of the display to accommodate a speaker or other components. Data lines may provide data signals from display driver circuitry to the display pixels. Gate lines may control loading of the data signals into the display pixels.
When displaying data for a rectangular image, the data lines may be provided with data signals corresponding to pixels that would exist in a uniformly rectangular display, but that do not exist due to the presence of the inactive notch region. These data signals for nonexistent pixels (null data signals) may cause nonuniformities in a displayed image. The null data signals can be adjusted to minimize the nonuniformities (e.g., smooth the edge between the active area and the inactive notch region), but these adjustments may create abrupt transitions in the voltages that are provided on the data lines. These abrupt transitions may lead to undesirable display artifacts.
Data signal compensation operations may be used to gradually transition the voltages on the data lines. Null data signals corresponding to the inactive notch region may be highest closer to the border between the active area and the inactive notch, and decrease to zero farther from the border. All of the data signals corresponding to a portion of the display in which there are no actual pixels may be set to a uniform gray level.
An illustrative electronic device of the type that may be provided with a display is shown in
As shown in
Input-output circuitry in device 10 such as input-output devices 12 may be used to allow data to be supplied to device 10 and to allow data to be provided from device 10 to external devices. Input-output devices 12 may include buttons, joysticks, scrolling wheels, touch pads, key pads, keyboards, microphones, speakers, tone generators, vibrators, cameras, sensors, light emitting diodes and other status indicators, data ports, proximity sensors, ambient light sensors, etc. A user can control the operation of device 10 by supplying commands through input-output devices 12 and may receive status information and other output from device 10 using the output resources of input-output devices 12.
Input-output devices 12 may include one or more displays such as display 14. Display 14 may be a touch screen display that includes a touch sensor for gathering touch input from a user. A touch sensor for display 14 may be based on an array of capacitive touch sensor electrodes, acoustic touch sensor structures, resistive touch components, force-based touch sensor structures, a light-based touch sensor, or other suitable touch sensor arrangements. A touch sensor for display 14 may be formed from electrodes formed on a common display substrate with the pixels of display 14 or may be formed from a separate touch sensor panel that overlaps the pixels of display 14. If desired, display 14 may be insensitive to touch (i.e., the touch sensor may be omitted).
Control circuitry 16 may be used to run software on device 10 such as operating system code and applications. During operation of device 10, the software running on control circuitry 16 may display images on display 14. If desired, control circuitry 16 may include a data signal attenuator 55 for attenuating image data signals provided to display 14. In one illustrative example, control circuitry 16 may also include a data signal compensator 57 for adjusting data signals that have been attenuated by attenuator 55. In another illustrative example, data signal compensator 57 may be incorporated into display 14, where it may receive and adjust data signals that have been attenuated by attenuator 55.
A perspective view of an illustrative electronic device 10 is shown in
As shown in
Display 14 may be an organic light-emitting diode display. In an organic light-emitting diode display, each pixel contains a respective organic light-emitting diode. A positive power supply voltage ELVDD may be supplied to a positive power supply terminal of the organic light-emitting diode and a ground power supply voltage ELVSS may be supplied to ground power supply terminal of the organic light emitting diode. The diode has an anode (terminal AN) and a cathode (terminal CD). The state of a drive transistor controls the amount of current flowing through the diode and therefore the amount of emitted light from the display pixel. The cathode is coupled to the ground terminal, so the cathode terminal of the diode may sometimes be referred to as the ground terminal.
As shown in
Display 14 may have an array of image pixels 22 arranged in rows and columns. Pixels 22 form an active area AA of display 14 that displays images for a user. Inactive border portions of display 14 such as inactive areas IA along one or more of the edges of substrate 24 do not contain pixels 22 and do not display images for the user (i.e., inactive area IA is free of pixels 22).
Each pixel 22 (sometimes referred to herein as light-emitting pixels 22) may have a light-emitting diode such as organic light-emitting diode and associated thin-film transistor circuitry. The array of pixels 22 may be formed from rows and columns of pixel structures (e.g., pixels formed from structures on display layers such as substrate 24). There may be any suitable number of rows and columns in the array of pixels 22 (e.g., ten or more, one hundred or more, or one thousand or more). Display 14 may include pixels 22 of different colors. As an example, display 14 may include red pixels that emit red light, green pixels that emit green light, and blue pixels that emit blue light. Configurations for display 14 that include pixels of other colors may be used, if desired. The use of a pixel arrangement with red, green, and blue pixels is merely illustrative.
Display driver circuitry 20 for display 14 may be mounted on a printed circuit board that is coupled to substrate 24 or may be mounted on substrate 24. Signal paths such as signal path 26 may couple display driver circuitry 20 to control circuitry 16. Circuitry 20 may include one or more display driver integrated circuits and/or thin-film transistor circuitry.
During operation, the control circuitry of device 10 (e.g., control circuitry 16 of
Gate driver circuitry 18 may assert gate line signals on the gate lines G in display 14. For example, gate driver circuitry 18 may receive clock signals and other control signals from display driver circuitry 20 and may, in response to the received signals, assert a gate signal on gate lines G in sequence, starting with the gate line signal G in the first row of display pixels 22. As each gate line is asserted, data from data lines D is loaded into the corresponding row of display pixels. In this way, control circuitry in device 10 such as display driver circuitry 20 may provide pixels 22 with signals that direct pixels 22 to generate light for displaying a desired image on display 14.
The circuitry of pixels 22 and, if desired, display driver circuitry such as circuitry 18 and/or 20 may be formed using thin-film transistor circuitry. Thin-film transistors in display 14 may, in general, be formed using any suitable type of thin-film transistor technology (e.g., silicon transistors such as polysilicon thin-film transistors, semiconducting-oxide transistors such as indium gallium zinc oxide transistors, etc.).
Conductive paths (e.g., one or more signal lines, blanket conductive films, and other patterned conductive structures) may be provided in display 14 to route data signals D, gate signals G, and power signals such as positive power supply signal ELVDD to pixels 22. As shown in
As shown in
A display of the type shown in
Because gate lines G control the loading of data signals (data loading) from the data lines D into the pixels 22, the presence of notch 50 may result in an arrangement in which a first set of gate lines that extend edge-to-edge across the active area of the display in the X direction (e.g., gate lines that do not run into notch 50 and are not in active area portion AA′) to control data loading for both a first set of data lines and a second set of data lines. The first set of data lines may extend across the display in the Y direction to the edge of the active area adjacent to the notch in active area portion AA′ (e.g., data lines that do not run into notch 50). The second set of data lines may extend across the display and terminate at the notch. A second set of gate lines that do extend through active area portion AA′ and that run into notch 50 may control data loading for the first set of data lines that are present adjacent to the notch in active area portion AA′, but not for the second set of data lines that extend across the display and terminate at the notch. The first and second sets of gate lines may each include any suitable numbers of gate lines (e.g., three, five, ten, one hundred, five hundred, or other suitable numbers of gate lines). The first and second sets of data lines may each include any suitable numbers of data lines (e.g., three, five, ten, one hundred, five hundred, or other suitable numbers of data lines).
Despite the fact that there are no actual image pixels 22 in notch 50, data lines that provide data signals to the columns of pixels that terminate at notch 50 may still generate data signals as if there were pixels in notch 50. For example, these data lines may still be toggled between different data voltages for every row of pixels as the gate lines load a frame of data into the display. Since there are no display pixels in notch 50, however, these data signals are not actually received by any display pixels 22 and are simply replaced with a new data signal on data line D when the next row of pixels is programmed. These data signals may be referred to as data signals for virtual pixels 22′ (because the data signals correspond to pixels that do not actually exist), inactive data (because the data corresponds to the inactive notch area of the display), non-image data (because the data signals do not correspond to any image content displayed in the active area), null data signals (because even though the data signals may have a value greater than zero, they are not being used to drive pixels in the active area), constant or constant value data (because the data that is driven onto the data lines D corresponding to the inactive notch may not change between frames), dummy data signals, filler data signals, or notch data signals. Once programming for the frame has reached a row that does include display pixels coupled to the data lines D that terminate early (i.e., the data lines that run into notch 50), the data signals on these data lines D will be provided to a display pixel 22.
Null data/non-image data may correspond to data signals that, if provided to a pixel, would cause the pixel to emit no light (e.g., the pixel would remain off and would appear black). In this way, null data/non-image data may have the minimum data signal voltage level (e.g., 0 volts) and correspond to a gray level of 0, and may be referred to as black data. Null data/non-image data may correspond to data signals that, if provided to a pixel, would cause the pixel to emit some light while remaining below the pixel's maximum luminance. In this way, null data/non-image data may have a data signal voltage level higher than the minimum and correspond to a gray level of 1 or greater, and may be referred to as gray data.
In arrangements in which the active area AA of display 14 has rounded corners as shown in
In organic light-emitting diode displays, colored emissive material may be used to provide the light-emitting diodes with the ability to emit red, green, and blue light (or light of other colors). For example, red organic light-emitting diodes may contain red organic emissive material, green organic light-emitting diodes may contain green organic emissive material, and blue organic light-emitting diodes may contain blue organic emissive material. The emissive material may degrade as the light-emitting diodes are used. Heavy use, in which diodes are driven with large currents, may age the diodes more rapidly than light use, in which the diodes are driven with small currents. As the diodes age, the degraded emissive material will cause the diodes to emit a reduced amount of light for a given drive current. Pixel luminance in organic light-emitting diode displays is therefore generally a function of the aging history of the pixels in the display. Pixel luminance and aging may be monitored based on the data signals that are provided to the pixels. For example, a pixel that is provided with data signals that cause the pixel to be driven at a high luminance level using large currents will degrade more quickly than if the same pixel were provided with data signals that cause the pixel to be driven at a low luminance level using low currents. Because data signals sent out on data lines D generally correspond to a gray value between 0 and 255 (i.e., the larger the value of the data signal/gray value, the more brightly the pixel is driven), circuitry in electronic device 10 may be able to track the aging of the pixels of the display based on these data signals as they are provided on data lines D.
To compensate for these undesired aging-induced changes in display pixels 22 and therefore ensure that display 14 can display images accurately, device 10 may be provided with pixel luminance degradation compensation capabilities (sometimes referred to herein as burn-in compensation). In particular, the control circuitry of device 10 may be used to implement a pixel luminance degradation tracker and/or pixel luminance degradation compensator that maintains information on the aging history of each of the pixels (sometimes referred to herein as burn-in statistics) in display 14. Based on this aging information, the pixel luminance degradation compensator can adjust the luminance values supplied to each of the pixels in display 14. As the luminance of pixels that have degraded due to aging decreases over time, the data signals (sometimes referred to herein as pixel luminance values or gray values) provided to other pixels in the display may be altered (e.g., reduced) so that the overall luminance of the display matches the reduced luminance of the pixels that have aged more quickly.
As described above in connection with
In order to prevent the pixel luminance degradation compensator from reducing the brightness of the display based on pixel aging information for pixels that do not actually exist, electronic device 10 may implement data signal attenuation (sometimes referred to herein as data signal reduction, data signal minimization, adaptive border gain, or edge filtering) that adjusts the values of the inactive data signals that are being provided for virtual pixels 22′ (e.g., in notch 50 or corner regions 59) before these data signals are distributed on data lines D. For example, data signal attenuation may be implemented in control circuitry 16 such that the values of the inactive data signals for virtual pixels 22′ are adjusted to zero (i.e., minimum luminance or black pixel data) before being provided to display driver circuitry 20 or distributed on data lines D. Since these data signals are adjusted to 0, their effect on pixel luminance degradation tracking can be reduced or eliminated, thereby preventing the pixel luminance degradation compensator from reducing the brightness of the display based on pixel aging information for pixels that do not actually exist. Data signal attenuation may not adjust data signals for display pixels 22 in the active area AA of the display, so these data signals will be distributed normally on data lines D.
If desired, adaptive border gain operations (data signal attenuation) of the type described above may also be used to provide a smooth visual transition between the active area AA and the inactive area IA in the region around notch 50. For example, when the border 51 has curved portions as shown in
If desired, data signal attenuation operations may be performed using circuitry in control circuitry 16 and/or display driver circuitry 20. In another example, electronic device 10 may include hardware structures such as a data signal attenuator (sometimes referred to herein as data signal attenuation circuitry, a data signal minimizer, a data signal reducer, an edge filter engine, or an adaptive border gain mechanism) that performs data signal attenuation operations. If desired, data signal attenuator 55 may be formed in control circuitry 16, in display driver 20, or from other circuitry in device 10.
As described above in connection with
To reduce or eliminate the dim line at the border between the central active area AA and the portion of the active area AA′ adjacent to notch 50 without causing premature display dimming due to pixel luminance degradation compensation, the null data signals that are provided for virtual pixels 22′ (e.g., in notch 50 or corner regions 59) may be adjusted to a value that eases the data signal value transition at the active area beneath notch 50 or near corner regions 59. Operations that adjust the data signals to ease this transition may be referred to herein as data signal compensation, data signal correction, data signal adjustment, or data signal masking. In one example, data signal compensation operations may be performed using circuitry in control circuitry 16 and/or display driver circuitry 20. In another example, electronic device 10 may include hardware structures such as a data signal compensator 57 (sometimes referred to herein as data signal compensation circuitry or a data signal nullifier) that performs data signal compensation operations. If desired, data signal compensator 57 may be formed in control circuitry 16, in display driver 20, or using other circuitry in device 10. Data signal compensation operations may be performed using a mathematical mask that is applied to the null data signals, using a look-up table that relates specific pixel addresses (e.g., the specific row and column in which a pixel is located) with respective compensated inactive data signals or inactive data signal compensation factors (e.g., gain values), using a look-up table that relates specific pre-compensation data signals to compensated inactive data signal values, or using other operations.
An illustrative diagram of a portion of display 14 in the vicinity of notch 50 is shown in
In one illustrative example, the values of inactive data signals corresponding to transition area 61 may gradually decrease for rows of virtual pixels 22′ that are farther from the border between the inactive notch and the active area. For example, the gray level value A for display pixels 22 in active area AA may be 150. Rather than adjusting the gray level values for all virtual pixels 22′ to zero (which may cause undesirable display artifacts), the gray level T1 for a first row of virtual pixels 22′ in transition area 61 may be set to 100. The gray level TN for the last row of virtual pixels may be set to 1. The gray levels for the virtual pixels 22′ between the first and last rows of virtual pixels in transition zone 61 may have values between 1 and 100. In this way, null data corresponding to the inactive notch (e.g., transition zone 61) may be referred to as gray data or gray image data that includes a plurality of different gray levels. The gray levels may decrease linearly or exponentially the farther into transition zone 61 the virtual pixel is. In other words, gray levels (data signals) corresponding to the inactive notch may decrease linearly or exponentially with increasing distance from the active area-inactive notch border (e.g., the farther from the inactive notch-active area border the location in transition zone 61 to which the null data signal corresponds is, the lower the gray level may be). The gray level Z for virtual pixels 22′ in upper zone 63 may be set to zero. In this way, null data corresponding to the inactive notch (e.g., upper zone 63) may be referred to as black data. By gradually reducing (tapering) the gray levels provided on data lines D that terminate at notch 50, the voltage drop on the positive power supply line may be limited and the presence of the dim line around the border 53 may be reduced or eliminated. Because the inactive data signals provided on data lines D are still taken to zero for some of the virtual pixels 22′, and because the inactive data signals that are higher than zero are still reduced relative to the data signals that are being provided to display pixels 22 in active area AA, the impact of these inactive data signals on pixel luminance degradation tracking may be limited such that premature display dimming is minimized.
Because transition region 61 and upper region 63 of notch 50 correspond to rows of pixels into which notch 50 extends, the null data corresponding to the values of Z, T1, TN, and/or the other gray values for transition region 61 may be provided when the gate lines for these rows are being used control data loading. For example, while using a first gate line(s) corresponding to a row(s) of pixels into which notch 50 extends, display driver circuitry 20 may provide a data line(s) D that truncates at notch 50 with null data signals corresponding to gray values of T1, TN, and/or the other gray values (e.g., gray data) for transition region 61. There may be one, two, three, four, five, ten, or more gate lines for which display driver circuitry 20 operates in this manner to provide gray data. The gray levels associated with the gray data may decrease linearly or exponentially with increasing distance (of the gate line) from the border between inactive notch 50 and the active area AA. While using a second gate line(s) corresponding to a second row(s) of pixels into which notch 50 extends, display driver circuitry 20 may provide the data line(s) D that truncates at notch 50 with null data signals corresponding to gray values of Z (e.g., black data). There may be one, two, three, four, five, ten, or more gate lines for which display driver circuitry 20 operates in this manner to provide black data.
The example described above is merely illustrative. If desired, the gray levels for virtual pixels 22′ may be determined in other ways. For example, the gray levels for virtual pixels 22′ may decrease with distance from border 51 according to functions other than linear or exponential functions, may be adjusted using fixed or dynamically determined offset values, may be adjusted from a value of 0 (or other value) as previously determined by data signal attenuation operations, may be adjusted from an original gray level that was not determined by data signal attenuation operations, or may be determined in other ways. If desired, the values of Z, T1, TN, and/or the other gray values for transition region 61 may all be the same. For example, all of the virtual pixels 22′ may be provided with the same gray level (e.g., a gray level between 0 and 255). In another illustrative arrangement, the values of Z, T1, TN, and/or the other gray values for transition region 61 may be random gray levels, some or all of which are between 0 and 255. The values of gray levels for display pixels 22 and virtual pixels 22′ provided above are also merely illustrative. The gray levels provided to display pixels in active area AA may vary based on the frame of image data behind displayed on display 14. The adjusted gray levels provided on data lines D for virtual pixels 22′ may vary based on the gray levels of pixels 22 near notch 50 and based on the function or other method used for determining the adjusted gray levels. Gray levels for virtual pixels 22′ may be static (e.g., may be predetermined and held constant between multiple frames of display data) or may be dynamic (e.g., changing between frames of display data and determined based on the data provided to pixels 22 in active area AA, if desired).
In arrangements in which gray values for virtual pixels 22′ are predetermined or random gray values (as opposed to being gradually reduced to zero as a function of distance from the border 51), the gray values may be selected so as to minimize the impact of these inactive data signals on pixel luminance degradation tracking and limit premature display dimming. For example, the pixel luminance degradation compensator may not take into account (i.e., may be insensitive to) gray levels that are below a threshold value when tracking pixel luminance degradation. In one illustrative example, this threshold value may be a gray level of 50. Setting the gray levels for virtual pixels 22′ below this threshold may not affect pixel luminance degradation tracking (e.g., pixel luminance degradation tracking can be effectively bypassed for inactive data signals provided on data lines D that are not actually provided to pixels 22) while still easing the gray level transition at border 51.
Although data signal compensation operations are described above in connection with notch 50 in
A diagram of an illustrative pipeline for displaying an image on display 14 using gray level compensation of the type described above in connection with
At block 34, data signal compensation operations of the type described above in connection with
In another illustrative arrangement, data signal compensation operations at block 34 may not be performed until after pixel luminance degradation tracking and compensation are performed at block 36. In this type of arrangement, the gray levels for virtual pixels 22′ are still adjusted to a low value (e.g., a gray level between 0 and 10, inclusive) using data signal attenuation operations before pixel luminance degradation tracking and compensation are performed at block 36 so that the effects of these inactive data signals on pixel luminance degradation tracking are minimized. In order to make the gray level transition between the active area and the inactive area more gradual, however, the inactive data signals can be adjusted again before being driven onto data lines D. In one arrangement, data signal compensation operations in block 40 may include applying an offset to the gray values (e.g., adding to the gray value) as reduced by the data signal attenuation and applying a gain to the gray levels as reduced by the data signal attenuation (and/or as adjusted by the offset). The combination of the offset and the gain may adjust all of the inactive data signals for virtual pixels 22′ to an arbitrary gain level (e.g., 255) that reduces or eliminates the presence of undesirable display artifacts such as dim lines near notch 50.
In another illustrative arrangement, data signal compensation operations in block 34 may include applying a gain to the gray levels that have been reduced by the data signal attenuation operations without applying an offset. In such an arrangement, the inactive data signals may have been adjusted by the data signal attenuation operations to a value greater than 0 (e.g., between 1 and 10). The gain may adjust all of the inactive data signals for virtual pixels 22′ to an arbitrary gain level (e.g., 255) that reduces or eliminates the presence of undesirable display artifacts such as dim lines near notch 50.
When performed after pixel luminance degradation tracking and compensation operations of block 36, data signal compensation operations may be performed in display driver circuitry 20. If desired, data signal compensation may be performed at the same time as other pixel compensation operations that occur in display driver circuitry 20. In another example, data signal compensation operations may be performed between the time at which the data signals are transmitted from display driver circuitry 20 in block 36 and when they are displayed on display 14 in block 38.
In another example, display driver circuitry 20 may be configured to not provide data signals to the data lines D that terminate under notch 50 when the display rows that are being programmed do not include pixels that receive data signals from those data lines D (i.e., rows of the display into which notch 50 extends). In other words, display driver circuitry 20 may temporarily suspend data line toggling when the data signals would not actually be provided to display pixels 22 (and instead correspond to virtual pixels 22′). In this arrangement, there would be no data signals being provided for virtual pixels 22′ to affect pixel luminance degradation tracking compensation or to create a sudden gray level transition, helping to minimize both premature display dimming and undesirable display artifacts at the active area-inactive area border 51. Because display driver circuitry 20 suspends data signal writing operations for a period of time, operating display 14 in this manner may also help to conserve power.
An illustrative flow chart of steps that may be taken in a method of adjusting display signals corresponding to notch 50 is shown in
At step 100, control circuitry 16 may provide a frame of display data to be displayed on display 14.
At step 102, data signal attenuator 55 may attenuate (convert to black data) the inactive data signals (e.g., data signals corresponding to virtual pixels 22′) in the frame to minimize the effect of the data signals on pixel luminance degradation tracking.
At optional step 104, data signal compensator 57 may adjust (convert to gray data) the attenuated data signals to ease the transition between the data signals that are provided to the pixels in the active area AA of display 14 and the inactive data signals for virtual pixels. If optional step 104 is performed, optional step 108 may be skipped and step 106 may proceed directly to step 110.
At step 106, the data signals may be tracked using pixel luminance and degradation compensation to monitor the aging of pixels in display 14.
At optional step 108, data signal compensator 57 may adjust the attenuated data signals to ease the transition between the data signals that are provided to the pixels in the active area AA of display 14 and the inactive data signals for virtual pixels. If optional step 108 is performed, optional step 104 may be skipped and step 102 may proceed directly to step 106.
At step 110, the compensated data signals may be conveyed on data lines D without actually being provided to pixels 22 in the active area of the display.
The foregoing is merely illustrative and modifications can be made to the described embodiments. The foregoing embodiments may be implemented individually or in any combination.
This application is a continuation of application Ser. No. 15/989,066, filed May 24, 2018, which claims the benefit of provisional patent application No. 62/553,745, filed Sep. 1, 2017, which are hereby incorporated by reference herein in their entireties.
Number | Date | Country | |
---|---|---|---|
62553745 | Sep 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15989066 | May 2018 | US |
Child | 16802756 | US |