Patent Application
20240087494
A refresh rate may refer to the number of times per second at which an image refreshes on a display panel of a device. For example, a refresh rate of 60 Hertz (Hz) means that an image is refreshed 60 times per second. Higher refresh rates typically lead to better user experiences, but also result in higher power usage for the device.
Sometimes, a display panel can operate at multiple refresh rates. For example, when executing a video streaming application, a device may set the refresh rate of a display panel to 90 Hz, whereas when executing a word processing application, the device may set the refresh rate of the display panel to 60 Hz.
The present disclosure generally relates to a display panel of a device. The display panel may be configured to operate at a first refresh rate or a second refresh rate. Depending on measured optical properties of the display panel at the first refresh rate and the second refresh rate, the device may be configured to adjust input display data when the display panel is transitioning from the first refresh rate to the second refresh rate.
In a first aspect, a computer-implemented method is provided. The method may include measuring, from a device having a display panel configured to operate at multiple refresh rates, an optical property of the display panel for an input gray level at a first refresh rate. The method may further include measuring, from the device, the optical property of the display panel for a plurality of candidate gray levels at a second refresh rate. The method may also include selecting, based on the measured optical property of the display panel for the input gray level and the plurality of candidate gray levels, a corresponding gray level for the input gray level, wherein the corresponding gray level is selected from the plurality of candidate gray levels. The method may further include storing, at the device, the corresponding gray level for the input gray level, wherein subsequent to the storing, the device is configured to adjust input display data using the corresponding gray level for the input gray level when the display panel is transitioning from the first refresh rate to the second refresh rate.
In a second aspect, a system is provided. The system may include one or more processors. The system may also include data storage, where the data storage has stored thereon computer-executable instructions that, when executed by the one or more processors, cause the system to carry out operations. The operations may include measuring, from a device having a display panel configured to operate at multiple refresh rates, an optical property of the display panel for an input gray level at a first refresh rate. The operations may further include measuring, from the device, the optical property of the display panel for a plurality of candidate gray levels at a second refresh rate. The operations may also include selecting, based on the measured optical property of the display panel for the input gray level and the plurality of candidate gray levels, a corresponding gray level for the input gray level, wherein the corresponding gray level is selected from the plurality of candidate gray levels. The operations may further include storing, at the device, the corresponding gray level for the input gray level, wherein subsequent to the storing, the device is configured to adjust input display data using the corresponding gray level for the input gray level when the display panel is transitioning from the first refresh rate to the second refresh rate.
In a third aspect, a device is provided. The device includes one or more processors operable to perform operations. The operations may include measuring, from a device having a display panel configured to operate at multiple refresh rates, an optical property of the display panel for an input gray level at a first refresh rate. The operations may further include measuring, from the device, the optical property of the display panel for a plurality of candidate gray levels at a second refresh rate. The operations may also include selecting, based on the measured optical property of the display panel for the input gray level and the plurality of candidate gray levels, a corresponding gray level for the input gray level, wherein the corresponding gray level is selected from the plurality of candidate gray levels. The operations may further include storing, at the device, the corresponding gray level for the input gray level, wherein subsequent to the storing, the device is configured to adjust input display data using the corresponding gray level for the input gray level when the display panel is transitioning from the first refresh rate to the second refresh rate.
In a fourth aspect, an article of manufacture is provided. The article of manufacture may include a non-transitory computer-readable medium having stored thereon program instructions that, upon execution by one or more processors of a computing device, cause the computing device to carry out operations. The operations may include measuring, from a device having a display panel configured to operate at multiple refresh rates, an optical property of the display panel for an input gray level at a first refresh rate. The operations may further include measuring, from the device, the optical property of the display panel for a plurality of candidate gray levels at a second refresh rate. The operations may also include selecting, based on the measured optical property of the display panel for the input gray level and the plurality of candidate gray levels, a corresponding gray level for the input gray level, wherein the corresponding gray level is selected from the plurality of candidate gray levels. The operations may further include storing, at the device, the corresponding gray level for the input gray level, wherein subsequent to the storing, the device is configured to adjust input display data using the corresponding gray level for the input gray level when the display panel is transitioning from the first refresh rate to the second refresh rate.
In a fifth aspect, a computer-implemented method is provided. The method may include identifying an input gray level while a display panel of a device is operating at a first refresh rate. The method may further include retrieving, from a storage at the device, a corresponding gray level for the input gray level, wherein the corresponding gray level has been selected from a plurality of candidate gray levels based on a measured optical property of the display panel of the device for the input gray level and the plurality of candidate gray levels at the first refresh rate and at a second refresh rate. The method may also include adjusting input display data using the corresponding gray level for the input gray level. The method may further include transitioning, based on the adjusted input display data, the display panel from the first refresh rate to the second refresh rate.
In a sixth aspect, a system is provided. The system may include one or more processors. The system may also include data storage, where the data storage has stored thereon computer-executable instructions that, when executed by the one or more processors, cause the system to carry out operations. The operations may include identifying an input gray level while a display panel of a device is operating at a first refresh rate. The operations may further include retrieving, from a storage at the device, a corresponding gray level for the input gray level, wherein the corresponding gray level has been selected from a plurality of candidate gray levels based on a measured optical property of the display panel of the device for the input gray level and the plurality of candidate gray levels at the first refresh rate and at a second refresh rate. The operations may also include adjusting input display data using the corresponding gray level for the input gray level. The operations may further include transitioning, based on the adjusted input display data, the display panel from the first refresh rate to the second refresh rate.
In a seventh aspect, a device is provided. The device includes one or more processors operable to perform operations. The operations may include identifying an input gray level while a display panel of a device is operating at a first refresh rate. The operations may further include retrieving, from a storage at the device, a corresponding gray level for the input gray level, wherein the corresponding gray level has been selected from a plurality of candidate gray levels based on a measured optical property of the display panel of the device for the input gray level and the plurality of candidate gray levels at the first refresh rate and at a second refresh rate. The operations may also include adjusting input display data using the corresponding gray level for the input gray level. The operations may further include transitioning, based on the adjusted input display data, the display panel from the first refresh rate to the second refresh rate.
In an eighth aspect, an article of manufacture is provided. The article of manufacture may include a non-transitory computer-readable medium having stored thereon program instructions that, upon execution by one or more processors of a computing device, cause the computing device to carry out operations. The operations may include identifying an input gray level while a display panel of a device is operating at a first refresh rate. The operations may further include retrieving, from a storage at the device, a corresponding gray level for the input gray level, wherein the corresponding gray level has been selected from a plurality of candidate gray levels based on a measured optical property of the display panel of the device for the input gray level and the plurality of candidate gray levels at the first refresh rate and at a second refresh rate. The operations may also include adjusting input display data using the corresponding gray level for the input gray level. The operations may further include transitioning, based on the adjusted input display data, the display panel from the first refresh rate to the second refresh rate.
Other aspects, embodiments, and implementations will become apparent to those of ordinary skill in the art by reading the following detailed description, with reference where appropriate to the accompanying drawings.
Example methods, devices, articles of manufacture, and systems are described herein. It should be understood that the words “example” and “exemplary” are used herein to mean “serving as an example, instance, or illustration.” Any embodiment or feature described herein as being an “example” or “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments or features. Other embodiments can be utilized, and other changes can be made, without departing from the scope of the subject matter presented herein.
Thus, the example embodiments described herein are not meant to be limiting. Aspects of the present disclosure, as generally described herein, and illustrated in the figures, can be arranged, substituted, combined, separated, and designed in a wide variety of different configurations, all of which are contemplated herein.
Further, unless context suggests otherwise, the features illustrated in each of the figures may be used in combination with one another. Thus, the figures should be generally viewed as component aspects of one or more overall embodiments, with the understanding that not all illustrated features are necessary for each embodiment.
High display refresh rates (e.g., 90 Hz or 120 Hz) for a display panel of a computing device may be desirable when executing visually complex software applications, such as video or gaming applications. However, higher refresh rates also cause the computing device to consume more power. To strike a balance between performance and battery life, some display panels can operate at one of multiple different refresh rates (e.g., 10 Hz, 30 Hz, 60 Hz, 90 Hz, and 120 Hz). That is, depending on the application being executed, the display panel can switch between multiple refresh rates.
However, optical characteristics may differ between different refresh rates. Specifically, the luminance and color of a display panel may differ between 60 Hz and 90 Hz. When the display panel switches from 60 Hz to 90 Hz (and vice versa), this optical difference may manifest itself as a visual flicker on the display panel. Consequently, if the display panel frequently switches between 60 Hz and 90 Hz refresh rates, the visual flicker may become highly pronounced and detrimental to a user's experience. Further, because human eyes are highly sensitive to changes at low luminance settings, the visual flicker is especially noticeable when the luminance of the display panel is low and/or when the ambient light of the environment surrounding the display panel is low.
Some solutions attempt to solve this “flicker problem” by disabling transitions between 60 Hz and 90 Hz when the luminance of the display panel is low. But an issue with these solutions is that the definition of what is considered “low display luminance” can be fairly high. In some example computing devices, the ideal transition threshold to alleviate all flickering has been found to be 75%. In other words, if the luminance of the display panel is at or above 75% of the total possible luminance of the display panel, then transitions between 60 Hz and 90 Hz may be permitted. And if the luminance of the display panel is below 75% of the total possible luminance, then transitions between 60 Hz and 90 Hz may not be permitted. But because users often keep the luminance of the display panel below 75%, minimum benefits of using multiple refresh rates are obtained.
One way to achieve a smooth transition of a display panel from a first refresh rate to a second refresh rate is to minimize a difference in an optical property of the display panel during the transition at all gray levels and brightness settings. The term, “optical property” as used herein may refer to any measurable property of an image displayed by a device. For example, the optical property may refer to a color or luminance value of a display panel when an image is displayed by the device, or when a device transitions between different refresh rates. Also, for example, an optical property may refer to properties such as, for example, levels of refraction, absorption, scattering, reflection, and so forth.
Generally, values for an optical property (e.g., color and luminance) can be calibrated at factory and stored in a display drive integrated circuit (DDIC). In practice, this is performed for high brightness and high gray levels. However, such calibration for low brightness and low gray levels may require additional time (“takt time”). Generally, takt time refers to an amount of time a manufacturer has per unit to produce enough goods to fulfil customer demand. Accordingly, manufacturers may be less inclined to perform such calibrations given the higher takt time. Therefore, optical distortions may appear for transitions at low brightness and low gray levels. In some implementations, a blocking zone may be applied to disable transitions of a display panel between refresh rates when the display is at low brightness and low gray levels. However, it is desirable to remove blocking zones and enable transitions for all brightness and gray levels.
Some techniques described herein address these issues by adjusting input display data using a corresponding gray level for an input gray level when the display panel of a device is transitioning from the first refresh rate to the second refresh rate. After applying these adjustments, the optical property of the display panel (e.g., color, luminance, etc.) when operating at 60 Hz may become similar to the optical property of the display panel when operating at 90 Hz, and thus the visual flicker that occurs when switching between 60 Hz and 90 Hz may become less pronounced. To facilitate this, an optical property of the display panel for an input gray level at a first refresh rate may be measured for the display panel. Also, the optical property of the display panel may be measured for a plurality of candidate gray levels at a second refresh rate. Then, based on the measured optical property of the display panel for the input gray level and the plurality of candidate gray levels, a corresponding gray level for the input gray level may be selected. The corresponding gray level may be selected from the plurality of candidate gray levels. The corresponding gray level may be stored at the device. Subsequently, the device can be configured to adjust input display data using the corresponding gray level for the input gray level when the display panel is transitioning from the first refresh rate to the second refresh rate.
By using the herein-described techniques, multiple refresh rates can be utilized while reducing or eliminating any flickering effect. Other advantages are also contemplated and will be appreciated from the discussion herein.
To enable accurate control of brightness levels, each DBV band may also have a plurality of gray levels that are designated as gamma control points (“tap points”). For example, as illustrated in table 100, each DBV band has register tap points at gray level G7, gray level G12, gray level G24, gray level G37, and so forth. The tap points may range from gray level G255 to G7. For each tap point, a device may be configured with a control or a knob to control the pixel values of red, green, and blue (RGB). The RGB ratio can be balanced between 60 and 90 Hz. Each DBV band and gray level corresponds to a brightness value.
For example, at DBV band 7 and gray level G7, the brightness value is 0.184 nits, at DBV band 6 and gray level G7, the brightness value reduces to 0.029 nits. At DBV band 1 and gray level G7, the brightness value reduces to 0.001 nits.
The cells in table 100 are of three types based on the brightness settings: a first type of cells are those that are at a high level of brightness, and are indicated without any shading. The brightness settings in these cells can be accurately configured (e.g., by a device manufacturer). For example, at DBV band 7, with a luminance of 500 nits, brightness levels at all tap points can be accurately configured for the device, except at a tap point of G7. Similarly, at DBV band 6, with a luminance of 80 nits, brightness levels at all tap points can be accurately configured for the device, except at tap points G7 and G15.
A second type of cells are those that are at an intermediate level of brightness. These cells are generally those with a luminance value greater than 0.055 nits, and are shaded with vertical lines. For example, at DBV band 6, tap point G15 corresponds to an intermediate brightness setting. As another example, at DBV band 5, tap points G15 and G23 correspond to an intermediate brightness setting. For these DBV bands and tap points, the brightness levels may not be accurately configured by a manufacturer, and adjustments to respective gamma values at 90 Hz are needed to reduce optical defects (this is described in more detail below). The adjusted gamma values can then be stored in the device (e.g., as a lookup table), and used at run time to modify luminance settings as the device transitions from a first refresh rate (e.g., 60 Hz) to a second refresh rate (e.g., 90 Hz).
A third type of cells are those that are at a low level of brightness. These cells are generally those with a luminance value less than 0.055 nits, and are shaded with horizontal lines. For example, at DBV bands 5 and 6, tap point G7 corresponds to a low brightness setting. As another example, at DBV band 4, tap points G15 and G7 correspond to a low brightness setting. For these DBV bands and tap points, the brightness levels may not be accurately configured by a manufacturer, and gamma adjustments can also not be made because of high takt time. Generally, these low brightness settings are blocked during transitions from a first refresh rate (e.g., 60 Hz) to a second refresh rate (e.g., 90 Hz). However, as described below, a device can be configured to transition smoothly at these settings by determining respective luminance values at input gray levels at different refresh rates (e.g., 60 Hz and 90 Hz), and then selecting, for each input gray level at 60 Hz, a corresponding gray level at 90 Hz, so that the respective optical property (e.g., luminance values) are similar. These techniques can also be applied to the second type of cells. This reduces optical defects for all brightness settings, and there is no need to block brightness settings.
For higher DBV bands and larger brightness values, devices can be accurately configured with brightness settings, and transitions may occur smoothly. As illustrated in table 100, brightness values are very small for low DBV bands and low gray levels. Equipment in factories are generally not able to accurately measure such brightness levels, such as, for example, when the brightness values are less than 0.055 nits. Therefore, transitions between refresh rates may be blocked for such low brightness values and low DBV bands in an effort to reduce optical defects such as flickering.
For example, an image can be displayed on a device for a fixed DBV band and gray level at a first refresh rate (e.g., 60 Hz), and a colorimeter can capture the image and measure the luminance values. Then, the optical property of the display panel can be measured for the image at a second refresh rate (90 Hz). For example, while the image is displayed at 60 Hz, the refresh rate for the device can be switched to 90 Hz, and the colorimeter can capture a second image and measure the luminance value at 90 Hz. From the cross-section of each image, the respective brightness levels at each gray level can be determined. In some instances, depending on how the colorimeter is calibrated, the measurement of the brightness level may not be an absolute value of the brightness level, but may be a relative value between the two refresh rates. In some embodiments, one or more optical properties can be measured at each refresh rate, and these measured values can be used individually, or in combination, to determine a corresponding gray level for an input gray level. For example, the corresponding gray level can be determined based on luminance values, color, and/or a combination of the two. Additional and/or alternative optical properties can be used. Also, for example, different measurements can be determined for various optical viewing distances and/or viewing angles, and such measurements can be appropriately normalized and/or averaged. For purposes of clarity, the examples below will refer to a specific optical property such as luminance.
As illustrated in image 200, region 205 displays luminance values from gray levels 13 to 32 at 60 Hz, while region 210 displays luminance values from gray levels 13 to 32 at 90 Hz. As illustrated, the visible differences in luminance are negligible.
Region 215 displays luminance values from gray levels 5 to 13 at 60 Hz, while region 220 displays luminance values from gray levels 5 to 13 at 90 Hz. As illustrated, the visible differences in luminance are apparent. These differences may be further analyzed graphically.
One way to quantitatively measure a difference in luminance values is to determine a delta luminance value. For example, delta luminance may be calculated as follows.
or as:
As illustrated in
As illustrated in graph 400, at gray level G9 410, the measured luminance value at 60 Hz is 0.028 and the measured luminance value at 90 Hz is 0.056. However, the measured luminance at gray level G7 405 at 90 Hz is 0.030. Therefore, at gray level 9 410, in transitioning from 60 Hz to 90 Hz, the gray level at 90 Hz can be adjusted (as shown by arrow 415) to be at gray level 7 405, with a luminance value of 0.030, which is close to the luminance value 0.028 for gray level 9 410 at 60 Hz. Accordingly, in transitioning the display panel of the device from 60 Hz to 90 Hz, the luminance value changes from 0.028 nits to 0.030 nits, resulting in little to no flickering. However, if during transition, the luminance values had been changed from 0.028 to 0.056, the delta luminance would be very high, and there would likely be perceptible levels of flickering.
As another example, at gray level G11 420, the measured luminance value at 60 Hz is 0.058 and the measured luminance value at 90 Hz is 0.081. However, the measured luminance at gray level G9 410 at 90 Hz is 0.056. Therefore, at gray level 11 420, in transitioning from 60 Hz to 90 Hz, the gray level at 90 Hz can be adjusted (as shown by arrow 425) to be at gray level 9 410, with a luminance value of 0.056, which is close to the luminance value 0.058 for gray level 11 420 at 60 Hz. Accordingly, in transitioning the display panel of the device from 60 Hz to 90 Hz, the luminance value changes from 0.058 nits to 0.056 nits, resulting in little to no flickering. However, if during transition, the luminance values had been changed from 0.058 to 0.081, the delta luminance would be very high, and there would likely be perceptible levels of flickering.
In some embodiments, the DBV band and/or the input gray level may be identified as ones that need to be adjusted and/or calibrated. For example, at a gray level G14, the luminance at 60 Hz is 0.126 and the luminance at 90 Hz is 0.131. Therefore, the corresponding delta luminance can be determined to be 4.42%, which is below a threshold percentage for delta luminance (e.g., 7%). Accordingly, a determination can be made that the gray level for G14 at 90 Hz does not need to be calibrated.
Row 525 displays values for gray level G9. As indicated in columns 510, 515, and 520 respectively, the luminance at 60 Hz is 0.028, the luminance at 90 Hz is 0.056, resulting in a delta luminance of 95.80%. Such a high delta luminance will likely cause perceptible optical defects. Accordingly, a determination can be made that the gray level for G9 at 90 Hz needs to be calibrated.
Calibration can be performed as illustrated with respect to
For each input gray value in block 605, block 610 displays how the gray level values at 60 Hz in block 605 are adjusted to obtain corresponding gray levels at 90 Hz. Similarly, for each input gray value in block 615, block 620 displays how the gray level values at 60 Hz in block 615 are adjusted to obtain corresponding gray levels at 90 Hz, and for each input gray value in block 625, block 630 displays how the gray level values at 60 Hz in block 625 are adjusted to obtain corresponding gray levels at 90 Hz. It may be noted that such an adjustment depends on the optical property of a display panel of a device.
As described with reference to
As another example, continuing to consider block 605 as an example, for input gray level 33 in column C1 and row 640, the corresponding luminance value at 60 Hz is 0.0543 (displayed in column C2) and the luminance value at 90 Hz is 0.0476 (displayed in column C3). The delta luminance value before calibration is 12.34% (as displayed in column C6). Accordingly, gray level 33 can be identified as another input gray level for which the luminance value at 90 Hz has to be adjusted. In an example implementation, the luminance value at 90 Hz is selected from among the luminance values for the plurality of candidate gray levels (displayed in column C3), and is selected to be a luminance value that is closest to the luminance value of 0.0543 for the input gray level 33 at 60 Hz. Accordingly, a luminance value of 0.0545 is selected (displayed in column C4), thereby selecting 35 as the corresponding gray level (displayed in column C5). A comparison of the delta luminance values in columns C6 and C7 indicates a drop in the delta luminance from 12.34% before calibration, to 0.39% after calibration. This leads to a desired reduction of optical defects when the input display data is adjusted using the corresponding gray level while transitioning the display panel from 60 Hz to 90 Hz.
Considering input gray levels in block 615, input gray level of 21 with a luminance value of 0.0190 at 60 Hz is mapped to a corresponding gray level of 23 at 90 Hz with a luminance value of 0.0194, thereby decreasing the corresponding delta luminance from 15.79/o to 1.86%. As another example, input gray level of 20 with a luminance value of 0.0171 at 60 Hz is mapped to a corresponding gray level of 21 at 90 Hz with a luminance value of 0.0160, thereby decreasing the corresponding delta luminance from 11.81% to 6.09%. Also, for example, input gray level of 19 with a luminance value of 0.0153 at 60 Hz is mapped to a corresponding gray level of 20 at 90 Hz with a luminance value of 0.0151, thereby decreasing the corresponding delta luminance from 10.51% to 1.49%.
Considering input gray levels in block 625, input gray level of 17 with a luminance value of 0.0122 at 60 Hz is mapped to a corresponding gray level of 17 at 90 Hz with a luminance value of 0.0119, thereby leaving the corresponding delta luminance unchanged at 2.65%. For each input gray level at 60 Hz in block 625, the corresponding gray level at 90 Hz remains unchanged, as shown in block 630.
In some embodiments, at least one difference in the optical property of the display panel (e.g., delta luminance) between the first refresh rate and the second refresh rate for a second input gray level can be measured from the device. It can be determined that the at least one difference exceeds an optical threshold. In such instances, selection of a corresponding gray level for the second input gray level can be triggered. For example, a determination to adjust the input display data for an input gray level may be made by determining if a delta luminance before calibration (as displayed in column C6) exceeds a predefined threshold (e.g., 6%). For example, for input gray levels in the range from 18 to 50, the delta luminance before calibration exceeds 6% and a determination to adjust the input display data is made for these gray levels. However, for input gray levels in the range 11 to 17, the delta luminance before calibration does not exceed 6% and a determination not to adjust the input display data can be made for these gray levels.
Similar techniques may be used when the display panel transitions from a second refresh rate to a third refresh rate. For example, the optical property of the display panel can be measured for the input gray levels at a third refresh rate. For example, when transitioning from 90 Hz to 120 Hz, luminance values at 120 Hz can be measured for input gray levels, and a column of values similar to column C3 of
Measurements of the optical property at input gray levels and candidate gray levels can be performed for specific DBV bands. In some embodiments, such measurements can be performed for all input gray levels at the selected DBV band. Also, for example, in some embodiments, after measurements are performed, delta luminance values may be determined, and DBV bands and input gray levels can be identified based on when the delta luminance values exceed a predetermined threshold.
Referring to
In some embodiments, the input gray level may be based on determining that an optical property is less than an optical threshold. Referring again to
In some embodiments, when the optical property exceeds the optical threshold, a different technique for adjustment may be applied. Referring again to
To make refresh rate changes between 60 Hz and 90 hz appear less conspicuous to users, it may be desirable to modify the gamma values in a gamma table (e.g., table 100 of
To modify gamma values of tap points in table 100, some implementations involve altering one or more register values in display adjustment circuitry 1020 of
In order to modify gamma values in table 100, an offset could be applied so that, for a given color channel, the register values at refresh rate 60 Hz become similar to the register values at refresh rate 90 Hz. The magnitude of this offset may be determined based on delta luminance values. For example, if the delta luminance between 60 Hz and 90 Hz for an input gray level is 25%, then the register value for the green color channel at 90 Hz is significantly higher than the register value for the green color channel at 60 Hz. Thus, a larger offset may be applied. Alternatively, if the delta luminance between 60 Hz and 90 Hz for an input gray level is 10%, then the register value for the green color channel at 90 Hz is relatively similar to the register value for the green color channel at 60 Hz, and thus a smaller offset value may be applied.
In some embodiments, at least one difference in the optical property of the display panel between the first refresh rate and the second refresh rate for an input gray level can be measured. Generally, magnitudes of gamma offsets may differ depending on the delta luminance (or another measured difference in an optical property) for an input gray level. Some embodiments may involve a series of offset tables that detail the offset value that should be applied for various delta luminances. In some implementations, these offset tables are determined based on analysis of devices that contain similar display panels to display panel 1010 (perhaps devices that were developed by the same manufacturer that developed display panel 1010).
In some embodiments, based on the at least one measured difference, a value offset to a default gamma value used by the device for the input gray level can be applied when the display panel is operating at the second refresh rate, thereby generating a new gamma value. In some embodiments, the display panel may have a plurality of color channels, and the default gamma value may include respective register values for the plurality of color channels. In such instances, the value offset can include an offset to at least one of the register values of the default gamma value. The plurality of color channels can include red, green and blue (RGB) color channels. For example, delta luminance 902 is the delta luminance for DVB band 4/input gray level G15. Upon determining that the value for delta luminance 902 is −15.446, offset table 920 could be used to determine that the value of −15.446 falls in the range [−15.5, −13], and thus an offset value of 1 should be applied to the green color channel register value of DVB band 4/input gray level G15 at 90 Hz. As another example, delta luminance 904 is the delta luminance for DVB band 2/input gray level G15. Upon determining that the value for delta luminance 904 is 12.67, offset table 940 could be used to determine that the value of 12.67 falls in the range [7, 14], and thus an offset value of −1 should be applied to the green color channel register of DVB band 2/input gray level G15 at 90 Hz, an offset value of 1 should be applied to the red color channel register of DVB band 2/input gray level G15 at 90 Hz, and an offset value of 1 should be applied to the blue color channel register of DVB band 2/input gray level G15 at 90 Hz.
In some embodiments, the new gamma value is stored in the device, wherein subsequent to the storing, the device is configured to override the default gamma value for the second input gray level with the new gamma value when the display panel is operating at the second refresh rate. In some embodiments, the process of updating register values for an input gray level occurs until the delta luminance for the input gray level is less than a predefined threshold. In some examples, the predefined threshold in a range between 5% and 95%. For instance the predefined threshold may be 5%, 10%, or 90%.
In certain embodiments, the process of updating register values for an input gray level occurs until: (i) the delta luminance for the input gray level is less than a predefined threshold, and (ii) the delta color difference for the input gray level is less than a predefined color threshold, where the color difference is measured as a linear combination of the squared difference between the u′ at 90 Hz and at 60 Hz and the squared difference between the v′ at 90 Hz and at 60 Hz, where u′ and v′ are color coordinates in CIELUV color space. For example, the color difference can be measured as:
Δ(u′,v′)=√{square root over ((u′90 Hz−u′60 Hz)2+(v′90 Hz−v′60 Hz)2)} (Eqn. 3)
In some instances, the predefined color threshold is 0.4%, i.e., it may be desirable to keep Δ(u′, v′) to be less than 0.004. In some instances, even if delta luminance is small, but the color difference is big, an optical defect may remain perceptible. Accordingly, to achieve better results, in some embodiments, both luminance and color may need to be adjusted. During measurements of an optical property, both luminance and color changes can be recorded and/or monitored. The color difference can be measured similar to how a delta luminance is measured.
Display panel 1010 may be configured to provide output signals to a user by way of one or more screens (including touch screens), cathode ray tubes (CRTs), liquid crystal displays (LCDs), light emitting diodes (LEDs), displays using digital light processing (DLP) technology, and/or other similar technologies. Display panel 1010 may also be configured to generate audible outputs, such as with a speaker, speaker jack, audio output port, audio output device, earphones, and/or other similar devices. Display panel 1010 may further be configured with one or more haptic components that can generate haptic outputs, such as vibrations and/or other outputs detectable by touch and/or physical contact with computing device 1000.
In example embodiments, display panel 1010 is configured to provide output signals at a given refresh rate. The refresh rate may correspond to the number of times display panel 1010 updates with new content each second. For example, a 60 Hz refresh rate may mean that display panel 1010 updates 60 times per second. In example embodiments, display panel 1010 may operate at a 60 Hz, a 90 Hz, or a 120 Hz refresh rate, among other possibilities.
In certain embodiments, display panel 1010 may be a color display utilizing a plurality of color channels for generating images. For example, display panel 1010 may utilize red, green, and blue (RGB) color channels, or cyan, magenta, yellow, and black (CMYK) color channels, among other possibilities. As described herein, display adjustment circuitry 1020 may adjust input display data using a corresponding gray level for the input gray level when the display panel is transitioning from the first refresh rate to the second refresh rate. As further described herein, display adjustment circuitry 1020 may adjust the gamma characteristics for each of the color channels of display panel 1010, as described with reference to
In some embodiments, display panel 1010 may include a plurality of pixels disposed in a pixel array defining a plurality of rows and columns. For example, if display panel 1010 had a resolution of 1024×600, each column of the array may include 600 pixels and each row of the array may include 1024 groups of pixels, with each group including a red, blue, and green pixel, thus totaling 3072 pixels per row. In example embodiments, the color of a particular pixel may depend on a color filter that is disposed over the pixel.
In example embodiments, display panel 1010 may receive image data from controller 1060 and correspondingly send signals to its pixel array in order to display the image data. To send image data to display panel 1010, controller 1060 may first convert a digital image into numerical data that can be interpreted by display panel 1010. For instance, a digital image may contain various image pixels that correspond to respective pixels of display panel 1010. Each image pixel of the digital image may have a numerical value that represents the luminance (e.g., brightness or darkness) of the digital image at a particular spot. These numerical values may be referred to as “gray levels.” The number of gray levels may depend on the number of bits used to represent the numerical values. For example, if 8 bits were used to represent a numerical value, display panel 1010 may provide 256 gray levels, with a numerical value of 0 corresponding to full black and a numerical value of 255 corresponding to full white. As a more specific example, controller 1060 may provide to display panel 1010 a digital image stream containing 24 bits, with 8 bits corresponding to a gray level for each of the red, green, and blue color channels of a pixel group.
In some cases, the luminance characteristics of images displayed by display panel 1010 may be depicted inaccurately when perceived by users. Such inaccuracies may result from the non-linear response of the human eye and could cause inaccurate portrayals of color/luminance on display panel 1010 from the viewpoint of users. To compensate for such inaccuracies, computing device 1000 could use display adjustment circuitry 1020.
Display adjustment circuitry 1020 may include circuitry that could compensate for inaccuracies that occur when displaying images on display panel 1010. To do this, display adjustment circuitry may include memory for storing one or more gamma curves/tables. The values in each curve/table may be determined based upon the transmittance sensitivities of display panel 1010 over a range of input gray levels.
As an illustrative example,
As shown in graph 1100, each gamma curve includes a relationship between input gray levels (on the x-axis) and luminance of a viewable image displayed on display panel 1010 (on the y-axis). These relationships are non-linear. For instance, in band 7, an input gray level of 1100 corresponds to a luminance value of 300 nits. Consequently, by using a gamma curve to adjust input gray levels, the images displayed on display panel 1010 may exhibit a non-linear luminance to input gray level relationship. Yet, when viewed by a user, the response of the human eye may cause the user to perceive the displayed images as having a linear relationship between luminance and input gray level. Thus, by using gamma curves, display panel 1010 is able to produce images that may be perceived by a user as having a generally linear relationship with regard to input gray level and luminance.
Display panel 1010 could use different gamma curves depending on whether display panel 1010 is operating at a first refresh rate (e.g., 60 Hz) or at a second refresh rate (e.g., 90 Hz). For instance, display panel 1010 may utilize the gamma curves shown in graph 1100 when it is operating at 60 Hz. On the other hand, display panel 1010 may utilize the gamma curve shown in graph 1110 of
The gamma curves for 60 Hz may differ from the gamma curves for 90 Hz. For example, the gamma curve for DBV band 6 in graph 1100 differs from the gamma curve for DBV band 6 in graph 1110. More specifically, the gamma curve for DBV band 6 in graph 1110 has, on average, higher luminance values for input gray levels than the gamma curve for DBV band 6 in graph 1100. In line with the discussion above, this difference may cause a visual flicker to manifest on display panel 1010 when display panel 1010 transitions between 60 Hz to 90 Hz (and vice versa). Consequently, if the display panel 1010 frequently switches between 60 Hz and 90 Hz refresh rates, the visual flicker may become highly pronounced and detrimental to a user's experience. Further, because human eyes are highly sensitive at low luminance settings, the visual flicker is especially noticeable when the luminance of display panel 1010 is low.
Returning back to
In some embodiments, ambient light sensor(s) 1030 may include a plurality of photodetector elements disposed in a one-dimensional array or a two-dimensional array. For example, ambient light sensor(s) 1030 may include sixteen detector elements arranged in a single column (e.g., a linear array). The detector elements could be arranged along, or could be at least parallel to, a primary axis.
In some embodiments, computing device 1000 can include one or more other sensors 1040. Other sensor(s) 1040 can be configured to measure conditions within computing device 1000 and/or conditions in an environment of (e.g., within 1 m, 5 m, or 10 m of) computing device 1000 and provide data about these conditions. For example, other sensor(s) 1040 can include one or more of: (i) sensors for obtaining data about computing device 1000, such as, but not limited to, a thermometer for measuring a temperature of computing device 1000, a battery sensor for measuring power of one or more batteries of computing device 1000, and/or other sensors measuring conditions of computing device 1000; (ii) an identification sensor to identify other objects and/or devices, such as, but not limited to, a Radio Frequency Identification (RFID) reader, proximity sensor, one-dimensional barcode reader, two-dimensional barcode (e.g., Quick Response (QR) code) reader, and/or a laser tracker, where the identification sensor can be configured to read identifiers, such as RFID tags, barcodes, QR codes, and/or other devices and/or objects configured to be read, and provide at least identifying information; (iii) sensors to measure locations and/or movements of computing device 1000, such as, but not limited to, a tilt sensor, a gyroscope, an accelerometer, a Doppler sensor, a Global Positioning System (GPS) device, a sonar sensor, a radar device, a laser-displacement sensor, and/or a compass; (iv) an environmental sensor to obtain data indicative of an environment of computing device 1000, such as, but not limited to, an infrared sensor, an optical sensor, a biosensor, a capacitive sensor, a touch sensor, a temperature sensor, a wireless sensor, a radio sensor, a movement sensor, a proximity sensor, a radar receiver, a microphone, a sound sensor, an ultrasound sensor and/or a smoke sensor; and/or (v) a force sensor to measure one or more forces (e.g., inertial forces and/or G-forces) acting about computing device 1000, such as, but not limited to one or more sensors that measure: forces in one or more dimensions, torque, ground force, friction, and/or a zero moment point (ZMP) sensor that identifies ZMPs and/or locations of the ZMPs. Many other examples of other sensor(s) 1040 are possible as well.
Data gathered from ambient light sensors(s) 130 and other sensor(s) 1040 may be communicated to controller 1060, which may use the data to perform one or more actions.
Network interface 1050 can include one or more wireless interfaces and/or wireline interfaces that are configurable to communicate via a network. Wireless interfaces can include one or more wireless transmitters, receivers, and/or transceivers, such as a Bluetooth™ transceiver, a Zigbee® transceiver, a Wi-Fi™ transceiver, a WiMAX™ transceiver, and/or other similar types of wireless transceivers configurable to communicate via a wireless network. Wireline interfaces can include one or more wireline transmitters, receivers, and/or transceivers, such as an Ethernet transceiver, a Universal Serial Bus (USB) transceiver, or similar transceiver configurable to communicate via a twisted pair wire, a coaxial cable, a fiber-optic link, or a similar physical connection to a wireline network.
In some embodiments, network interface 1050 can be configured to provide reliable, secured, and/or authenticated communications. For each communication described herein, information for facilitating reliable communications (e.g., guaranteed message delivery) can be provided, perhaps as part of a message header and/or footer (e.g., packet/message sequencing information, encapsulation headers and/or footers, size/time information, and transmission verification information such as cyclic redundancy check (CRC) and/or parity check values). Communications can be made secure (e.g., be encoded or encrypted) and/or decrypted/decoded using one or more cryptographic protocols and/or algorithms, such as, but not limited to, Data Encryption Standard (DES), Advanced Encryption Standard (AES), a Rivest-Shamir-Adelman (RSA) algorithm, a Diffie-Hellman algorithm, a secure sockets protocol such as Secure Sockets Layer (SSL) or Transport Layer Security (TLS), and/or Digital Signature Algorithm (DSA). Other cryptographic protocols and/or algorithms can be used as well or in addition to those listed herein to secure (and then decrypt/decode) communications.
Controller 1060 may include one or more processors 1062 and memory 1064. Processor(s) 1062 can include one or more general purpose processors and/or one or more special purpose processors (e.g., display driver integrated circuit (DDIC), digital signal processors (DSPs), tensor processing units (TPUs), graphics processing units (GPUs), application specific integrated circuits (ASICs), etc.). Processor(s) 1062 may be configured to execute computer-readable instructions that are contained in memory 1064 and/or other instructions as described herein.
Memory 1064 may include one or more non-transitory computer-readable storage media that can be read and/or accessed by processor(s) 1062. The one or more non-transitory computer-readable storage media can include volatile and/or non-volatile storage components, such as optical, magnetic, organic or other memory or disc storage, which can be integrated in whole or in part with at least one of processor(s) 1062. In some examples, memory 1064 can be implemented using a single physical device (e.g., one optical, magnetic, organic or other memory or disc storage unit), while in other examples, memory 1064 can be implemented using two or more physical devices.
In example embodiments, processor(s) 1062 are configured to execute instructions stored in memory 1064 so as to carry out operations.
The operations may include identifying an input gray level while display panel 1010 is operating at a first refresh rate.
The operations may further include retrieving, from a storage (e.g., memory 1064) at the computing device 1000, a corresponding gray level for the input gray level. The corresponding gray level may have been selected from a plurality of candidate gray levels based on a measured optical property of display panel 1010 for the input gray level and the plurality of candidate gray levels at the first refresh rate and at a second refresh rate. For example, an optical property of display panel 1010 for the input gray level at the first refresh rate may have been measured. Also, for example, the optical property of display panel 1010 for a plurality of candidate gray levels at a second refresh rate may have been measured. This may involve measurements by an image capturing device configured to measure the optical property (e.g., a spectroradiometer or a colorimeter) that is different from computing device 1000. In some embodiments, one or more optical properties can be measured.
The operations may also include adjusting input display data using the corresponding gray level for the input gray level.
The operations may also include transitioning, based on the adjusted input display data, display panel 1010 from the first refresh rate to the second refresh rate. For example, controller 1060 may transition display panel 1010 from a 60 Hz refresh rate to a 90 Hz refresh rate, or vice versa.
The operations may further include identifying a rate change triggering event while display panel 1010 is operating at the first refresh rate. The transitioning of display panel 1010 from the first refresh rate to the second refresh rate may be performed in response to the identifying of the rate change triggering event. In some embodiments, the rate change triggering event may be initiated by a process running on the device (e.g., brightness settings for different applications, specified times of day, and so forth). In some embodiments, the rate change triggering event may include a user interaction with display panel 1010 (e.g., a fingerprint detection event where the device attempts to authenticate a fingerprint of a user of the computing device 1000). In some embodiments, the rate change triggering event may be based on an environmental state measurement (e.g., by ambient light sensor(s) 1030, and/or other sensor(s) 1040) associated with an environment around the computing device 1000.
The operations may further include, after transitioning display panel 1010 from the first refresh rate to the second refresh rate, detecting that the rate change triggering event has ended. Then, the operations may include, in response to detecting that the rate change triggering event has ended, transitioning display panel 1010 from the second refresh rate to the first refresh rate.
Some or all of the blocks of method 1200 may be carried out by various elements of computing device 1000. Alternatively and/or additionally, some or all of the blocks of method 1200 may be carried out by a computing device that is communicatively coupled to computing device 1000. Furthermore, some implementations of method 1200 may utilize the relationships depicted in graphs and/or tables that are illustrated and described with regard to
Block 1210 includes measuring, for a device having a display panel configured to operate at multiple refresh rates, an optical property of the display panel for an input gray level at a first refresh rate.
Block 1220 includes measuring, for the device, the optical property of the display panel for a plurality of candidate gray levels at a second refresh rate.
Block 1230 includes selecting, based on the measured optical property of the display panel for the input gray level and the plurality of candidate gray levels, a corresponding gray level for the input gray level, wherein the corresponding gray level is selected from the plurality of candidate gray levels.
Block 1240 includes storing, at the device, the corresponding gray level for the input gray level, wherein subsequent to the storing, the device is configured to adjust input display data using the corresponding gray level for the input gray level when the display panel is transitioning from the first refresh rate to the second refresh rate.
In some embodiments, the measuring may be performed for a given display brightness band for the display panel.
Some embodiments involve determining a display brightness band. Such embodiments may also involve determining the input gray level at the determined display brightness band. In some embodiments, the input gray level is based on determining that the optical property is less than an optical threshold.
In some embodiments, a second input gray level may be determined based on a determination that the optical property is greater than an optical threshold. Such embodiments may also involve measuring, from the device, at least one difference in the optical property of the display panel between the first refresh rate and the second refresh rate for the second input gray level. Such embodiments may further involve applying, based on the at least one measured difference, a value offset to a default gamma value used by the device for the second input gray level when the display panel is operating at the second refresh rate, thereby generating a new gamma value. Such embodiments may also involve storing, at the device, the new gamma value wherein subsequent to the storing, the device is configured to override the default gamma value for the second input gray level with the new gamma value when the display panel is operating at the second refresh rate.
In some embodiments, the display panel may have a plurality of color channels. The default gamma value may include respective register values for the plurality of color channels. The value offset may include an offset to at least one of the register values of the default gamma value. In some embodiments, the plurality of color channels may include red, green and blue (RGB) color channels.
In some embodiments, the value offset may be determined, at least in part, based on a default gamma value used by the device for the input gray level when the display panel is operating at the first refresh rate.
In some embodiments, the measuring may be performed by an image capturing device configured to measure the optical property.
In some embodiments, the first refresh rate may be 60 Hz and the second refresh rate may be 90 Hz.
In some embodiments, the optical property may be one of a luminance or a color of the display panel.
In some embodiments, the storing may include storing, in a boot image of the device and for a plurality of input gray levels, a plurality of corresponding gray levels.
Some embodiments involve measuring, for the device, the optical property of the display panel for a second plurality of candidate gray levels at a third refresh rate. Such embodiments may further involve selecting, based on the corresponding gray level for the input gray level and the second plurality of candidate gray levels at the third refresh rate, a second corresponding gray level for the input gray level, wherein the second corresponding gray level is selected from the second plurality of candidate gray levels. Such embodiments may also involve storing, at the device, the second corresponding gray level for the input gray level, wherein subsequent to the storing, the device is configured to adjust the input display data using the second corresponding gray level for the input gray level when the display panel is transitioning from the second refresh rate to the third refresh rate.
Some embodiments involve measuring, from the device, at least one difference in the optical property of the display panel between the first refresh rate and the second refresh rate for a second input gray level. Such embodiments may further involve determining that the least one difference exceeds an optical threshold. Such embodiments may also involve triggering the selecting of the corresponding gray level for the second input gray level.
Some or all of the blocks of method 1300 may be carried out by various elements of computing device 1000. Alternatively and/or additionally, some or all of the blocks of method 1300 may be carried out by a computing device that is communicatively coupled to computing device 1000. Furthermore, some implementations of method 1300 may utilize the relationships depicted in graphs and/or tables that are illustrated and described with regard to
Block 1310 includes identifying an input gray level while a display panel of a device is operating at a first refresh rate.
Block 1320 includes retrieving, from a storage at the device, a corresponding gray level for the input gray level, wherein the corresponding gray level has been selected from a plurality of candidate gray levels based on a measured optical property of the display panel for the input gray level and the plurality of candidate gray levels at the first refresh rate and at a second refresh rate.
Block 1330 includes adjusting input display data using the corresponding gray level for the input gray level.
Block 1340 includes transitioning, based on the adjusted input display data, the display panel from the first refresh rate to the second refresh rate.
Some embodiments involve identifying a rate change triggering event while the display panel is operating at the first refresh rate. The transitioning of the display panel from the first refresh rate to the second refresh rate may be performed in response to the identifying of the rate change triggering event.
In some embodiments, the rate change triggering event may be initiated by a process running on the device.
In some embodiments, the rate change triggering event may include a user interaction with the display panel.
In some embodiments, the rate change triggering event may be based on an environmental state measurement associated with an environment around the device.
Some embodiments involve, after transitioning the display panel from the first refresh rate to the second refresh rate, detecting that the rate change triggering event has ended. Such embodiments may also involve, in response to detecting that the rate change triggering event has ended, transitioning the display panel from the second refresh rate to the first refresh rate.
The particular arrangements shown in the Figures should not be viewed as limiting. It should be understood that other embodiments may include more or less of each element shown in a given Figure. Further, some of the illustrated elements may be combined or omitted. Yet further, an illustrative embodiment may include elements that are not illustrated in the Figures.
A step or block that represents a processing of information can correspond to circuitry that can be configured to perform the specific logical functions of a herein-described method or technique. Alternatively or additionally, a step or block that represents a processing of information can correspond to a module, a segment, or a portion of program code (including related data). The program code can include one or more instructions executable by a processor for implementing specific logical functions or actions in the method or technique. The program code and/or related data can be stored on any type of computer readable medium such as a storage device including a disk, hard drive, or other storage medium.
The computer readable medium can also include non-transitory computer readable media such as computer-readable media that store data for short periods of time like register memory, processor cache, and random access memory (RAM). The computer readable media can also include non-transitory computer readable media that store program code and/or data for longer periods of time. Thus, the computer readable media may include secondary or persistent long term storage, like read only memory (ROM), optical or magnetic disks, compact-disc read only memory (CD-ROM), for example. The computer readable media can also be any other volatile or non-volatile storage systems. A computer readable medium can be considered a computer readable storage medium, for example, or a tangible storage device.
While various examples and embodiments have been disclosed, other examples and embodiments will be apparent to those skilled in the art. The various disclosed examples and embodiments are for purposes of illustration and are not intended to be limiting, with the true scope being indicated by the following claims.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US2021/014902 | 1/25/2021 | WO |
