The present disclosure relates to the field of display technology, and particularly relates to a display control method, a display control apparatus, a display device, an electronic device, and a storage medium.
With rapid development of mini Light-Emitting Diode (mini LED) display technology, a mini LED display product has begun to be applied to the high definition display field of super large display screen, such as vehicle-mounted display, monitoring and commanding, high-definition broadcasting, high-end cinema, medical diagnosis, advertisement display, conference exhibition, office display, virtual reality, and the like, and a better display effect has been achieved.
The present disclosure aims to solve at least one technical problem in the prior art and provides a display control method, a display control apparatus, a display device, an electronic device, and a storage medium.
In a first aspect, a technical solution adopted to solve the technical problem of the present disclosure is a display control method, including:
In some implementations, the determining the first backlight feature values of the respective backlight partitions of the backlight module according to the first pixel data of respective pixels in the image to be displayed, includes:
In some implementations, the value of the weighting coefficient is in a range from 0.5 to 0.9.
In some implementations, the determining the backlight driving values of the light sources in the respective backlight partitions according to the first backlight feature values of the respective backlight partitions, includes:
In some implementations, the determining the second backlight feature values of the respective backlight partitions according to the backlight diffusion factor group set in advance and the first backlight feature values of the respective backlight partitions, includes:
In some implementations, the first adjacent partitions further include first mirroring partition having a partition distance from the backlight partition less than or equal to the first preset distance threshold; and
In some implementations, the determining the first backlight feature value of the first mirroring partition according to the first backlight feature value of the backlight partition in mirror correspondence with the first mirroring partition, includes:
In some implementations, the compensating the first pixel data of respective pixels in the image to be displayed according to the second backlight feature values of the respective backlight partitions, to obtain the compensated second pixel data, includes:
In some implementations, the compensating the first pixel data of respective pixels in the image to be displayed according to the second backlight feature values of the respective backlight partitions, to obtain the compensated second pixel data, includes:
In some implementations, the filtering the second backlight feature values of the respective backlight partitions to obtain the fourth backlight feature values of the respective backlight partitions, includes:
In some implementations, the second adjacent partitions further include second mirroring partitions each having a partition distance from the backlight partition less than or equal to the second preset distance threshold, where the filter coefficient group includes n×n filter coefficients, and n is a positive integer; and
In some implementations, the determining the second backlight feature value of the second mirroring partition according to the second backlight feature value of the backlight partition in mirror correspondence with the second mirroring partition, includes:
In some implementations, the determining, with preset linear interpolation algorithm, the third backlight feature value of the respective pixels in the image to be displayed, according to the fourth backlight feature values of the respective backlight partitions, includes:
In some implementations, the compensating the first pixel data of the respective pixels in the image to be displayed, according to the third backlight feature values of the respective pixels in the image to be displayed, to obtain the compensated second pixel data, includes:
In a second aspect, an embodiment of the present disclosure further provides a display control apparatus, including a first processing module, a second processing module, a third processing module, and a fourth processing module;
In a third aspect, an embodiment of the present disclosure further provides a display device, including a backlight module, a display module, and a display control apparatus, where the display control apparatus is connected to both of the backlight module and the display module, and the display control apparatus is the display control apparatus in the second aspect;
In some implementations, the display module includes a 14.96-inch display screen.
In a fourth aspect, an embodiment of the present disclosure further provides an electronic device, including:
In some implementations, the processor includes a Field Programmable Gate Array (FPGA).
In a fifth aspect, an embodiment of the present disclosure further provides a non-transitory computer readable storage medium storing thereon a computer program which, when being executed by a processor, performs steps of any one display control method in the first aspect.
In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings of the embodiments of the present disclosure. Obviously, the described embodiments are some, but not all, embodiments of the present disclosure. The components of the embodiments of the present disclosure, described and illustrated in the drawings herein, generally could be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure, provided in the accompanying drawings, is not intended to limit the protection scope of the present disclosure, but merely represents selected embodiments of the present disclosure. All other embodiments, which can be derived by one of ordinary skill in the art from the described embodiments of the present disclosure without creative efforts, are within the protection scope of the present disclosure.
Unless defined otherwise, technical or scientific terms used herein shall have the ordinary meaning as understood by one of ordinary skill in the art to which the present disclosure belongs. The use of “first”, “second”, and the like in the present disclosure is not intended to indicate any order, quantity, or importance, but rather serves to distinguish one element from another. Also, the term “a”, “an”, “the” or the like does not denote a limitation of quantity, but rather denotes the presence of at least one. The word “comprising/including”, “comprises/includes”, or the like means that the element or item preceding the word includes the element or item listed after the word and its equivalent, but does not exclude other elements or items. The term “connected”, “coupled” or the like is not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The terms “upper”, “lower”, “left”, “right”, and the like are used only to indicate relative positional relationships, and when the absolute position of the object being described is changed, the relative positional relationships may also be changed accordingly.
Reference to “a plurality of” or “a number of” in the present disclosure means two or more. “And/or” describes an association relationship between associated objects, and indicates that three relationships may exist. For example, A and/or B may indicate: A exists alone, A and B exist simultaneously, or B exists alone. The character “/” generally indicates that the associated objects before and after the character “/” are in an “or” relationship.
In recent years, with the rapid rise of new energy automobiles, trends of “electrification”, “intelligence” and “large screen display” are more obvious, and vehicle-mounted display becomes an important factor for measuring vehicle experience. Adopting mini LED display technology to realize vehicle-mounted display can realize better display effect, and promote a user's experience with the vehicle.
In the related art, for the conventional image display, image information input by the system is used to extract a brightness feature on one hand, so as to determine a backlight driving value to drive a backlight panel; and on the other hand, the input image information is used for simulating pixel compensation, so as to improve the display effect. However, the conventional display algorithm has certain defects, on one hand, the implementation process of the algorithm needs a large amount of storage resources and is not favorable for being deployed on a low-end chip, so that the hardware cost for supporting the conventional algorithm is high; on the other hand, the backlight module is divided into a plurality of backlight partitions, partition control of the light source causes a fact that the backlight brightness is not unified any more, and the backlight driving values between adjacent backlight partitions still have a relatively large difference therebetween, so that smooth transition effect of the pixel compensation between the adjacent partitions is poor, and block effect of the image cannot be eliminated.
It should be noted that the backlight driving value in the present disclosure is driving data used by the LED driving module to drive the backlight module.
In order to overcome the defects in the related art, the backlight brightness of the LED display system may be dynamically adjusted with a local dynamic backlight control method. The local dynamic backlight control is realized based on the pixel display principle of a liquid crystal display. The liquid crystal display displays pixels by controlling the deflection of liquid crystal molecules with an electro-optic effect of liquid crystal, to vary an output luminous flux of each pixel. When displaying the same image with backlights of different brightness, it is theoretically possible to ensure that the displayed image is constant as long as the output luminous flux of each pixel remains constant, and this principle is summarized into a formula as follows:
In formula (1), BL is a backlight brightness value of the pixel before light adjusting, g is a pixel gray scale value of the pixel before light adjusting (i.e., a maximum gray scale value of R, G, B sub-pixels in the pixel),
In a first aspect, an embodiment of the present disclosure provides a display control method, and
At step S11, determining first backlight feature values of respective backlight partitions of a backlight module, according to first pixel data of respective pixels in an image to be displayed.
The image to be displayed is obtained from an image acquisition device or obtained by calling image resources in a memory. The first pixel data is, for example, sub-pixel values of respective sub-pixels (R, G, and B) in the pixels.
The backlight module is divided into a plurality of backlight partitions in advance, where each backlight partition corresponds to at least one light source. Each backlight partition corresponds to a plurality of pixels.
Illustratively, the embodiment of the present disclosure is applied to a 14.96-inch vehicle-mounted display screen, where a resolution of the screen is 2000×1200, the backlight module is divided into 48×24 backlight partitions in advance, and each backlight partition includes 50×50 pixels.
At step S12, determining backlight driving values of light sources in the respective backlight partitions, according to the first backlight feature values of the respective backlight partitions.
The backlight driving values of the light sources in the respective backlight partitions serves to drive the light sources in the respective backlight partitions to emit backlight corresponding to the image to be displayed.
Illustratively, the backlight driving values of the light sources in the respective backlight partitions may be smoothed, through the first backlight feature values of the respective backlight partitions corresponding to the image to be displayed, and in combination with screen characteristics of the display module, so as to reduce backlight difference between adjacent backlight partitions.
At step S13, determining second backlight feature values of the respective backlight partitions, according to a backlight diffusion factor group set in advance and the first backlight feature values of the respective backlight partitions.
The backlight diffusion factor group includes N×N backlight diffusion factors, where N is a positive integer.
It should be noted that, since the first backlight feature values of different backlight partitions are different, the determined backlight driving values of different backlight partitions are often different, so that backlight light emitted by adjacent backlight partitions may affect each other in a process of projecting and diffusing to a panel in a backlight cavity, and the actual backlight distribution of each backlight partition is not consistent with the backlight driving value corresponding to the backlight partition. If the influence of light diffusion is not considered and a pixel compensation is directly performed according to the determined first backlight feature value, not only does it fail to accurately reproduce image information, but also obvious block effect may be generated. Meanwhile, crosstalk occurs in light diffusion, so that the brightness of bright areas is reduced while the brightness of dark areas is increased, thereby affecting the display effect.
The backlight diffusion factor group may be a diffusion model which is established in advance by simulating the projection and diffusion process of the backlight light in the backlight cavity. Illustratively, a 9×9 convolution diffusion model may be established by actually testing the projection and diffusion of the backlight light in the backlight cavity, which model can simulate the backlight diffusion phenomenon more accurately. The 9×9 convolution diffusion model includes 81 backlight diffusion factors.
Illustratively, the above display control method of the present disclosure may be deployed on a low-end chip, such as a Field Programmable Gate Array (FPGA). The 81 backlight diffusion factors are actual measurement values and may be pre-stored in a Read-Only Memory (ROM) inside the FPGA.
The backlight feature value (including the first backlight feature value and the second backlight feature value) in the present disclosure may also be understood as a brightness value of the backlight.
At step S14, compensating the first pixel data of respective pixels in the image to be displayed according to the second backlight feature values of the respective backlight partitions, to obtain compensated second pixel data for displaying.
Target compensation factors of the pixels may be determined based on the second backlight feature values of the respective backlight partitions; and the first pixel data of the pixels is compensated through the target compensation factors, to obtain the second pixel data of the pixels.
In the foregoing steps S11 to S14 of the embodiment of the present disclosure, the conventional display algorithm is improved based on the screen characteristics and the chip resource characteristics, and the backlight driving values of the light sources in the respective backlight partitions are smoothed, through the first backlight feature values of the respective backlight partitions corresponding to the image to be displayed, and in combination with the screen characteristics of the display module, so that the backlight difference between adjacent backlight partitions is reduced. Meanwhile, the influence of light diffusion in the backlight partition is eliminated according to the backlight diffusion factor group set in advance. On this basis, the first pixel data of respective pixels in the image to be displayed is compensated according to the second backlight feature values of the respective backlight partitions, the contrast of the image to be displayed can be improved, the power consumption can be reduced, and the image display details can be enhanced, and therefore the display effect is improved. Meanwhile, the above display control method of the present disclosure can be deployed on a low-end chip, such as a Field Programmable Gate Array (FPGA), so that the cost of a display product is reduced.
The display control method according to the embodiment of the present disclosure is described in detail with specific implementations below.
At step S111, performing gray scale feature extraction on the respective pixels according to the first pixel data of the respective pixels in the image to be displayed, to obtain first gray scale values of the respective pixels.
The first pixel data of each pixel includes sub-pixel values of respective sub-pixels (R, G, and B) in the pixel, denoted as R(u,v), G(u,v), B(u,v).
Illustratively, for each pixel, a maximum sub-pixel value of the sub-pixel values of the sub-pixels may be taken as the first gray scale value of the pixel, which is shown in the following formula (2):
At step S112, for each backlight partition, according to the first gray scale values of respective pixels corresponding to the backlight partition, determining a maximum first gray scale value of the first gray scale values as a second gray scale value of the backlight partition, and determining a mean value of the first gray scale values of the pixels corresponding to the backlight partition as a third gray scale value of the backlight partition.
Illustratively, for each backlight partition, the first backlight feature value may be extracted by a maximum method and/or an average method.
Illustratively, the second gray scale value may be determined by a maximum method for each of the backlight partitions. Specifically, a maximum one of the first gray scale values of the pixels corresponding to the backlight partition may be taken as the second gray scale value of the backlight partition, which is shown in the following formula (3):
Illustratively, the second gray scale value may be determined by an average method for each of the backlight partitions. Specifically, a mean value of the first gray scale values of the pixels corresponding to the backlight partition may be taken as the third gray scale value of the backlight partition, which is shown in the following formula (4):
At step S113, determining the first backlight feature value of the backlight partition, according to the second gray scale value, the third gray scale value and a weighting coefficient set in advance.
A value of the weighting coefficient set in advance ranges from 0 to 1.
The second gray scale value and the third gray scale value may be weighted according to the weighting coefficient, to obtain the first backlight feature value of the backlight partition.
Illustratively, for each backlight partition, the first backlight feature value thereof may be determined according to the following formula (5):
In a case where P=0, BL=BLmax, that is, the first backlight feature value is determined by the maximum method.
In a case where P=1, BL=BLave, that is, the first backlight feature value is determined by the average method.
Although the maximum method can greatly retain image details, the brightness of the image in a dark field area cannot be effectively controlled, the contrast is not improved sufficiently, and the power consumption is reduced limitedly. The average method can reduce the backlight to a great extent and reduce the power consumption, but for an area with high contrast, a backlight reduction degree exceeds a degree that the pixel compensation can reach, so that the image cannot be properly restored, and the correct display effect is difficult to generate. In view of above, the embodiment of the present disclosure adopts the maximum method and the average method to extract the first backlight feature value, which not only retains the advantages of the maximum method and the average method to a certain extent, but also makes up for the disadvantages of the two methods to a certain extent. Illustratively, a value of the weighting coefficient ranges from 0.5 to 0.9. For example, P is 0.85, so that the vehicle-mounted display screen has an extremely small halo effect.
At step S121, mapping the first backlight feature values of the respective backlight partitions into corresponding unadjusted backlight driving values of the light sources, based on a preset mapping mode.
After the first backlight feature values of the backlight partitions are obtained, the first backlight feature values of the backlight partitions may be mapped to corresponding unadjusted backlight driving values of the light sources, based on a preset mapping mode. For example, the backlight driving value corresponding to the first backlight feature value is queried through lookup, based on a mapping Look-Up Table, where different first backlight feature values and backlight driving values corresponding to the first backlight feature values are stored in the mapping Look-Up Table in advance. For another example, the first backlight feature value may be mapped to a corresponding unadjusted backlight driving value of the light source, based on a mapping algorithm designed in advance. In the subsequent process, the backlight driving values obtained after the processing in step S121 may be input to a driving component (e.g., a driving chip) of a backlight assembly, to drive the LED lamps in the respective backlight partitions of the backlight panel to emit backlight corresponding to the target image. Thus, the processing of the backlight is completed.
At step S122, comparing, for each backlight partition, the unadjusted backlight driving value with a first preset threshold value.
Step S123 is executed, in a case where the unadjusted backlight driving value is less than the first preset threshold; and step 124 is executed, in case where the unadjusted backlight driving value is greater than or equal to the first preset threshold.
The first preset threshold may be a reference backlight driving value determined empirically, such as a backlight driving value indicated by a point O in
At step S123, determining an adjusted backlight driving value of the light source in the backlight partition, by a nonlinear mapping algorithm with a display module parameter gamma<1.
As shown in
At step S124, determining the adjusted backlight driving value of the light source in the backlight partition, by a nonlinear mapping algorithm with the display module parameter gamma>1.
As shown in
In the above steps S121 to S124 of the present embodiment, by combining the first backlight feature values of the respective backlight partitions corresponding to the image to be displayed and the gamma parameter, reflecting a screen feature, of the display module, through the nonlinear transformation as shown in
In some implementations, in the step S13, the determining the second backlight feature values of the respective backlight partitions specifically includes: for each backlight partition, the first backlight feature value of the backlight partition and the first backlight feature values of first adjacent partitions of the backlight partition may be weighted with N×N backlight diffusion factors in the backlight diffusion factor group, to determine the second backlight feature value of the backlight partition.
The larger the value of N in the backlight diffusion factor group is, the higher the accuracy of the backlight diffusion simulation is, but the greater the calculation amount is; the smaller the value of N in the backlight diffusion factor group is, the lower the accuracy of the backlight diffusion simulation is, but the less the calculation amount is. N in the backlight diffusion factor group may be generally set according to the accuracy requirement and the calculation amount requirement of the light diffusion simulation. The embodiment of the present disclosure is described by taking N=9 as an example, that is, a backlight diffusion simulation is performed on 9×9 backlight partitions.
The first adjacent partitions include backlight partitions each having a partition distance from the backlight partition less than or equal to a first preset distance threshold. Illustratively, in a case of N=9, the first preset distance threshold may be 4, and the first adjacent partitions include 9×9-1 backlight partitions, which are centered on a backlight partition in 5th row and 5th column, and spaced by 4 backlight partitions from each of the upper, lower, left and right sides. Further illustratively, in a case of N=5, the first preset distance threshold may be 2, and the first adjacent partitions include 5×5-1 backlight partitions, which are centered on a backlight partition in 3rd row and 3rd column, and spaced by 2 backlight partitions from each of the upper, lower, left and right sides.
It should be noted that, where the selected backlight partition located at the center is located at an edge of the whole backlight module, the first adjacent partitions of the backlight partition located at the center further include virtual partitions each having a partition distance from the backlight partition less than or equal to the first preset distance threshold.
In one case, the first backlight feature value of each virtual partition is set in advance as a preset fixed value, where the preset fixed value may be set according to actual experience, for example, the preset fixed value may be set as 0. Alternatively, other data may be selected, which is not specifically limited in the embodiments of the present disclosure.
In another case, the respective virtual partitions are obtained by mirroring the backlight partitions, for example, as first mirroring partitions. The first backlight feature values of respective first mirroring partitions are first backlight feature values of the backlight partitions corresponding to the mirroring partitions, respectively. Taking this as an example,
At step S131, determining, with a preset mirroring algorithm, a plurality of first virtual mirroring areas of the backlight module, according to size information of the N×N backlight diffusion factors and size information of a plurality of backlight partitions divided from the backlight module.
Each first virtual mirroring area includes at least N rows and N columns of first mirroring partitions.
The size information of the N×N backlight diffusion factors is N rows and N columns. The size information of the plurality of backlight partitions divided from the backlight module is W rows and H columns, where W represents the number of the backlight partitions divided in a row direction of the backlight module, and H represents the number of the backlight partitions divided in a column direction of the backlight module. Taking a 14.96-inch vehicle-mounted display screen as an example, the backlight module is divided into 48×24 backlight partitions in advance, where W=48, and H=24.
As shown in
At step S132, determining a first backlight feature value of the first mirroring partition, according to the first backlight feature value of the backlight partition in mirror correspondence with the first mirroring partition.
In one case, a corresponding memory may be separately created for storing the first backlight feature values of the first mirroring partitions, where the first backlight feature value of the first mirroring partition is the same as the first backlight feature value of the backlight partition in mirror correspondence with the first mirroring partition. Then, the first backlight feature value of the first mirroring partition may be directly acquired from the memory corresponding to the first mirroring partitions.
However, if there are more first mirroring partitions, then the additional storage space required for storing the first backlight feature values of the first mirroring partitions is larger. For a low-end chip, such as a GW2A-18 FPGA chip, Block RAM (BRAM) resources are very limited, so BRAM storage cannot be created separately for mirrored data. Therefore, in the case of being applied to an FPGA chip, after the respective first mirroring partitions are determined, calling addresses are configured for at least part of the first mirroring partitions, and the first backlight feature value of the first mirroring partition is read according to the calling address configured for the first mirroring partition.
Taking the backlight diffusion factor group including 9×9 backlight diffusion factors as an example, for the first virtual mirroring area 91, only the calling addresses of the first mirroring partitions in the 5th to 9th rows and the 5th to 9th columns need to be configured. For the first virtual mirroring area 92, only the calling addresses of the first mirroring partitions in the 5th to 9th rows need to be configured. For the first virtual mirroring area 93, only the calling addresses of the first mirroring partitions in the 5th to 9th columns need to be configured.
The 81 backlight diffusion factors are stored in ROM, and the calling addresses of the first mirroring partitions are stored in BRAM. It should be noted that the sum of the data amounts of the calling addresses is much less than the sum of the data amounts of the first backlight feature values of the first mirroring partitions.
Specifically, in the embodiment of the present disclosure, only one BRAM is required, and the data is stored in a form of rows and columns. For example, the storage starts from a calling address of the first backlight feature value of the backlight partition of the 5th row and 5th column. When performing 9×9 convolution calculation, weighted summation is performed on the first backlight feature values of the backlight partition e5 and the first adjacent partitions (a1 to e4, and e6 to i9) of the backlight partition. When reading the first adjacent partition of the 1st row, the address read from BRAM is mirrored and shifted to the 9th row, so that the first backlight feature value corresponding to the first adjacent partition of the 9th row is read as the first backlight feature value of the first adjacent partition of the 1st row. When reading the first adjacent partition of the 2nd row, the address to be read from BRAM is mirrored and shifted to the 8th row, so that the first backlight feature value corresponding to the first adjacent partition of the 8th row is read as the first backlight feature value of the first adjacent partition of the 2nd row. When reading the first adjacent partition of the 3rd row, the address to be read from BRAM is mirrored and shifted to the 7th row, so that the first backlight feature value corresponding to the first adjacent partition of the 7th row is read as the first backlight feature value of the first adjacent partition of the 3rd row. When reading the first adjacent partition of the 4th row, the address to be read from BRAM is mirrored and shifted to the 6th row, so that the first backlight feature value corresponding to the first adjacent partition of the 6th row is read as the first backlight feature value of the first adjacent partition of the 4th row. Similarly, when reading the first adjacent partition of the 1st column, the address to be read from BRAM is mirrored and shifted to the 9th column, so that the first backlight feature value corresponding to the first adjacent partition of the 9th column is read as the first backlight feature value of the first adjacent partition of the 1st column. When reading the first adjacent partition of the 2nd column, the address to be read from BRAM is mirrored and shifted to the 8th column, so that the first backlight feature value corresponding to first adjacent partition of the 8th column is read as the first backlight feature value of the first adjacent partition of the 2nd column. When reading the first adjacent partition of the 3rd column, the address to be read from BRAM is mirrored and shifted to the 7th column, so that the first backlight feature value corresponding to the first adjacent partition of the 7th column is read as the first backlight feature value of the first adjacent partition of the 3rd column. When reading the first adjacent partition of the 4th column, the address to be read from BRAM is mirrored and shifted to the 6th column, so that the first backlight feature value corresponding to the first adjacent partition of the 6th column is read as the first backlight feature value of the first adjacent partition of the 4th column. The method can realize the 9×9 convolution by only mirroring and shifting the row and column addresses to be read, without increasing the utilization amount of BRAM, so that the low resource utilization rate of a chip can be met.
At step S133, for each backlight partition, weighting the first backlight feature value of the backlight partition and the first backlight feature values of the first adjacent partitions of the backlight partition, with N×N backlight diffusion factors in the backlight diffusion factor group, to determine the second backlight feature value of the backlight partition.
Taking the backlight partition e5 as an example, a cumulative sum of the first backlight feature value of the backlight partition e5 and the first backlight feature values of the first adjacent partitions (including the backlight partitions and the first mirroring partitions surrounding the backlight partition e5) multiplied by the correspondingly obtained backlight diffusion factors, respectively, is the second backlight feature value of the backlight partition e5.
Here, the influence of light diffusion in the backlight partition can be eliminated through the backlight diffusion factor group, thereby improving the display effect.
At step S14-1-1, filtering the second backlight feature values of the respective backlight partitions, to obtain fourth backlight feature values of the respective backlight partitions.
In some display scenes, the brightness difference between different backlight partitions is great, and even if the backlight simulation in the processes of steps S131 to S133 is performed on the backlight partitions, the brightness difference between different backlight partitions still is obvious, so that block effect occurs during compensation. In order to improve this defect, in the embodiment of the present disclosure, data processing is performed on the second backlight feature values of the respective backlight partitions through mean filtering, to obtain the fourth backlight feature values of the respective backlight partitions.
Specifically, for each backlight partition, the second backlight feature value of the backlight partition and the second backlight feature values of second adjacent partitions of the backlight partition may be filtered with a filter coefficient group determined in advance, to determine the fourth backlight feature value of the backlight partition.
The filter coefficient group includes n×n filter coefficients, where n is a positive integer. The larger the value of n in the filter coefficient group is, the higher the filtering accuracy is, but the larger the calculation amount is; the smaller the value of n in the filter coefficient group is, the lower the filtering accuracy is, but the calculation amount is smaller. Generally, n in the filter coefficient group may be set according to the filtering accuracy requirement and the calculation amount requirement. In the embodiments of the present disclosure, n=5 is taken as an example for description, that is, 5×5 filter coefficients are adopted in the mean filtering.
The second adjacent partitions include backlight partitions each having a partition distance from the backlight partition less than or equal to a second preset distance threshold. Illustratively, in a case of n=5, the second preset distance threshold may take 2, and the second adjacent partitions includes 5×5-1 backlight partitions, which are centered on the backlight partition of the 3rd row and 3rd column, and spaced by 2 backlight partitions from each of the top, bottom, left, and right sides.
It should be noted that, where the selected backlight partition located at the center is located at an edge of the whole backlight module, the second adjacent partitions of the backlight partition located at the center further include virtual partitions each having a partition distance from the backlight partition less than or equal to the second preset distance threshold.
In one case, the second backlight feature value of each virtual partition is set in advance as a preset fixed value, where the preset fixed value may be set according to actual experience, for example, the preset fixed value may be set to be 0. Alternatively, other data may be selected, which is not specifically limited in the embodiments of the present disclosure.
In another case, the respective virtual partitions are obtained by mirroring the backlight partitions, for example, as second mirroring partitions. The second backlight feature values of respective second mirroring partitions are the second backlight feature values of the backlight partitions in mirror correspondence with the mirroring partition. Taking this as an example,
At step S14-1-11, determining, with a preset mirroring algorithm, a plurality of second virtual mirroring areas of the backlight module, according to size information of the n×n filter coefficients and the size information of the plurality of backlight partitions divided from the backlight module.
Each second virtual mirroring area includes at least n rows and n columns of second mirroring partitions. The size information of n×n filter coefficients is n rows and n columns. The size information of the plurality of backlight partitions divided from the backlight module is W rows and H columns, where W represents the number of the backlight partitions divided in the row direction of the backlight module, and H represents the number of the backlight partitions divided in the column direction of the backlight module. Taking a 14.96-inch vehicle-mounted display screen as an example, the backlight module is divided into 48×24 backlight partitions in advance, where W=48, and H=24.
The principle of determining the second virtual mirroring area is the same as that of determining the first virtual mirroring area, and repeated descriptions are omitted.
At step S14-1-12, determining a second backlight feature value of the second mirroring partition, according to the second backlight feature value of the backlight partition in mirror correspondence with the second mirroring partition.
In one case, a corresponding memory may be separately created for storing the second backlight feature values of the second mirroring partitions, where the second backlight feature value of the second mirroring partition is the same as the second backlight feature value of the backlight partition in mirror correspondence with the second mirroring partition. Then, the second backlight feature value of the second mirroring partition may be directly acquired from the memory corresponding to the second mirroring partitions.
It should be noted that, if there are more second mirroring partitions, then the additional storage space required for storing the second backlight feature values of the second mirroring partitions is larger. For a low end chip, such as a GW2A-18 FPGA chip, Block RAM (BRAM) resources are very limited, so BRAM storage cannot be created separately for mirrored data. Therefore, in the case of being applied to an FPGA chip, after the respective second mirroring partitions are determined, calling addresses are configured for at least part of the second mirroring partitions, and the second backlight feature value of the second mirroring partition is read according to the calling address configured for the second mirroring partition.
The 25 filter coefficients are stored in ROM, and the calling addresses of the second mirroring partitions are stored in BRAM. It should be noted that the sum of the data amounts of the calling addresses is much less than the sum of the data amounts of the second backlight feature values of the second mirroring partitions.
Specifically, in the embodiment of the present disclosure, only one BRAM is required, and the data is stored in a form of rows and columns. For example, the storage starts from a calling address of the second backlight feature value of the backlight partition of the 3rd row and 3rd column. When performing 5×5 filtering calculation, weighted summation is performed on the second backlight feature value of the backlight partition B11 and the second backlight feature values of the second adjacent partitions (B11 to B32, and B34 to B55) of the backlight partition. When reading the second adjacent partition of the 1st row, the address to be read from BRAM is mirrored and shifted to the 5th row, so that the second backlight feature value corresponding to the second adjacent partition of the 5th row is read as the second backlight feature value of the second adjacent partition of the 1st row. When reading the second adjacent partition of the 2nd row, the address to be read from BRAM is mirrored and shifted to the 4th row, so that the second backlight feature value corresponding to the second adjacent partition of the 4th row is read as the second backlight feature value of the second adjacent partition of the 2nd row. Similarly, when reading the second adjacent partition of the 1st column, the address to be read from BRAM is mirrored and shifted to the 5th column, so that the second backlight feature value corresponding to the second adjacent partition of the 5th column is read as the second backlight feature value of the second adjacent partition of the 1st column. When reading the second adjacent partition of the 2nd column, the address to be read from BRAM is mirrored and shifted to the 4th column, so that the second backlight feature value corresponding to the second adjacent partition of the 4th column is read as the second backlight feature value of the second adjacent partition of the 2nd column. The method can realize the 5×5 filtering by only mirroring and shifting the row and column addresses to be read, without increasing the utilization amount of BRAM, so that the low resource utilization rate of a chip can be met.
At step S14-1-13, for each backlight partition, weighting the second backlight feature value of the backlight partition and the second backlight feature values of the second adjacent partitions of the backlight partition, with n×n filter coefficients in the filter coefficient group, to determine the fourth backlight feature value of the backlight partition.
Taking the backlight partition B11 as an example, a cumulative sum of the second backlight feature value of the backlight partition B11 and the second backlight feature values of the second adjacent partitions (including the backlight partitions and the second mirroring partitions surrounding the backlight partition B11) multiplied by the correspondingly obtained filter coefficients, respectively, is the fourth backlight feature value of the backlight partition B11.
Here, in the above steps S14-1-11 to S14-1-13, the block effect can be eliminated through the filtering processing with the filter coefficient group, thereby improving the display effect.
At step S14-1-2, determining, with a preset linear interpolation algorithm, third backlight feature values of the respective pixels in the image to be displayed, according to the fourth backlight feature values of the respective backlight partitions.
The preset linear interpolation algorithm may be, for example, a bilinear interpolation algorithm, a trilinear interpolation algorithm, a nearest neighbor interpolation algorithm, or the like, which is not specifically limited in the embodiments of the present disclosure.
Illustratively, the third backlight feature values of the respective pixels in the image to be displayed are determined, with the bilinear interpolation algorithm, according to the fourth backlight feature values of the respective backlight partitions.
At step S14-1-21, dividing a plurality of backlight partitions into a plurality of backlight partition groups, where each backlight partition group includes 2×2 backlight partitions.
At step S14-1-22, for each backlight partition group, determining a central area of the backlight partition group, according to central positions of respective backlight partitions in the backlight partition group.
The number of pixels in the central area is equal to that of the pixels in the backlight partition. Taking a 14.96-inch vehicle-mounted display screen as an example, the number of pixels in the central area is 50×50.
A calculation formula (6) of the third backlight feature value f(i,j) of any one pixel (i,j) in the central area 43 surrounded by the central points of the four backlight partitions is as follows:
However, the values of i/W and j/H are all decimal numbers, and in GW2A-18 FPGA, a digital signal processor (i.e., DSP multiplier) does not support decimal calculation, so that quantization processing is further required for data such as x, y, (1-x), (1-y), and the like.
At step S14-1-23, determining quantized data of linear interpolation of respective pixels, according to size information of the central area.
The size information of the central area is the number of pixels in the central area, i.e., W×H pixels. Data “1” is quantized to 50, data x is quantized to 50x, and data y is quantized to 50y.
In GW2A-18 FPGA, the digital signal processor (i.e., DSP multiplier) supports calculations with a bit width such as 9×9, 18×18, 36×36, or the like, and the number of the bit widthes is 48 in total. The DSP with a 9×9 bit width does not support the data calculation before quantization, so the present embodiment firstly performs quantization processing on position data of respective pixels in the central area, which can ensure that the DSP with a 9×9 bit width can be utilized, thereby reducing the waste of DSP resources.
After using 9×9 DSP, a second multiplication operation may use a 18×18 DSP multiplier, avoiding waste of resources.
At step S14-1-24, for each backlight partition group, determining, with a preset linear interpolation algorithm, the third backlight feature values of the respective pixels in the central area, according to the fourth backlight feature values of the respective backlight partitions in the backlight partition group and the quantized data of the pixels in the central area.
Referring to formula (6), middle backlight feature value f(i,j)′ of each pixel in the central area is determined as: f(i,j)′=A1×(50−50x)×(50−50y)+A2×50××(50−50x)+A3×(50−50x)×50y+A4×50x×50y.
Then, for each pixel, the third backlight feature value of the pixel is f(i,j)=f(i,j)′/50.
The determination process of the third backlight feature values of respective pixels in other central areas is the same, and repeated description is omitted. In this step, the central areas of respective backlight partition groups form a plurality of backlight partitions of the backlight module. Therefore, the third backlight feature values of the pixels of respective backlight partitions can be obtained through determining the third backlight feature values of the pixels of the respective central areas.
At step S14-1-3, compensating the first pixel data of respective pixels in the image to be displayed, according to the third backlight feature values of the respective pixels in the image to be displayed, to obtain the compensated second pixel data.
At step S14-1-31, for each pixel in the image to be displayed, determining a first compensation factor of the pixel, according to the third backlight feature value of the pixel.
Taking a pixel (i,j) as an example, the process of determining the first compensation factor is shown in the following formula (7):
At step S14-1-32, determining a second compensation factor of the pixel, according to the first compensation factor and the first gray scale value of the pixel.
Taking the pixel (i,j) as an example, the process of determining the second compensation factor is shown in the following formula (8):
At step S14-1-33, compensating the first pixel data of the pixel with the second compensation factor, to obtain the second pixel data of the pixel.
Taking the pixel (i,j) as an example, the process of determining the second pixel data of the pixel is shown in the following formula (9):
The second pixel data includes sub-pixel values of respective sub-pixels (R, G, and B) in the pixel, that is, R′(i,j), G′(i,j), and B′(i,j).
At step S14-2-1, determining, with a preset linear interpolation algorithm, third backlight feature values of respective pixels in the image to be displayed, according to the second backlight feature values of the respective backlight partitions.
The process of determining the third backlight feature values of the respective pixels in this step, may refer to the detailed implementation process of determining the third backlight feature values of respective pixels in step S14-1-2, and repeated description is omitted.
At step S14-2-2, compensating the first pixel data of respective pixels in the image to be displayed, according to the third backlight feature values of respective pixels in the image to be displayed, to obtain the compensated second pixel data.
The process of obtaining the compensated second pixel data in this step may refer to the detailed implementation process of obtaining the compensated second pixel data in step S14-1-3, and repeated description is omitted.
In some implementations, in the case that the display condition of the target image is satisfied, the backlight driving values of the plurality of backlight partitions and the second pixel data of the respective pixels are simultaneously input into the driving component and the display module, respectively.
That is to say, if the display condition of the image to be displayed is met, the backlight driving values of the plurality of backlight partitions and the second pixel data of the respective pixels are respectively input into the driving component in the backlight module and the display module at the same time, so that the driving component drives the light sources of the plurality of backlight partitions to emit backlight corresponding to the image to be displayed, and meanwhile the display module displays the image to be displayed.
In the embodiment of the present disclosure, the backlight data (the backlight driving values of respective backlight areas) and the pixel data (the second pixel data of the respective pixels) corresponding to the same image to be displayed are simultaneously transmitted to the backlight module and the display module, respectively, so as to ensure the matching between the backlight data and the pixel data.
To facilitate understanding of various embodiments of the present disclosure, an implementation flow of a display control method is described below with a complete example.
At step S21, inputting an image to be displayed;
At step S22, performing gray scale feature extraction by weighting of an average method and a maximum method, and synchronously executing the steps S23 and S28;
At step S23, performing 9×9 convolution, to determine the second backlight feature values of respective backlight partitions;
At step S24, performing 5×5 filtering, to determine the fourth backlight feature values of the respective backlight partitions;
At step S25, determining third backlight feature values of respective pixels in the image to be displayed, with a bilinear interpolation;
At step S26, compensating the first pixel data of the respective pixels in the image to be displayed to obtain compensated second pixel data;
S27, inputting the compensated second pixel data into a display module, for displaying an image.
S28, performing a gamma nonlinear transformation, to determine the adjusted backlight driving values of the light sources in the backlight partitions; and
S29, inputting the adjusted backlight driving values of the light sources in the backlight partitions into a driving component in a backlight module, to drive, by the driving component, the light sources of the plurality of backlight partitions to emit backlight corresponding to the image to be displayed.
The display control method according to the present disclosure improves the traditional algorithm based on the screen characteristics and the chip resource characteristics, so that the contrast can be improved, the power consumption can be reduced, and the image display details can be enhanced, and in addition, the display control method can be deployed to a low-end chip, thereby reducing the product cost.
The above is a full description of the display control method according to the present disclosure.
It will be understood by one of ordinary skill in the art that in the above method of the present embodiment, the writing order of the respective steps does not imply a strict execution order and does not impose any limitations on the implementation. The specific execution order of the respective steps should be determined by their function and possibly inherent logic.
In a second aspect, an embodiment of the present disclosure further provides a display control apparatus corresponding to the display control method. Since a principle of solving the problem of the apparatus in the embodiment of the present disclosure is similar to that of the display control method in the embodiment of the present disclosure, the implementation of the apparatus may refer to the implementation of the method, and repeated description is omitted.
The embodiments of the present disclosure essentially improve the traditional display algorithm based on screen characteristics and chip resource characteristics, and smooth the backlight driving values of the light sources in the respective backlight partitions, through the first backlight feature values of the respective backlight partitions corresponding to the image to be displayed, and in combination with the screen characteristics of the display module, thereby reducing the backlight difference between the adjacent backlight partitions. Meanwhile, the influence of light diffusion in the backlight partition is eliminated according to a backlight diffusion factor group set in advance, and on this basis, first pixel data of respective pixels in the image to be displayed is compensated according to second backlight feature values of the respective backlight partitions, so that the contrast of the image to be displayed can be improved, the power consumption can be reduced, and the image display details can be enhanced, thereby improving the display effect. Meanwhile, the display control method can be deployed on a low-end chip, such as an FPGA, thereby reducing the cost of display product.
In a third aspect, an embodiment of the present disclosure further provides a display device corresponding to the display control method. Since a principle of solving the problem of the display device in the embodiment of the present disclosure is similar to that of the display control method in the embodiment of the present disclosure, implementation of the display device may refer to the implementation of the method, and repeated description is omitted.
In some implementations, the display control apparatus 53 may be a field programmable gate array FPGA, or may be another type of logic device, which is not limited in the present disclosure.
In some implementations, the display module 52 includes a 14.96-inch display screen.
In a fourth aspect, an embodiment of the present disclosure further provides an electronic device.
The processor 601 is a device with data processing capability, which includes but is not limited to a central pocessing unit (CPU), or the like. The memory 602 is a device having data storage capabilities including, but not limited to, random access memory (RAM, more specifically SDRAM, DDR, etc.), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory (FLASH). The I/O interface (read/write interface) 603 coupled between the processor 601 and the memory 602 may enable information interaction between the processor 601 and the memory 602, which may include, but is not limited to, a data bus (Bus), or the like.
In some implementations, the processor 601, the memory 602, and the I/O interface 603 are connected to each other through a bus 604, and in turn to other components of the computing device.
In some implementations, the one or more processors 601 include a Field Programmable Gate Array (FPGA).
In a fifth aspect, an embodiment of the present disclosure further provides a non-transitory computer readable storage medium. The non-transitory computer readable storage medium stores thereon a computer program which, when being executed by a processor, implements steps in any one display control method in the above embodiments.
In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product including a computer program carried on a machine readable medium, where the computer program includes program codes for performing the method illustrated by the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via a communication part, and/or installed from a removable medium. The above functions defined in the system of the present disclosure are performed when the computer program is performed by a Central Processing Unit (CPU).
It should be noted that the non-transitory computer readable medium shown in the present disclosure may be a computer readable signal medium, a computer readable storage medium, or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of the computer readable storage medium may include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a Read-Only Memory (ROM), an Erasable Programmable Read-Only Memory (EPROM or flash memory), an optical fiber, a portable Compact Disc Read-Only Memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer readable storage medium may be any tangible medium that contains or stores a program, which can be used by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may include a propagated data signal with computer readable program code carried therein, in a baseband or as a part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic signal, optical signal, or any suitable combination thereof. A computer readable signal medium may also be any non-transitory computer readable storage medium other than a computer readable storage medium, which may transmit, propagate, or convey a program for use by or in connection with an instruction execution system, apparatus, or device. The program codes on the non-transitory computer readable storage medium may be conveyed by any appropriate medium, including but not limited to wireless, a wire, fiber optic cable, RF, etc., or any suitable combination thereof.
The flowchart and block diagram in the figures illustrate an architecture, functionality, and operation possibly implemented by the apparatus, the method and the computer program product according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of codes, which includes one or more executable instructions for implementing a specified logical function. It should also be noted that, in some alternative implementations, the function noted in the block may occur in a different order from that noted in the figures. For example, two blocks connected to each other may, in fact, denote to be executed substantially concurrently, or the blocks may sometimes be executed in a reverse order, depending upon the functionality involved. It should also be noted that each block in the block diagram and/or the flowchart, and combinations of blocks in the block diagram and/or the flowchart, may be implemented by a special purpose hardware-based system that performs the specified function or act, or by a combination of a special purpose hardware and computer instructions.
It will be understood that the above embodiments are merely exemplary embodiments adopted to illustrate the principles of the present disclosure, and the present disclosure is not limited thereto. It will be apparent to one of ordinary skill in the art that various modifications and improvements can be made without departing from the spirit and scope of the present disclosure, and such modifications and improvements are also considered to be within the scope of the present disclosure.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/CN2023/114149 | 8/22/2023 | WO |