The disclosures herein relate to image display control devices, image display systems and image display control methods.
In recent years, in an image display control device, which is a device to display on a display device having a backlight in which a plurality of light sources are arranged in an array, local dimming to adjust luminance of respective light sources according to luminance of an input image has been known. The local dimming enables to reduce power consumption while improving a contrast ratio.
A backlight unit including a plurality of LED elements capable of independently controlling an amount of light emitted, and a plurality of optical sensors to detect the luminance of respective LED elements is known. In this type of backlight unit, when one of the optical sensors fails, another optical sensor is used instead of the failed optical sensor to estimate the luminance of the LED element corresponding to the failed optical sensor (e.g., see Patent Literature (PTL) 1).
If any of a plurality of light emitting regions included in a light source for illumination of a liquid crystal panel fails, a method for moving an image of a display region corresponding to the failed light emitting region to a display region corresponding to a normal light emitting region is known (e.g., see PTL 2).
For example, an image display control device that performs local dimming has a luminance control unit that adjusts the luminance of a plurality of light sources according to the luminance of an input image, and a pixel compensation unit that adjusts the luminance of an image according to an adjusted luminance of the light sources. If an abnormality occurs in the luminance control unit, the luminance or color of the image displayed on the display device may change.
For example, a part of the abnormality in the luminance control unit can be detected by a cyclic redundancy check (CRC) or the like that detects an abnormality in communication between the luminance control unit and a driver that drives the light sources. However, for example, if an image (video) is displayed in a state where each light source is not turned off but is still emitting light, it is difficult to confirm whether or not the luminance output value from the luminance control unit to the driver is normal. For example, an abnormality in the luminance output value can be determined by implementing identical circuits in parallel and comparing two outputs. However, in this case, a circuit size increases and a cost of the image display control device increases.
An object of the present invention is to detect the abnormality in the luminance control unit to control the luminance of the plurality of light sources mounted on the image display control device having a local dimming function.
According to an embodiment of the present invention, an image display control device having a local dimming function, includes a luminance control unit configured to generate backlight control information used for controlling a plurality of light sources included in a backlight based on first image information indicating an input image, a pixel compensation unit configured to generate second image information indicating an output image by correcting one or more pixel values included in the first image information based on luminance of the plurality of light sources, a first statistics acquisition unit configured to acquire first statistical data of the pixel values included in the first image information, a second statistics acquisition unit configured to acquire second statistical data of one or more luminance values included in the backlight control information, the luminance values corresponding to the light sources, and an abnormality detection unit configured to detect an abnormality of the luminance control unit according to whether or not the second statistical data is included in a range between an upper limit value and a lower limit value, the upper limit value and the lower limit value being determined by the first statistical data.
According to the disclosed technology, an abnormality in a luminance control unit to control luminance of a plurality of light sources mounted on an image display control device having a local dimming function can be detected.
In the following, embodiments of the present invention will be described with reference to the accompanying drawings. In the following description, image data may be referred to simply as an image.
The head unit 10 generates an image to be displayed on the display 50. The head unit 10 outputs image data 10a and control information 10b corresponding to the generated image to the serializer 20. For example, the control information 10b includes information used for control when displaying the image on the display 50. For example, the image data 10a may include a superimposed image such as an icon superimposed on an original image.
The serializer 20 converts the image data 10a and control information 10b output from the head unit 10 into serial data 20a. The serializer 20 transmits the serial data 20a acquired by the conversion to the deserializer 30 via one video link (transmission line). Although not specifically limited, transmission and reception of the serial data 20a via the video link is performed using an interface such as LVDS (Low Voltage Differential Signaling) or APIX (Automotive Pixel Link).
The deserializer 30 converts the serial data 20a received via the video link into image data 30a and control information 30b. The image data 30a and the control information 30b correspond to the original image data 10a and the control information 10b output by the head unit 10, respectively. The deserializer 30 outputs the image data 30a and the control information 30b acquired by the conversion to the display controller 40.
The display controller 40 outputs information 40a, including image data that specifies the image to be displayed on the display 50, based on the image data 30a and the control information 30b received from the deserializer 30. The display controller 40 also outputs information 40b that controls the luminance of the backlight 60 to the backlight 60, based on the image data 30a and the control information 30b. The display controller 40 is an example of an image display control device.
Although not specifically limited, the image data input to the display controller 40 and the image data output from the display controller 40 include pixel values of red (R) pixels, green (G) pixels, and blue (B) pixels representing RGB color space.
The display 50 is, for example, a liquid crystal display including a liquid crystal shutter to adjust transmittance of light emitted from the backlight 60 and a color filter to receive light transmitted through the liquid crystal shutter. The display 50 may be a display other than a liquid crystal display as long as the transmittance of light emitted from the backlight 60 can be adjusted. The display 50 is an example of a display unit.
The backlight 60 includes a plurality of LED (Light Emitting Diode) light sources arranged in a matrix, and is arranged to face a surface of the display 50 opposite the image display surface. Hereinafter, a light irradiation zone corresponding to each LED light source in the display 50 is referred to as an LED zone. In place of the plurality of LED light sources arranged in a matrix, the backlight 60 may include a plurality of other light sources with adjustable luminance.
For example, the image display system 1 may be mounted on a vehicle. In this case, the display device 70 may be used, for example, to display an instrument cluster on an instrument panel or a center information display (CID). Alternatively, the display device 70 may be used for a head-up display to project an image onto a windshield.
The image display system 1 mounted on the vehicle is designed to satisfy requirements of ASIL (Automotive Safety Integrity Level). The image display system 1 equipped with the backlight and having a local dimming function is not limited to an in-vehicle application, and may be used for other image display systems such as digital signage.
For example, the display controller 40 performs a local dimming process to adjust independently the luminance of a plurality of LED backlights in accordance with the luminance (e.g., pixel values) of the image displayed on the display 50. In the local dimming process, the display controller 40 performs compensation control for suppressing an increase in the luminance of a surrounding image due to light leaking around a position facing the lit LED backlight. The local dimming process can improve the reproducibility of black in an image displayed on the display 50 while suppressing the power consumption of the backlight 60.
The display engine 200 includes an image input unit 210, a memory 220, a warping unit 230, an input color statistics acquisition unit 240, a local dimming unit 250, an output luminance statistics acquisition unit 260, an image output unit 270, and a register interface 280. The local dimming unit 250 includes a luminance control unit 251 and a pixel compensation unit 252. For example, each element of the display engine 200 operates as controlled by the processor 400. Although not specifically limited, the display engine 200 processes image data representing an RGB color space.
The image input unit 210 receives image data (e.g., input images per frame) transmitted from the deserializer 30 shown in
The input color statistics acquisition unit 240 sequentially acquires the average input video luminance AIVB, which is the average of pixel values of one screen (one frame) included in the input image data VIN input from the warping unit 230 to the local dimming unit 250. For example, the input color statistics acquisition unit 240 acquires the average input video luminance AIVB by calculation. The average input video luminance AIVB is an example of first statistical data. The input image data VIN is an example of first image information, and the input color statistics acquisition unit 240 is an example of first statistical acquisition unit.
The input color statistics acquisition unit 240 outputs the acquired average input video luminance AIVB to the processor 400 via the register interface 280 and the bus 500. The input color statistics acquisition unit 240 may have a storage unit such as a buffer to store the average input video luminance AIVB. In this case, the average input video luminance AIVB stored in the storage unit may be read by the processor 400.
The display controller 40 has a local dimming function. That is, the luminance control unit 251 of the local dimming unit 250 generates a backlight control signal BLCNT to adjust the luminance of the backlight 60 shown in
The luminance control unit 251 also outputs luminance information LINF indicating the luminance of each of the plurality of LED light sources of the backlight 60 to the output luminance statistics acquisition unit 260. For example, the luminance information LINF may include the same information as the information included in the backlight control signal BLCNT indicating the luminance of each of the plurality of LED light sources, or may be the backlight control signal BLCNT itself. A method of adjusting the luminance of the backlight 60 by the luminance control unit 251 will be described with reference to
The pixel compensation unit 252 of the local dimming unit 250 corrects the pixel value (e.g., a luminance value) of the input image data VIN based on the luminance of the backlight 60 adjusted by the luminance control unit 251, and outputs the corrected pixel value to the image output unit 270 as the output image data VOUT. The output image data VOUT is an example of the second image information. For example, the pixel compensation unit 252 corrects the pixel value of the region where the luminance of the backlight 60 is high to relatively small, and corrects the pixel value of the region where the luminance of the backlight 60 is low to relatively large. At that time, the pixel compensation unit 252 corrects the pixel value in consideration of the leakage of light into the surroundings of each LED light source. An image correction method by the local dimming unit 250 is described in
The output luminance statistics acquisition unit 260 sequentially acquires luminance information LINF output from the local dimming unit 250 for each screen (or frame). The output luminance statistics acquisition unit 260 acquires average backlight luminance ABB, which is an average luminance of each LED light source included in the luminance information LINF. For example, the output luminance statistics acquisition unit 260 acquires average backlight luminance ABB by calculation. The average backlight luminance ABB is an example of second statistical data. The output color statistics acquisition unit 290 is an example of the second statistics acquisition unit.
The output luminance statistics acquisition unit 260 outputs the acquired average backlight luminance ABB to the processor 400 via the register interface 280 and the bus 500. The output luminance statistics acquisition unit 260 may have a storage unit such as a buffer to store the average backlight luminance ABB. In this case, the average backlight luminance stored in the storage unit may be read out by the processor 400.
The image output unit 270 transmits the output image data VOUT (e.g., an output image per frame) received from the local dimming unit 250 to the display 50 shown in
The memory 300 stores, for example, an image display control program executed by the processor 400 and data used in the image display control program. The processor 400 is a controller such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). For example, the processor 400 controls the operation of the display controller 40 by executing the image display control program.
The processor 400 detects the abnormality of the luminance control unit 251 based on the average input video luminance AIVB acquired by the input color statistics acquisition unit 240 and the average backlight luminance ABB acquired by the output luminance statistics acquisition unit 260 by executing the image display control program, for example. The functional unit to detect the abnormality of the luminance control unit 251 in the processor 400 is an example of an abnormality detection unit. The processor 400 can facilitate or hinder the detection of the abnormality based on threshold information received from outside the processor 400. The threshold information may be supplied from outside the image display system 1.
When the processor 400 has not acquired one or both of the average input video luminance AIVB from the input color statistics acquisition unit 240 and the average backlight luminance ABB from the output luminance statistics acquisition unit 260, the abnormality detection process of the luminance control unit 251 is prevented. The abnormality detection process of the luminance control unit 251 will be described with reference to
The luminance distribution calculation unit 253 receives luminance information LINF indicating the luminance of each LED light source received from the luminance control unit 251, and LSF (Lighting Spread Function) which is a luminance distribution function when only one LED light source is lit up. Based on the luminance information LINF and the luminance distribution function LSF, the luminance distribution calculation unit 253 generates a luminance distribution of the backlight 60 in consideration of the leakage of light into the surroundings of each LED light source, and outputs information indicating the generated luminance distribution to the RGB correction unit 254. For example, the luminance distribution generated by the luminance distribution calculation unit 253 indicates the distribution of luminance values of the backlight 60 in each pixel of the display 50, and is indicated by a value greater than 0 and less than 1. The lower the luminance value of the luminance distribution, the closer to 0, and the higher the luminance value, the closer to 1.
Based on the luminance distribution (luminance value), the RGB correction unit calculates a gain of a pixel value to be applied to each pixel of the display 50 using formula (1). According to formula (1), the minimum value of the gain is one and the maximum value of the gain is infinity. Here, infinity is the maximum value that can be expressed by the number of bits representing the gain.
The RGB correction unit 254 calculates a correction value of the pixel value of each color component by multiplying the pixel value of each color component of a corresponding pixel included in the input image data VIN by the gain calculated by formula (1) using formulae (2-1), (2-2), and (2-3). Symbol R in formula (2-1) refers to the pixel value of a red pixel. Symbol G in formula (3-2) refers to the pixel value of a green pixel. Symbol B in formula (2-3) refers to the pixel value of a blue pixel.
For example, the pixel value of each color component of each pixel of the input image data VIN is normalized to be between 0 and 1. Therefore, when the image input unit 210 shown in
For example, each pixel value of the image data VC is expressed by twelve bits, and the minimum value is 0 and the maximum value is 4095. Note that each pixel value of the image data VC may be expressed by a number of bits other than twelve bits (e.g., ten bits or fourteen bits, etc.). When each pixel value of the input image data VIN is expressed by eight bits (0 to 255), each pixel value of the image data VC may be expressed by twenty bits (0 to 1048576).
The saturation processing unit 255 generates output image data VOUT by setting the highest pixel value of the image data VC to 1 and normalizing the other pixel values to 0 or more and less than 1. The saturation processing unit 255 outputs the generated output image data VOUT to the display 50.
Then, the luminance control unit 251 calculates the luminance of each LED zone using formula (3), outputs the backlight control signal BLCNT indicating the luminance found by the calculation to the backlight 60, and outputs the luminance information LINF to the pixel compensation unit 252 and the output luminance statistics acquisition unit 260. In formula (3), symbol α is a parameter for adjusting the luminance, and is set, for example, from 0 to 1. For example, when the luminance adjustment parameter α is 0.5, the maximum value ZMAX and the average value ZAVE are mixed by 50%. For example, the luminance adjustment parameter α may be set by a user using the image display system 1 or may be set externally.
In the formula shown in
For this reason, the RGB correction unit 254 calculates the gain for each pixel (for each RGB component) of the input image data VIN using formula (1), and corrects the pixel value by multiplying the calculated gain by the pixel value of the input image data VIN, thereby canceling the luminance of the backlight 60. As a result, the luminance of the image displayed on the display 50 can be correctly set using the light from the backlight 60 in which the luminance of the LED light source is individually adjusted according to the luminance of the image.
In the pixel value saturation process by the saturation processing unit 255 in
The input color statistics acquisition unit 240 finds the maximum value MAX (the maximum value among the pixel value of a red pixel, the pixel value of a green pixel, and the pixel value of a blue pixel) of pixel values for each pixel in all pixels of the input image data VIN of each frame. The input color statistics acquisition unit 240 finds the average input video luminance AIVB by dividing the total of the maximum values MAX of all pixels by the total number of pixels.
The output luminance statistics acquisition unit 260 acquires the luminance (set luminance) of each LED light source of the backlight 60 based on the luminance information LINF received from the luminance control unit 251. The output luminance statistics acquisition unit 260 acquires the average backlight luminance ABB by dividing the acquired total luminance of each LED light source by the total number of LED light sources.
For example, when the pixel value of at least one pixel in the pixel region corresponding to the LED zone that is the irradiation zone of one LED light source is “1” (i.e., white), the maximum value ZMAX of formula (3) is “1”. In formula (3), when the maximum value ZMAX is “1” and the luminance adjustment parameter α is greater than “0”, the luminance of the LED zone found according to formula (3) is higher than the average value ZAVE of the pixel values in the pixel region corresponding to the LED zone, and reaches the upper limit. Therefore, applying this condition (ZMAX=“1”) to formula (3), the average input video luminance AIVB is used instead of the average value ZAVE of the pixel values corresponding to the LED zone of formula (3), and the upper threshold is found according to formula (4).
The luminance of each LED zone shown in formula (3) is the average value ZAVE when the luminance adjustment parameter α is “0”. Therefore, the condition (α=“0”) is applied to formula (3), the average input video luminance AIVB is used instead of the average value ZAVE of the pixel values corresponding to the LED zone in formula (3), and the lower threshold is found by formula (5).
For example, when α=“0.5” and the average input video luminance of the judgment target frame AIVB=“0.5”, the upper threshold is “0.75” according to formula (4), and the lower threshold is “0.5” according to formula (5).
Then, when the average backlight luminance ABB is not in the range sandwiched between the upper threshold and the lower threshold in the average input video luminance AIVB of the judgment target frame, the processor 400 judges that the luminance control unit 251 is abnormal (black circle: NG). For example, the abnormality of the luminance control unit 251 occurs due to an abnormality in the generation process of the luminance information LINF and the backlight control signal BLCNT. Conversely, when the average backlight luminance ABB of the average input video luminance AIVB of the judgment target frame is in the range sandwiched between the upper threshold and the lower threshold, the processor 400 judges that the luminance control unit 251 is normal (white circle: OK).
First, in step S10, the processor 400 causes the image input unit 210 to acquire frame image data. Next, in step S20, the processor 400 causes the input color statistics acquisition unit 240 to acquire the average input video luminance AIVB of the input image data VIN.
Next, in step S30, the processor 400 finds the upper threshold and lower threshold values of the average backlight luminance ABB based on the average input video luminance AIVB acquired in step S20. After step S10, in step S40, the processor 400 causes the output luminance statistics acquisition unit 260 to acquire the average backlight luminance ABB.
After steps S30 and S40, in step S60, the processor 400 determines whether or not the average backlight luminance ABB acquired in step S40 is within the range of the upper threshold and lower threshold found in step S30. If the average backlight luminance ABB is within the range of the upper threshold and lower threshold, the processor 400 determines that the luminance control unit 251 is normal, and returns the process to step S10. If the average backlight luminance ABB is not within the range of the upper threshold and lower threshold, the processor 400 determines that the luminance control unit 251 is abnormal, and shifts the process to step S70.
In step S70, the processor 400 determines whether or not the contents of the image displayed on the display 50 have been switched. When the contents have been switched, the processor 400 determines that a deviation of either the average input video luminance AIVB or the average backlight luminance ABB, or of both has increased due to the switching of the contents, and that the abnormality of the luminance control unit 251 has been determined.
The processor 400 then returns the process to step S10. That is, if the contents of the image have been switched, the processor 400 prevents the abnormality detection process of the luminance control unit 251 even if the average backlight luminance ABB is not within the upper threshold and lower threshold ranges. If the contents have not been switched, the processor 400 determines that the abnormality has occurred in the luminance control unit 251, and the process proceeds to step S80.
In step S80, the processor 400 performs the process when the abnormality of the luminance control unit 251 is detected, and ends the process shown in
When the processor 400 determines that the contents are switched in step S70, it may return the process to step S10 by assuming that the luminance control unit 251 is normal without determining the abnormality in step S60 for a duration of at least one frame.
The processor 400 may also prevent the detection process of the abnormality of the luminance control unit 251 by step S60 for a duration of at least one frame when the image display system 1 or the display controller 40 is started. The processor 400 may return the process to step S10 by assuming that the luminance control unit 251 is normal without determination in step S60. Thus, it is possible to prevent the erroneous detection of the abnormality of the luminance control unit 251 due to video disturbance or the like when the contents are switched or the device is started.
Next, in step S82, the processor 400 stops the dimming operation performed by the local dimming unit 250, causes all the LED light sources of the backlight 60 to be turned on, and sets the backlight 60 to the preset luminance (e.g., maximum luminance). That is, the processor 400 causes all the LED light sources to be turned on at the predetermined luminance regardless of the operation of the luminance control unit 251. Thus, when the abnormality in the luminance control unit 251 is a decrease in luminance, it is possible to display an image on the display 50 without a decrease in luminance.
Next, in step S83, the processor 400 determines whether the display of an icon indicating the abnormality in the luminance control unit 251 is permitted. If the display of an icon indicating an abnormality is permitted, the processor 400 proceeds to step S84. If the display of an icon indicating an abnormality is not permitted, the processor 400 ends the process shown in
In step S84, the processor 400 causes the display 50 to display an icon indicating an abnormality, and ends the process shown in
As described above, in the present embodiment, it is possible to detect an abnormality of the luminance control unit 251 that cannot be detected conventionally based on the input image data VIN input to the pixel compensation unit 252 and the luminance information LINF output from the luminance control unit 251.
The processor 400 finds an upper threshold and a lower threshold of the average backlight luminance ABB to determine an abnormality of the luminance control unit 251 based on the average input video luminance AIVB of the input image data VIN input to the local dimming unit 250. Thus, the upper threshold value and the lower threshold value for detecting the abnormality of the luminance control unit 251 can be appropriately set in accordance with the characteristics of the image represented by the input image data VIN for each frame. As a result, the determination accuracy of the abnormality of the luminance control unit 251 can be improved.
The processor 400 does not detect the abnormality of the luminance control unit 251 for a duration of at least one frame when the contents are switched, or the display controller 40 or the like is started. Thus, it is possible to prevent the erroneous detection of the abnormality of the luminance control unit 251 due to video disturbance or the like when the contents are switched or the device is started.
When the abnormality of the luminance control unit 251 is detected, the processor 400 stops the pixel value correction operation by the pixel compensation unit 252. Thus, when the luminance information LINF is not normal due to the abnormality of the luminance control unit 251 and the luminance distribution calculation unit 253 cannot generate a normal luminance distribution, it is possible to prevent the RGB correction unit 254 from generating image data VC using an erroneous luminance distribution.
When the abnormality of the luminance control unit 251 is detected, by turning on all the LED light sources of the backlight 60, when the abnormality of the luminance control unit 251 is a decrease in luminance, it is possible to display an image on the display 50 without reducing luminance. When an abnormality of the luminance control unit 251 is detected, an icon indicating the abnormality can be displayed on the display 50 to notify the user or the like of the abnormality of the luminance control unit 251. In practice, the icon indicating the abnormality is one or both of a graphic and a character by which the user or the like can recognize the abnormality of the display controller 40.
Furthermore, even when a normal local dimming process is not performed due to the occurrence of the abnormality of the luminance control unit 251 and the contrast of the image displayed on the display device 70 is low, the abnormality of the luminance control unit 251 can be detected and the LED light source of the backlight 60 can be fully turned on. As a result, the contrast of the image displayed on the display device 70 can be increased, thereby satisfying the requirement of the ASIL.
The display controller 40A has a display engine 200A instead of the display engine 200 of
The output color statistics acquisition unit 290 sequentially acquires the average output image luminance AOVB, which is the average of pixel values of one screen (one frame) included in the output image data VOUT output from the local dimming unit 250 to the image output unit 270. For example, the output color statistics acquisition unit 290 acquires the average output image luminance AOVB by calculation.
In the present embodiment, the average input video luminance AIVB is an example of the first statistical data. The input color statistics acquisition unit 240 is an example of the first statistical data acquisition unit. The average output image luminance AOVB is an example of the second statistical data. The output color statistics acquisition unit 290 is an example of the second statistics acquisition unit. The average backlight luminance ABB is an example of the third statistics data. The output luminance statistics acquisition unit 260 is an example of the third statistics acquisition unit.
The output color statistics acquisition unit 290 outputs the acquired average output image luminance AOVB to the processor 400 via the register interface 280 and the bus 500. The output color statistics acquisition unit 290 may have a storage unit such as a buffer to store the average output image luminance AOVB. In this case, the average output image luminance AOVB stored in the storage unit may be read out by the processor 400.
The input color statistics acquisition unit 240 acquires the average input video luminance AIVB, which is statistical data of the input image data VIN normalized from 0 to 1. The output color statistics acquisition unit 290 acquires the average output image luminance AOVB, which is statistical data of the output image data VOUT normalized from 0 to 1. Thus, the processor 400 can calculate the upper threshold and lower threshold values described later without matching the scales (number of bits, etc.) of the average input video luminance AIVB and the average output image luminance AOVB to each other.
The output color statistics acquisition unit 290 finds the maximum value MAX (maximum value among the pixel value of a red pixel, the pixel value of a green pixel, and the pixel value of a blue pixel) of pixel values for each pixel in all pixels of the output image data VOUT of each frame. Then, the output color statistics acquisition unit 290 finds the average output video luminance AOVB by dividing the total of the maximum values MAX of all pixels by the number of all pixels.
As described in
For example, in Formula (7), “input image data VIN” can be approximated to “average input video luminance AIVB” acquired by input color statistics acquisition unit 240. “Output image data VOUT” can be approximated to “average output image luminance AOVB” acquired by the output color statistics acquisition unit 290. “Backlight luminance” can be approximated to “average backlight luminance ABB” acquired by the output luminance statistics acquisition unit 260. Formula (8) is derived by replacing formula (7) with the respective approximated terms. That is, “average backlight luminance ABB×average output image luminance AOVB” has a value corresponding to (approximating) “average input video luminance AIVB”.
In the present embodiment, when “average backlight luminance ABB×average output image luminance AOVB” in “average input video luminance AIVB” acquired by the input color statistics acquisition unit 240 does not fall within a predetermined range, the processor 400 determines an abnormality of the luminance control unit 251. The predetermined range is indicated by an upper threshold value and a lower threshold value. “Average backlight luminance ABB×average output image luminance AOVB” is an example of output statistical data. The upper threshold value is an example of an upper limit value, and the lower threshold value is an example of a lower limit value.
Here, as described with reference to
Therefore, “average backlight luminance ABB×average output video luminance AOVB” in formula (8) does not exceed the product of the actual luminance of the backlight 60 and the output image data VOUT output from the pixel compensation unit 252, and the upper threshold of “average backlight luminance ABB×average output video luminance AOVB” in formula (8) does not exceed the average input video luminance AIVB. Therefore, “average input video luminance AIVB” itself is set to the upper threshold (formula (9)).
Since the “average backlight luminance ABB×average output video luminance AOVB” is smaller than the average value of the actual luminance of the LED zones of the backlight 60, the lower threshold of “average backlight luminance ABB” must be set in consideration of the bleed from the adjacent LED zones. For this reason, the lower threshold is set to a value found by multiplying the “average input video luminance AIVB” by the luminance adjustment parameter β(0<β<1) (formula (10)). The luminance adjustment parameter β is an example of a coefficient to be multiplied by the average input video luminance AIVB. For example, the luminance adjustment parameter β is set to the ratio A/B between the area A and the area B shown in
The “average input video luminance AIVB” in formula (9) and the “average input video luminance AIVB×β” in formula (10) are examples of input statistical data. When the “average backlight luminance ABB×average output video luminance AOVB” of the frame to be determined is not within the range sandwiched between the upper threshold and the lower threshold shown in formulae (9) and (10), the processor 400 determines an of abnormality the luminance control unit 251 (black circle: NG). When the “average backlight luminance ABB×average output video luminance AOVB” of the frame to be determined is included in the range sandwiched between the upper threshold and the lower threshold shown in formulae (9) and (10), the processor 400 determines that the luminance control unit 251 is normal (white circle: OK).
In the flowchart shown in
In step S30A, the processor 400 finds an upper threshold value and a lower threshold value corresponding to the product of the average backlight luminance ABB and the average output image luminance AOVB based on the average input video luminance AIVB acquired in step S20 and the preliminarily found luminance adjustment parameter β. Next, in step S50, the processor 400 causes the output color statistics acquisition unit 290 to acquire the average output image luminance AOVB of the output image data VOUT. Step S50 may be performed in parallel with steps S20 and S40.
After steps S40 and S50, in step S60A, the processor 400 finds the product “ABB×AOVB” of the average backlight luminance ABB and the average output image luminance AOVB acquired in steps S40 and S50. Then, the processor 400 determines whether or not the found product “ABB×AOVB” is within the range of the upper threshold and lower threshold values found in step S30A.
When the product “ABB×AOVB” is within the range of the upper threshold and lower threshold, the processor 400 determines that the luminance control unit 251 is normal, and returns the process to step S10. When the product “ABB×AOVB” is not within the range of the upper threshold and lower threshold, the processor 400 determines that the luminance control unit 251 is abnormal, and returns the process to step S70. The processes of steps S70 and S80 are same as those of steps S70 and S80 in
As described above, the same effects as those of the above-described embodiment can be acquired in the present embodiment. For example, based on the input image data VIN input to the pixel compensation unit 252, the output image data VOUT output from the pixel compensation unit 252, and the luminance information LINF output from the luminance control unit 251, it is possible to detect abnormalities of the luminance control unit 251 that could not be detected conventionally.
Furthermore, in the present embodiment, the processor 400 can determine the upper threshold value and the lower threshold value without using the luminance adjustment parameter α. Thus, it is possible to prevent the upper threshold value and the lower threshold value from changing depending on the luminance adjustment parameter α set by the user or the like. As a result, for example, it is possible to prevent the normal range of the luminance of the backlight 60 set by the upper threshold value and the lower threshold value from widening depending on the luminance adjustment parameter α, and it is possible to prevent the detection accuracy of abnormalities of the luminance control unit 251 from deteriorating.
Incidentally, in the first and second embodiments described above, an example of calculating the upper and lower threshold values in step S30 of
In the first and second embodiments described above, the upper and lower threshold values are found based on all the pixel values of the input image data VIN input by the local dimming unit 250, and the abnormality of the luminance control unit 251 is detected based on the found upper and lower threshold values. However, instead of all the pixel values included in the input image data VIN, the upper and lower threshold values may be found based on the pixel values of pixels having a smaller number of images acquired by thinning out a part of the pixels included in the input image data VIN. In this case, the calculation load of the input color statistics acquisition unit 240 and the output color statistics acquisition unit 290 can be reduced, and the calculation load of the upper and lower threshold values by the processor 400 can be reduced. As a result, an increase in the power consumption of the display controllers 40 and 40A can be suppressed.
Further, the present invention is not limited to these embodiments, but various variations and modifications may be made without departing from the scope of the present invention.
This application is a continuation application of International Application No. PCT/JP2022/029076, filed on Jul. 28, 2022, and designated the U.S., the entire contents of which are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2022/029076 | Jul 2022 | WO |
Child | 19033122 | US |