Patent Application
20240331118
The present invention relates to a method of processing multiple image sources, a related display device and a computer-readable medium, to a method of processing multiple image sources, a related display device and a computer-readable medium capable of dynamically applying different electro-optical transfer functions on multiple image sources.
High Dynamic Range (HDR) signal source may provide more detail and contrast of images, and is commonly utilized in conventional upper-intermediate, advanced displays. When a user activates a picture-in-picture (PiP) function and adjusts a resolution setting of the display, identical image settings are applied on different image sources of the PiP images with conventional technique, which cannot provide a good user experience. For example, since the conventional display can only apply the identical image settings on the PiP images, when a picture of the PiP images is a standard dynamic range (SDR) image source and another picture of the PiP images is HDR image source, abnormal SDR images might be generated when applying the settings of the HDR signal resources, and vice versa.
Therefore, improvements are necessary to the conventional technique.
In light of this, the present disclosure provides a method of processing multiple image sources, a related display device and a computer-readable medium, which dynamically applies different EOTFs on the image sources to optimize scenes of pictures on the display device.
An embodiment of the present disclosure discloses a processing method for a plurality of image sources, for a display device, comprises inputting said a plurality of image sources; detecting the said a plurality of image sources according to metadata of the said a plurality of image sources to determine electro-optical transfer function (EOTF) corresponding to the said a plurality of image sources; and dynamically applying different EOTFs on corresponding image sources
Another embodiment of the present disclosure discloses a display device, comprises a display panel, configured to display a screen image; a plurality of input interfaces, configured to receive a plurality of image sources; and a scaler, configured for processing said a plurality of image sources, and detecting said a plurality of image sources according to metadata of said a plurality of image sources, so as to determine electro-optical transfer function (EOTF) corresponding to said a plurality of image sources; and dynamically applying different EOTFs on corresponding image sources.
Another embodiment of the present disclosure discloses a computer readable medium, comprises a computer program product, the computer program product is configured for executing a processing method for a plurality of image sources on a display device having a display panel, a plurality of input interfaces and a scaler, and the display panel is configured for displaying a screen image, the plurality of input interfaces are configured for receiving said a plurality of image sources, and the instructions executed by the scaler comprises processing said a plurality of image sources, detecting said a plurality of image sources according to metadata of said a plurality of image sources to determine electro-optical transfer function (EOTF) corresponding to said a plurality of image sources; and dynamically applying different EOTFs on corresponding image sources.
These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
Please refer to
The scaler 106 may detect the multiple image sources according to metadata of the multiple image sources to determine electro-optical transfer function (EOTF) corresponding to the multiple image sources, and to dynamically apply different EOTFs on corresponding image sources, wherein the metadata includes a Maximum Content Light Level (MaxCLL), a Maximum Frame Average Light Level (MaxFALL), and a Minimum Content Light Level (MinCLL) of the image source. Therefore, the display device 10 according to an embodiment of the present disclosure may present better screen images by applying optimal EOTF on the image sources.
In detail, please refer to
Based on the processing method 20 for multiple image sources, the scaler 106 may perform decoding (i.e. step 204) for the image sources from different input interfaces or the smart TV embedded in the display device 10. In step 206, the scaler 106 may read the metadata of the image sources to determine whether the image sources belong to the HDR image source or not, if yes, a statistical analysis for the metadata of the HDR image source is performed to determine the EOTF of the HDR image source and the EOTF is applied on the HDR image sources.
In contrast, in step 210, when the scaler 106 determines that the image sources does not belong to the HDR image source according to the metadata of the image sources, the image sources may be determined as standard dynamic range (SDR) image sources. In this embodiment, the scaler 106 directly applies the Gamma correction on the SDR image resources.
In step 208, the scaler 106 may perform the dynamic tone mapping process for the HDR image sources to detect variations of each frame of the HDR image sources, and to dynamically adjust appropriate EOTF when the HDR image source is varied.
The display device 10 according to an embodiment of the present disclosure may analyze the variations of each frame of the HDR image source, and apply optimal EOTF on the HDR image source according to a variation result of the image. Please refer to
Based on the dynamic tone mapping method 30, the scaler 106 of the display device 10 according to an embodiment of the present disclosure may dynamically apply the default EOTFs EOTF_1 to EOTF_n on the HDR image source. For example, the scaler 106 in step 306_1 determines that the EOTF EOTF_1 is appropriate for current frame of the HDR image source, the EOTF EOTF 1 is applied thereon (step 306_1_1) . Then, when variation of the following frame of the HDR image source is detected (step 306_1_2), goes back to step 304 to look for other appropriate EOTF. In contrast, when no variation of the following frame of the HDR image source is detected by the scaler 106 (step 306_1_2), current HDR image source is outputted with identical EOTF in step 308
Therefore, the display device 10 according to an embodiment of the present disclosure may dynamically adjust the EOTF applied on the HDR image source.
In order to avoid screen flickering caused by severe variation of the HDR image source, the display device 10 according to an embodiment of the present disclosure may further perform the temporal filtering for the HDR image source. Please refer to
Based on the temporal filtering method 40, the display device 10 according to an embodiment of the present disclosure may respectively detect the moving vector between the first frame and the second frame of the HDR image source in step 404, determine the pixel difference of the first frame and the second frame of the HDR image source in step 406, and determine whether the pixel difference of the first frame and the second frame of the HDR image source exceeds a default value or not in step 408. As such, the scaler 106 of the display device 10 may determine whether the pixel difference of the first frame and the second frame of the HDR image source is larger than the default value or not accordingly to perform the smooth filtering in step 410. In contrast, when the pixel difference determined by the scaler 106 does not exceed the default value in step 408, the scaler 106 directly outputs the HDR image source in step 412.
Notably, the default value is related to a ratio of the pixel difference of each frame, e.g. when the pixel difference between the second frame and the first frame exceeds ⅓ of the first frame, the variation of the screen image of the HDR image source is too severe, and the smooth filtering is necessary to the HDR image source, wherein the smooth filtering is configured to perform image blending according to a similarity ratio of the current frame (i.e. the first frame) and the following frame (i.e. the second frame).
In contrast, when the pixel difference between the second frame and the first frame does not exceed ⅓ of the first frame, the original HDR image source is outputted. Therefore, the display device 10 according to an embodiment of the present disclosure may dynamically detect the inputted image sources to dynamically adjust the EOTF applied on the HDR image source to optimize the screen image.
Notably, the display device 10 according to an embodiment of the present disclosure may not only support the PiP function but also the POP function. In other words, when one of images of the PiP screen is sourced from high dynamic rage (HDR) content, the processing method 20 for multiple image sources as described in an embodiment of the present disclosure, may dynamically apply the EOTF on the HDR image source and apply the Gamma correction on the SDR image sources.
In another embodiment, when pictures of the PiP screen of the display device 10 are the HDR image sources, the processing method 20 for multiple image sources according to an embodiment of the present disclosure may apply the EOTF on the HDR image sources to optimize the screen image.
In another embodiment, a computer readable medium, e.g. a memory device of a processor or an external memory device operable by the processor, includes a computer program product for executing the processing method 20 for multiple image sources of the display device 10.
Notably, the content of the EOTF as described in the above embodiments, the default value for determining a variation of the screen are not limited thereto and can be modified according to different user requirements or system settings, which are all within the scope of the present disclosure.
In summary, the present disclosure provides a method of processing multiple image sources, a related display device and a computer-readable medium, which dynamically applies different EOTFs on the image sources to optimize scenes of pictures on the display device.
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 112111476 | Mar 2023 | TW | national |
