This application is a National Phase of PCT Patent Application No. PCT/CN2021/097499 having International filing date of May 31, 2021, which claims the benefit of priority of Chinese Patent Application No. 202110018233.4 filed on Jan. 7, 2021. The contents of the above applications are all incorporated by reference as if fully set forth herein in their entirety.
The present disclosure relates to the field of display technologies, and more particularly, to a holographic display method and a holographic display system.
Liquid crystal display (LCD) devices are one of common electronic devices. They have features such as low power consumption, small size, and light weight, and therefore are popular among customers. Conventional LCD devices are mainly thin-film transistor (TFT) LCD devices. In LCD devices, an arrangement of liquid crystal molecules can be controlled by determining if a voltage is applied to an electrode substrate. As such, light is blocked or is able to pass through a liquid crystal layer, thereby realizing a grayscale display. However, when the LCD devices are applied to holographic display technologies, a color shading issue commonly occurs on the LCD devices due to optical-anisotropic properties of liquid crystals and influences of viewing angles and voltage. Therefore, colors of images are distorted when the images are viewed at different viewing angles, which affects a viewing experience when the LCD devices are viewed at large viewing angles.
Nowadays, the color shading issue is usually addressed by adjusting hardware (for example, changing a four-domain pixel structure to an eight-domain pixel structure). However, if doing so, transmittance of LCD panels would be reduced, causing a reduction of a usage rate of the LCD panels.
Therefore, how to alleviate a color-shading issue occurring when LCD devices are viewed at different viewing angles without affecting transmittance of the LCD devices is a technical problem to be solved by those who are skilled in this art.
Regarding the technical problem: in conventional technologies, a four-domain pixel structure is changed to an eight-domain pixel structure to alleviate a color shading issue occurring when LCD devices are viewed at different viewing angles, which makes transmittance of LCD panels reduced, and further causes a reduction of a usage rate of the LCD panels.
In a first aspect, an embodiment of the present disclosure provides a holographic display method, including following steps:
In the holographic display method provided by the embodiment of the present disclosure, the S20 further includes:
In the holographic display method provided by the embodiment of the present disclosure, the S201 further includes:
In the holographic display method provided by the embodiment of the present disclosure, in the S2011, the feature extraction network is trained by a convolutional neural network module to obtain the original image feature information.
In the holographic display method provided by the embodiment of the present disclosure, in the S2012, in the area extraction network, using a plurality of sliding windows with different sizes to encircle parts of an area having the original image feature information as a selected area and creating a ROIs, wherein the ROIs is configured to extract the HOG feature of the selected area and output the HOG feature to the classification and position feedback network.
In the holographic display method provided by the embodiment of the present disclosure, the step of creating the ROIs further includes following steps:
In the holographic display method provided by the embodiment of the present disclosure, the S30 further includes following steps:
In the holographic display method provided by the embodiment of the present disclosure, in the S301, directly extracting the important feature of face from the human face information if the character of the human face area information does not wear glasses.
In the holographic display method provided by the embodiment of the present disclosure, the S302 further includes:
In the holographic display method provided by the embodiment of the present disclosure, the S40 further includes:
In the holographic display method provided by the embodiment of the present disclosure, the lateral viewing angle and the driving voltage information are obtained by following steps:
In a second aspect, an embodiment of the present disclosure provides a holographic display system, including a light beam controlling system, a light guiding system, a display device, and a target scene obtaining system;
wherein the target scene obtaining system is configured to obtain target scene information, the holographic display system recognizes a pupil position of the target scene information, calculates a lateral viewing angle between each pixel area and each pupil position in a display panel and a driving voltage value of each pixel area at the lateral viewing angle corresponding to each pixel area, and applies the driving voltage value to the corresponding pixel area.
In the holographic display system provided by the embodiment of the present disclosure, the target scene information includes image information of a moving character and image information of a stationary background.
In the holographic display system provided by the embodiment of the present disclosure, wherein the holographic display system recognizes human face area information of the target scene information according to a human face area detecting module, and confirms the pupil position of the human face area information.
In the holographic display system provided by the embodiment of the present disclosure, the pupil position is a relative position between a pupil of the eyes area information and the display panel.
In the holographic display system provided by the embodiment of the present disclosure, the target scene obtaining system includes a pupil tracker, the pupil tracker is a color camera; and the light beam controlling system includes a backlight module, the light guiding system includes a light guiding thin film or a light guiding plate, and the display device includes a liquid crystal display.
In the holographic display system provided by the embodiment of the present disclosure, an internal register of the display panel stores viewing angle and driving voltage information, and the holographic display system obtains the driving voltage value of each pixel area in the display device at a current lateral viewing angle according to the viewing angle and driving voltage information.
Regarding the beneficial effects: compared with conventional technologies, in an embodiment of the present disclosure, corresponding driving voltage values of each sub-pixel of a display image of a holographic display system viewed at different viewing angles are adjusted. Therefore, viewing angles of LCD panels could be increased without affecting transmittance of the LCD panels.
An embodiment of the present disclosure aims to solve a following technical problem: conventionally, a color shading issue occurring when LCD devices are viewed at different viewing angles is alleviated by adjusting hardware of the LCD devices, which causes transmittance of LCD panels to be reduced, and further results in a reduction of a usage rate of the LCD panels.
As shown in
Wherein, the display device 13 includes an LCD device, and the display device 13 is configured to display target scene information 20.
The target scene obtaining system 14 is configured to obtain the target scene information 20. The target scene obtaining system 14 includes a pupil tracker. Preferably, the pupil tracker is a color camera. The light beam controlling system 11 includes a backlight module. The light guiding system 12 includes a light guiding thin film or a light guiding plate. The light guiding system 12 is configured to increase a usage rate of the backlight module.
Specifically, the holographic display system recognizes a pupil position of the target scene information 20 and calculates a lateral viewing angle between each pixel area of the display device 13 and the pupil position and a driving voltage value of each pixel area viewed at the corresponding lateral viewing angle, and then applies the driving voltage values to the corresponding pixel area. Wherein, the lateral viewing angle is an angle between line of human sight and a plane of the display device 13. The pupil position is a relative position between a pupil of human eye and the display device 13.
Furthermore, the holographic display system recognizes human-face area information of the target scene information 20 by the human-face area detecting module, and confirms the pupil position of the human-face area information.
Specifically, viewing angle and driving voltage information is stored in an internal register of the display device 13. The holographic display system can obtain the driving voltage value of each pixel area in the display device at a current lateral viewing angle according to the viewing angle and driving voltage information. Therefore, human eyes can see an image with normal colors at a current lateral viewing angle.
Furthermore, a scene extracting frequency of the target scene obtaining system 14 is adjusted to immediately trace the pupil position. Therefore, the driving voltage value of the corresponding pixel can be adjusted immediately according to an angle between human position and the display device 13. As such, a color shading can be compensated immediately, and a wider viewing angles can be realized.
In the holographic display system provided by the present embodiment, the lateral viewing angle between each pixel area and the pupil position and the driving voltage value of each pixel area at the corresponding lateral viewing angle are calculated, and pupil tracking technology is applied to realize a real-time drive. Therefore, within a certain range, a range of viewing angles of the display device changes following changes in a pupil position (human position). A specific working process is described as follows:
Please refer to
Wherein, the S10 further includes following steps:
Wherein, the S20 further includes following steps:
Specifically, the human face area detecting module includes: providing an original image data set including a human face image to a feature extraction network, wherein the feature extraction network outputs original image feature information; and respectively inputting the original image feature information into an area extraction network and a classification and position feedback network, wherein the area extraction network is configured to extract a histogram of oriented gradient (HOG) feature of a predetermined area. HOG is a feature descriptor configured to detect objects during vision and image processes of computers. The classification and position feedback network classifies the HOG feature and outputs the human face area information.
As shown in
Then, the original image feature information is inputted into the area extraction network and the classification and position feedback network, respectively. In the area extraction network, a plurality of sliding windows with different sizes are used to encircle parts of an area having the original image feature information as a selected area, and the ROIs is formed, wherein the ROIs is configured to extract the HOG feature of the selected area and output the HOG feature to the classification and position feedback network.
Finally, the classification and position feedback network classifies and recognizes the HOG features, corresponds the HOG features to each area of human face, and outputs the human face area information, thereby obtaining the human face area detecting module 30.
Specifically, the step of creating the ROIs further includes following steps:
Specifically, the S30 further includes following steps:
Wherein, the image processing algorithm of deep learning includes a generative adversarial networks (GAN) algorithm which is an unsupervised learning algorithm provided by Ian Goodfellow in 2014. A main principle of this algorithm is to make a target generative network G battle with a target adversarial network D on a 0-1 game during a training process. Finally, a result is converged to one target generative network G. By inputting a random vector to the target generative network G, a data which is judged to be true by a classifier which is compared favorably with a real classifier D can be obtained.
Specifically, segmenting and extracting an image of the human face area information by a deep learning image feature extraction technology to obtain the important feature of face of the human face area information. The important feature of face includes eyes area information of the human face area information. A pupil position is calculated according to the eyes area information. The pupil position is a relative position between a pupil of the eyes area information and the display panel. The specific pupil position can be confirmed according to an autoencoder algorithm o deep learning.
Specifically, the segmenting and extracting step is to classify each pixel point of an image and confirm a category of each pixel point, thereby segmenting an area to obtain the eyes area information of the human face area information. The deep learning image feature extraction technology includes a fully convolutional networks (FCN) algorithm and a convolutional network for biomedical image segmentation (U-Net) algorithm which is used to segment biomedical images. Wherein, a principle of the FCN algorithm is to use continuous layers to supply regular convolutional networks, which replaces a pooling operation with an upsampling operation. The U-Net algorithm is mainly used to realize image segmentation based on the FNC algorithm, which amends and expands a structure of the FCN algorithm. Therefore, the FNC algorithm can use and form a more accurate segmentation with very few training images.
Specifically, the S40 includes following steps:
Wherein, the lateral viewing angle and the driving voltage information are obtained by following steps:
The present embodiment provides a holographic display method based on deep learning. By adjusting a corresponding driving voltage value of each sub-pixel of an image displayed by a holographic display system and applying a pupil tracking technology to realize a real-time drive, a range of viewing angles of a display panel changes following changes in a pupil position (human position). Finally, by confirming the pupil position to adjust a pixel voltage of an entire display image to compensate color shading, colors of the image viewed by people are normal without color shading within a certain range of viewing angles (an angle between line of human sight and the display panel). Therefore, quality of the display panel is improved.
In summary, the present embodiment provides a holographic display method and a holographic display system, by adjusting a corresponding driving voltage value of each sub-pixel of an image displayed by a holographic display system, viewing angles of LCD panels can be wider without affecting transmittance of the LCD panel.
Each operation can be specifically referred to the above-mentioned embodiment and is not described here again.
It should be noted that many changes and modifications to the described embodiments can be carried out by those skilled in the art, and all such changes and modifications are intended to be included within the scope of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
202110018233.4 | Jan 2021 | CN | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/CN2021/097499 | 5/31/2021 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2022/147956 | 7/14/2022 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20050117186 | Li | Jun 2005 | A1 |
20160070113 | Travis | Mar 2016 | A1 |
20190014884 | Fu | Jan 2019 | A1 |
20210088788 | Choi | Mar 2021 | A1 |
20210390897 | Kim | Dec 2021 | A1 |
20220121839 | Tagra | Apr 2022 | A1 |
Number | Date | Country |
---|---|---|
101859550 | Oct 2010 | CN |
101950550 | Jan 2011 | CN |
103888742 | Jun 2014 | CN |
206532099 | Sep 2017 | CN |
109359522 | Feb 2019 | CN |
109658876 | Apr 2019 | CN |
111091785 | May 2020 | CN |
112863453 | May 2021 | CN |
WO 02093483 | Nov 2002 | WO |
WO 2005052673 | Jun 2005 | WO |
WO-2017036160 | Mar 2017 | WO |
Number | Date | Country | |
---|---|---|---|
20230134309 A1 | May 2023 | US |