Patent Application
20230237971
The present application claims priority to Chinese Patent Application No. 202210081204.7, filed on Jan. 24, 2022, entitled by “CIRCUIT AND METHOD FOR VIDEO DATA CONVERSION AND DISPLAY DEVICE”, and published as CN114495855A on May 13, 2022, the contents of which are incorporated herein by reference in their entireties.
The present disclosure relates to a field of video image processing technology, in particular to a circuit and a method for video data conversion and a display device.
With the increasing demand for display quality of images, the physical resolution of a display device has been upgraded from standard definition, high definition to full high definition, ultra-high definition, and 8 K. Therefore, the bandwidth of a high-definition multimedia interface (HDMI) or display port (DP) interface between a display card and a display chip is also increasing to meet the above demand.
In general, an input interface of a liquid crystal display (LCD) video controller is a HDMI (High Definition Multimedia Interface) or DP (DisplayPort) interface. After an input video is captured and processed, it is finally output to an LCD screen via the HDMI or DP interface between the LCD video controller and the LCD screen. Usually, if a video with a resolution of 4K*2K is output via a gigabit network interface, nearly 20 gigabit network cables are required to fully output the video to the LCD screen. The controller has many interfaces, and if a single video controller may have a load capacity with a larger resolution, more gigabit network interfaces are required, which makes the video controller having a larger size, so the load capacity of the single LCD video controller is commonly within a resolution of 4K*2K. Meanwhile, because a system clock is limited by technology, the data throughput cannot be increased by increasing the frequency.
Therefore, in the era of 4K and 8K, HDMI/DP meets the requirement of rapidly increasing data volume by converting single-pixel video data into dual-pixel video data (that is, simultaneously transmitting pixel data by using two transmission channels) and reducing frequency. However, when the dual-pixel video data is subjected to dynamic contrast and sharpening processing, the data throughput of a corresponding processing apparatus is often less than the volume of the input dual-pixel video data, such that the dynamic contrast and sharpening processing of the input dual-pixel video data cannot be implemented.
Therefore, it is necessary to provide an improved technical solution to solve the above technical problems existing in the prior art.
To solve the above technical problems, the present disclosure provides a circuit and a method for video data conversion and a display device, which can meet data throughput requirements while performing dynamic contrast and sharpening processing on multi-pixel video data, may be applicable to filters with different numbers of stages, and can eliminate middle bright lines on a re-synthesized video image.
According to a first aspect of the present disclosure, a video data conversion circuit is provided and comprises: a pixel splicing module, configured to sequentially receive each group of pixel data in each frame of image data in input video data, to perform pixel splicing on the received pixel data, and to output spliced pixel data; and
a data conversion module, configured to perform data processing on the spliced pixel data to convert each frame of image data into first image data representing a first part of a corresponding frame of image and second image data representing a second part of the corresponding frame of image, the first image data and the second image data being configured for driving a display panel to complete display of the corresponding frame of image,
wherein the first part at least comprises a left half part of the corresponding frame of image, and the second part at least comprises a right half part of the corresponding frame of image.
Optionally, the first part and the second part have an overlap region.
Optionally, the data conversion module further comprises:
a first static memory, configured to write the received spliced pixel data according to a first write address sequence when receiving a first write enable signal being valid, so as to store the first image data corresponding to each frame of image data, and to output the stored first image data according to a first read address sequence when receiving a first read enable signal being valid;
a second static memory, configured to write the received spliced pixel data according to a second write address sequence when receiving a second write enable signal being valid, so as to store the second image data corresponding to each frame of image data, and to output the stored second image data according to a second read address sequence when receiving a second read enable signal being valid;
a first write controller, configured to output the first write enable signal being valid when receiving a row enable signal, and to output the first write enable signal being invalid when receiving a second flag signal;
a first read controller, configured to output the first read enable signal being valid when receiving a first flag signal;
a second write controller, configured to output the second write enable signal being valid when receiving the first flag signal, and to output the second write enable signal being invalid when receiving a third flag signal;
a second read controller, configured to output the second read enable signal being valid when receiving the first flag signal; and
a flag signal generating unit, configured to generate the first flag signal, the second flag signal, and the third flag signal according to a row resolution of the display panel, the row enable signal, and a size of an image overlap region, wherein the image overlap region is the overlap region of the first part and the second part.
Optionally, each of the first static memory and the second static memory comprises a first enable terminal and a second enable terminal;
the first enable terminal of the first static memory is configured to receive the first write enable signal, and the second enable terminal of the first static memory is configured to receive the first read enable signal; and
the first enable terminal of the second static memory is configured to receive the second write enable signal, and the second enable terminal of the second static memory is configured to receive the second read enable signal.
Optionally, each of the first static memory and the second static memory comprises a third enable terminal; and
the data conversion module further comprises:
a first selector, wherein a first input terminal of the first selector is configured to receive the first write enable signal, a second input terminal of the first selector is configured to receive the first read enable signal, an output terminal of the first selector is connected to the third enable terminal of the first static memory, and the first selector is configured to selectively transmit the first write enable signal and the first read enable signal to the third enable terminal of the first static memory according to a first gating signal, so as to control the first static memory to perform data read/write operation in a time-sharing manner; and
a second selector, wherein a first input terminal of the second selector is configured to receive the second write enable signal, a second input terminal of the second selector is configured to receive the second read enable signal, an output terminal of the second selector is connected to the third enable terminal of the second static memory, and the second selector is configured to selectively transmit the second write enable signal and the second read enable signal to the third enable terminal of the second static memory according to a second gating signal, so as to control the second static memory to perform data read/write operation in a time-sharing manner,
wherein each group of pixel data comprises N pieces of adjacent pixel data, and the pixel splicing module is configured to complete pixel splicing once within every N clock cycles, N being greater than or equal to 2.
Optionally, the flag signal generating unit is configured to generate the first flag signal when a start position of the image overlap region corresponding to each row of pixel data in each frame of image data is detected, to generate the second flag signal when an end position of the image overlap region corresponding to each row of pixel data in each frame of image data is detected, and to generate the third flag signal when an end position of each row of pixel data in each frame of image data is detected.
Optionally, the flag signal generating unit is implemented by a comparator, and the comparator is configured to, by at least one of an operation for comparing a read/write address of each frame of image data to a preset reference address, and an operation for comparing a read/write time of each frame of image data to a preset time threshold, determine whether the start position and end position of the image overlap region corresponding to each row of pixel data in each frame of image data are detected, and to determine whether the end position of each row of pixel data in each frame of image data is detected.
Optionally, the video data conversion circuit further comprises:
a data alignment module, configured to determine storage positions of pixel data, corresponding to the start position of the image overlap region, in the first static memory and the second static memory, respectively, according to a width of a target image and the size of the image overlap region, and to perform alignment processing on the first image data and the second image data according to the determined storage positions.
According to a second aspect of the present disclosure, a display device is provided and comprises: an interface circuit configured to output a plurality of pieces of pixel data in each frame of image data in input video data in groups;
the video data conversion circuit, described as above, configured to process each group of pixel data to convert each frame of image data into first image data representing a first part of a corresponding frame of image and second image data representing a second part of the corresponding frame of image;
a synthesis circuit, configured to perform data synthesis processing on the first image data and the second image data to obtain target image data; and
a display panel, configured to complete display of the corresponding frame of image on the basis of the target image data,
wherein the first part at least comprises a left half part of the corresponding frame of image, and the second part at least comprises a right half part of the corresponding frame of image.
According to a third aspect of the present disclosure, a method for video data conversion is provided, and comprises: sequentially receiving each group of pixel data in each frame of image data in input video data, and performing pixel splicing on the received pixel data to obtain spliced pixel data; and
performing data processing on the spliced pixel data to convert each frame of image data into first image data representing a first part of a corresponding frame of image and second image data representing a second part of the corresponding frame of image,
wherein the first part at least comprises a left half part of the corresponding frame of image, and the second part at least comprises a right half part of the corresponding frame of image.
Optionally, the first part and the second part have an overlap region.
Optionally, the method for video data conversion further comprises:
performing alignment processing on the first image data and the second image data, and outputting data obtained after performing the alignment processing.
By adopting the technical solution according to embodiments of the present disclosure, the data throughput requirements can be met while the dynamic contrast and sharpening processing is performed on the multi-pixel video data (that is, the plurality of pieces of pixel data are transmitted every time).
It should be noted that the general description above and the detailed description below are only exemplary and explanatory, and cannot limit the present disclosure.
For the convenience of understanding the present disclosure, the present disclosure will be more comprehensively described below with reference to the relevant accompanying drawings. The preferred embodiments of the present disclosure are shown in the accompanying drawings. However, the present disclosure may be implemented in different forms, and is not limited to the embodiments described herein. On the contrary, the objective of providing these embodiments is to make a more thorough and comprehensive understanding of the content provided by the present disclosure.
Referring to
Herein, the interface circuit 100 is configured to output a plurality of pieces of pixel data in each frame of image data in input video data in groups. The interface circuit 100 connects a display card and a display chip in the display device, is, for example, any one of a high-definition multimedia interface (HDMI) and a display port (DP) interface, and is configured to implement transmission of the input video data between the display card and the display chip. In this embodiment, the interface circuit 100 receives single-pixel video data and outputs multi-pixel video data, that is to say, an input terminal of the interface circuit 100 comprises a single data transmission path on the basis of which one piece of pixel data Pn is transmitted each time, while an output terminal of the interface circuit 100 comprises a plurality of data transmission paths on the basis of which a plurality of pieces of adjacent pixel data (comprising Pn, Pn+1) may be transmitted simultaneously each time. In this way, the interface circuit 100 can implement conversion of the single-pixel video data to the multi-pixel video data, and thus can meet the demand for dramatic increase in the volume of data to be transmitted by even reducing the frequency when the resolution of the display panel 400 is increased, n being a natural number.
The video data conversion circuit 200 is configured to process each group of pixel data output by the interface circuit 100 to convert each frame of image data in the input video data into first image data Data1 representing a first part of a corresponding frame of image and second image data Data2 representing a second part of the corresponding frame of image. Herein, the first part at least comprises a left half part of the corresponding frame of image, and the second part at least comprises a right half part of the corresponding frame of image.
The synthesis circuit 300 is configured to perform data synthesis processing on the first image data Data1 and the second image data Data2 to obtain target image data (Data). In this embodiment, the synthesis circuit 300 may merge the first image data Data1 and the second image data Data2 into the target image data (Data) with a target size after performing processing, comprising dynamic contrast, image sharpening, filtering, etc., on the first image data Data1 and the second image data Data2 in a time-sharing manner.
The display panel 400 completes display of the corresponding frame of image on the basis of the target image Data, and thus completes display of an input video on the basis of the display of each frame of image.
Referring to
Herein, the pixel splicing module 210 is configured to sequentially receive each group of pixel data in each frame of image data in input video data, to perform pixel splicing on the received pixel data, and to output spliced pixel data AP. Herein, the pixel splicing module 210 completes pixel splicing once within every N clock cycles, each group of pixel data comprises N adjacent pixel data (Pn, Pn+1) in the data of the corresponding frame of image, and each piece of pixel data is only subjected to pixel splicing once, N being greater than or equal to 2.
For example where each group of pixel data comprises two adjacent pixels, the pixel splicing module 210 receives a first group of pixel data (such as comprising first pixel data P0 and second pixel data P1 adjacent to each other) in a first clock cycle, and receives a second group of pixel data (such as comprising third pixel data P2 and fourth pixel data P3 adjacent to each other) in a second clock cycle; and by parity of reasoning, it receives an nth group of pixel data in an nth clock cycle. Moreover, the pixel splicing module 210 performs pixel splicing on the received pixel data, comprising splicing and combining m groups of pixel data received within every m clock cycles and then outputs the obtained data, m being greater than or equal to 2.
The data conversion module 220 is configured to perform data processing on the spliced pixel data Ap to convert each frame of image data into the first image data Data1 representing the first part of the corresponding frame of image and the second image data Data2 representing the second part of the corresponding frame of image. It may be understood that the first image data Data1 and the second image data Data2 are configured for driving the display panel 400 to complete the display of the corresponding frame of image. In this embodiment, each frame of image data in the input multi-pixel video data is converted into the first image data Data1 containing at least the left half part of the corresponding frame of image and the second image data Data2 containing at least the right half part of the corresponding frame of image, such that when the data corresponding to each frame of image is subjected to the dynamic contrast and sharpening processing subsequently, the data throughput requirements of the corresponding processing apparatus may be met by processing the first image data Data1 and the second image data Data2 at times in a time-sharing manner.
Further, the first part and the second part of the above each frame of image have an overlap region, that is to say, the first image data Data1 representing the first part of the corresponding frame of image and the second image data Data2 representing the second part of the corresponding frame of image, generated after conversion, have an image overlap region, which is marked as Overlap, as shown in
In the present disclosure, to implement the conversion of each frame of image data to the first image data Data1 and the second image data Data2 by controlling a static random access memory (SRAM) to store the spliced pixel data Ap in a specific format according to a specific read/write sequence, a conversion method and a required circuit structure are simple, and the corresponding data conversion process can be completed quickly and accurately. As shown in
Herein, the first static memory 223 is configured to write the received spliced pixel data Ap according to a first write address sequence when receiving a first write enable signal ENW1 being valid, so as to store the first image data Data1 corresponding to each frame of image data, and to output the stored first image data Data1 according to a first read address sequence when receiving a first read enable signal ENR1 being valid. Similarly, the second static memory 226 is configured to write the received spliced pixel data Ap according to a second write address sequence when receiving a second write enable signal ENW2 being valid, so as to store the second image data Data2 corresponding to each frame of image data, and to output the stored second image data Data2 according to a second read address sequence when receiving a second read enable signal ENR2 being valid.
In the present disclosure, the pixel splicing module 210 performs pixel splicing on the received pixel data, comprising splicing and combining m groups of pixel data received within every m clock cycles and then outputting the obtained data, where m is greater than or equal to 2, and a specific value of m may be determined according to a data bit width of the selected static memory and the number of pixel data contained in each group of pixel data received by the pixel splicing module 210. For example, if it is assumed that the data bit width of the selected static memory is 4, and the number of pixel data contained in each group of pixel data received by the pixel splicing module 210 is 2, then m is equal to 2. In this way, the pixel splicing module 210 can output the spliced pixel data Ap containing four pieces of pixel data within every m clock cycles to adapt to the data bit width of the static memory, such that one address of the static memory can correspond to four pieces of pixel data, thereby determining a read/write time sequence for subsequent read/write control.
The first write controller 221 is configured to output the first write enable signal ENW1 being valid when receiving a row enable signal EN, and to output the first write enable signal ENW1 being invalid when receiving a second flag signal. The first read controller 222 is configured to output the first read enable signal ENR1 being valid when receiving a first flag signal. The second write controller 224 is configured to output the second write enable signal ENW2 being valid when receiving the first flag signal, and to output the second write enable signal ENW2 being invalid when receiving a third flag signal. The second read controller 225 is configured to output the second read enable signal ENR2 being valid when receiving the first flag signal.
In a first embodiment of the present disclosure, referring to
In a second embodiment of the present disclosure, referring to
The flag signal generating unit is configured to generate the first flag signal, the second flag signal, and the third flag signal according to a row resolution of the display panel, the row enable signal EN, and a size of the image overlap region Overlap. The flag signal generating unit 227 is configured to generate the first flag signal when a start position (an edge position of a leftmost side of the region Overlap in
For example, the flag signal generating unit 227 is implemented by a comparator. For example, the comparator is configured to, by at least one of an operation for comparing a read/write address of each frame of image data to a preset reference address, and an operation for comparing a read/write time of each frame of image data to a preset time threshold, determine whether the start position and end position of the image overlap region Overlap corresponding to each row of pixel data in each frame of image data are detected, and to determine whether the end position of each row of pixel data in each frame of image data is detected.
Referring to
In the embodiment of the present disclosure, the width W3 of the image overlap region Overlap may be adjusted according to the number of stages of a filter applied in subsequent filtering, so as to adapt to processing of filters with different numbers of stages. For example, the width W3 of the image overlap region Overlap is in direct proportion to the number of stages of the filter, and the width W3 of the image overlap region Overlap is greater than at least half of the number of stages of the filter. It may be understood that the greater the width W3 of the image overlap region Overlap is, the more the pixel data, relative to the middle part of the whole image, contained in the first image data Data1 and the second image data Data2 is, the higher the consistency of the brightness at the corresponding synthesis positions of the first image data Data1 and the second image data Data2 processed by the filter is during subsequent synthesis and filtration of the image, the darker the middle bright lines generated in the final synthesized image are, and the better the display effect is.
Referring to
When the first write controller 221 receives the row enable signal EN being valid corresponding to a certain row, it outputs the first write enable signal ENW1 being valid to control the first static memory 223 to start writing the spliced pixel data AP from the first group of pixel data (P0, P1, P2, P3) by the first write address sequence according to vesa standards, where four pieces of pixel data are written each time according to one write address. Meanwhile, the flag signal generating unit 227 starts comparing the write address or data write time to the corresponding threshold.
It is assumed that when the first static memory 223 writes a group of pixel data (Pn, Pn+1, Pn+2, Pn+3) according to a certain write address, the flag signal generating unit 227 detects the start position of the image overlap region Overlap, and then outputs the first flag signal to trigger the second write controller 224 to output the second write enable signal ENW2 being valid to control the second static memory 226 to start writing the spliced pixel data AP from the current group of pixel data (Pn, Pn+1, Pn+2, Pn+3) by the second write address sequence according to the vesa standards. Meanwhile, the first read controller 222 is also triggered to output the first read enable signal ENR1 being valid to control the first static memory 223 to start outputting the corresponding pixel data from the first group of pixel data (P0, P1, P2, P3) according to the first read address until the corresponding group of pixel data (Pn, Pn+1, Pn+2, Pn+3) or k groups of pixel data after the corresponding group of pixel data (Pn, Pn+1, Pn+2, Pn+3) is or are output, the first static memory 223 is controlled to stop outputting, the second read controller 225 is triggered to output the second read enable signal ENR2 being valid to control the second static memory 226 to start outputting the corresponding pixel data from the corresponding group of pixel data (Pn, Pn+1, Pn+2, Pn+3) according to the second read address sequence until the corresponding group of pixel data (Pj, Pj+1, Pj+2, Pj+3) or k groups of pixel data after the corresponding group of pixel data (Pj, Pj+1, Pj+2, Pj+3) is or are output, and the second static memory 226 is controlled to stop outputting, where k is any natural number from 0 to 3.
It is assumed that when the first static memory 223 writes a group of pixel data (Pi, Pi+1, Pi+2, Pi+3) according to a certain write address, the flag signal generating unit 227 detects the end position of the image overlap region Overlap, and then outputs the second flag signal to trigger the first write controller 221 to output the first write enable signal ENW1 being invalid to control the first static memory 223 to stop writing the spliced pixel data AP. Moreover, it is assumed that when the second static memory 226 writes a group of pixel data (Pj, Pj+1, Pj+2, Pj+3) according to a certain write address, the flag signal generating unit 227 detects the end position of the pixel data corresponding to a current row in the data of the frame of image, and then outputs the third flag signal to trigger the second write controller 224 to output the second write enable signal ENW2 being invalid to control the first static memory 223 to stop writing the spliced pixel data AP. Then, the first write controller 221 receives the row enable signal EN being valid corresponding to a next row and repeats the above process.
It may be understood that after the above process is performed on the data corresponding to the frame of image for row-number times, the first image data Data1 and the second image data Data2 may be obtained from the outputs of the first static memory 223 and the second static memory 226, respectively, thereby completing the conversion of the data of the frame of image. Next, the conversion of data of other frames of image in the input video data may be completed by repeating the above process.
The data alignment module 230 is configured to determine storage positions of pixel data, corresponding to the start position of the image overlap region Overlap, in the first static memory 223 and the second static memory 226 respectively according to a width W of a target image and the size (comprising the width W3 of the image overlap region Overlap) of the image overlap region Overlap, and to perform alignment processing on the first image data Data1 and the second image data Data2 according to the determined storage positions and transmit the aligned image data to a post-stage circuit.
In this embodiment, since the two static memories are used to store the pixel data and simultaneously output the plurality of pieces of pixel data (Pn, Pn+1, Pn+2, Pn+3) corresponding to one address each time, and the storage positions of a pixel, corresponding to the start position of the image overlap region Overlap, in corresponding addresses of the first static memory 223 and the second static memory 226 are not fixed and may be, for example, in any one of Pn, Pn+1, Pn+2, Pn+3. Therefore, in the embodiment of the present disclosure, the data alignment module 230 is arranged to perform alignment processing such as data rearrangement on the first image data Data1 and the second image data Data2 according to the width W of the target image and the size of the image overlap region Overlap, so as to ensure that the complete and accurate target image data (Data) can be output.
Based on the above description, the present disclosure can meet the data throughput requirements while performing the dynamic contrast and sharpening processing on the multi-pixel video data, may be applicable to the filters with different numbers of stages, and can eliminate the middle bright lines on the re-synthesized video image, which is advantageous to enhancing the display effect.
It should be noted that the modules and units described above maybe implemented by hardware. For example, the modules and units can all be implemented by hardware, for example implemented by circuit.
Further, the present disclosure provides a method for video data conversion. The method may be applied to the video data conversion circuit and display device described in
In Step S1, each group of pixel data in each frame of image data in input video data is sequentially received, and pixel splicing is performed on the received pixel data to obtain spliced pixel data.
In this embodiment, Step S1 may be understood with reference to the foregoing description of the pixel splicing module 210, which will not be repeated here.
In Step S2, data processing is performed on the spliced pixel data to convert each frame of image data into first image data representing a first part of the corresponding frame of image and second image data representing a second part of the corresponding frame of image. Herein, the first part at least comprises a left half part of the frame of image, the second part at least comprises a right half part of the frame of image, and the first part and the second part have an overlap region.
In this embodiment, Step S2 may be understood with reference to the foregoing description of the data conversion module 220, which will not be repeated here.
In Step S3, alignment processing is performed on the first image data and the second image data, and output is performed. In this embodiment, Step S3 may be understood with reference to the foregoing description of the data alignment module 230, which will not be repeated here.
In conclusion, firstly, in the technical solution of the present disclosure, each frame of image data in the multi-pixel video data input via the interface circuit such as the HDMI or the DP interface is converted into two pieces of multi-half-frame image data (the first image data and the second image data) containing at least the left half part of the corresponding frame of image and at least the right half part of the corresponding frame of image, such that the two pieces of multi-half-frame image data may be processed at times in a time-sharing manner subsequently to meet the data throughput requirements while the dynamic contrast and sharpening processing is performed.
Secondly, in the technical solution of the present disclosure, the overlap region is arranged in the first image data and the second image data, such that the middle bright lines of the synthesized image can be eliminated in the subsequent video image synthesis, thereby enhancing the display effect.
Thirdly, in the technical solution of the present disclosure, the size of the overlap region between the first image data and the second image data is adjustable, so as to adapt to the processing of the filters with different numbers of stages.
Finally, it should be noted that the above embodiments are only examples to clearly illustrate the present disclosure, rather than defining the embodiments. Those of ordinary skill in the art may also make other changes or variations in different forms on the basis of the above description. It is unnecessary and impossible to enumerate all embodiments here. The obvious changes or variations arising therefrom are still within the scope of protection of the present disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202210081204.7 | Jan 2022 | CN | national |
