The present invention relates generally to displaying video on a display panel of a display set. More specifically, the present invention relates to a timing controller that is integrated with an encoder that encodes a digital signal into an analog signal for a display.
Image sensors, display panels, and video processors are continually racing to achieve larger formats, greater color depth, higher frame rates, and higher resolutions. Local-site video transport includes performance-scaling bottlenecks that throttle throughput and compromise performance while consuming ever more cost and power. Eliminating these bottlenecks can provide advantages.
For instance, with increasing display resolution, the data rate of video information transferred from the video source to the display screen is increasing exponentially: from 3 Gbps a decade ago for full HD, to 160 Gbps for new 8K screens. Typically, a display having a 4K display resolution requires about 20 Gbps of bandwidth at 60 Hz while at 120 Hz 40 Gbps are needed. And, an 8K display requires 80 Gbps at 60 Hz and 160 Gbps at 120 Hz.
Currently, conventional column (or source) drivers rely upon a wiring loom within the display set that can restrict scaling to larger formats and higher frame rates for a number of reasons. For one, the area and volume required by a complex wiring loom becomes too large, meaning that the size and cost of the printed circuit implementing the wiring loom exceeds practical limits. Further, the DACs of the source drivers are limited to 8 bits of resolution; a further increase would lead to excessive data rates and would consume too much power. These restrictions force an architecture discontinuity on the display set industry, increasing cost and risk.
Until now, the data is transferred digitally using variants of low voltage differential signaling (LVDS) data transfer, using bit rates of 16 Gbps per signal pair (depending upon the architecture), and parallelizing the pairs to achieve the required total bit rate. This digital information then needs to be converted to the analog pixel information on the fly using D-to-A conversion at the source drivers of the display.
Nowadays, most source driver D-to-A converters require 8 bits; soon, D-to-A conversion may need 10 or even 12 bits and then it will become very difficult to maintain a fast enough data rate. Thus, displays must clock the digital data in a very short amount of time, resulting in destabilization of the digital signal transmission. Another issue due to the limits of existing digital transport is that not all 12 bits or 10 bits or even 8 bits per sample are conveyed within the display panel; modern intra-display compression schemes carry just 6 bits per sample, thereby limiting the color depth of the display.
Accordingly, new apparatuses and techniques are desirable to eliminate the need for D-to-A conversion at a source driver of a display, to increase bandwidth, and to utilize an analog video signal generated within a display unit.
To achieve the foregoing, and in accordance with the purpose of the present invention, a timing controller of a display set is integrated with an SSVT transmitter having at least one encoder to allow for transport of analog signals between a display controller of the display set and source drivers of the display panel.
It is realized that digital representations (e.g., 8-bit or 10-bit numerals) of the pixel brightness levels are poor representations of that video data, especially during video transport, whereas analog voltages representing those brightness levels are better representations and have much greater resolution. Therefore, the present invention proposes to transport video data within a display set in the analog domain using voltages that represent pixel brightness levels.
Advantages of the present invention include reducing power consumption. In the prior art, power consumption significantly constrains display performance; using the present invention, less power is consumed by the display electronics. Embodiments of the invention described below can scale to arbitrarily large formats and frame rates, consuming as much as 50% less power for panel driving and offering greater than ten times the noise rejection. Further, embodiments provide noise immunity and EM stealth in that EMI/RFI emissions of a display set will be well below mandated limits. Yet further, the transmission reach of the novel analog signal can be much greater than that of conventional Ethernet or HDBaseT signals. And, whereas conventional transport uses expensive, mixed-signal processes for high-speed digital circuits, embodiments of the present invention make use of mature analog processes for greater flexibility and lower production cost. Further, the size of the wiring loom is reduced thus taking up less space in the edge areas of the display panel.
Further, use of spread-spectrum video transport (SSVT) for data transfer within a display set between a display controller and source drivers of a display panel can reduce the silicon area, and thus the chip cost, associated with video transport by up to a factor of three for 4K 60 Hz panels and by up to a factor of ten for 8K 120 Hz panels.
In a specific embodiment, the SSVT transmitter (and its encoders) and integrated timing controller are within a single integrated circuit. The main advantage of this integration is that digital video transfer occurs on-chip, so that there is no difficulty in bringing digital signals from the TCON to the encoders. There will be power and cost benefits as well. Another advantage is that the combined chip area will be smaller due to saving pins and sharing components. In a variation, the transmitter, TCON and SoC are all within an integrated circuit. Integrating the SSVT transmitter into the TCON also aligns with existing industry practice where the TCON has an integrated digital video transport (like CEDS). In another specific embodiment, the SSVT transmitter and timing controller chip (or transmitter, TCON and SoC) are part of a display panel driver chipset, the other semiconductor chip or chips receiving the SSVT signal and implementing source drivers of the display.
The invention, together with further advantages thereof, may best be understood by reference to the following description taken in conjunction with the accompanying drawings in which:
In a video system the transformation of the incident light into a signal is generally performed by a source assembly or a Graphics Processing Unit (GPU) and a predetermined transformation will determine the format of the payload that is to be transported from the source assembly, over one or more electromagnetic pathways, to a sink assembly, which may be a display or a video processor, which receives the predetermined format and transforms the received payload into a signal used with a suitable output device for creating radiated light suitable for viewing by humans.
It is realized that digitization of the video signal takes place at the signal source of the system (usually at the GPU) and then the digital signal is transferred, usually using a combination of high performance wiring systems, to the display drivers, where the digital signal is returned to an analog signal again, to be loaded onto the display pixels. So, the only purpose of the digitization is data transfer from video source to display pixel. Therefore, we realize that it is much more beneficial to avoid digitization altogether (to the extent possible), and to directly transfer the analog data from video source (or from a display controller) to the display drivers. This can be done using our novel encoding, leading to accurate analog voltages to be decoded again in the source drivers. The decoded analog data is a high-bit-depth approximation of each sample, without the need to reproduce exactly a predetermined number of bit positions. This means the sample rate is at least a factor of ten lower than in the case of digital transfer, leaving further bandwidth for expansion.
Further it is recognized that it is much easier to perform the D-to-A conversion (if needed) at the point where less power is needed than at the end point where the display panel is driven, where much power is required. Thus, instead of transporting a digital signal from the video source (or from a display controller) all the way to the location where the analog signal needs to be generated, we transport the analog signal to the display panel using a much lower sample rate than normally needed by digitalization. This means that instead of having to send Gigabits per second over a number of lines, we can now do with only a few analog mega-samples per second, thus reducing the bandwidth of the channel that has to be used. Further, with prior art digital transport, every bit will occupy just about half an inch in the signal wire, whereas transporting analog data results in an increase of tenfold amount of space available, meaning extra bandwidth available. And further, a bit in digital data must be well defined. This definition is fairly sensitive to errors and noise, and one needs to be able to detect the high point and the low point very accurately, whereas the proposed analog transport is much less sensitive. That means that the quality of the cable (e.g., going from one side to the other in a display set) does not need to be high.
The invention is especially applicable to high resolution, high dynamic range displays used in computer systems, televisions, monitors, game displays, home theater displays, retail signage, outdoor signage, etc.
Shown is an input of a digital video signal 62 to the display set via an HDMI connector (or via LVDS, HDBaseT, MIPI, IP video, etc.) into a system-on-a-chip (SoC) 63 of the display set. SoC 63 performs functions such as a display controller, reverse compression and outputs the video signal 64 to a conventional TCON (timing controller) 50. In turn, the timing controller transports a digital signal 66 to a display panel 30. (Digital transport may also use MLVDS, DDI, etc.) Display panel 30 includes any number of DACs (digital-to-analog converters) within the column drivers 68 of the display panel which convert the digital signal into an analog signal for input into pixels of the display panel. High-speed shift registers 70 use a “cascade” technique to pass the digital signal from column driver to column driver. Shown also is a timing and framing signal 72 output by the timing controller 50 that provides timing and framing for the gate drivers 74.
In addition to the disadvantages above, this digital transport within the conventional display set results in higher EMI/RFI concerns due to reliance on high-speed digital circuits, and it must be implemented using relatively costly integrated circuit processes. Further, an 8K V-by-One HS requires 48 wire pairs at 3.5 Gbps, for example. And, a high-speed bit-serial interface will also have synchronization issues.
It is realized that performing the conversion of the digital video signal from digital to analog as close as possible to the SoC will not only eliminate the need for DACs within the column drivers of the display panel but will also eliminate the disadvantages above and will realize advantages in transporting an analog signal within the display set instead of transporting a digital signal.
In one embodiment, transmitter and timing controller chip 150 is one of two semiconductor chips in a display panel driver chipset, the other semiconductor chip (an “SSVT source driver” chip) receiving a signal 167 and incorporating source drivers 169. Depending upon the size of the display panel, there may be more than one SSVT source driver chip. Typically, the distance between chip 150 and source drivers 169 is in the range of about 5 cm to about 1.5 m, depending on the panel size.
Transmitter 150 converts the received digital video signal into spread-spectrum video transport (SSVT) signals 167 which are transported to a display panel 130. Preferably, signals 167 are delivered to the source drivers 169 using differential pairs of wires, e.g., one or two pairs per source driver. Display panel 130 has a corresponding SSVT decoder (typically within each source driver 169) which then decodes each analog SSVT signal into an analog signal expected by the display panel. Note that no DACs (digital-to-analog converters) are needed at the display panel nor within the source drivers. Timing signal 171 controls the gate drivers 174 so that the correct line of the display is enabled in synchronization with the source drivers 169. In one particular embodiment, novel source drivers 169 are implemented as described herein and in U.S. patent application Ser. No. 17/900,570 (HYFYP009) mentioned above.
Advantageously, through use of SSVT signals within the display instead of using digital transport, EMI/RFI emissions are well below mandated limits, and an 8K display will only require 24 wire pairs at 680 Mbps. By contrast, prior art transport of a digital video signal within a display set from the system-on-a-chip (SoC) (for example) to the display panel must be implemented in high resolution and therefore relatively costly IC processes, and EMI/RFI emissions will be a concern due to reliance upon high-speed digital circuits, and an 8K display will require 48 wire pairs at 3.5 Gbps.
There is a significant advantage to using SSVT signals internally in a display set even if the input signal 162 is not SSVT, i.e., it is a digital video signal. In prior art display sets, one decompresses the HDMI signal and then one has the full fledged, full-bit-rate digital data that must then be transferred from the receiving end of the display set to all locations within the display set. Those connections can be quite long for a 64- or 80-inch display set; one must transfer that digital data from one side of the set where the timing controller is to the other side where the final display source driver is. Therefore, there is an advantage to converting the digital signal to SSVT internally at or near the SoC and then sending SSVT signals to all locations of the display set where the source drivers are located. Specifically, there will be a shorter distance for digital transmission and longer distance for SSVT transmission, thereby reducing the cost and complexity of the digital transmission implementation while increasing the flexibility of system integration.
Shown is an input of a digital video signal 162 via an HDMI connector (or via LVDS, HDBaseT, MIPI, IP video, etc.) into the display set 120, which is then transmitted internally 162′ to SoC 140′. The system-on-a-chip (SoC) 140′ performs its traditional functions such as display controller, reverse compression, brightness, contrast, overlays, etc., as well as serving as a timing controller and SSVT transmitter. After the SoC performs its traditional functions, the modified digital video signal (not shown) is then delivered internally to the integrated SSVT transmitter and timing controller using a suitable protocol such as LVDS, V-by-one, etc. In this embodiment, the timing controller and SSVT transmitter are both integrated with the SoC and all three are implemented within a single circuit, preferably an integrated circuit on a semiconductor chip.
Because SoC 140′ performs the encoding, a corresponding semiconductor chip or chips (“SSVT source driver” chips) receives signals 167 and incorporates source drivers 169. Depending upon the size of the display panel, there may be more than one SSVT source driver chip. Typically, the distance between chip 140′ and column drivers 169 is in the range of about 5 cm to about 1.5 m, depending on the panel size.
The SSVT transmitter within chip 140′ converts the modified digital video signal into spread-spectrum video transport (SSVT) signals 167 which are transported to display panel 130. Preferably, signals 167 are delivered to the source drivers 169 using differential pairs of wires, e.g., one or two pairs per source driver. Display panel 130 has a corresponding SSVT decoder (typically within each column driver 169) which then decodes an analog SSVT signal into an analog signal expected by the display panel. Note that no DACs (digital-to-analog converters) are needed at the display panel nor within the source drivers. Timing signal 171 controls the gate drivers 174 so that the correct line of the display is enabled in synchronization with the source drivers 169.
The integrated SoC chip 140′may be implemented as herein described, i.e., as shown in
Briefly, a stream of input digital video samples is received at chip 150, the input digital video samples are repeatedly (1) distributed by assigning the input video samples into encoder input vectors (four, in this example) according to a predetermined permutation and (2) encoded using encoders 42 in order to generate multiple composite analog EM signals 260. The analog EM signals are then transmitted (3) over a transmission medium to a corresponding chip or chips that incorporate the source drivers. On the receive side, (4) the incoming analog EM signals are decoded using corresponding decoders, in order to reconstruct the samples into output vectors and then (5) the output vectors are collected by assigning the reconstructed video samples from the output vectors to an output stream using the inverse of the predetermined permutation. As a result, the original stream of time-ordered video samples containing color and pixel-related information is conveyed from video source to video sink.
Signal 164 is typically an LVDS digital signal from the SoC in which the pixel values come in row-major order through successive video frames. More than one pixel value may arrive at a time (e.g., two, four, etc.); they are serial in the sense that groups of pixels are transmitted progressively, from one side of the line to the other. Unpacker 26 unpacks (or exposes) these serial pixel values into parallel RGB values. The number of output sample values S in each set of pixel samples is determined by the color space applied by the video source. With RGB, S=3, and with YCbCr 4:2:2, S=2. In other situations, the sample values S in each set of samples can be just one or more than three. Unpacker 26 also unpacks from digital signal 164 framing information in the form of framing flags 27 (shown in
A distributor 40 of block 220 (shown in detail in
In this particular embodiment shown, there are four EM pathways, and each encoder 42 generates an EM signal for each of the four pathways respectively. It should be understood, however, the present invention should be by no means be limited to four pathways; the number of pathways on the transmission medium may widely range from one to any number more than one.
On the receive side, an SSVT receiver is provided (not shown). The function of the SSVT receiver is the complement of the SSVT transmitter and timing controller 150 on the transmit side. That is, the SSVT receiver (a) receives the sequences of EM signals from the multiple EM pathways of the transmission medium, (b) decodes each sequence by applying SSVT demodulation to reconstruct the video samples in multiple output vectors, and (c) collects the samples from the multiple output vectors using the same permutation used to distribute the input samples into input vectors on the transmit side. More specifically, the output vectors are rearranged in their spatially correct location on the source driver's output pins towards the display panel. The collected output samples are then transformed into a format that is suitable for display by the video sink for display in a time-shifted mode.
The modulation and demodulation, as described herein, may be performed in the analog or digital domain as explained below in
As mentioned earlier, modified digital video signal 164 arrives from the SoC 163 via LVDS pairs (for example); typically, the number of pairs is implementation specific and depends upon the data rate per pair as well as upon panel resolution, frame rate, bandwidth etc. Digital signal processing (DSP) is performed in function block 210 and includes frame-by-frame inversion and other processing such as gamma correction, LCD drive optimization, gamma correction, LCD drive optimization, HDR implementation, compensation for specific EM pathway electrical characteristics, etc. Gamma correction converts samples from a linear color space to a non-linear color space in order to take best advantage of the physical luminance characteristics of an individual display. Gamma correction is a fundamental requirement for high-video-quality systems. Compensation for EM pathway characteristics includes any signal processing function that corrects in advance for measured parameters of the circuit elements in the EM pathway.
After DSP and Gamma correction 210 the digital video signal is passed internally 214 into block 220 which includes a line buffer (and line buffer controller), lane distribution (via the distributor 40), clock domain crossing, and generation of gate drivers control signals 171. Line buffer memory 230 provides temporary storage for a row of pixel information before distribution to the encoders. Typically, pixel information for a row of the display panel arrives serially from the SoC, but, as the gate drivers will enable a row of pixel information to be displayed at the same time, the source drivers 169 will need pixel voltages for an entire row to be ready at the same time. Thus, line buffer memory 230 provides storage for a row of pixel information as it arrives serially from the SoC; once an entire row of pixel information is stored it may then be used by block 220 for later conversion, encoding, transport and display in the appropriate row of the display panel. Furthermore, sometimes on the display panel only half of the row of pixels is enabled at any given time by the gate drivers, thus half the row information has to be sent to the source drivers, and then the other half; the line buffer memory helps to facilitate this. E.g., a line is stored in the line buffer memory, then extracted half-by-half to be transmitted, while a new line is being stored. Depending upon the specific implementation, line buffer memory 230 may be within integrated circuit 150 or may be external.
The digital video samples are then converted using medium frequency DACs 240 before being encoded in analog using any number of SSVT encoders 42, the number of encoders corresponding to the number of EM signals (EM pathways) desired to be used over the transmission medium as will be described in greater detail below. Analog signals 260 are then each sent to source drivers 169 for decoding into the voltage levels expected by the display panel 130.
Referring now to
In various embodiments, the number of N samples may widely vary. By way of example, consider an embodiment with N=60. In this case, the total number of N samples included in the four vectors V0, V1, V2 and V3 is 240 (60×4=240). The four encoder input vectors V0, V1, V2 and V3, when completely built up, include the samples (where S=3) for 80 distinct sets of samples 22 (240/3=80). In other words:
It should be understood that the above example is merely illustrative and should not be construed as limiting. The number of samples N may be more or less than 60. Also, it should be understood that (a) the exposed color information for each set of samples can be any color information (e.g., Y, C, Cr, Cb, etc.) and is not limited to RGB. The number of EM pathways over the transmission medium can also widely vary. Accordingly, the number of vectors V and the number of encoders 42 may also widely vary from just one or any number larger than one. It should also be understood that any permutation scheme used to construct the vectors may be used, limited only by the requirement that whichever permutation scheme is used on the transmit side is also used (as de-permutation) on the receive side.
The distributor 40 is arranged to receive the exposed color information (e.g., RGB) from the line buffer controller 290, which in turn has received this information from the unpacker 26 (after DSP and Gamma correction). In response, the assembly bank 50 builds the four vectors V0, V1, V2 and V3 from the exposed color information (e.g., RGB) for the incoming stream of sets of samples. As the sets of samples are received, they are stored in the assembly bank 50 according to the predetermined permutation. Again, the distributor 40 may use any number of different permutations when building the vectors containing N samples each.
The staging bank 52 facilitates the crossing of the N samples of each of the four vectors V0, V1, V2 and V3 from a first clock frequency (or pixel clock domain) used by the unpacker 26 into a second clock frequency (or SSVT clock domain) used for the encoding and transmission of the resulting EM signals over the transmission medium. As previously discussed in the example above with N=60 and S=3, the samples representing exactly 80 sets of RGB samples are contained in the four encoder input vectors V0, V1, V2 and V3.
Boundary 180 shows the clock domain crossing between the pixel clock domain and the SSVT clock domain. The pixel clock domain clocks in pixel values to the left of boundary 180, while the SSVT clock domain clocks out the sample values into the DACs and encoders. Essentially, the pixel clock allows for the signals in the staging bank 52 to be stable long enough for the presentation bank 54 to sample those signals in the SSVT clock domain. The controller 56 will use the pixel clock in the staging bank and the SSVT clock in the presentation bank.
In various embodiments, the pixel clock frequency can be faster, slower or the same as the SSVT clock frequency. The first clock frequency f_pix is determined by the video format selected by any suitable video source. The second clock frequency f_ssvt is a function of f_pix, the number P of EM pathways in the transmission medium, the number S of samples in each set of input/output samples, and the SSVT transform parameters N (the number of input/output vector locations) and L (the length of each SSDS code), where f_ssvt=(f_pix*S*L)/(P*N). With this arrangement, the input clock (pix_clk) oscillates at one rate, and the SSVT clock (ssvt_clk) oscillates at a different rate. These clock rates may be the same or may be different.
The presentation bank 54 presents the N samples (0 through N−1) of each of the four encoder input vectors V0, V1, V2 and V3 to the encoder block 60. Typically, N input samples (individual color components) are assigned to an input vector; then the encoder performs the forward transform (modulation) while the next input vector is prepared.
The controller 56 controls the operation and timing of the assembly bank 50, the staging bank 52, and the presentation bank 54. In particular, the controller is responsible for defining the permutation used and the number of samples N when building the four encoder input vectors V0, V1, V2 and V3. The controller 56 is also responsible for coordinating the clock domain crossing from the first clock frequency to the second clock frequency as performed by the staging bank 52. The controller 56 is further responsible for coordinating the timing of when the presentation bank 54 presents the N samples (0 through N−1) of each of the encoder input four vectors V0, V1, V2 and V3 to the encoder block 60. Controller 56 may also include a permutation controller that controls distribution of the RGB samples to locations in the encoders' input vectors.
Within the encoder block 60, a plurality of digital-to-analog Converters (DACs) 62 is provided, each arranged to receive one of the P*N samples (P0, N0 through P3, NN−1) assigned to the four encoder input vectors V0, V1, V2 and V3 collectively. Each DAC 62 converts its received sample from the digital domain into a differential pair of voltage signals having a magnitude that is proportional to its incoming digital value. In one embodiment, the output of the DACs 62 range from a maximum voltage to a minimum voltage. In this example, there is one DAC per signal pair (i.e., N lower-speed DACs per encoder, each DAC output presenting one sample to the encoder for an entire encoding interval). It is also possible in this configuration to use one DAC per encoder (thus driving levels into the wire pair at F_ssvt) and to multiplex the samples onto the one DAC. Such a multiplexing requires a fast and accurate DAC to do N conversions within one SSVT clock cycle.
The four encoders 42 are provided the four encoder input vectors V0, V1, V2 and V3 respectively. Each encoder 42 receives the differential pair of signals for each of the N samples (0 through N−1) for its encoder input vector, modulates each of the N differential pair of voltage signals using unique orthogonal codes as discussed herein, accumulates the modulated values, and then generates a differential EM signal, which is the accumulated modulated sample values. Since there are four encoders 42 in this example, there are four EM signals (Signal0 through Signal3) that are simultaneously transmitted over the transmission medium. Modulation and encoding are discussed in greater detail below in
A sequencer circuit 65 coordinates the timing of the operation of the DACs 62 and the encoders 42. The sequencer circuit 65 is responsible for controlling the clocking of the DACs 62 and the encoders 42. As described in detail below, the sequencer circuit 65 is also responsible for generating two clock phase signals, “clk 1” and “clk 2”, that are responsible for controlling the operation of the encoders 42.
As mentioned before, line buffer controller 290 coordinates storage and retrieval of pixel values into and from line buffer memory 230. The line buffer controller stores a row of pixels for the display in the line buffer memory and then retrieves that row into the line buffer when the row is complete so that the source drivers of the display can be sent the pixel values for that row (via the distributor, encoders, EM pathways, etc.) at the same time for display. Line buffer memory 230 may be a memory implemented within the SSVT transmitter and timing controller chip 150 or may be a memory separate from chip 150.
As mentioned earlier, framing flags 27 come from the unpacker 26 and are input into line buffer controller 290 which uses these flags in order to know the location of pixels in a line, in order to store and then place them into the correct encoders. After the framing flags are output from the line buffer controller (typically delayed) they are input into gate driver controller 280 which will then generate numerous gate driver control signals 171 for control of the timing of the gate drivers. These signals 171 will include at least one clock signal, at least one frame-strobe signal, and at least one line-strobe signal. Once the pixel values have been pushed into the source drivers for a specific line the line-strobe signal is used for a particular line that has been enabled by the panel gate driver controller. The line-strobe signal, thus, drives the selected line at the right time. Control of the timing of the gate drivers may be performed as is known by a person skilled in the art. Also shown is bidirectional communication 57 between controller 56 and gate driver controller 280; this communication is used for timing management between the source and gate drivers.
Each multiplier stage 70 is arranged to receive at first (+) and second (−) terminals a differential pair of sample signals (+SampleN−1/−SampleN−1 through +Sample0/−Sample0) from one of the DACs 62 respectively. Each multiplier stage 70 also includes a terminal to receive a chip from a code, an inverter 73, sets of switches S1-S1, S2-S2 and S3-S3, sets of switches driven by clk 1 and clk 2, and storage devices C1 and C2 of equal value that each store a voltage sample when subjected to the various switches, thus storing differing voltages across each device at different times according to the switching sequence.
During operation, each multiplier stage 70 modulates its received differential pair of analog signals by conditionally multiplying by either (+1) or (−1), depending on a value of a received chip. If the chip is (+1), then when clk 1 is active, switch pairs S1-S1 and S3-S3 close, while switch pair S2-S2 remain open. As a result, both the differential pair of +/−samples are stored on the storage devices C1 and C2 without any inversion (i.e., multiplied by +1) respectively. On the other hand, if the chip is (−1), then the complement of the above occurs. In other words, switch pair S1-S1 opens and switch pair S2-S2 closes, and pair S3-S3 closes when clk 1 is active. As a result, the differential pair of samples are switched and stored on C1 and C2, respectively, thus effecting multiplication by −1.
The accumulator stage 72 operates to accumulate the charges on the storage devices C1 and C2 for all of the multiplier stages 70. When clk 1 transitions to inactive and clk 2 transitions to active, then all the clk 1 controlled switches (S3-S3, S4-S4) open and the clk 2 controlled switches (S5-S5, S6-S6) close. As a result, all the charges on the first storage devices C1 of all the multiplier stages 70 are amplified by amplifiers 78 and accumulated on a first input of the differential amplifier 74, while all the charges on the second storage devices C2 of all the multiplier stages 70 are amplified by amplifiers 78 and accumulated on a second input of the differential amplifier 74. In response, the differential amplifier 74 generates a pair of differential electro-magnetic (EM) level signals. Amplifier 74 may use the same Vcm as amplifier 78 to its immediate left. Depending upon the implementation, the resistors R1 shown for each amplifier 78 and 74 may be the same or different, and the resistors R1 of amplifier 74 may be the same or different from those of amplifiers 78. Capacitors C1, C2, C3 and C4 should be of the same size.
The above process is performed for all four vectors V0, V1, V2 and V3. In addition, the above-described process is continually repeated so long as the stream of sets of samples 22 is received by the SSVT transmitter 28. In response, four streams of differential EM output level signals are transmitted over the transmission medium.
Elements 26, 210-230, and 171 are implemented and performed as previously discussed in
On the receive side, the decoders of each source driver are responsible for decoding the stream of the differential EM signals received over the transmission medium back into a format suitable for display. Once in the suitable format, the video content contained in the samples can be presented on a video display, frame after frame. As a result, the video capture by any video source can be re-created by a video sink. Alternatively, the decoded video information can be stored for display at a later time in a time-shifted mode.
As mentioned earlier, various embodiments of the present invention disclose that an analog signal be used to transport video information within a display set in order to dispense with the need for DACs within the source drivers, among other advantages.
For the purposes of this disclosure, an electromagnetic signal (EM signal) is a variable represented as electromagnetic energy whose amplitude changes over time. EM signals propagate through EM paths, such as a wire pair (or cable), free space (or wireless) and optical or waveguide (fiber), from a transmitter terminal to a receiver terminal. EM signals can be characterized as continuous or discrete independently in each of two dimensions, time and amplitude. “Pure analog” signals are continuous-time, continuous-amplitude EM signals; “digital” signals are discrete-time, discrete-amplitude EM signals; and “sampled analog” signals are discrete-time, continuous-amplitude EM signals. The present disclosure discloses a novel discrete-time, continuous-amplitude EM signal termed a “spread-spectrum video transport” (SSVT) signal that is an improvement over existing SSDS-CDMA signals. SSVT refers to the transmission of electromagnetic signals over an EM pathway or pathways using an improved spread-spectrum direct sequence (SSDS)-based modulation.
Code Division Multiple Access (CDMA) is a well-known channel access protocol that is commonly used for radio communication technologies, including cellular telephony. CDMA is an example of multiple access, wherein several different transmitters can send information simultaneously over a single communication channel. In telecommunications applications, CDMA allows multiple users to share a given frequency band without interference from other users. CDMA employs Spread Spectrum Direct Sequence (SSDS) encoding which relies on unique codes to encode each user's data. By using unique codes, the transmission of the multiple users can be combined and sent without interference between the users. On the receive side, the same unique codes are used for each user to demodulate the transmission, recovering the data of each user respectively.
An SSVT signal is different from CDMA. As a stream of input video (for example) samples is received at encoders, they are encoded by applying an SSDS-based modulation to each of multiple encoder input vectors to generate the SSVT signals. The SSVT signals are then transmitted over a transmission medium. On the receive side, the incoming SSVT signals are decoded by applying the corresponding SSDS-based demodulation in order to reconstruct the samples that were encoded. As a result, the original stream of time-ordered video samples containing color and pixel-related information is conveyed from a single video source to a single video sink, unlike CDMA which delivers data from multiple users to multiple receivers.
Preferably, the range of these voltages is from 0 to 1 V for efficiency, although a different range is possible. These voltages typically are taken from pixels in a row of a frame in a particular order, but another convention may be used to select and order these pixels. Whichever convention is used to select these pixels and to order them for encoding, that same convention will be used at the receiving end by the decoder in order to decode these voltages in the same order and then to place them in the resulting frame where they belong. By the same token, if the frame is in color and uses RGB, the convention in this encoder may be that all of the R pixel voltages are encoded first, and then the G and B voltages, or the convention may be that voltages 902-906 are the RGB values of a pixel in that row and that the next three voltages 908-912 represent the RGB values of the next pixel, etc. Again, the same convention used by this encoder to order and encode voltages will be used by the decoder at the receiving end. Any particular convention for ordering analog values 902-908 (whether by color value, by row, etc.) may be used as long as the decoder uses the same convention. As shown, any number of N analog values 902-908 may be presented for encoding at a time using code book 920, limited only by the number of entries in the code book.
As mentioned, code book 920 has any number of N codes 932-938; in this simple example, the code book has four codes meaning that four analog values 902-908 are encoded at a time. A greater number of codes such as 127 codes, 255 codes, etc., may be used, but due to practical considerations such as circuit complexity, fewer codes are preferably used. As known in the art, code book 920 includes N mutually-orthogonal codes each of length L; in this example L=4. Typically, each code is an SSDS code, but need not necessarily be a spreading code as discussed herein. As shown, each code is divided into L time intervals (also called “chips”) and each time interval includes a binary value for that code. As shown at code representation 942, code 934 may be represented in the traditional binary form “1100”, although that same code may also be represented as “1 1 −1 −1” as shown in code representation 944 for ease-of-use in modulating the value as will be explained below. Codes 932 and 936-938 may also be represented as in 942 or in 944. Note that each code of length L is not associated with a different computing device (such as a telephone), a different person or a different transmitter, as is done in CDMA.
Therefore, in order to send the four analog values 902-908 over a transmission medium to a receiver (with a corresponding decoder) the following technique is used. Each analog value will be modulated by each chip in the representation 944 of its corresponding code; e.g., value 902, namely .3, is modulated 948 by each chip in the representation 944 of code 932 sequentially in time. Modulation 948 may be the multiplication operator. Thus, modulating .3 by code 932 results in the series “.3, .3, .3, .3”. Modulating .7 by code 934 becomes “.7, .7, −.7, −.7”; value “0” becomes “0, 0, 0, 0”; and “value “1” becomes “1, −1, 1, −1”. Typically, the first chip of each code modulates its corresponding analog value, and then the next chip of each code modulates its analog value, although an implementation may also modulate a particular analog value by all the chips of its code before moving on to the next analog value.
Each time interval, the modulated analog values are then summed at 951 (perceived vertically in this drawing) to obtain analog output levels 952-958; e.g., the summation of modulated values for these time intervals results in output levels of 2, 0, .6, −1.4. These analog output levels 952-958 may be further normalized or amplified to align with a transmission line's voltage restrictions, and may then be sent sequentially in time as they are produced over an electromagnetic pathway (such as a differential twisted-pair) of transmission medium in that order. A receiver then receives those output levels 952-958 in that order and then decodes them using the same code book 920 using the reverse of the encoding scheme shown here. The resultant pixel voltages 902-908 may then be displayed in a frame of a display at the receiving end in accordance with the convention used. Thus, analog values 902-908 are effectively encoded synchronously and sent over a single electromagnetic pathway in a sequential series of L analog output levels 952-958. Numerous encoders and electromagnetic pathways may also be used as shown and described herein. Further, the number of N samples that can be encoded in this manner depends upon the number of orthogonal codes used in the code book.
Advantageously, even though the use of robust SSDS techniques (such as spreading codes) results in a significant drop in bandwidth, the use of mutually-orthogonal codes, the modulation of each sample by chips of its corresponding code, summation, and the transmission of N samples in parallel using L output levels results in a significant bandwidth gain. In contrast with traditional CDMA techniques in which binary digits are encoded serially and then summed, the present invention first modulates the entire sample (i.e., the entire analog or digital value, not a single bit) by each chip in a corresponding code, and then sums those modulations at each time interval of the codes to obtain a resultant analog voltage level for each particular time interval, thus exploiting the amplitude of the resultant waveform. It is these analog output levels that are sent over a transmission medium, not representations of binary digits. Further, the present invention facilitates sending analog voltages from one video source to another video sink, i.e., from endpoint to endpoint, unlike CDMA techniques which allow for multiple access by different people, different devices or different sources, and send to multiple sinks. Moreover, compression is not required for the transport of the sample values.
Summing digitally, these modulated values in the first time interval yields digital value 952′ “011001” (again, the MSB is the sign bit); the other digital values 954′-958′ are not shown in this example, but are calculated in the same way. Considering this summation in base 10, one can verify that the modulated values 13, 3, 1 and 8 do sum to 25. Although not shown in this example, typically additional MSBs will be available for the resultant levels 952′-958′ in that the sum may require more than five bits. For example, if values 902′-908′ are represented using four bits, then levels 952′-958′ may be represented using up to ten bits, in the case where there are 64 codes (adding log 2 of 64 bits). Or, if 32 modulated values are summed then five more bits will be added. The number of bits needed for the output levels will depend upon the number of codes.
The output levels 950′ may be first normalized to adjust to the DAC' s input requirements and then fed sequentially into a DAC 959 for conversion of each digital value into its corresponding analog value for transmission over the EM pathway. DAC 959 may be a MAX5857 RF DAC (includes a clock multiplying PLL/VCO and a 14-bit RF DAC core, and the complex path may be bypassed to access the RF DAC core directly), and may be followed by a bandpass filter and then a variable gain amplifier (VGA), not shown. In some situations the number of bits used in levels 950′ are greater than the number allowed by DAC 959, e.g., level 952′ is represented by ten bits but DAC 959 is an 8-bit DAC. In these situations, the appropriate number of LSBs are discarded and the remaining MSBs are processed by the DAC, with no loss in the visual quality of the resultant image at the display.
Advantageously, entire digital values are modulated, and then these entire modulated digital values are summed digitally to produce a digital output level for conversion and transmission. This technique is different from CDMA which modulates each binary digit of a digital value and then sums these modulated bits to produce outputs. For example, assuming that there are B bits in each digital value, with CDMA, there will be a total of B*L output levels to send, whereas with this novel digital (or analog) encoding technique there will only be a total of L output levels to send, thus having an advantage.
As previously explained, analog voltage levels are sent sequentially over an electromagnetic pathway, each level being the summation of modulated samples per time interval, such as the analog output levels 952-958 above or the digital output levels 952′-958′ above (after being passed through a DAC). When sent, these output levels then appear as a waveform such as waveform 602. In particular, voltage level 980 represents the summation in a particular time interval of modulated samples (i.e., an output level). Using a simplistic example, sequential voltage levels 980-986 represent the transmission of four output levels. In this example, 32 codes are used, meaning that 32 samples may be transmitted in parallel; thus, voltage levels 980-986 (followed by a number of subsequent voltage levels, depending upon the number of chips in a code, L) form the transmission in parallel of 32 encoded samples (such as pixel voltages from a video source). Subsequent to that transmission, the next set of L voltage levels of waveform 602 represent the transmission of the next 32 samples. In general, waveform 602 represents the encoding of analog or digital values into analog output levels, and the transmission of those levels in discrete time intervals to form a composite analog waveform.
Next, as indicated by the horizontal arrows, each series of modulated values is summed in order to produce one of the analog values 902-908. For example, the first series is summed to produce the analog value “1.2” (which becomes “.3” after being normalized using the scale factor of “4). In a similar fashion, the other three series of modulated values are summed to produce the analog values “2.8”, “0” and “4”, and after being normalized yield the output vector of analog values 902-908. Each code may modulate the input levels and then that series may be summed, or, all may modulate the input levels before each series is summed. Thus, the output vector of N analog values 902-908 has been transported in parallel using L output levels. Not shown in these examples is an example of decoding digital input levels, although one of skill in the art will find it straightforward to perform such decoding upon reading the encoding of digital values in the above description.
Due to such phenomena as attenuation, reflections due to impedance mismatches, and impinging aggressor signals, every electromagnetic pathway degrades electromagnetic signals that propagate through it, and thus measurements taken of input levels at a receiving terminal are always subject to error with respect to corresponding output levels made available at the transmitting terminal. Hence, scaling of input levels at a receiver (or normalization or amplification of output levels at a transmitter) may be performed to compensate, as is known in the art. Further, due to process gain (i.e., due to an increase in L which also increases electrical resilience) decoded input levels at a decoder are normalized by a scale factor using the code length to recover the transmitted output levels as is known in the art. Further, as herein described, although it is preferable that L>=N>=2, in some situations it is possible that L will be less than N, i.e., N>L>=2.
The above describes in general integration of the SSVT transmitter with a timing controller and integration of the SSVT transmitter with a timing controller and system-on-a-chip. Below are specific embodiments showing examples of this integration.
Integrated module 320 may take different forms such as a single integrated circuit or implementation upon a printed circuit board, and may include a single TCON or two or more TCONs. Module 320 may be implemented as shown in
The encoders of the SSVT transmitter then each send an SSVT signal 322 to corresponding source drivers 324 of the display 328. In this example, there are 24 encoders, meaning 24 SSVT signals and 24 source drivers. As mentioned above, each source driver is preferably implemented as described herein and in U.S. application Ser. No. 17/900,570 (HYFYP009) and integrates an SSVT receiver (having a corresponding decoder) with elements of a traditional source driver.
Not shown is an example of an 8K120 display set which may be implemented as shown in
Integrated module 350 may take different forms such as a single integrated circuit or implementation upon a printed circuit board, and may include a single TCON or two or more TCONs. Integration of the TCON and SSVT transmitter may be implemented as shown in
The encoders of the SSVT transmitter then each send an SSVT signal 352 to corresponding source drivers 354 of the display 358. In this example, there are 24 encoders, meaning 24 SSVT signals and 24 source drivers. As mentioned above, each source driver is preferably implemented as described herein and in U.S. application Ser. No. 17/900,570 (HYFYP009) and integrates an SSVT receiver (having a corresponding decoder) with elements of a traditional source driver. No DACs are needed in such a source driver.
Not shown is an example of an 8K120 display set which may be implemented as shown in
Input into the integrated SoC, TCON and SSVT transmitter 450 of the display set is a compressed digital video signal 432 that may be input via an HDMI connector 433 or an RJ-45 connector 435, among other suitable types of connectors. The SoC uncompresses this digital data (and performs other processing as known in the art and as described above) and transfers this modified digital data internally to the integrated timing controller and SSVT transmitter.
Integrated module 450 may take different forms such as a single integrated circuit or implementation upon a printed circuit board, and may include a single TCON or two or more TCONs. Integration of the TCON and SSVT transmitter may be implemented as shown in
The encoders of the SSVT transmitter then each send an SSVT signal 452 to source drivers 354 of the display 458, each source driver receiving three SSVT signals, i.e., 3×SSVT Pairs at 317×3 MSamples/s. In this example, there are 48 encoders, meaning 48 SSVT signals and only 16 source drivers needed because of the multiplexing. As mentioned above, each source driver is preferably implemented as described herein and in U.S. application Ser. No. 17/900,570 (HYFYP009) and integrates an SSVT receiver (having a corresponding decoder) with elements of a traditional source driver. No DACs are needed in such a source driver. Multiplexing of the three incoming SSVT signals into each source driver may be performed as known to one of skill in the art. Advantageously, the multiplexing dramatically reduces the number and cost of the source drivers.
As mentioned above, the SSVT signals 167 from the integrated SSVT transmitter and timing controller 150 or from the integrated SSVT transmitter, timing controller and SoC 140′ shown in the various embodiment herein, are transported to source drivers 169 of a display panel. Below is a description of how an SSVT receiver may be integrated with such a source driver or drivers.
Decoding unit 610 may have any number (P) of decoders and having only a single decoder is also possible. Unit 610 decodes the SSVT signal or signals (described in greater detail below) and outputs numerous reconstructed analog sample streams 612, i.e., analog voltages (the number of samples corresponding to the number of outputs of the source driver). Because these analog outputs 612 may not be in the voltage range required by the display panel they may require scaling and may be input into a level shifter 620 which shifts the voltages into a voltage range for driving the display panel using an analog transformation. Any suitable level shifters may be used as known in the art, such as latch type or inverter type. Level shifters may also be referred to as amplifiers.
By way of example, the voltage range coming out of the decoding unit might be 0 to 1 V and the voltage range coming out of the level shifter may be −8 up to +8 V (using the inversion signal 622 to inform the level shifter to flip the voltage every other frame, i.e., the range will be −8 to 0 V for one frame and then 0 V to +8 V for the next frame). In this way, the SSVT signals do not need to have their voltages flipped every frame; the decoding unit provides a positive voltage range (for example) and the level shifter flips the voltage every other frame as expected by the display panel. The decoding unit may also implement line inversion and dot inversion. The inversion signal tells level shifter which voltages to switch. Some display panels such as OLED do not require this voltage flipping every other frame in which case the inversion signal is not needed and the level shifter would not flip voltages every other frame. Display panels such as LCD do require this voltage flipping. The inversion signal 622 is recovered from the decoding unit as will be explained below.
Also input into the level shifter 620 can be a gain and a gamma value; gain determines how much amplification is applied and the gamma curve relates the luminous flux to the perceived brightness which linearizes human's optical perception of the luminous flux. Typically, in prior art source drivers both gain and gamma are set values determined by the manufactured characteristics of a display panel. In the analog level shifter 620 gain and gamma may be implemented as follows. Gamma is implemented in the digital part of the system in one embodiment, and level shifting and gain are implemented in the driver by setting the output stage amplification. In the case of gamma, implementation is also possible in the output driver, by implementing a non-linear amplification characteristic. Once shifted, the samples are output into outputs 634 which are used to drive the source electrodes in their corresponding column of the display panel as is known in the art.
In order to properly encode an SSVT signal for eventual display on a particular display panel (whether encoded within the display unit itself or farther upstream outside of that display unit) various physical characteristics or properties of that display panel are needed by the GPU (or other display controller) or whichever entity performs the SSVT encoding. These physical characteristics are labeled as 608 and include, among others, resolution, tessellation, backlight layout, color profile, aspect ratio, and gamma curve. Resolution is a constant for a particular display panel; tessellation refers to the way of fracturing the plane of the panel into regions in a regular, predetermined way and is in units of pixels; backlight layout refers to the resolution and diffusing characteristic of the backlight panel; color profile is the precise luminance response of all primary colors, providing accurate colors for the image; and the aspect ratio of a display panel will have discrete, known values.
These physical characteristics of a particular display panel may be delivered to, hardwired into, or provided to a particular display controller in a variety of manners. In one example, a signal 608 delivers values for these physical characteristics directly from the display panel (or from another location within a display unit) to the SSVT transmitter 540. Or, an SSVT transmitter 540 embedded within a particular display unit comes with these values hardcoded within the transmitter. Or, a particular display controller is meant for use with only particular types of display panels and its characteristic values are hardcoded into that display controller.
Input to the display panel can also be a backlight signal 604 that instructs the LEDs of the backlight, i.e., when to be switched on and at which level. In other words, it is typically a low-resolution representation of an image meaning that the backlight LEDs light up where the display needs to be bright and they are dimmed where the display needs to be dim. The backlight signal is a monochrome signal that can also be embedded within the SSVT signal, i.e., it can be another parallel and independent video signal traveling along with the other parallel video signals, R, G and B (for example), and may be low or high resolution.
Output from decoding unit 610 is a gate driver control signal 606 that shares timing control information with gate drivers 560 on the left edge of the display panel in order to synchronize the gate drivers with the source drivers. Typically, each decoding unit includes a timing acquisition circuit that obtains the same timing control information for the gate drivers and one or more of the source driver flex foils (typically leftmost and/or rightmost source driver) will conduct that timing control information to the gate drivers. The timing control information for the gate drivers is embedded within the SSVT signal and is recovered from that signal using established spread spectrum techniques.
Note that
Many variations of providing the gate control signals are possible. The gate signal is a stand-alone signal in origin (start pulse+clock+control), but can be transported together with the SSVT signal as shown in
Typically, a conventional display driver is connected directly to glass using “COF” (Chip-on-Flex or Chip-on-Foil) IC packages; conventional COG (chip-on-glass) is also possible but is not common on large displays. It is possible to replace these drivers by the novel source drivers of
On the receive side, the decoders of each source driver are responsible for decoding the stream of the differential EM level signals received over the transmission medium back into a format suitable for display. Once in the suitable format, the video content contained in the samples can be presented on a video display, frame after frame. As a result, the video capture by any video source can be re-created by a video sink. Alternatively, the decoded video information can be stored for display at a later time in a time shifted mode.
The P decoders 780 (labeled 0 through P-1) are arranged to receive differential EM level signals Level0 through LevelP−1 respectively, 702-704. In response, each of the decoders 780 generates N differential pairs of reconstructed samples (Sample0 through SampleN−1). In the case where there are four decoders 780 (P=4), four vectors V0, V1, V2 and V3 are constructed respectively. The number of samples, N, is exactly equal to the number of orthogonal codes used for the earlier encoding i.e., there are N orthogonal codes used, meaning N codes from the code book.
Reconstruction banks 782 sample and hold each of the differential pairs of N reconstructed samples (Sample0 through SampleN−1) for each of the four decoder output vectors V0, V1, V2 and V3 at the end of each decoding interval respectively. These received differential pair of voltage signals are then output as samples (SampleN−1 through Sample0) for each of the four vectors V0, V1, V2 and V3 respectively. Essentially, each reconstruction bank reconstructs from a differential pair to a single voltage. The staging bank 786 receives all the reconstructed samples (Nn−1 through N0) for each of the four decoder output vectors V0, V1, V2 and V3 and serves as an analog output buffer as will be described in greater detail below. Once the samples are moved into staging bank 786 they are triggered by a latch signal 632 derived from the decoded SSVT signal. The latch signal may be daisy-chained between source drivers. Once the samples are released from the staging bank they are sent to level shifter 620.
Decoding unit 610 also includes a channel aligner 787 and a staging controller 789, which receives framing information and aperture information from each decoder 780. In response, the staging controller 789 coordinates the timing of the staging bank 786 to ensure that all the samples come from a common time interval in which the level signals were sent by the SSVT transmitter. As a result, the individual channels of the transmission medium do not necessarily have to all be the same length since the channel aligner 787 and staging controller 789 compensate for any timing differences. The gate driver control signals 606 provide the timing information to the gate drivers (or to intermediate circuitry) thus providing the correct timing and control signals to the gate drivers and may originate from channel aligner 787. Note that
Shown are 24 720 MHz SSVT signals 652-654, each being a twisted-wire pair from an SSVT transmitter 540, that is, each twisted wire pair originating at an encoder of the transmitter. Each pair is input into one of decoders 656-658, each decoder outputting 64 analog samples at a frequency of 11.25 MHz. These samples are each input into one of 24 collectors 662-664, each collector collecting 15 sets of these samples before updating its output once every 15 decoding intervals as is shown in greater detail below. As mentioned above, each collector consists of a reconstruction bank plus a staging bank (not shown explicitly in this drawing). In turn, these 960 analog samples from each collector are then input at a frequency of 750 kHz into one of amplifiers 666-668 for amplification before being output at a frequency of 750 kHz (11.25 MHz×64/960) as amplified analog levels 670 onto the display columns of the display panel. In the interests of clarity, not shown are signals 604, 606, 608, 622, 632 which are shown in
Theoretically, the amplifiers or level shifters may be left out if the encoded SSVT signals are higher voltages and the decoded signals result in sample voltages that are required by a display. But, as the SSVT signal will typically be low voltage (and a higher voltage output is required for a display), amplification is necessary. Note that
The controller 1098 of each of the decoders 780 also generates a number of control signals, including a strobe signal, an end-of-bank (EOB) signal, an aperture signal and a framing signal. The EOB signal is provided to the reconstruction bank 782 and signifies the timing for when the staging bank 786 is completely full with samples. When this occurs, the EOB signal is asserted, clearing both the decoder tracks 1096 and the staging bank 786 in anticipation of a next set of reconstructed samples (Nn−1 through N0). The aperture control signal is provided to the sample and hold circuit 1094, and the framing signal is provided to the channel aligner 787 and also to the staging controller 789.
Referring to
If the SSDS chip has a value of (+1), then transistor pairs S1-S1 and S3-S3 close, while S2-S2 remain open, when clk 1 is active. As a result, the voltage values at the first level input (level +) terminal and the second level input (level −) are passed onto and stored by the two capacitors C1 and C1 on the positive and negative rails respectively. In other words, the input values are multiplied by (+1) and no inversion takes place.
If the SSDS chip has a value of −1, then the S1-S1 switches are both off, while the switches S2-S2 and S3-S3 are all turned on when clk 1 is active. As a result, the voltage values received at the positive or first (+) terminal and the negative or second (−) terminal are swapped. In other words, the input voltage value provided at the first or positive terminal is directed to and stored on the capacitor C1 on the lower negative rail, while the voltage value provided on the second or (−) terminal is switched to and stored on the capacitor C1 on the positive upper rail. The received voltage values at the input terminals are thereby inverted or multiplied by (−1).
When clk 1 transitions to inactive, the accumulated charge on C1 and C1 remain. When clk 2 transitions to active, then transistor pairs S4-S4 open while transistor pairs S5-S5 and S6-S6 close. The accumulated charge on the capacitors C1 on the upper or positive rail and C1 on the lower or negative rail are then provided to the differential inputs of the operational amplifier. The output of the operational amplifier is the original +/− sample pair prior to encoding on the transmit side.
The accumulated charge on the two capacitors C1 and C1 are also passed on to the capacitors CF and CF on the upper or positive rail and the lower or negative rail when Clk 2 is active. With each demodulation cycle, the charges on the capacitors C1 and C1 on the upper and lower rails are accumulated onto the two capacitors CF and CF on the upper and lower rails, respectively. When clk 1 and the EOB signal are both active, then the transistor pair S7-S7 are both closed, shorting the plates of each of the capacitors CF and CF. As a result, the accumulated charge is removed, and the two capacitors CF and CF are reset and ready for the next demodulation cycle.
Since each decoder 780 has N decoder track circuits 1096, N decoded or original +/− sample pairs are re-created each demodulation cycle. These N +/− sample pairs are then provided to the reconstruction bank 782, and then to the staging bank 786. As a result, the original set of samples is re-created with its original color content information (e.g., S=3 for RGB).
The decoder track 1096 reconstructs incoming level samples over a succession of L cycles, demodulating each successive input level with the successive SSDS chips of that tracks code. The results of each of the L demodulations is accumulated on the feedback capacitor CF. When EOB is asserted during clk 1 corresponds to the first demodulation cycle of the decoding cycle, CF is cleared after EOB such that it can begin again accumulating from zero volts or some other reset voltage. In various non-exclusive embodiments, the value of L is a predetermined parameter. In general, the higher the parameter L the greater the SSDS process gains and the better the electrical resiliency of the transmission of the SSVT signals over the transmission medium. On the other hand, the higher the parameter L, the higher the required frequency for the application of the SSVT modulation, which may compromise the signal quality due to insertion losses caused by the transmission medium. The above-described demodulation cycle is repeated over and over with each of the decoders. The net result is the recovery of the original time-ordered sets of samples, each with their original color content information (i.e., a set of S samples).
We propose a split OLED DDIC architecture which will have the following advantages: enables optimal DDIC-TCON and DDIC-SD partitioning; provides a short distance MIPI transmission from the SoC; optimizes the digital DDIC-TCON for SRAM and image processing; provides a simplified DDIC which is all analog; and only requires a small number of digital-to-analog converters in DDIC-TCON integrated with the SSVT transmitter.
Shown is a mobile telephone (or smartphone) 500 which may be any similar handheld, mobile device used for communication and display of images or video. Device 500 includes a display panel 510, a traditional mobile SoC 520, an integrated DDIC-TCON (Display Driver IC-Timing Controller) and SSVT transmitter module 530, and an integrated analog DDIC-SD (DDIC-source driver) and SSVT receiver 540. Mobile SoC 520 and module 530 are shown external to the mobile telephone for ease of explanation although they are internal components of the telephone.
Mobile SoC 520 is any standard SoC used in mobile devices and delivers digital video samples via MIPI DSI 524 (Mobile Industry Processor Interface Display Serial Interface) to the module 530 in a manner similar to V×1 input signals discussed above. Included within module 530 is the DDIC-TCON integrated with an SSVT transmitter. Upon a reading of this disclosure and with reference to the previous drawings, one of skill in the art will understand how to implement the SSVT transmitter in order to output any number of analog SSVT signals 534. In this example, the SSVT transmitter outputs 12 pairs of SSVT signals at 380 Msps. Not shown are the timing and framing controls signals from module 530 to the gate drivers of display panel 510. Typically, for a mobile telephone, the DDICs are located at the bottom narrow edge of the telephone while the SoC is about in the middle of the device. Accordingly, the integrated DDIC-TCON/SSVT transmitter is located close to the SoC, within about 10 cm or less, or even about 1-2 centimeters or less. Since the transmission of digital data is at extreme frequencies, it is advantageous to keep the conductor lengths as short as possible. For a table computer, the distance is about 25-30 cm or less.
These analog SSVT signals received at the integrated analog DDIC-SD and SSVT receiver 540. A description of how to integrate a source driver with an SSVT receiver in order to receive any number of analog SSVT signals and to generate voltages for driving a display panel may be found herein and in application Ser. No. 17/900,570 (HYFYP009) referenced above. Advantageously, only a single source driver is needed to drive the display panel 510 and module 540 does not need any digital-to-analog converters.
The invention includes the following other embodiments.
Although the foregoing invention has been described in some detail for purposes of clarity of understanding, it will be apparent that certain changes and modifications may be practiced within the scope of the appended claims. Therefore, the described embodiments should be taken as illustrative and not restrictive, and the invention should not be limited to the details given herein but should be defined by the following claims and their full scope of equivalents.
This application is a continuation of U.S. application Ser. No. 18/098,612, filed Jan. 18, 2023 (HYFYP013), which claims priority of U.S. provisional patent application No. 63/300,975, filed Jan. 19, 2022 (HYFYP013P), No. 63/317,746, filed on Mar. 8, 2022 (Docket No. HYFYP013P2), No. 63/391,226, filed on Jul. 21, 2022 (Docket No. HYFYP013P3), all of which are hereby incorporated by reference. This application also incorporates by reference U.S. application Ser. No. 15/925,123, filed on Mar. 19, 2018 (Docket No. HYFYP001), U.S. application Ser. No. 16/494,901 filed on Sep. 17, 2019 (Docket No. HYFYP002), U.S. application Ser. No. 17/879,499 filed on Aug. 2, 2022 (Docket No. HYFYP003), U.S. application Ser. No. 17/686,790, filed on Mar. 4, 2022 (Docket No. HYFYP004AX1), U.S. application Ser. No. 17/887,849 filed on Aug. 15, 2022 (Docket No. HYFYP006), U.S. application Ser. No. 17/851,821, filed on Jun. 28, 2022 (Docket No. HYFYP007), U.S. provisional application No. 63/398,460 filed on Aug. 16, 2022 (Docket No. HYFYP008P), U.S. application Ser. No. 17/900,570 filed on Aug. 31, 2022 (Docket No. HYFYP009), and U.S. provisional application No. 63/346,064 filed on May 26, 2022 (Docket No. HYFYP014P2).
Number | Date | Country | |
---|---|---|---|
63300975 | Jan 2022 | US | |
63317745 | Mar 2022 | US | |
63391226 | Jul 2022 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 18098612 | Jan 2023 | US |
Child | 18333987 | US |