Patent Grant
11271673
Communication systems strive to reliably transmit a high quantity of information over a channel of a given bandwidth. In traditional design of communication systems, predominantly modulation formats without memory are used. These systems cannot approach the theoretical bounds of spectral efficiency, also known as the Shannon limit or Shannon capacity without the aid of error control coding (ECC). Coupled with sophisticated encoding schemes that jointly optimize the modulation and error control coding, communication systems without memory can perform close to the theoretical bounds. Error-control codes typically append redundant information bits, or symbols, so as to achieve resilience and/or improved performance in the presence of obstacles in the process of the information transfer, such as noise and distortions.
Improved performance can be achieved with so-called iterative decoding at the receiver, in which the reliability estimates on the received information symbols are exchanged between the constituent codes' decoders multiple times, with an improved estimate on the information symbols being obtained with each additional iteration.
The process of iterative decoding encompasses interleaving and deinterleaving processes. In these processes, the passing of the codewords between multiple constituent decoders can include the permutation of the relevant information symbols corresponding to the pertinent constituent codes.
In some embodiments, a bandwidth constrained equalized transport (BCET) communication system comprises a transmitter that transmits a signal, a communication channel that transports the signal, and a receiver that receives the signal. The transmitter can comprise an error control code encoder, a pulse-shaping filter, and a first interleaver. The receiver can comprise a receiving filter, an information-retrieving equalizer, a deinterleaver with an error control code decoder, and a second interleaver. In some embodiments, the error control code encoder appends redundant information onto the signal, and the pulse-shaping filter in the transmitter intentionally introduces memory into the signal in the form of inter-symbol interference. The receiving filter can be matched to the pulse-shaping filter and the information-retrieving equalizer can be a trellis-based equalizer. In some embodiments, the information-retrieving equalizer, the second interleaver, and the deinterleaver with the error control code decoder are joined in an iterative turbo equalization loop. In some embodiments, the error control code encoder is a low-density parity-check (LDPC) error control code encoder, and the error control encoder comprises code that is optimized based on the intentionally introduced memory into the signal, a code rate, a signal-to-noise ratio, and an equalizer structure in the receiver. In some embodiments, the communication system is bandwidth constrained, and the transmitted signal comprises an information rate that is higher than for an equivalent system without intentional introduction of the memory at the transmitter.
In some embodiments, a method comprises providing a signal comprising symbols, encoding the symbols using an error control code encoder in a transmitter of a communication system to produce encoded symbols, interleaving the encoded symbols using a first interleaver in the transmitter to produce interleaved symbols, intentionally introducing memory into the interleaved symbols in the form of inter-symbol interference using a pulse-shaping filter in the transmitter to produce pulse-shaped symbols, transmitting the pulse-shaped symbols to a receiver of the communication system over a physical memoryless channel with additive white Gaussian noise, receiving the transmitted pulse-shaped symbols using a receiving filter in the receiver to produce a receiving filtered signal, equalizing the receiving filtered signal using an information-retrieving equalizer in the receiver to produce equalized symbols, deinterleaving the equalized symbols using a deinterleaver in the receiver to produce deinterleaved symbols, processing the deinterleaved symbols using a non-linear function block in the receiver to produce a non-linear signal, decoding the non-linear signal using an error control code decoder in the receiver to produce decoded symbols, and iteratively updating the decoded symbols using a turbo equalization loop in the receiver to produce updated decoded symbols after each iteration.
In some embodiments of the above method, the turbo equalization loop in the receiver comprises iteratively repeating: equalizing iterated interleaved symbols using the information-retrieving equalizer to produce iterated equalized symbol likelihoods, deinterleaving the iterated equalized symbol likelihoods using a deinterleaver in the turbo equalization loop to produce iterated deinterleaved symbol likelihoods, transforming the iterated deinterleaved symbol likelihoods using a non-linear function to produce iterated non-linearly transformed symbol likelihoods, decoding the iterated non-linearly transformed symbol likelihoods to produce the updated decoded symbol likelihoods, and interleaving the updated decoded symbol likelihoods using a second interleaver in the turbo equalization loop to produce an iterated interleaved signal comprising the updated decoded symbols. In some embodiments of the above method, the error control code encoder appends redundant information onto the symbol stream, the error control code encoder is a low-density parity-check (LDPC) error control code encoder, and the error control encoder comprises code that is optimized based on the intentionally introduced memory into the signal, a code rate, a signal-to-noise ratio, and the receiver equalizer structure. In some embodiments of the above method, the receiving filter is matched to the pulse-shaping filter. In some embodiments, the information-retrieving equalizer is a trellis-based equalizer. In some embodiments of the above method, the non-linear function block transforms the deinterleaved symbols according to a non-linear function. In some embodiments of the above method, the communication system is bandwidth constrained, and the transmitted signal comprises an information rate that is higher than for an equivalent system without intentional introduction of the memory at the transmitter.
In some embodiments, a method comprises: a. providing a bandwidth constrained equalized transport (BCET) communication system comprising a transmitter, a receiver, a partial channel response, a channel equalization structure, a low-density parity-check (LDPC) error control code encoder in the transmitter, and a non-linear function block in the receiver; and providing input parameters comprising a codeword length, a code rate, a level of parallelism, and a maximum variable degree; b. initializing a variable node degree distribution; c. calculating a check node degree distribution for the provided input parameters; d. optimizing a variable node degree distribution for the LDPC codes in the LDPC error control encoder, and non-linear parameters of a non-linear function using a density evolution algorithm for partial response channels; e. calculating a corresponding threshold; f repeating steps b.-e. for different input parameters to generate a database of possible solutions; and g. recalculating the variable node degree distribution and the check node degree distribution for a part of a parity check matrix (H1) excluding a double diagonal matrix.
The present invention includes systems and methods directed at improving the performance of bandwidth constrained systems and/or the capacity of communication systems and in particular with the aim of reducing the associated processing, or circuit implementation complexity. In some embodiments, the described systems and methods also simplify the receiver structure in bandwidth constrained systems. In some embodiments, the described communication systems and methods are referred to as bandwidth constrained equalized transport (BCET) systems and methods. The term “BCET communication system” (or “BCET system”) as used herein is defined as a communication system that uses narrowband filtering in the transmitter to intentionally introduce memory into a signal, and equalization techniques in the receiver to account for the intentionally introduced memory. If properly designed, the achievable information rate in BCET systems can be improved over conventional communication systems that do not intentionally introduce memory in the signal.
BCET systems typically rely on equalization to mitigate the effect of bandwidth limitation. In particular, the systems with high spectral efficiency, or equivalently a considerable amount of bandwidth limitation, can be affected by distortions that induce a significant extension of the channel response duration, thus requiring long, and/or complex equalization structures to appropriately handle the effects of the induced intersymbol interference. Complex equalizers required to implement the sophisticated encoding schemes not only significantly increase the complexity and the practical realization of their systems, but also increase the overall system power consumption.
The overall performance and the underlying complexity of the equalizer used in communication systems represent critical concerns in their practical realizations, and are of particular importance for wideband systems with high throughput. These properties result in both higher reliability and/or capacity in communication systems, as well as a lower receiver and system overall power dissipation and an easier practical implementation.
In some embodiments, a BCET system includes a receiver comprising an equalizer, an optional pre-processing approach applied to the incoming waveforms (i.e., samples) availing the utilization of a lower complexity information retrieving equalizer, and an error control decoder matched to the encoder in the transmitter and to the bandwidth constrained channel. Advantageously, BCET systems can obtain superior system performance, with lower system complexity, latency and power dissipation. In some cases, BCET systems employ digital reshaping at the receiver in a specific way, so as to avail utilization of lower complexity information retrieving equalizers in the receiver processing chain.
In some embodiments, a method for receiving data in a BCET communications system includes the following steps: (1) shortening the channel response by means of a specific signal processing step; (2) equalization, or information retrieval by an appropriate equalizer, and (3) error control decoding. The equalizers in the receiver can be implemented in the time domain or the frequency domain.
In some embodiments, a method for complexity reduction of equalizers in communication systems, consists of the following steps: (1) acquiring a full length channel response, i.e., for symbol patterns equal in length (or longer) to the length of the channel spread, (2) reducing the set of channel responses by averaging (e.g., weighted averaging) the subsets of responses chosen in a particular way (e.g., the channel responses are divided into subgroups, based on the underlying symbol patterns they correspond to), and (3) using the thus obtained reduced set of responses as a model channel response for lower complexity equalization. In some cases, steps (1) and (2) in the method above can be repeated periodically (e.g., in the case of time varying channels).
Systems and methods relating to BCET systems are described more completely in U.S. Patent Application Pub. No. 2014/0269894 and U.S. Pat. No. 9,154,346, the entirety of which are incorporated herein by reference.
The present invention employs optimized error control coding in conjunction with bandwidth constriction (i.e., intentionally introducing memory into the communication system) to attain a novel quality (e.g., in performance and capacity) in communication systems. In some embodiments, a system architecture is applied at the receiver of a bandwidth constrained communication system (or in a BCET communication system with intentionally introduced memory) to attain a novel quality (e.g., in performance and capacity). In some embodiments, the systems and methods described herein can operate even closer to the theoretical bounds than conventional systems (e.g., those mentioned above). For example, the systems and methods described herein can operate close to or above the Shannon limit for memoryless channels with additive white Gaussian noise.
The present communication systems provide superior system performance, latency and power dissipation compared to conventional systems, with complexity levels suitable for practical implementations. In different embodiments, the described systems include non-orthogonal pulse shape transmission, receivers comprising equalizers, optionally a pre-processing method applied to the incoming waveforms with the goal of using a lower complexity information retrieving equalizer, and/or error control coders and decoders matched to the bandwidth constrained channels of the systems.
A method is described for use with bandwidth restricted communication systems, which includes an appropriate combination of partial response channel design, equalization, and error control coding, and qualitatively improves the overall system performance and capacity. A “partial response channel” usually denotes a channel where the channel output at some time instant is a weighted sum (or other function) of a finite number of previous channel inputs, rather than just the amplified channel input value at the same time instant (plus some noise value). In contrast, a “full response channel” is a channel with no inter-symbol interefence (ISI). For example, in BCET systems partial response channels are intentionally created by using specially designed pulse-shape filters that are non-orthogonal to the sample rate. However, partial response channels are traditionally considered as unwanted phenomenon in communication transmission, which appear as a consequence of some implementation imprecision or multipath propagation effects. In some embodiments, a partial response channel in a bandwidth restricted communication system transmits a bandwidth limited signal (e.g., signals that have been shaped using particular types of pulse shaping filters, such as root-cosine and root-raised-cosine filters). In some embodiments, in addition to the intentional pulse shaping performed on the bandwidth constrained signal, partial response channels can also unintentionally distort signals during transmission through the channel. In some embodiments, the described systems and methods include digital reshaping at the receiver in a specific way (e.g., to whiten colored noise samples after matched filtering, and to shorten the channel response), which enables the use of lower complexity information retrieving equalizers in the receiver processing chain. In some embodiments, the described systems and methods include the following steps: (1) implementation of a non-orthogonal partial response channel design; (2) shortening of the channel response by means of a specific signal processing step; (3) equalization (or information retrieval by an appropriate equalizer); and (4) error control decoding.
The present invention is different from conventional systems and methods. Some examples of differences, in some embodiments, include that the described systems and methods: (1) encompass a particular combination of processing steps (e.g., specific pulse shape design, optimized error control coding in bandwidth constricted systems, and intersymbol interference shortening and trellis-based equalization) that provide qualitatively novel and improved system performance; (2) enable a significant complexity reduction of the information retrieving equalizer by introducing a pre-processing step of signal reshaping; (3) enable additional gains by employing nonlinear processing elements on internal receiver signal paths: (4) provide additional gains closer to theoretical capacities (e.g., close to or exceeding the Shannon limit for memoryless channels with additive white Gaussian noise) by optimizing error control code structures according to introduced narrowband response parameters. The present systems employ bandwidth constriction to improve the information rate by advantageously intentionally introducing memory (or ISI) through unconventional pulse shaping in the transmitter. This is in contrast to conventional systems, which may be affected by unintentional memory (or ISI), which is minimized, and viewed as a problem or disadvantage.
The present invention is applicable to a wide range of transmission technologies and/or communication protocols. For example, it can be used for binary and/or M-ary information streams, a variety of error-correction schemes, as well as in M-ary single carrier or Orthogonal-Frequency Division Multiplex (OFDM) modulation modes.
Furthermore, the present invention is not restricted to a certain equalization techniques. For example, pulse shaping filters can be employed with the optimal full complexity BCJR equalizer (i.e., a Bahl-Cocke-Jelinek-Raviv equalizer, named after the inventors), BCJR equalizers with reduced complexity (e.g., M-BCJR, T-BCJR), or Viterbi-based equalizers. The described systems and methods are also applicable to a BCET system with an arbitrary bandwidth narrowing factor and/or equalizer complexity level.
In some embodiments, the receivers of the systems described herein contain a detector, a filter, an equalizer and a decoder with an interleaver (and optionally, a de-mapper). Similar components can be found in conventional receivers. However, the systems described herein are bandwidth constrained systems with intentionally introduced memory, and therefore conventional components and methods are insufficient. For example, the equalizers in the current systems (e.g., BCJR equalizers) are much more complex than conventional equalizers employed to deal with unintentional partial response channels. Such complex equalizers are not used in conventional receivers, due to the inherent exponential complexity with memory. For another example, the current data extraction systems and methods can contain turbo-equalization-loops (i.e., multiple circular exchanges of information between the equalizer and the decoder, which are described more completely below), which, in addition to adding complexity, also adds significant latency. The advantage of the current systems and methods over conventional systems and methods is that exceptional performance can be achieved with lower complexity than has been previously described.
Additionally, in some embodiments, methods for designing optimized structured irregular low-density parity-check (LDPC) codes are described. These codes can be applied as error correction methods within trellis-based equalization in turbo loops in BCET systems.
In some embodiments, the method enables construction of optimized LDPC codes that fulfil one or more of the following requirements: 1) the code belongs to the irregular repeat accumulator (IRA) class of codes, that enables linear complexity of the encoding; 2) the parity check matrix can be rearranged in quasi-cyclic (QC) form, that enables layered decoding without hardware memory (i.e., information storage within electronic hardware such as field programmable gate array/application-specific integrated circuit (FPGA/ASIC), and not memory effects applied to a signal such as intersymbol interference) conflicts; 3) the degree distributions and the parameters of the turbo loop are optimized for the known (i.e., designed) partial response channel and required level of parallelism; and 4) the designed code compensates for the imprecision caused by reducing the complexity of the equalization part of a turbo loop.
In some embodiments, the present invention combines different optimization techniques in a unique fashion, to produce optimized LDPC codes that are adjusted to BCET pulse shaping and receiving filters in BCET systems. These optimized LDPC codes can enable reliable communication rates in BCET systems that operate close to or even potentially exceed the Shannon limit.
In some embodiments, the information is encoded with error-control redundant symbols using an ECC encoder (e.g., in element 110) with a Low-Density Parity-Check (LDPC) code, a turbo code, a polar code, or other type of error control code. Although different types of error-control codes can have different strengths and weaknesses, the systems and methods described herein are not limited to a particular type of code. For instance, LDPC codes can enable superior system capacity while using attractive implementation architectures (e.g., with layered LDPC decoders), compared to turbo codes. LDPC code optimization is discussed in more detail below. Polar codes also can enable high system capacity, but can have higher complexity for practical implementations (e.g., using a successive cancellation decoder), compared to systems based on LDPC codes. In another example, polar codes can be used in ECC encoders in BCET systems by replacing the block polarization kernel that is used in the polar code construction for channels without memory by a kernel appropriate for channels with memory and possibly a convoluted kernel. In adoption of polar codes for BCET systems, the successive cancellation list decoding algorithm can be used, that is a sub-optimal version of the successive cancellation decoding algorithm, which in turn enables higher information throughputs of the overall system as well as a lower receiver complexity. In some embodiments, the ECC encoder includes a cascade of two component encoders (e.g., an outer and an inner encoder). Throughout this disclosure, the present systems and methods are often described within the context of LDPC codes, however, the examples above illustrate that the systems and methods described herein are applicable to applications using many different types of codes (e.g., turbo codes or polar codes).
In some embodiments, the pulse-shaping filter 150 narrows the bandwidth required for the transmission by spreading the value of a single modulated symbol to L neighboring symbols, i.e., producing ISI and thus intentionally introducing memory into the transmitted signals. In other words, L is the symbol memory length in the BCET system. The systems and methods described herein intentionally distort the signal (i.e., by narrowband filtering) and contain an ECC optimized for the distorted signal, which unexpectedly improve system performance (e.g., increases the spectral efficiency of the system, improves the dispersion of the system, and/or increases the system capacity). The systems described herein are therefore different than traditional communication systems, which have unintentional distortions that degrade system performance. System capacity, as used herein, refers to the information rate per bandwidth of frequency that is achieved at a given signal-to-noise ratio (SNR). Systems and methods wherein memory is intentionally introduced into transmitted signals in communications systems with increased spectral efficiency and/or dispersion are described more completely in U.S. Pat. No. 8,155,530, the entirety of which is incorporated herein by reference.
In some embodiments, the pulse-shaping is the result of a specific design optimization procedure. In some embodiments, the pulse-shaping filter 150 is compatible with one or more of the following design requirements: 1) a high achievable information rate; 2) overall narrowband response (NBR) energy clustering; 3) spectral power concentration (or power in/out of band (PIB/POB) criterion); 4) compliance with the existing spectral masks for wireless transmission; 5) appropriate peak-to-average-power-ratio (PAPR); and 6) appropriate complexity of the information-retrieving equalizer on the receiver side of the system.
In some embodiments, a parameter to consider in pulse shape optimization is the complexity of the information retrieving equalizer. More symbol memory intentionally induced in the system 100 (i.e., increasing L), corresponds to an exponential increase in hardware complexity of the equalizer. In some embodiments, the present pulse shaping filters (e.g., 150) have the required PIB (Power in Band) performance criterion, for example 99% or 99.9% of the power inside a specified constrained bandwith, and also induce low memory that is acceptable for practical implementations of the system. An example of an optimal pulse shape that fulfills these criteria are Prolate Spheroidal Wave Functions (PSWF). In some cases, those pulse shapes have optimal time-bandwidth properties.
In some embodiments, a pulse-shaping filter narrows the bandwidth to a specified value, and maximizes the spectral efficiency and achievable information rates, and has PAPR that is not significantly larger than the PAPR of an orthogonal Nyquist linear modulated signal with higher order modulations with the same spectral efficiency (for a specified PIB criterion, a required hardware complexity, and a maximal memory (i.e., maximum L) induced in the system 100).
Returning to
In some embodiments, the equalization block 194 works directly on symbols obtained by matched filtering, wherein the filter transfer characteristic is matched to the characteristic of the pulse-shaping filter 150. In some cases, the symbol observations contain samples of the noise that are correlated (e.g., those generated using the so-called Ungerboeck observation model). In such cases, an equalizer algorithm is used that can accommodate the colored noise.
In some embodiments, optional impulse response adjustment block 193 is used to whiten the colored noise samples after matched filtering, and shorten the channel response, enabling the utilization of a less complex information-retrieving equalizer. In some embodiments, impulse response adjustment block 193 contains a noise whitening filter which is designed to partially or fully decorrelate the noise samples and/or cluster the majority of the energy of the equivalent partial response to only a small number of samples L′<L.
In some embodiments, the impulse response adjustment block 193 can be realized as a finite impulse response filter, which additionally shortens the impulse response (i.e., effectively reduces L), however other similar approaches achieving the same effect can be applied. Channel shortening is advantageous because it can shorten the effective impulse response, which enables lower complexity equalizer design. In some cases, it is not necessary to adapt the equalizer algorithm to work with the colored noise samples (e.g., using the so-called Forney observation model).
Continuing with
In some embodiments, the BCET equalization is a two-step process: in the first step interference introduced by the communication channel is removed or mitigated, for which any conventional equalizer can be used (e.g., Feed-Forward and/or Decision-Feedback Equalizers), while in the second step a sophisticated equalization technique (e.g., utilizing a BCJR equalizer) is employed to extract transmitted symbols from the intentionally introduced ISI. The equalization process can be optionally joined with the de-mapper 195, interleaver and deinterleaver/ECC decoder 196 blocks in an iterative loop, i.e., a turbo equalization loop, as described further herein.
In some embodiments, the equalizer in a BCET system contains the BCJR algorithm. Equalizers using the BCJR algorithm are optimal for BCET systems (considering MAP (maximum a posteriori probability) criteria). BCJR is a sequential algorithm with a trellis structure where the number of states in each stage of the trellis is ML, where M is the size of the modulation alphabet (e.g., M=2 for BPSK, M=4 for QPSK, M=8 for 8PSK, etc.), and L is the span of ISI memory. The algorithm processes a received (input) data sequence (e.g., an LDPC codeword) on a symbol-by-symbol basis starting from the beginning of the sequence. In some embodiments, the equalizer contains a sub-optimal BCJR variant of the algorithm, such as M-BCJR, T-BCJR, or similar families of algorithms (e.g., Viterbi algorithm, or soft output Viterbi algorithm (SOVA)).
Both the optimal BCJR and sub-optimal algorithms described above typically process data serially. The sequential nature of the algorithms used in BCET system can pose a significant constraint on the achievable throughput of the system using such equalizers.
In order to improve this imposed throughput constraint, in some embodiments, the equalizer in a BCET system contains a plurality of modules in a parallel arrangement, where each module contains a BCJR algorithm utilizing windows or partitions. In some cases, the trellis length N (i.e., the length of the received sequence) of the algorithm can be partitioned into K smaller trellises that are processed in parallel (e.g., one in each module), thereby increasing the system throughput K-fold. In such cases, the length of each trellis partition is N/K. In some embodiments, N/K is greater than 100, or is greater than 200, or is greater than 500, or is from 100 to 1000, and the sub-optimal solution with parallel processing exhibits negligible performance degradation when compared to the optimal full-length trellis without parallel processing. In some embodiments, the receiver is implemented following the Forney channel model, and the partitions are completely independent (i.e., there is no overlap between the neighboring trellises). In other embodiments, the receiver is implemented following the Ungerboeck channel model, and the neighboring partitions overlap. In some embodiments, this overlap is about 10 symbols, or about 20 symbols, or about 50 symbols, or from 10 to 100 symbols. For example, when the neighboring partitions have lengths of 200 and overlap by 20 symbols, the overall system throughput increase is about (1-20/200)*K=0.9*K compared to the optimal BCJR (i.e., a 10% lower overall boost in throughput when compared to Forney channel model which achieves K-fold increase in throughput). In some embodiments, K is greater than 10, or greater than 100, or greater than 200, or greater than 300, or greater than 500, or is from 10 to 1000, or is from 50 to 500. In addition to the type of model used, the value of K that is possible depends on the partition size, and the LDPC codeword length. For example, given a partition size of 200 for the Forney model (or, 220 for the Ungerboeck model including the overhead), and an LDPC codeword size of 16200 or 64800, the value of K achieved can be 80 or 320, respectively. One tradeoff of boosting the overall system throughput by parallelizing the BCJR-based equalization, is that the system is required to have K times more hardware memory (e.g., on a FPGA/ASIC) to process all of the partitions in parallel. When windowed/partitioned BCJR is used in a turbo equalization loop, only in the first iteration of the turbo loop is equal likelihood assigned to each state at the initialization stage for each window/partition. After the first iteration of the turbo loop, likelihoods at the decoder output are assigned to each state at the initialization stage for each window/partition.
In some embodiments, the equalizer contains a BCJR variant algorithm, with reduced complexity compared to the full complexity optimal BCJR algorithm.
In some embodiments, the equalizer contains an I and Q (i.e., in-phase and quadrature) BCJR algorithm (e.g., in systems processing QPSK modulated signals). As described above, the BCJR complexity is ML, which is a polynomial in the modulation alphabet M. If the modulation alphabet is higher than binary (e.g., higher than that using binary phase shift keying, or BPSK), the complexity can be reduced by introducing a sub-optimal solution which processes different parts of the alphabet separately. For example, the I and Q branches of the modulation alphabet (e.g., in QPSK schemes) can be processed separately. In that case, the overall complexity of the solution is 2*ML/2L which dramatically simplifies the equalizer architecture, and hardware memory consumption on FPGA/ASIC. In some embodiments, replacing a single QPSK-based BCJR with 2 BPSK-based BCJRs (one for the I-branch another for the Q-branch) running in parallel, results in a negligible loss in the system performance (e.g., a negligible increase in bit error rate (BER)).
In some embodiments, channel shortening can be applied in the receiver processing chain prior to the equalizer (e.g., at the output of the receiving filter), enabling the use of a lower complexity equalizer. As described above, the BCJR complexity is ML, where the complexity exponentially grows with the ISI length. A channel shortening process can be performed prior to the equalizer, which reduces the effective L enabling a reduction in the complexity of the equalizer. In some cases, the ISI memory elements at the edges of the ISI profile can be averaged, hence shortening the channel response and reducing the complexity (as described more completely in U.S. Pat. No. 9,154,346). In other embodiments, a shortening filter based on minimum mean-squared error (MMSE) criteria is used to generate a shortened version of the channel impulse response prior to the equalizer (e.g., at the output of the receiving filter).
In some embodiments, the equalizer contains a BCJR variant algorithm, with reduced complexity compared to the full complexity optimal BCJR algorithm that is a MAX-BCJR algorithm. In each stage of the full complexity BCJR algorithm, a state metric update is conducted at each state by summing all of the branch metrics from the connecting states of the previous stage. Instead of the full complexity summation operation, MAX-BCJR uses only the maximum branch metric to update the state metric, which avoids a plurality of summation operations (i.e., saves arithmetic operations), thereby reducing the overall algorithm complexity.
In some embodiments, the complexity of the trellis-based equalization process used by equalizer 230 is related to the cardinality of the linear modulation symbol alphabet (M) used, and the symbol memory length (L) induced by the BCET system. Complexity of the equalization process, and therefore hardware complexity, in such cases is proportional to ML.
In some embodiments of turbo equalization loops, trellis-based equalizers, mainly BCJR and reduced complexity BCJR variants, like max-BCJR, M-BCJR, T-BCJR, forward-only BCJR, or windowed BCJR, are used. SOVA or even MMSE equalizer techniques can be used with restrictions as well. At the output of the BCJR-based equalizer, a soft demodulation block 240 is placed, which converts symbol likelihoods into the bit likelihoods.
In an alternative embodiment, and as a further complexity reduction, when pulse-shaping filter coefficients are real and 2-dimensional linear modulation is employed with cardinality M (for example QPSK, M=4), the pulse train can be modeled as two independent lower cardinality 1-dimensional modulation pulse trains (each with cardinality equal to log2 M), one on the I branch, and the other on the Q branch. The equalizer can then be formed by two lower complexity equalizers (complexity equal to log2 ML instead of ML where L is the symbol memory length induced by the BCET system) operating in parallel, and this can significantly reduce hardware complexity and hardware resources without any loss in the receiver overall performance. These I/Q branch equalizers could use any trellis based equalizer architectures (e.g., BCJR, or a reduced complexity BCJR variant). In this case, there is a parallel-to-serial conversion of symbol likelihoods produced by two I/Q equalizers prior to soft demodulation block 240 which converts them to bit likelihoods.
Extrinsic information of BCJR is obtained when the input bit-level log-likelihood ratios (LLRs) are substracted from the output bit-level LLRs. The result is passed through deinterleaver 250. Interleavers can take the sequence of symbols from its input and produce the identical symbols at the output, but in a different temporal order. In some embodiments, interleavers are used to disperse sequences in bit streams (or in streams of symbols) so as to minimize the effects of burst errors. The deinterleaver 250 and the ECC decoder 270 in
The use of reduced-complexity equalization techniques in turbo equalization schemes can significantly reduce the quality of the LLRs. The quality of the LLRs can strongly affect the system performance. In some embodiments, a non-linear function 260 can be optimized to transform a signal with low quality LLRs at the output of the deinterleaver 250, in order to maximize the effectiveness of the subsequent error control code optimization processes and iterative equalization and detection processes. For example, block 260 can be implemented in the form of a clipping circuit, an element that transforms a signal using a non-linear function that re-scales extrinsic LLRs, or an element that transforms a signal using a lookup table that incorporates a more elaborate distribution transformation. Non-linear LLR transformations can either be fixed from one turbo iteration to another, or can be adapted from iteration to iteration. Non-linear functions used by block 260 can be optimized based on different factors, for example: 1) estimated channel SNR; 2) pulse shaping response characteristics; 3) type of LDPC code applied; 4) decoding algorithm; and 5) other criteria. The non-linear transformation parameters can be pre-computed when an adaptive transformation law is applied, or they can be adapted on-the-fly based on the current codeword processed. Adaptation on the fly requires additional processing steps after the LDPC decoder block and adds to the overall complexity of the receiver 102. In some embodiments, the nonlinear operation can be precomputed and stored (e.g., as a look-up table, or map), which requires hardware memory space but does not result in an increase in system complexity. In other embodiments, the nonlinear operation can be computed on the fly, which increases the complexity of the system but does not require extra hardware memory. In some embodiments, a non-linear transformation is implemented in the form of an LLR clipping law. In these cases, threshold values can be pre-computed in advance by using Density evolution (DE) technique, so that the LDPC code employed has the largest DE threshold values.
Due to the serial nature of the trellis based equalizers, in order to achieve high throughput, in some embodiments, it is necessary to highly parallelize trellis based equalizers. In some embodiments, a received frame is divided into windows that are of equal length. And in some embodiments, the received frames are processed fully in parallel. In such cases, the number of windows can be chosen based on an optimization procedure with the criteria including: system throughput, hardware resources employed, and amount of degradation of the receiver performance compared to the a non-parallelized approach. Therefore, special attention should be paid to adequate interleaver design between the equalizer and the LDPC decoder in the receiver. In some embodiments, the interleaver supports a large number of equalizer windows, and is adapted to the layered LDPC decoder architecture, enabling fast transfer of LLRs between equalizer windows and LDPC decoder memories. In some cases, the interleaver is contention free. The underlying interleaving pattern can be deterministic, but can also emulate (or approximate) random pattern interleavers.
In some embodiments, an improved interleaver design is implemented. The interleaver can be designed with the following design goals: 1) include W equalizer windows and V LDPC memories (e.g., V=360 is an example of a possible LDPC parallelism level); 2) all LDPC memories are two port memories and each hardware memory is connected to two equalizer windows, and each hardware memory is divided in two hardware sub-memories, with each hardware sub-memory assigned to one equalizer window; 3) each equalizer window is connected to V/W hardware memories and serially sends data using a round-robin principle; and 4) the equalizer window address assignment is random. Since in a layered LDPC architecture, each LLR is read serially, LDPC reads a first location from the first hardware memory, then a first location from a second hardware memory and so on. In some embodiments, the above design goals can be modified to include more than two equalizer windows. The above described interealver design is a hybrid between random and block interleavers, and can achieve a high parallelism level with simple timing control. Simulations show that there are no losses in such systems compared to fully random interleavers.
Continuing with
In some embodiments, the LDPC code structure is optimized using the following requirements: 1) the code belongs to the irregular repeat accumulator (IRA) class of codes, that enables linear complexity of the encoding; 2) a parity check matrix can be rearranged in quasi-cyclic (QC) form, that enables layered decoding without hardware memory conflicts; 3) a degree distribution and parameters of the turbo loop are optimized for the known partial response channel and required level of parallelism; and 4) the designed code compensates imprecision caused by any reduction of the complexity of the equalization part of a turbo loop, as described above.
In some embodiments, the LDPC code is decoded using an iterative method using belief propagation or sum-product message passing (i.e., a message passing algorithm that is an optimal method for iterative decoding of LDPC codes). However, the optimality of sum-product message passing comes at the cost of a high complexity, numerical instability, and dependence on noise variance estimation (i.e., SNR estimation).
In some embodiments, a lower complexity LLR calculation in LDPC decoding can be used such as a min-sum algorithm (e.g., 3-min-sum, or 5-min-sum) that trade performance, or optimality for complexity of implementation. For the min-sum algorithm, complex computations in the sum-product algorithm are approximated using simpler comparison and summation operations (hence the “min-sum” name). 3-min-sum and 5-min-sum refer to versions of the algorithm with different numbers of elements used in the comparison logic of the algorithm. In some embodiments, a 5-min-sum algorithm is used in a BCET system with a turbo loop (i.e., iteration between the LDPC decoder and the equalizer), and negligible performance loss is observed compared to the same system using a sum-product solution.
In some embodiments, the LDPC code optimization process uses the distribution of the constituent variable node degrees and check node degrees, as well as the parameters of the non-linear function inside the turbo equalization loop (described above). The optimization can also be based on the density evolution for partial response channels, and on producing an optimized degree distribution that satisfies a predefined set of constraints that enable the construction of structured QC IRA codes (for a desired decoder complexity and level of parallelism).
In some embodiments, the parity check matrix in the LDPC code optimization process ensures that the QC structure is suitable for layered decoding. In addition, enabling low complexity encoding is an important optimization constraint. In some embodiments, the above constraints on the LDPC code optimization process reduce the search area in which the optimization algorithm looks for the degree distribution of the irregular code that provides the minimal value of the SNR threshold, thereby reducing system complexity.
In some embodiments, a layered LDPC decoder architecture is employed.
In some embodiments, the receiver performance of the BCET system depends on the number of iterations in the turbo loop and the internal LDPC decoder iterations in the receiver. Larger bandwidth constriction produces more severe ISI (or symbol memory) in the system. When there is a more severe ISI in the system, the turbo equalization scheme needs more iterations to remove the ISI and to achieve the desired LDPC decoder performance (for a given SNR). The number of turbo iterations is a trade off between the required BCET performance, hardware complexity, and system throughput.
As described above, bandwidth constrained equalized transport (BCET) systems (e.g., similar to those described in U.S. Pat. No. 8,155,530, and U.S. Patent Application Pub. No. 2014/0269894) increase spectral efficiency of the transmission by narrowing the transmission bandwidth, while retaining a constant information rate.
By stepping into the faster-than Nyquist (FTN) signaling realm, a BCET system relies on proper pulse shaping and equalization techniques to control the ISI. The present BCET systems additionally include error control coding techniques that enable reliable data transmission using practical hardware complexity. In some embodiments, the systems and methods described herein can increase the information rate in satellite communications, for example, using similar system parameters as in DVB-S2 and DVB-S2X standards, or using other wireless communication standards (e.g. 5G, WiFi, xDSL).
The low-density parity-check codes (LDPC) described in the DVB-S2 and DVB-S2X standards, optimized for additive white Gaussian noise (AWGN) channels, are not adequate solutions in BCET systems. In some embodiments, the present systems and methods are used to optimize the degree distribution for irregular LDPC codes, which satisfy requirements related to the impulse response of the partial response channel, required complexity of the equalizer, required information rate, and data throughput. In some embodiments, the degree distribution of both the variable nodes and the check nodes, as well as the parameters of the non-linear function in the turbo equalization loop are optimized together. This optimization can result in improved system performance for a given signal-to-noise ratio (SNR) and information rate. The value of the SNR that ensures that the FER is below a predetermined level can be denoted as a “turbo cliff”. Therefore, in some embodiments the goal of the optimization is to minimize the turbo cliff (i.e., minimizing the SNR required to achieve a low FER) for a given information rate and for a particular (e.g., limited) complexity of a turbo equalizer. Optimizing for a particular system complexity is important, because typically processing power and hardware memory resources are limited. As the processing latency determines throughput, the optimization is performed for a limited number of iterations, in some embodiments.
Referring again to
Referring again to
Continuing with
In some embodiments, the ECC encoder and decoder utilize LDPC codes, and an LDPC code optimization process is performed, which includes optimizing the distribution of the variable node degrees and check node degrees, as well as the parameters of the non-linear function. The optimization can be based on the density evolution for partial response channels, and the produced optimized degree distributions can satisfy a predefined set of constraints that enable the construction of structured QC IRA codes, for a desired complexity of the decoder and level of parallelism. An example of a process for LDPC code optimization is shown in
In some embodiments, the parity check matrix has a QC structure that is suitable for layered decoding. Additionally, in some embodiments, the parity check matrix is designed to minimize the complexity of encoding. The constraints on the parity check matrix imposed by the above optimizations can be used to reduce the search area in which the optimization algorithm looks for the degree distribution of the irregular code that provides the minimal value of the SNR threshold.
In one possible optimization setup (mode 1), only a part of the variable degree distribution is optimized, while another part of the distribution is predefined. In such a case, the columns with weight equal to 2 can be placed in a double diagonal matrix only, the check node degrees can be fixed to two successive values, and the check node distribution can be determined with the code rate and structural properties of QC IRA codes. In another scenario (mode 2), the columns with weight equal to 2 can be placed in the double diagonal matrix, and can also be placed in the rest of the parity check matrix.
As shown in
Then, at step 310 the maximum variable degree is chosen, and set of the check node degrees is fixed. The optimization mode, as described above, is also selected in step 310. In step 320 the variable node distribution is initialized, and the distribution of check node degrees is calculated for the given input parameters. In other words, in step 320, for a given code rate and limitations of structured IRA codes (i.e., those selected in steps 300 and 310), the distributions of the check node degrees for the initial variable node degree are calculated.
Using a density evolution algorithm for partial response channels, the degree distribution and parameters of the non-linear function are optimized, and the corresponding threshold is calculated in step 330. In other words, in step 330, the optimal variable node degree distribution and nonlinear function parameters, along with the corresponding thresholds, are found using density evolution. The procedure in step 330 is repeated for an appropriate subset of initial conditions, and a database of the possible solutions for the various resulting sets of check node degrees is generated in step 340.
In some embodiments, the parity check matrix H contains two parts, a first part H1 and a second part H2, such that H=[H1H2], where H2 is a double diagonal matrix and H1 is the quasi-cyclic part of the parity check matrix with the structure determined by a random masking matrix that satisfies the degree distribution condition. Each binary zero in the masking matrix can correspond to a P×P zero submatrix in H1, and every binary one in the masking matrix can correspond to a cyclically shifted eye submatrix with dimensions P×P. The corresponding values of the shifts in the cyclically shifted eye submatrices (e.g., in the range [0, 1, . . . , P−1]) are defined in a prototype matrix and can be generated by using an appropriate algorithm, as described in more detail herein. Starting from the degree distribution that corresponds to H, and taking into account a simple structure of H2, the degree distribution that corresponds to H1 is calculated, in some embodiments. By using this distribution, the random masking matrix is generated, and the prototype matrix is produced in step 350 (e.g., as will be described further below and in
The prototype matrix is an intermediate result before generating a parity check matrix. At decision step 355, if it is possible to construct a prototype matrix, then the parity check matrix suitable for layered decoding is generated at step 370. The parity check matrix is then represented in the form of the corresponding permutation matrix that is suitable for low complexity encoding at step 380, and the real degree distribution of the generated code is estimated and checked at step 390.
The prototype matrix can be generated in a few successive steps. In step 400, known optimal degree distributions for the parity check matrix (H) In step 410, the degree distribution is recalculated, to correspond to the first part of matrix H (denoted by H1). In step 420, a binary masking matrix with size (1−R)n/P×nR/P is generated from the recalculated degree distribution. In step 430, the double diagonal matrix (denoted by H2) is concatenated with the matrix H1 such that H=[H1H2], to complete the parity check matrix H.
Using the present systems and methods, the prototype matrix can directly determine the structure of matrix H. In some embodiments, both dimensions of the prototype matrix are P times less than those of the first part of the parity check matrix (H1), and every element in the prototype matrix defines a number of cycle shifts in a corresponding submatrix with size P×P. For example,
The data in
Two optimization modes (mode 1 and mode 2) are described above. In the first mode (mode 1), LDPC codes were designed to achieve excellent performance without using any outer code. In the second mode (mode 2), inner codes were designed that have good performance in the waterfall region, but with poor performance in the error floor region compared to general LDPC code properties. However, when the outer code that corrects up to t errors is applied, the codes designed in mode 2 can have even better performance that the codes designed in mode 1.
Several embodiments of a transmitter in systems employing narrowband filtering (e.g., BCET systems) will now be described.
In some embodiments, a transmitter in a system employing narrowband filtering comprises: 1) a pulse shaping filter that is specifically designed for maximization of achievable information rates and high spectral efficiency, with different possible optimization criteria, such as lowest possible induced symbol memory (i.e., intentionally induced inter-symbol interference that can minimize receiver complexity); and 2) an error control code encoder used to append redundant information so as to avail information symbols' retrieval in the presence of noise and impairments, wherein the code structure is specifically designed along with the pulse-shaping design procedure (e.g., achieving performance closer to the achievable information rates than conventional systems). In some embodiments, the transmitter is for use in a digital communication system conveying information symbols at a certain symbol rate in which the information bearing waveforms are filtered to a bandwidth significantly narrower than the communication symbol rate; and wherein the apparatus achieves an improved energy performance and increased spectrum efficiency compared with systems not employing the bandwidth constraint.
In some embodiments, the system described above, further comprises a receiving filter. In some embodiments, the receiver further comprises an optional transmission impairments mitigating equalizer, which is prior to the information retrieving equalizer. In some embodiments, the receiver further comprises a channel response adjustment (or, impulse response adjustment) as an optional additional processing block prior to information retrieving equalization. In some embodiments, the information retrieving equalizer outputs the reliability estimates, often referred to as the soft information of the information symbols. In some embodiments, the information receiving equalizer functions as a trellis-based equalizer (e.g., a BCJR or SOVA equalizer), or as a reduced complexity trellis-based equalizer (e.g., a M-BCJR, T-BCJR, or SOMA equalizer). In some embodiments, the information receiving equalizer is divided in two parallel independent equalizers, one processing an I demodulator branch and the other working on a Q demodulator branch of a signal, thus significantly reducing the complexity of each equalizer. In some embodiments, the information receiving equalizer functions as a windowed variation of a maximum a posteriori equalizer that can work fully in parallel. In some embodiments, the information receiving equalizer supports a very large number (e.g., 72, or up to 80, or up to 100, or greater than 100) of windowed MAP equalizers which are fully parallel and independent (or in a slight sliding window variant), thus achieving large system throughputs. In some embodiments, iterative detection is employed, wherein the information retrieving equalizer outputs likelihood estimates LLRs on the received symbols and pass it on to the error control decoder with the information retrieving equalizer and the error control decoder iteratively exchanging their estimates on the received information for a number of times (i.e., in a turbo equalization loop).
In some embodiments of the system described above, non-linear transformation of LLRs (e.g., low quality LLRs) is employed in order to transform them into an appropriate optimized form for turbo equalization loop constituents (i.e., equalizer and error control decoder), which can significantly improve overall system gain. In some embodiments, soft information LLRs are interleaved/deinterleaved between turbo equalization loop constituents. In some embodiments, the turbo equalization loop has a plurality of iterations (i.e., turbo iterations) and the number of iterations is optimized for attainment of performance closer to the optimized achievable information rates and overall system throughput. In some embodiments, turbo loop interleavers/deinterleavers are specifically designed to support a high level of parallelism of windowed equalizer and are quasi-random and contention free.
In some embodiments, a BCET communication system contains a transmitter that employs a pulse-shaping filter, and the filter response is designed using a numerical optimization procedure.
In some embodiments, a BCET communication system contains a receiver that employs joint channel symbol detection and error control code symbol detection that are combined using iterative decoding. In some embodiments, the error control code is obtained by a numerical optimization procedure.
In some embodiments, a BCET communication system contains an early termination criterion for LDPC codes to reduce the number of LDPC iterations, which in turn results in the overall reduction of the duration of the processing performed by the turbo equalization loop. This can be advantageous, for example, by enabling substantial power savings at the receiver.
In some embodiments, a BCET communication system contains an outer block code, such as a BCH code or a Reed-Solomon code.
In some embodiments, a method for optimizing LDPC codes in BCET systems includes: a) providing a parity check matrix of a low-density parity-check (LDPC) code, which is employed in error correction techniques in turbo-equalization-based bandwidth-constrained communication systems; and b) determining an optimized non-linear transformation of input log-likelihood ratios (LLRs) to the error correction decoder adjusted jointly with the parity check matrix.
In some embodiments, the method for optimizing LDPC codes in the BCET systems above further includes the utilization of an equalizer that operates using BCJR (Bahl-Cocke-Jelinek-Raviv) algorithms, Viterbi algorithms, reduced trellis states, and/or reduced trellis search variants of BCJR and Viterbi algorithms.
In some embodiments, the method for optimizing LDPC codes in the BCET systems above further includes the utilization of a plurality of equalizer complexity reduction techniques and/or partial response channel shortening.
In some embodiments, the method for optimizing LDPC codes in the BCET systems above further includes the utilization of pulse-shaping and receiving filters such as those described above and in U.S. Patent Application Pub. No. 2014/0269894, and U.S. Pat. No. 9,154,346.
In some embodiments, the method for optimizing LDPC codes in the BCET systems above results in the optimized transmission system outperforming ISI-free transmission in terms of achievable information rate, for the same signal-to-noise ratio (SNR) and the same occupied bandwidth.
In some embodiments, the method for optimizing LDPC codes in the BCET systems above results in an optimized transmission system that outperforms the ISI-free transmission in terms of signal-to-noise ratio (SNR), for the same achievable information rate and the same occupied bandwidth.
In some embodiments, a communication system described above, when optimized using the methods described above, can produce a large number of operating points when performing close to or above traditional Shannon capacity bounds.
Reference has been made in detail to embodiments of the disclosed invention, one or more examples of which have been illustrated in the accompanying figures. Each example has been provided by way of explanation of the present technology, not as a limitation of the present technology. In fact, while the specification has been described in detail with respect to specific embodiments of the invention, it will be appreciated that those skilled in the art, upon attaining an understanding of the foregoing, may readily conceive of alterations to, variations of, and equivalents to these embodiments. For instance, features illustrated or described as part of one embodiment may be used with another embodiment to yield a still further embodiment. Thus, it is intended that the present subject matter covers all such modifications and variations within the scope of the appended claims and their equivalents. These and other modifications and variations to the present invention may be practiced by those of ordinary skill in the art, without departing from the scope of the present invention, which is more particularly set forth in the appended claims. Furthermore, those of ordinary skill in the art will appreciate that the foregoing description is by way of example only, and is not intended to limit the invention.
This application is a continuation of U.S. patent application Ser. No. 16/418,798 filed on May 21, 2019, which claims priority to: 1) U.S. Provisional Patent Application No. 62/676,942 filed on May 26, 2018, and entitled “Reduced-Complexity Receiver Architecture Design in Bandwidth Constrained Communication Systems”; and 2) U.S. Provisional Patent Application No. 62/795,993 filed on Jan. 23, 2019, and entitled “Optimized Low-Density Parity-Check Codes for Bandwidth Constrained Communication Systems”; all of which are hereby incorporated by reference for all purposes.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7616701 | Ungerboeck | Nov 2009 | B2 |
| 8599914 | Eliaz | Dec 2013 | B1 |
| 9154346 | Alic | Oct 2015 | B2 |
| 10715276 | Radosevic | Jul 2020 | B2 |
| 20070116143 | Bjerke et al. | May 2007 | A1 |
| 20070226599 | Motwani | Sep 2007 | A1 |
| 20080226301 | Alic et al. | Sep 2008 | A1 |
| 20090063926 | Cho et al. | Mar 2009 | A1 |
| 20090259915 | Livshitz et al. | Oct 2009 | A1 |
| 20100064195 | Dore et al. | Mar 2010 | A1 |
| 20110276860 | Lei et al. | Nov 2011 | A1 |
| 20120163489 | Ramakrishnan | Jun 2012 | A1 |
| 20130336377 | Liu et al. | Dec 2013 | A1 |
| 20140269885 | Alic | Sep 2014 | A1 |
| 20140269894 | Alic et al. | Sep 2014 | A1 |
| 20150098521 | Beidas | Apr 2015 | A1 |
| 20150156041 | Eliaz | Jun 2015 | A1 |
| 20150311927 | Beidas | Oct 2015 | A1 |
| 20150318955 | Wu et al. | Nov 2015 | A1 |
| 20150333942 | Land et al. | Nov 2015 | A1 |
| 20150381392 | Beidas | Dec 2015 | A1 |
| 20160164626 | Cavaliere et al. | Jun 2016 | A1 |
| 20160218752 | Liu | Jul 2016 | A1 |
| 20160233979 | Koike-Akino | Aug 2016 | A1 |
| 20160315637 | Cai | Oct 2016 | A1 |
| 20170033894 | Ahn et al. | Feb 2017 | A1 |
| 20170099173 | Yun et al. | Apr 2017 | A1 |
| 20170207934 | Iyer Seshadri | Jul 2017 | A1 |
| 20170272283 | Kingery et al. | Sep 2017 | A1 |
| 20180115323 | Marchand et al. | Apr 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 3454517 | May 2019 | EP |
| 2016093568 | Jun 2016 | WO |
| Entry |
|---|
| International Search Report dated Sep. 10, 2019 for PCT Patent Application No. PCT/US19/33524. |
| Matsumoto, T., et al., “Adaptive Transmission With Single-Carrier Multilevel BICM”, Proceedings of the IEEE, vol. 95,, Issue: 12, IEEE, Dec. 2007, pp. 2354-2367. (Year: 2007). |
| Notice of Allowance dated Mar. 16, 2020 for U.S. Appl. No. 16/418,798. |
| Number | Date | Country | |
|---|---|---|---|
| 20200343997 A1 | Oct 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62795993 | Jan 2019 | US | |
| 62676942 | May 2018 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 16418798 | May 2019 | US |
| Child | 16927615 | US |
