Patent Application
20220329829
At least one of the present embodiments generally relates to a method or an apparatus for video encoding or decoding, and more particularly, to a method or an apparatus for efficiently providing chroma component residual scaling taking into account chroma quantization parameter (QP) derivation and/or luma mapping, for the video encoding or decoding.
To achieve high compression efficiency, image and video coding schemes usually employ prediction, including motion vector prediction, and transform to leverage spatial and temporal redundancy in the video content. Generally, intra or inter prediction is used to exploit the intra or inter frame correlation, then the differences between the original image and the predicted image, often denoted as prediction errors or prediction residuals, are transformed, quantized, and entropy coded. To reconstruct the video, the compressed data are decoded by inverse processes corresponding to the entropy coding, quantization, transform, and prediction.
Recent additions to video compression technology include various industry standards, versions of the reference software and/or documentations such as Joint Exploration Model (JEM) and later VTM (Versatile Video Coding (VVC) Test Model) being developed by the JVET (Joint Video Exploration Team) group. The aim is to make further improvements to the existing HEVC (High Efficiency Video Coding) standard.
The drawbacks and disadvantages of the prior art are solved and addressed by the general aspects described herein.
According to a first aspect, there is provided a method. The method comprises determining one or more chroma residual scaling parameters based one or more luma mapping parameters and based on a corrective value of the one or more chroma residual scaling parameters; and encoding the video based on the determined one or more chroma residual scaling parameters.
According to another aspect, there is provided another method. The method comprises determining one or more chroma residual scaling parameters based on one or more luma mapping parameters and based on a corrective value of the one or more chroma residual scaling parameters; and decoding the video based on the determined one or more chroma residual scaling parameters.
According to another aspect, there is provided an apparatus. The apparatus comprises one or more processors, wherein the one or more processors are configured to determine one or more chroma residual scaling parameters based on one or more luma mapping parameters and based on a corrective value of the one or more chroma residual scaling parameters; and encode the video based on the determined one or more chroma residual scaling parameters.
According to another aspect, there is provided another apparatus. The apparatus comprises one or more processors, wherein the one or more processors are configured to determine one or more chroma residual scaling parameters based one or more luma mapping parameters and based on a corrective value of the one or more chroma residual scaling parameters; and decode the video based on the determined one or more chroma residual scaling parameters.
According to another general aspect of at least one embodiment, the corrective value of the one or more chroma residual scaling parameters is determined based on a luma quantization parameter value.
According to another general aspect of at least one embodiment, the luma quantization parameter value is not dependent on another luma quantization parameter value used for collocated luma samples of a chroma block for which the one or more chroma residual scaling parameters are being determined.
According to another general aspect of at least one embodiment, the corrective value of the one or more chroma residual scaling parameters is based on an average value of selected luma samples.
According to another general aspect of at least one embodiment, the luma mapping parameters are representative of a slope of a luma forward mapping function applied to a prediction of luma samples.
According to another general aspect of at least one embodiment, the method further comprises signaling of said corrective value of the one or more chroma residual scaling parameters.
According to another general aspect of at least one embodiment, the corrective value of the one or more chroma residual scaling parameters is signaled as adaptive parameter in APS.
According to another general aspect of at least one embodiment, the corrective value of the one or more chroma residual scaling parameters is an additive value to be added to the luma mapping parameters resulting in corrected luma mapping slope values.
According to another general aspect of at least one embodiment, the chroma residual scaling parameters are derived by inverting the corrected luma mapping slope values.
According to another general aspect of at least one embodiment, the corrective value of the one or more chroma residual scaling parameters is in the range [−7, 7].
According to another general aspect of at least one embodiment, the corrected luma mapping slope values are bounded.
According to another general aspect of at least one embodiment, the corrected luma mapping slope values in the range (OrgCW>>3) to (OrgCW<<3−1), inclusive where OrgCW represents a neutral value of scaling.
According to a second aspect, there is provided a second method. The method comprises determining one or more chroma quantization parameters based on one or more chroma residual scaling parameters or on one or more luma mapping parameters; and encoding the video based on the determined one or more chroma quantization parameters.
According to another aspect, there is provided another method. The method determining one or more chroma quantization parameters based on one or more chroma residual scaling parameters or on one or more luma mapping parameters; and decoding the video based on the determined one or more chroma quantization parameters.
According to another aspect, there is provided an apparatus. The apparatus comprises one or more processors, wherein the one or more processors are configured to: determine one or more chroma quantization parameters based on one or more chroma residual scaling parameters or on one or more luma mapping parameters; and encode the video based on the determined one or more chroma quantization parameters.
According to another aspect, there is provided another apparatus. The apparatus comprises one or more processors, wherein the one or more processors are configured to: determine one or more chroma quantization parameters based on one or more chroma residual scaling parameters or on one or more luma mapping parameters; and decode the video based on the determined one or more chroma quantization parameters.
According to another general aspect of at least one embodiment, the method further comprises determining the one or more chroma residual scaling parameters based on luma mapping parameters.
According to another general aspect of at least one embodiment, the one or more processors of the apparatus are further configured to determine the one or more chroma residual scaling parameters based on luma mapping parameters.
According to another general aspect of at least one embodiment, the determining one or more chroma quantization parameters is based on one or more chroma residual scaling parameters comprises correcting a value of one of the one or more chroma quantization parameters based on a value of a chroma residual scaling factor.
According to another general aspect of at least one embodiment, the correcting is based on a slope of a mapping function.
According to another general aspect of at least one embodiment, the determining the one or more chroma residual scaling parameters is based on luma mapping comprises correcting a value of one of the one or more chroma residual scaling parameters based on a luma quantization parameter value.
According to another general aspect of at least one embodiment, the luma quantization parameter value is not dependent on another luma quantization parameter value used for collocated luma samples of a chroma block for which the one or more chroma residual scaling parameters are being determined.
According to another general aspect of at least one embodiment, the correcting a value of one of the one or more chroma residual scaling parameters is based on an average value of selected luma samples.
According to another general aspect of at least one embodiment, the luma mapping comprises applying a luma forward mapping function to prediction luma samples.
According to another general aspect of at least one embodiment the corrective chroma residual scaling parameters are bounded.
According to another general aspect of at least one embodiment the corrective chroma residual scaling parameters comprises one of an offset parameter and shrink parameter used in a linear function applied to the chroma mapping parameters.
According to another general aspect of at least one embodiment, there is provided a device comprising an apparatus according to any of the decoding embodiments; and at least one of (i) an antenna configured to receive a signal, the signal including the video block, (ii) a band limiter configured to limit the received signal to a band of frequencies that includes the video block, or (iii) a display configured to display an output representative of the video block.
According to another general aspect of at least one embodiment, there is provided a non-transitory computer readable medium containing data content generated according to any of the described encoding embodiments or variants.
According to another general aspect of at least one embodiment, there is provided a signal comprising video data generated according to any of the described encoding embodiments or variants.
According to another general aspect of at least one embodiment, a bitstream is formatted to include data content generated according to any of the described encoding embodiments or variants.
According to another general aspect of at least one embodiment, there is provided a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out any of the described decoding embodiments or variants.
These and other aspects, features and advantages of the general aspects will become apparent from the following detailed description of exemplary embodiments, which is to be read in connection with the accompanying drawings.
The general aspects described here are in the field of video compression. These aspects aim at improving compression and/or decompression efficiency compared to existing video compression systems.
Present embodiments relate to interactions between chroma residual scaling and chroma quantization parameter (QP) derivation. In a previous version of VTM, both tools are fully independent, but both have an impact on the chroma residual scaling. The present application discloses embodiments for taking into account the interaction between the chroma residual scaling and the chroma QP derivation.
Luma mapping with Chroma scaling (LMCS) is a tool of VVC specification JVET-02001. It includes two aspects: luma mapping (LM), and luma-dependent chroma residual scaling (sometime abbreviated as CS, or CRS as used in the current specification).
Luma mapping consists of applying a luma forward mapping function Mapfwd(.) to the prediction luma samples. The luma forward mapping function Mapfwd(.) is based on a table, lumaMapTable, coded in the data stream, in which lumaMapTable indicates the slopes of the piece-wise linear luma mapping function Mapfwd(.). Each piece or segment is of uniform length, defined for an interval [Yi, Yi+1−1], i=0 to 15.
CRS is described, for instance, in contribution JVET-00098. CRS consists in using a luma-dependent scaling (in an encoder) or inverse scaling (in a decoder). The inverse scaling factors are derived from a table, chromaScaleTable, indexed by index values derived from luma values. The chromaScaleTable is deduced from lumaMapTable and can be approximated as chromaScaleTable[i]=1/lumaMapTable[i], for i=0 to 15. The scaling factors at the encoder side are the inverse of the inverse scaling factors used at the decoder.
When processing a chroma block, a CRS factor for each 64×64 block (called Virtual Processing Decoding Unit—VPDU) is derived from luma sample values from previously reconstructed VPDU neighbors (see the illustration in
First, the average value, avgY, of M left neighboring luma samples and M top neighboring luma samples which are the closest to the top-left position, as shown in
From avgY, the index idx in the chroma scaling table is computed. The avgY is derived from luma values that are in the forward mapped domain. Therefore, the index idx is computed as the value such that avgY belongs to the interval [Mapfwd(Yidx), Mapfwd(Yidx+1−1)]. The chroma prediction residual samples for all the chroma blocks in this VPDU are scaled by the scaling factor scale=(1/chromaScaleTable[idx]) (at encoder) or inverse scaled by the scaling factor invScale=chromaScaleTable[idx] (at decoder).
On the picture boundary, for the rightmost column VPDU, if the upper neighboring samples within the picture is less than M, the picture boundary sample is padded until M. For the bottom row VPDU, if the left neighboring samples within the picture is less than M, the picture boundary samples is padded until M. For the leftmost column VPDU, only M top neighboring samples are used for average value. For the top row VPDU, only M left neighboring samples are used for average value. For the left-top VPDU of the picture, avgY is directly set as 1<<(bitdepth−1).
The scaled chroma residual signal is then processed by a transform (105) and quantization (106), and the resulting signal is coded in the entropy coding (120). This signal is also processed by inverse quantization (107) and inverse transform (108) to produce the decoded chroma residual. An inverse CRS is applied in 109 to the decoded chroma residual signal. The inverse scaling factor applied in 109 is based on reconstructed mapped luma samples. The inverse scaled decoded chroma residual signal is then added in an adder (110) to the prediction chroma signal resulting from either the intra prediction (114) or from the motion estimation (115) and motion compensation (116), depending on the mode selection (intra or inter prediction) made at 117. The resulting signal is processed by in-loop filters (112) and the resulting signal is stored in the reference picture buffer (113).
An example of chroma inverse scaling value derivation process 302 is illustrated in
An example of lumaMapTable is given in Table 1 below. The table corresponds to the slope values of the forward mapping function Mapfwd(.), defined from index 0 to 15. For 10-bit signal, one index range corresponds to 64 luma values range (1024/16). The values are scaled by 64 (which means that 64 is equivalent to a slope value of 1), as shown in “normalized slope” row in Table 1.
indicates data missing or illegible when filed
The corresponding luma mapping function Mapfwd(.) is illustrated in
An example of the related chromaScaleTable (corresponding to inverse chroma scaling values) is given below. The values are scaled by 2048 (which means that 2048 is equivalent to a scale of 1).
In the most recent VVC implementation, chromaScaleTable[k]≈(2048/(lumaMapTable[k]/64)) (except when lumaMapTable[k]=0, in which case chromaScaleTable[k] is set to 2048), as shown in Table 2 below.
In the following description, it will be considered that lumaMapTable and chromaScaleTable are made of normalized, floating-point values. It is straightforward to generalize the concepts discussed below for values represented in integer/fixed-point.
Chroma QP Value Derivation from Luma QP Value
In VVC, the chroma QP value is derived from the luma QP value and from QP offset parameters, using chroma QP mapping tables. In latest VVC specification JVET-O2001, the chroma QP mapping tables are signalled in the bitstream at the SPS level, as illustrated in underlined portions of the syntax table, Table 3, below. The relevant semantics of the syntax elements are also provided below.
if( ChromaArravType !=0 ) {
same_qp_table_for_chroma
for( i = 0; i < same_qp_table_for_chroma ? 1 : 3; i++ ) {
num_points_in_qp_table_minus1[ i ]
for( i = 0; i <= num_points_in_qp_table_minus1[ i ];
j++) {
delta_qp_in_val_minus1[ i ][ j ]
delta_qp_out_val[ i ][ j ]
}
}
}
An example of related semantics is as follows:
same_qp_table_for_chroma equal to 1 specifies that only one chroma QP mapping table is signalled and this table applies to Cb and Cr residuals as well as joint Cb-Cr residuals. same_qp_table_for_chroma equal to 0 specifies that three chroma QP mapping tables are signalled in the SPS. When same_qp_table_for_chroma is not present in the bistream, the value of same_qp_table_for_chroma is inferred to be equal to 1.
num_points_in_qp_table_minus[i] plus 1 specifies the number of points used to describe the i-th chroma QP mapping table. The value of num_points_in_qp_table_minus1[i] shall be in the range of 0 to 63+QpBdOffsetC, inclusive. When num_points_in_qp_table_minus1[0] is not present in the bitstream, the value of num_points_in_qp_table_minus1[0] is inferred to be equal to 0.
delta_qp_in_val_minus[i][j] specifies a delta value used to derive the input coordinate of the j-th pivot point of the i-th chroma QP mapping table. When delta_qp_in_val_minus1[0][j] is not present in the bitstream, the value of delta_qp_in_val_minus1[0][j] is inferred to be equal to 0.
delta_qp_out_val[i][j] specifies a delta value used to derive the output coordinate of the j-th pivot point of the i-th chroma QP mapping table. When delta_qp_out_val[0][j] is not present in the bitstream, the value of delta_qp_out_val[0][j] is inferred to be equal to 0.
The i-th chroma QP mapping table ChromaQpTable[i] for i=0 . . . same_qp_table_or_chroma?0:2 is derived as follows:
Three types of chroma residual are considered in VVC: i) Cb residual (defined by a chroma index cldx equals to 1), ii) Cr residual (defined by a chroma index cldx equals to 2), iii) joint Cb-Cr residual (defined by a chroma index cldx equals to 3).
The joint Cb-Cr residual is used when the joint Cb-Cr coding mode is applied to the chroma block. When joint Cb-Cr residual is not applied to the chroma block, both Cb residual and Cr residuals exist. Three chroma QP mapping tables are therefore considered in VVC, that are noted here: ChromaQpTable[0] (for Cb, cldx=1), ChromaQpTable[1] (for Cr, cldx=2) and ChromaQpTable[2] (for joint Cb-Cr, cldx=3).
In the syntax, it is possible to signal the same syntax elements for the three tables (when same_qp_table_for_chroma equals 1) or to signal specific syntax elements for each of the three chroma QP mapping tables (when same_qp_table_for_chroma equals 0, which indicates that 3 sets of syntax elements are signaled, one set per chroma QP mapping table).
For a given chroma block of a given chroma index cldx, the chroma QP QPCcldx is computed as follows (e.g., see section “Derivation process for quantization parameters” of JVET-O2001).
Luma and chroma QPs are derived per area called quantization groups (QGs). This process applies to elements 106 and 107 of the encoder 100 of
The chroma QP, QPCcldx, derivation process 301 is illustrated in
An example of chromaQpTable is given in Table 4 below:
At least one of the present embodiments relates to the interaction between the chroma residual scaling and the chroma QP derivation. In a previous version of VTM, both tools are fully independent, but both have an impact on the chroma residual scaling. At least one of the present embodiments defines a process for taking into account the interaction between the chroma residual scaling and the chroma QP derivation.
The chroma QP is currently derived from luma QP information, QPY, deduced from the slice level, or luma coding blocks neighboring, or inside the luma area covering chroma block.
However, the luma samples are processed by a forward luma mapping (118 in encoder 100 of
At least one of the present embodiments aims at solving these issues and making improvements by taking into account the interaction between, e.g., the luma mapping, the chroma residual scaling and the chroma QP derivation.
It is possible to limit the impact of the problem discussed above by adjusting the local chroma QP, using delta chroma QP coding. However, this solution requires spending additional bits for coding the delta chroma QP coding and may therefore penalize the coding efficiency. Also, the accuracy of the scaling achieved with the delta chroma QP (step 203) may be not high enough, compared to the accuracy of the chroma residual scaling (step 205).
In JVET-J0067, another investigated solution consists in modifying the chroma residual scaling factor based on the value of the QP used for the collocated luma samples of the chroma samples. This solution creates a dependency on the luma QP of collocated luma samples, which can be problematic for implementation throughput.
Accordingly, at least one of the present embodiments consists in adjusting the chroma residual scaling factor based on the chroma QP table and luma QP parameters. Present exemplary embodiments comprise:
1. modifying the chroma QP derivation process by taking into account the mapping applied to luma samples or the scaling that will be applied in the further chroma residual scaling; and/or
2. modifying the chroma residual scaling process by taking into account the bias induced by the luma mapping applied to the luma samples used for computing the chroma scaling factor, but without having a dependency with the QP used for the collocated luma samples of the chroma block.
Advantages of the proposed embodiments include gaining a better luma-chroma quality balance.
The inverse quantization and inverse chroma residual scaling processes in a previous version of VVC specification are achieved by the following:
Step 301 (e.g., as shown in
In these embodiments, step 301 “chroma QP derivation” is modified/replaced by a step 601 of “chroma QP derivation with correction”, as shown in
In one exemplary embodiment, the value of QPY is corrected based on a value of the chroma residual scaling factor, or on a value depending on luma samples close to the relative location in the picture of the chroma samples, for instance, avgY.
The inverse quantization and inverse chroma residual scaling processes are achieved by the following steps, as illustrated in
The expected effect of function f is to decrease the QP value when the Y values used to derive the CRS factor have been forward mapped using a forward mapping function slope larger than 1, or to increase the QP value when the Y values used to derive the CRS factor have been forward mapped using a forward mapping function slope lower than 1.
f(Qp, avgY)=Qp−round(6*Log 2(fwpMappingSlope(invMapfwd(avgY))))
where fwpMappingSlope(Y) corresponds to the slope of the luma forward mapping function at value Y, and invMapfwd corresponds to the function approximating the inverse of the function Mapfwd. For a value Y belonging to the ith range interval, Y in [Yi, Yi+1−], fwpMappingSlope(Y) is equal to lumaMapTable[i]. Log 2(x) is the logarithmic function of base 2, round(x) is the nearest integer to x.
It should be also noted that in the VTM, fwpMappingSlope(invMapfwd(avgY)) is equivalent to (1/chromaScaleTable[idx(avgY)]), that is, (1/invScale).
Instead of using avgY, which is derived from luma samples neighboring the current VDPU, a luma representative value refValY of the luma samples collocated or close to the chroma block can be used instead. For instance,
In an embodiment, the function f can be defined as follows:
f(Qp, refValY)=Qp−round(6*Log 2(fwpMappingSlope(invMapfwd(refValY))))
In another embodiment, the function f is defined as follows:
f(Qp, invScale)=Qp−round(6*Log 2(1/invScale))=Qp+round(6*Log 2 (invScale))
In another exemplary embodiment, the value of qPcldx is corrected based on the value of the chroma residual scaling factor, or on the value of avgY.
The inverse quantization and inverse chroma residual scaling processes are achieved by the following steps, also shown in
Accordingly,
Embodiments—Correction Applied when Deriving the Chroma Residual Scaling Factor
In these embodiments, step 302 of inverse chroma residual scaling derivation (e.g., in
In one exemplary embodiment, the value of invScale is corrected based on the value of a luma QP value, noted QPref, that is not dependent on the luma QP used for the collocated luma samples of the chroma block.
For instance, QPref is the luma QP defined for the slice, SliceQpY or for the tile or for the brick.
In another example, QPref is derived from the luma QP of last luma block of the previous quantization group.
In another example, QPref is derived from the luma QP values used for the luma samples used to derive the CRS inverse scaling value of the current VDPU.
In a variant, QPref is selected at the encoder and coded in the stream, at SPS, PPS, APS, slice header, tile header, brick header or CTU level. It is then used to derive the scaling and inverse scaling factors at the encoder and at the decoder. QPref can for example be set to the slice luma QP SliceQpY of the I-slice arising at each intra period, with a pre-defined offset added:
The inverse quantization and inverse chroma residual scaling processes are achieved by the following steps, as illustrated in
The construction of function g is based on the following reasoning.
qPcldx has been derived as:
qPcldx=ChromaQpTable[cldx−1][QpY]
(if we neglect the effect of clipping (step 402)).
However, the luma signal used for deriving the chroma scaling value has been forward mapped, which is equivalent to a scaling. Typically, the luma scaling can be approximated as fwpMappingSlope(invMapfwd(avgY)) (which is equivalent to lumaMapTable[idx(avgY)]).
It means that QpY should have been corrected as (QpY−dQpY), where
dQpY=6*Log 2(fwpMappingSlope(invMapfwd(avgY)))
that can also be approximated by (−6*Log 2(inScale)), since in VVC specification inScale=fwpMappingSlope(invMapfwd(avgY)).
It also means that the true qPcldx should have been derived as (for sake of simplicity, the first table index related to the chroma component has been removed):
qPcldx=ChromaQpTable[QpY−dQpY]
It means that instead of inverse quantizing the chroma signal by a factor proportional to:
2{circumflex over ( )}(ChromaQpTable[QpY]/6)
the inverse quantizing factor should have been proportional to:
2{circumflex over ( )}(ChromaQpTable[QpY−dQpY]/6)
Consequently, the scaling factor should have been proportional to:
2{circumflex over ( )}(ChromaQpTable[QpY−dQpY−]/6)/2{circumflex over ( )}(ChromaQpTable[QpY]/6)≈
2{circumflex over ( )}((ChromaQpTable[ QpY−dQpY]−ChromaQpTable[QpY])/6)
Or equivalently, the inverse scaling factor should have been proportional to
2{circumflex over ( )}((ChromaQpTable[QpY]−ChromaQpTable[QpY−dQpY])/6)
In an embodiment, the scaling/inverse scaling factors are explicitly set to the following values:
scale=2{circumflex over ( )}((ChromaQpTable[QpY−round(dQpY)]−ChromaQpTable[QpY])/6)
invScale=2{circumflex over ( )}((ChromaQpTable[QpY])/6−ChromaQpTable[QpY−round(dQpY)])
The rounding is required because dQpY may be not an integer value.
In an alternate implementation, the factors are computed using linear interpolation, as follows:
Qp0=ChromaQpTable[QpY−floor(dQpY)]
Qp1=ChromaQpTable[QpY−floor(dQpY)+1]
Frac=dQpY−floor(dQpY)
QPmodif=(1−Frac)*Qp0+Frac*Qp1
deltaQP=QPmodif−ChromaQpTable[QpY]
scale=2{circumflex over ( )}(−deltaQP/6)
invScale=2{circumflex over ( )}(deltaQP/6)
where floor(x) is the the largest integer less than or equal to x.
Approximations of these functions can be used.
For instance, considering the approximation:
ChromaQpTable[QpY−dQpY]≈ChromaQpTable[QpY]−dQpY*
ChromaQpTable′[QpY]
where ChromaQpTable′ is a function approximating the derivative of a function approximated by the Look-up-table ChromaQpTable,
the scaling/inverse scaling factors are explicitly set to the following values:
invScale=2{circumflex over ( )}(−dQpY*ChromaQpTable′[QpY]/6)
scale=2{circumflex over ( )}(dQpY*ChromaQpTable′[QpY]/6)
Note that in case of ChromaQpTable′[QpY]=1, this leads to:
invScale=1/lumaMapTable[idx(avgY)]
scale=lumaMapTable[idx(avgY)]
which is the previous VTM way of deriving invScale and scale.
If it is considered that most of the time, QPY is relatively close to QPref, QPY can be replaced by QPref which does not relate to collocated luma samples of the chroma block. This approximation can apply to the variants of function g described above.
In an embodiment, the function g is defined as follows:
g(invScale, Qpref)=2{circumflex over ( )}((ChromaQpTable[Qpref−dQpY]−ChromaQpTable[Qpref])/6)
In an embodiment, dQpY=6*Log 2(lumaMapTable[idx(avgY)]
In an embodiment, dQpY=−6*Log 2(chromaScaleTable[idx(avgY)]
In another embodiment, the function g is defined as follows:
g(invScale, Qpref)=2{circumflex over ( )}(−slopeChMapTable*dQpY/6)
where slopeChMapTable is a given parameter, for instance derived as:
slopeChMapTable=(chromaScaleTable[QP1]−QP1)−
(chromaScaleTable[QP0]−QP0)/(QP1−QP0)
with for example QP0=20, QP1=50, or QP0=Qpref−K , QP1=Qpref+K, K being a pre-defined parameter.
In another embodiment, the function g is defined as follows:
g(invScale, Qpref)=lumaMapTable[idx(avgY)]{circumflex over ( )}slopeChMapTable
If it is considered that invScale=chromaScaleTable[idx(avgY)]≈1/lumaMapTable[idx(avgY)].
In another embodiment, steps 502 and 801 can be aggregated into one single step such that
invScale=chromaScaleTable[idx(avgY)]{circumflex over ( )}(1−slopeChMapTable)
In another embodiment, the correction is performed once to the complete chromaScaleTable. For instance, each element of the table is corrected as follows:
chromaScaleTable[i]=chromaScaleTable[i]{circumflex over ( )}(1−slopeChMapTable)
The block diagram of
In an embodiment, instead of using avgY in function g, a luma representative value refValY of the luma samples collocated or close to the chroma block may be used. For instance:
As there are possibly several chroma QP tables (one per chroma component), in an embodiment, one syntax element (e.g. named reference_qp_table_for_chroma) is signalled to indicate which of those tables is used to derive or correct the chroma scaling table. The syntax element can be for instance inserted in the SPS or in the slice header, and can take values 0 to 2. The processes described above apply using the chroma QP table ChromaQpTable[reference_qp_table_for_chroma].
Examples with Explicit Signaling of Correction Parameters of the Table ChromaScaleTable
In another embodiment, corrective parameters of the chroma scaling table chromaScaleTable are signalled in the bitstream. For instance, one to three corrective tables chromaScaleCorrectionTable[cldx−1] are signaled, of same size N as chromaScaleTable.
For each component cldx, a chroma scaling table table chromaScaleTable[cldx−1] is initialized in the same way as in VVC, based on the table lumaMapTable. For instance:
For i=0 to (N−1),
chromaScaleTable[cldx−1][i]=1/lumaMapTable[i] when
lumaMapTable[i] is different from 0
chromaScaleTable[cldx−1][i]=1 when
lumaMapTable[i] is equal to 0
The correction is performed as follows:
For i=0 to (N−1),
chromaScaleTable[cldx−1][i]=chromaScaleTable[cldx−1][i]*chromaScaleCorrectionTable[cldx−1][i]
In an embodiment, a high-level flag (chroma_res_scaling_correction_flag) is added to indicate if the correction is activated or not.
An example of new syntax, inserted at the slice level, is provided in Table 5 below. In this example, up to three correction tables are signaled, one for each chroma component. The syntax could also be inserted in a high-level structure such as the SPS, PPS, tile header, brick header, or APS.
Considering that chroma_res_scaling_correction_val[i][j] is coded as an integer, and that a neutral value is equal to 2K, K being a predefined parameter, on K bits, chromaScaleCorrectionTable[i][j] may be derived or approximated as follows:
For i=0 to (N−1),
chromaScaleCorrectionTable[i][j]=chroma_res_scaling_correction_val[i][j]/2{circumflex over ( )}K
In an embodiment, same_crs_table_for_chroma is not signalled but inferred to be of same value as same_qp_table_for_chroma.
In an alternate embodiment, the correction values that are signalled in the stream are defined in the scaling domain, not in the inverse scaling domain. This advantageously enabling limiting the range of the coded values. An example of related syntax for coding the chroma residual coding correction table is provided below. New syntax compared to a version of VVC syntax is underlined in the structure lmcs_data( ) contained in the APS.
lmcs_delta_crs_coded_flag
if (lmcs_delta_crs_coded_flag = = true ) {
lmcs_delta_crs_prec_minus1
for ( i = lmcs_min_bin_idx; i <= LmcsMaxBinIdx;
i++ ) {
lmcs_delta_abs_crs[ i ]
if (lmcs_delta_abs_crs[ i ] ) > 0 )
lmcs_delta_sign_crs_flag[ i ]
}
}
The semantics of the added syntax elements is provided below.
lmcs_delta_crs_coded_flag equal to 0 specifies that the syntax elements lmcs_delta_crs_prec_minus1, lmcs_delta_abs_crs[i] and lmcs_delta_abs_crs[i], with i=lmcs_min_bin_idx..LmcsMaxBinldx, are not present. lmcs_delta_crs_coded_flag equal to 1 specifies that these syntax elements are present.
lmcs_delta_crs_prec_minus1 plus 1 specifies the number of bits used for the representation of the syntax lmcs_delta_abs_crs[i]. The value of lmcs_delta_crs_prec_minus1 shall be in the range of 0 to BitDepthY−2, inclusive. When lmcs_delta_crs_prec_minus1 is not present, it is set equal to 0.
lmcs_delta_abs_crs[i] specifies the absolute codeword value for the ith correction value of the chroma residual scaling. When lmcs_delta_abs_crs[i] is not present, it is set equal to 0.
lmcs_delta_sign_crs_flag[i] specifies the sign of the variable lmcsDeltaCrs[i]. When lmcs_delta_sign_crs_flag[i] is not present, it is set equal to 0.
The variable lmcsDeltaCrs[i], with i=lmcs_min_bin_idx..LmcsMaxBinldx, is derived as follows:
lmcsDeltaCrs[i]
(1−2*lmcs_delta_sign_crs_flag[i])*lmcs_delta_abs_crs[i]
In addition, the following text from a version of VVC specification shall be modified (changes are underlined):
The variable ChromaScaleCoefff[i], with i=0 . . . 15, is derived as follows:
)
A constraint is set on the corrective value to avoid computation overflow as follows.
It is a requirement of bitstream conformance that (lmcsCW[i]+lmcsDeltaCrs[i]) is in the range of (OrgCW>>3) to (OrgCW<<3−1), inclusive.
It can be observed that the corrective term lmcsDeltaCrs[i] is added to the term lmcsCW[i], that corresponds in the VVC specification to the slope of the ith segment of the luma mapping function. OrgCW represents in the VVC specification the neutral value of scaling. lmcs_min_bin_idx, LmcsMaxBinldx represent the minimum and maximum indexes for which the LMCS syntax elements related to the LMCS tables are signalled.
In a variant, in order to avoid signaling a corrective table made of multiple elements, and to limit its related coding cost, only one or two corrective parameters, applying to the CRS table, are signalled. For example, an offset value “offset” and a shrink value “shrink” are signalled (considered as a floating point value here, but in practical implementations, fixed-point representation would be used). The table is modified as follows using offset and shrink:
Alternatively, in yet another variant, the process is modifed as follows (with the parameter offset denoted as lmcsDeltaCrs):
The constraint set on the corrective value to avoid computation overflow is formulated as follows: It is a requirement of bitstream conformance that, when lmcsCW[i] is not equal to 0, (lmcsCW[i]+lmcsDeltaCrs) is in the range of (OrgCW>>3) to (OrgCW<<3−1), inclusive.
An additional constraint can be imposed to the range of lmcsDeltaCrs. For instance, lmcsDeltaCrs can be constrained to be in the range [−7, 7]. This results when e.g. OrgCW=64 to a scale range of (64−7)/64=0.890625 to (64+7)/64=1.109375. Over this range, the scaling can be controlled by the delta QP of chroma.
An example of syntax for the case of coding a single offset is depicted in the table below (new added syntax is underlined).
lmcs_delta_abs_crs
if ( lmcs_delta_abs_crs ) > 0 )
lmcs_delta_sign_crs_flag
An example of related semantics is provided below.
lmcs_delta_abs_crs specifies the absolute codeword value of the variable lmcsDeltaCrs. The value of lmcs_delta_abs_crs shall be in the range of 0 and 7, inclusive. When not present, lmcs_delta_abs_crs shall be set equal to 0.
lmcs_delta_sign_crs_flag specifies the sign of the variable lmcsDeltaCrs. When not present, lmcs_delta_sign_crs_flag shall be set equal to 0.
The variable lmcsDeltaCrs is derived as follows:
lmcsDeltaCrs=(1−2*lmcs_delta_sign_crs_flag)*lmcs_delta_abs_crs
It is a requirement of bitstream conformance that, when lmcsCW[i] is not equal to 0, (lmcsCW[i]+lmcsDeltaCrs) is in the range of (OrgCW>>3) to (OrgCW<<3−1), inclusive.
The variable ChromaScaleCoeff[i], with i=0 . . . 15, is derived as follows:
The block diagram of
In a step 802, the corrective value lmcsDeltaCrs of the one or more chroma residual scaling parameters is added to the luma mapping parameters lmcsCW[i] representative of the slope of the ith segment of the luma forward mapping function a luma forward mapping function applied to a prediction of luma samples. Step 802 results in resulting in corrected luma mapping slope values (lmcsCW[i]+lmcsDeltaCrs).
According to a particular variant, the offset parameter lmcsDeltaCrs is signalled in the stream, at any of SPS, PPS, APS, slice header, tile header, brick header or CTU level as other variant of corrective values (for instance QPref). Advantageously offset parameter lmcsDeltaCrs is signaled with LMCS parameters in the Adaptation Parameter Set APS.
According to another particular variant, in a step 803, the corrected luma mapping slope values are bounded to avoid computation overflow. For instance, when lmcsCW[i] is not equal to 0, a corrected luma mapping slope value (lmcsCW[i]+lmcsDeltaCrs) is in the range of (OrgCW>>3) to (OrgCW<<3−1), inclusive where OrgCW represents a neutral value of scaling.
In yet another variant, the offset parameter lmcsDeltaCrs in the range [−7, 7] since, as previously demonstrated, outside of this range, the granularity of the chroma residual scaling is controllable by the delta QP of chroma.
In a step 804, the chroma residual scaling parameters ChromaScaleCoeff[i] are derived by inverting the corrected luma mapping slope values as follows:
Then, as previously described with the encoding method of
In a particular variant, steps 502 and 801 are aggregated into one single step such that invScale=OrgCW*(1<<11)/(lmcsCW[idx(avgY)]+lmcsDeltaCrs). In another variant, the correction is performed once to the chroma residual scaling parameters resulting in ChromaScaleCoeff[i], followed by a derivation step:
invScale=ChromaScaleCoeff[idx(avgY)].
In yet another embodiment of the above process is as follows.
The initial generation of ChromaScaleCoeff[i] is unchanged compared to a version of VVC specification:
When applying the scaling of a chroma residual sample of a chroma block, the offset is added (the change compared to the version of VVC specification is underlined):
varScale=ChromaScaleCoeff[idxYlnv]+lmcsDeltaCrs*K
idxYlnv being the index in the table ChromaScaleCoeff for the chroma block, derived as specified by the VVC specification, in the section 8.7.5.3 “Picture reconstruction with luma dependent chroma residual scaling process for chroma samples”. K is a pre-defined value enabling to limit the number of bits B (bitdepth) needed to signal the offset parameter lmcsDeltaCrs.
Of course, this can be done by modifying the table ChromaScaleCoeff depending on the implementation, as follows.
ChromaScaleCoeff[i]=(OrgCW*(1<<11)/lmcsCW[i])+lmcsDeltaCrs*K
Preferably K is a power of 2. In this variant, recommended bitdepth for signaling lmcsDeltaCrs is B=8/Log 2(K) where Log 2(x) is the base-2 logarithm of x. In this variant the signaling is slightly modified as follows:
In a variant, the parameter lmcsDeltaCrs is a pre-defined value not signalled in the bitstream. For instance, lmcsDeltaCrs=3 in the variant applying the following formula:
ChromaScaleCoeff[i]=OrgCW*(1<<11)/(lmcsCW[i]+lmcsDeltaCrs)
Here the process is described considering floating-point computations. Its adaptation for integer/fixed-point computations is straightforward and is not described.
This process is applied both at the encoder and decoder sides. Additionally, before the last operation above, modifiedCW can be clipped between (OrgCW>>3) to (OrgCW<<3−1), inclusive.
The description above relates to the derivation of the chroma residual inverse scaling factor or scale. The chroma residual scaling factor used at the encoder to scale the chroma residual is the inverse of the chroma residual inverse scaling factor used at the decoder (invScale). Therefore, its derivation is straightforward (scale=1/invScale).
The system 1200 includes at least one processor 1210 configured to execute instructions loaded therein for implementing, for example, the various aspects described in this document. Processor 1210 can include embedded memory, input output interface, and various other circuitries as known in the art. The system 1200 includes at least one memory 1220 (e.g., a volatile memory device, and/or a non-volatile memory device). System 1200 includes a storage device 1240, which can include non-volatile memory and/or volatile memory, including, but not limited to, EEPROM, ROM, PROM, RAM, DRAM, SRAM, flash, magnetic disk drive, and/or optical disk drive. The storage device 1240 can include an internal storage device, an attached storage device, and/or a network accessible storage device, as non-limiting examples.
System 1200 includes an encoder/decoder module 1230 configured, for example, to process data to provide an encoded video or decoded video, and the encoder/decoder module 1230 can include its own processor and memory. The encoder/decoder module 1230 represents module(s) that can be included in a device to perform the encoding and/or decoding functions. As is known, a device can include one or both of the encoding and decoding modules. Additionally, encoder/decoder module 1230 can be implemented as a separate element of system 1200 or can be incorporated within processor 1210 as a combination of hardware and software as known to those skilled in the art.
Program code to be loaded onto processor 1210 or encoder/decoder 1230 to perform the various aspects described in this document can be stored in storage device 1240 and subsequently loaded onto memory 1220 for execution by processor 1210. In accordance with various embodiments, one or more of processor 1210, memory 1220, storage device 1240, and encoder/decoder module 1230 can store one or more of various items during the performance of the processes described in this document. Such stored items can include, but are not limited to, the input video, the decoded video or portions of the decoded video, the bitstream, matrices, variables, and intermediate or final results from the processing of equations, formulas, operations, and operational logic.
In several embodiments, memory inside of the processor 1210 and/or the encoder/decoder module 1230 is used to store instructions and to provide working memory for processing that is needed during encoding or decoding. In other embodiments, however, a memory external to the processing device (for example, the processing device can be either the processor 1210 or the encoder/decoder module 1230) is used for one or more of these functions. The external memory can be the memory 1220 and/or the storage device 1240, for example, a dynamic volatile memory and/or a non-volatile flash memory. In several embodiments, an external non-volatile flash memory is used to store the operating system of a television. In at least one embodiment, a fast, external dynamic volatile memory such as a RAM is used as working memory for video coding and decoding operations, such as for MPEG-2, HEVC, or VVC (Versatile Video Coding).
The input to the elements of system 1200 can be provided through various input devices as indicated in block 1205. Such input devices include, but are not limited to, (i) an RF portion that receives an RF signal transmitted, for example, over the air by a broadcaster, (ii) a Composite input terminal, (iii) a USB input terminal, and/or (iv) an HDMI input terminal.
In various embodiments, the input devices of block 1205 have associated respective input processing elements as known in the art. For example, the RF portion can be associated with elements necessary for (i) selecting a desired frequency (also referred to as selecting a signal, or band-limiting a signal to a band of frequencies), (ii) downconverting the selected signal, (iii) band-limiting again to a narrower band of frequencies to select (for example) a signal frequency band which can be referred to as a channel in certain embodiments, (iv) demodulating the downconverted and band-limited signal, (v) performing error correction, and (vi) demultiplexing to select the desired stream of data packets. The RF portion of various embodiments includes one or more elements to perform these functions, for example, frequency selectors, signal selectors, band-limiters, channel selectors, filters, downconverters, demodulators, error correctors, and demultiplexers. The RF portion can include a tuner that performs various of these functions, including, for example, downconverting the received signal to a lower frequency (for example, an intermediate frequency or a near-baseband frequency) or to baseband. In one set-top box embodiment, the RF portion and its associated input processing element receives an RF signal transmitted over a wired (for example, cable) medium, and performs frequency selection by filtering, downconverting, and filtering again to a desired frequency band. Various embodiments rearrange the order of the above-described (and other) elements, remove some of these elements, and/or add other elements performing similar or different functions. Adding elements can include inserting elements in between existing elements, for example, inserting amplifiers and an analog-to-digital converter. In various embodiments, the RF portion includes an antenna.
Additionally, the USB and/or HDMI terminals can include respective interface processors for connecting system 1200 to other electronic devices across USB and/or HDMI connections. It is to be understood that various aspects of input processing, for example, Reed-Solomon error correction, can be implemented, for example, within a separate input processing IC or within processor 1210 as necessary. Similarly, aspects of USB or HDMI interface processing can be implemented within separate interface ICs or within processor 1210 as necessary. The demodulated, error corrected, and demultiplexed stream is provided to various processing elements, including, for example, processor 1210, and encoder/decoder 1230 operating in combination with the memory and storage elements to process the datastream as necessary for presentation on an output device.
Various elements of system 1200 can be provided within an integrated housing. Within the integrated housing, the various elements can be interconnected and transmit data therebetween using suitable connection arrangement 1140, for example, an internal bus as known in the art, including the I2C bus, wiring, and printed circuit boards.
The system 1200 includes communication interface 1250 that enables communication with other devices via communication channel 1260. The communication interface 1250 can include, but is not limited to, a transceiver configured to transmit and to receive data over communication channel 1260. The communication interface 1250 can include, but is not limited to, a modem or network card and the communication channel 1260 can be implemented, for example, within a wired and/or a wireless medium.
Data is streamed to the system 1200, in various embodiments, using a Wi-Fi network such as IEEE 802.11. The Wi-Fi signal of these embodiments is received over the communications channel 1260 and the communications interface 1250 which are adapted for Wi-Fi communications. The communications channel 1260 of these embodiments is typically connected to an access point or router that provides access to outside networks including the Internet for allowing streaming applications and other over-the-top communications. Other embodiments provide streamed data to the system 1200 using a set-top box that delivers the data over the HDMI connection of the input block 1205. Still other embodiments provide streamed data to the system 1200 using the RF connection of the input block 1205.
The system 1200 can provide an output signal to various output devices, including a display 1265, speakers 1275, and other peripheral devices 1285. The other peripheral devices 1285 include, in various examples of embodiments, one or more of a stand-alone DVR, a disk player, a stereo system, a lighting system, and other devices that provide a function based on the output of the system 1200. In various embodiments, control signals are communicated between the system 1200 and the display 1265, speakers 1275, or other peripheral devices 1285 using signaling such as AV.Link, CEC, or other communications protocols that enable device-to-device control with or without user intervention. The output devices can be communicatively coupled to system 1200 via dedicated connections through respective interfaces 1260, 1270, and 1280. Alternatively, the output devices can be connected to system 1200 using the communications channel 1290 via the communications interface 1250. The display 1265 and speakers 1275 can be integrated in a single unit with the other components of system 1200 in an electronic device, for example, a television. In various embodiments, the display interface 1260 includes a display driver, for example, a timing controller (T Con) chip.
The display 1265 and speaker 1275 can alternatively be separate from one or more of the other components, for example, if the RF portion of input 1205 is part of a separate set-top box. In various embodiments in which the display 1265 and speakers 1275 are external components, the output signal can be provided via dedicated output connections, including, for example, HDMI ports, USB ports, or COMP outputs.
The embodiments can be carried out by computer software implemented by the processor 1210 or by hardware, or by a combination of hardware and software. As a non-limiting example, the embodiments can be implemented by one or more integrated circuits. The memory 1220 can be of any type appropriate to the technical environment and can be implemented using any appropriate data storage technology, such as optical memory devices, magnetic memory devices, semiconductor-based memory devices, fixed memory, and removable memory, as non-limiting examples. The processor 1210 can be of any type appropriate to the technical environment, and can encompass one or more of microprocessors, general purpose computers, special purpose computers, and processors based on a multi-core architecture, as non-limiting examples.
Various implementations involve decoding. “Decoding”, as used in this application, can encompass all or part of the processes performed, for example, on a received encoded sequence in order to produce a final output suitable for display. In various embodiments, such processes include one or more of the processes typically performed by a decoder, for example, entropy decoding, inverse quantization, inverse transformation, and differential decoding. In various embodiments, such processes also, or alternatively, include processes performed by a decoder of various implementations described in this application.
As further examples, in one embodiment “decoding” refers only to entropy decoding, in another embodiment “decoding” refers only to differential decoding, and in another embodiment “decoding” refers to a combination of entropy decoding and differential decoding. Whether the phrase “decoding process” is intended to refer specifically to a subset of operations or generally to the broader decoding process will be clear based on the context of the specific descriptions and is believed to be well understood by those skilled in the art.
Various implementations involve encoding. In an analogous way to the above discussion about “decoding”, “encoding” as used in this application can encompass all or part of the processes performed, for example, on an input video sequence in order to produce an encoded bitstream. In various embodiments, such processes include one or more of the processes typically performed by an encoder, for example, partitioning, differential encoding, transformation, quantization, and entropy encoding.
In various embodiments, such processes also, or alternatively, include processes performed by an encoder of various implementations described in this application.
As further examples, in one embodiment “encoding” refers only to entropy encoding, in another embodiment “encoding” refers only to differential encoding, and in another embodiment “encoding” refers to a combination of differential encoding and entropy encoding. Whether the phrase “encoding process” is intended to refer specifically to a subset of operations or generally to the broader encoding process will be clear based on the context of the specific descriptions and is believed to be well understood by those skilled in the art.
Note that the syntax elements as used herein are descriptive terms. As such, they do not preclude the use of other syntax element names.
When a figure is presented as a flow diagram, it should be understood that it also provides a block diagram of a corresponding apparatus. Similarly, when a figure is presented as a block diagram, it should be understood that it also provides a flow diagram of a corresponding method/process.
Various embodiments refer to rate distortion optimization. In particular, during the encoding process, the balance or trade-off between the rate and distortion is usually considered, often given the constraints of computational complexity. The rate distortion optimization is usually formulated as minimizing a rate distortion function, which is a weighted sum of the rate and of the distortion. There are different approaches to solve the rate distortion optimization problem. For example, the approaches may be based on an extensive testing of all encoding options, including all considered modes or coding parameters values, with a complete evaluation of their coding cost and related distortion of the reconstructed signal after coding and decoding. Faster approaches may also be used, to save encoding complexity, in particular with computation of an approximated distortion based on the prediction or the prediction residual signal, not the reconstructed one. Mix of these two approaches can also be used, such as by using an approximated distortion for only some of the possible encoding options, and a complete distortion for other encoding options. Other approaches only evaluate a subset of the possible encoding options. More generally, many approaches employ any of a variety of techniques to perform the optimization, but the optimization is not necessarily a complete evaluation of both the coding cost and related distortion.
The implementations and aspects described herein can be implemented in, for example, a method or a process, an apparatus, a software program, a data stream, or a signal. Even if only discussed in the context of a single form of implementation (for example, discussed only as a method), the implementation of features discussed can also be implemented in other forms (for example, an apparatus or program). An apparatus can be implemented in, for example, appropriate hardware, software, and firmware. The methods can be implemented in, for example, a processor, which refers to processing devices in general, including, for example, a computer, a microprocessor, an integrated circuit, or a programmable logic device. Processors also include communication devices, such as, for example, computers, cell phones, portable/personal digital assistants (“PDAs”), and other devices that facilitate communication of information between end-users.
Reference to “one embodiment” or “an embodiment” or “one implementation” or “an implementation”, as well as other variations thereof, means that a particular feature, structure, characteristic, and so forth described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of the phrase “in one embodiment” or “in an embodiment” or “in one implementation” or “in an implementation”, as well any other variations, appearing in various places throughout this document are not necessarily all referring to the same embodiment.
Additionally, this document may refer to “determining” various pieces of information. Determining the information can include one or more of, for example, estimating the information, calculating the information, predicting the information, or retrieving the information from memory.
Further, this document may refer to “accessing” various pieces of information. Accessing the information can include one or more of, for example, receiving the information, retrieving the information (for example, from memory), storing the information, moving the information, copying the information, calculating the information, determining the information, predicting the information, or estimating the information.
Additionally, this document may refer to “receiving” various pieces of information. Receiving is, as with “accessing”, intended to be a broad term. Receiving the information can include one or more of, for example, accessing the information, or retrieving the information (for example, from memory). Further, “receiving” is typically involved, in one way or another, during operations such as, for example, storing the information, processing the information, transmitting the information, moving the information, copying the information, erasing the information, calculating the information, determining the information, predicting the information, or estimating the information.
It is to be appreciated that the use of any of the following “/”, “and/or”, and “at least one of”, for example, in the cases of “A/B”, “A and/or B” and “at least one of A and B”, is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of both options (A and B). As a further example, in the cases of “A, B, and/or C” and “at least one of A, B, and C”, such phrasing is intended to encompass the selection of the first listed option (A) only, or the selection of the second listed option (B) only, or the selection of the third listed option (C) only, or the selection of the first and the second listed options (A and B) only, or the selection of the first and third listed options (A and C) only, or the selection of the second and third listed options (B and C) only, or the selection of all three options (A and B and C). This may be extended, as is clear to one of ordinary skill in this and related arts, for as many items as are listed.
Also, as used herein, the word “signal” refers to, among other things, indicating something to a corresponding decoder. For example, in certain embodiments the encoder signals a particular one of a plurality of parameters. In this way, in an embodiment the same parameter is used at both the encoder side and the decoder side. Thus, for example, an encoder can transmit (explicit signaling) a particular parameter to the decoder so that the decoder can use the same particular parameter. Conversely, if the decoder already has the particular parameter as well as others, then signaling can be used without transmitting (implicit signaling) to simply allow the decoder to know and select the particular parameter. By avoiding transmission of any actual functions, a bit savings is realized in various embodiments. It is to be appreciated that signaling can be accomplished in a variety of ways. For example, one or more syntax elements, flags, and so forth are used to signal information to a corresponding decoder in various embodiments. While the preceding relates to the verb form of the word “signal”, the word “signal” can also be used herein as a noun.
As will be evident to one of ordinary skill in the art, implementations can produce a variety of signals formatted to carry information that can be, for example, stored or transmitted. The information can include, for example, instructions for performing a method, or data produced by one of the described implementations. For example, a signal can be formatted to carry the bitstream of a described embodiment. Such a signal can be formatted, for example, as an electromagnetic wave (for example, using a radio frequency portion of spectrum) or as a baseband signal. The formatting can include, for example, encoding a data stream and modulating a carrier with the encoded data stream. The information that the signal carries can be, for example, analog or digital information. The signal can be transmitted over a variety of different wired or wireless links, as is known. The signal can be stored on a processor-readable medium.
We describe a number of embodiments. Features of these embodiments can be provided alone or in any combination. Various other generalized, as well as particularized, aspects, embodiments and claims are also supported and contemplated throughout this disclosure. For example, various methods and other aspects described in this application can be used to modify modules, for example, chroma residual scaling module 104 and inverse chroma residual scaling module 109 of a video encoder 100 in
| Number | Date | Country | Kind |
|---|---|---|---|
| 19306117.3 | Sep 2019 | EP | regional |
| 19306170.2 | Sep 2019 | EP | regional |
| 19306288.2 | Oct 2019 | EP | regional |
| 19306324.5 | Oct 2019 | EP | regional |
| 19306325.2 | Oct 2019 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2020/075841 | 9/16/2020 | WO |
