The present disclosure relates to video coding technology, and in particular, to systems and methods for block division in video coding.
In the existing video coding technology, block division manners are not rich enough, which may affect the fitting performance of the block division to image texture, thereby affecting the efficiency of the video coding. In addition, the existing block division manners are regular, that is, boundaries of sub-blocks obtained by the block division are straight lines, which may reduce the flexibility of the block division and implicitly increase the division depth of the block division.
Therefore, it is desirable to provide systems and methods for block division, which may improve the fitting performance of the block division to the image texture, thereby improving the efficiency of the video coding.
According to an aspect of the present disclosure, a method for block division and encoding in video processing is provided. The method may include obtaining a block to be predicted in an image frame. The method may also include determining, based on a plurality of division modes of the block, a target division mode of the block. The plurality of division modes may include an equal division mode that is configured to divide the block into multiple sub-blocks with a same size. The method may further include dividing, based on the target division mode, the block into a plurality of sub-blocks, and encoding the block based on the plurality of sub-blocks.
In some embodiments, the plurality of division modes may further include at least one derivative division mode based on the equal division mode. The at least one derivative division mode may be obtained by removing a count of division boundaries from the equal division mode. The count may be greater than or equal to 1 and less than a difference between a count of the multiple of sub-blocks and 1.
In some embodiments, the plurality of division modes may include a combination division mode. The combination division mode may include a first division mode and a second division mode, and be configured to divide the block into multiple sub-blocks based on the first division mode and further divide at least one of the multiple sub-blocks based on the second division mode.
In some embodiments, a dividing direction of the first division mode may be vertical to a dividing direction of the second division mode.
In some embodiments, the plurality of division modes may further include a step division mode with a stepped division boundary.
In some embodiments, the step division mode may be determined based on a beginning position of the division of the block or a division direction of the division of the block.
In some embodiments, whether the step division mode is used and an index of a division proportion of the step division mode may be included in a codec end.
In some embodiments, the determining, based on the plurality of division modes of the block, the target division mode of the block may include comparing costs of the plurality of division modes; and designating, from the plurality of division modes, a division mode with a smallest cost as the target division mode.
In some embodiments, the method may further include determining a division condition based on at least one of a size of the block or a type of the image frame, and the dividing, based on the target division mode, the block into the plurality of sub-blocks include determining whether the target division mode is suitable for the block based on the division condition; and in response to a determination that the target division model is suitable for the block, dividing the block, based on the target division mode, into the plurality of sub-blocks.
In some embodiments, the method may further include encoding the block based on an index of the target division mode.
According to an aspect of the present disclosure, a system for block division and encoding in video processing is provided. The system may include at least one storage device storing executable instructions, and at least one processor in communication with the at least one storage device. When executing the executable instructions, the at least one processor may cause the system to perform a method including obtaining a block to be predicted in an image frame. The method may also include determining, based on a plurality of division modes of the block, a target division mode of the block. The plurality of division modes may include an equal division mode that is configured to divide the block into multiple sub-blocks with a same size. The method may further include dividing, based on the target division mode, the block into a plurality of sub-blocks, and encoding the block based on the plurality of sub-blocks.
According to an aspect of the present disclosure, a non-transitory computer readable medium is provided. The non-transitory computer readable medium may include a set of instructions. When executing the executable instructions, at least one processor may cause a system to perform a method including obtaining a block to be predicted in an image frame. The method may also include determining, based on a plurality of division modes of the block, a target division mode of the block. The plurality of division modes may include an equal division mode that is configured to divide the block into multiple sub-blocks with a same size. The method may further include dividing, based on the target division mode, the block into a plurality of sub-blocks, and encoding the block based on the plurality of sub-blocks.
Additional features will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following and the accompanying drawings or may be learned by production or operation of the examples. The features of the present disclosure may be realized and attained by practice or use of various aspects of the methodologies, instrumentalities, and combinations set forth in the detailed examples discussed below.
The present disclosure is further described in terms of exemplary embodiments. These exemplary embodiments are described in detail with reference to the drawings. These embodiments are non-limiting exemplary embodiments, in which like reference numerals represent similar structures throughout the several views of the drawings, and wherein:
In the following detailed description, numerous specific details are set forth by way of examples in order to provide a thorough understanding of the relevant disclosure. However, it should be apparent to those skilled in the art that the present disclosure may be practiced without such details. In other instances, well-known methods, procedures, systems, components, and/or circuitry have been described at a relatively high level, without detail, in order to avoid unnecessarily obscuring aspects of the present disclosure. Various modifications to the disclosed embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the present disclosure. Thus, the present disclosure is not limited to the embodiments shown, but to be accorded the widest scope consistent with the claims.
It should be understood that the term “encoding unit,” “current block,” “encoding block,” or “block,” used herein refer to a basic unit of image processing or a specific position in an image and are used interchangeably. In addition, in the description of the present disclosure, the term “unit” includes all concepts of encoding unit, prediction unit, and transformation unit.
The terminology used herein is for the purposes of describing particular examples and embodiments only and is not intended to be limiting. As used herein, the singular forms “a,” “an,” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “include” and/or “comprise,” when used in this disclosure, specify the presence of integers, devices, behaviors, stated features, steps, elements, operations, and/or components, but do not exclude the presence or addition of one or more other integers, devices, behaviors, features, steps, elements, operations, components, and/or groups thereof.
In addition, it should be understood that in the description of the present disclosure, the terms “first”, “second”, or the like, are only used for the purpose of differentiation, and cannot be interpreted as indicating or implying relative importance, nor can be understood as indicating or implying the order.
The flowcharts used in the present disclosure illustrate operations that systems implement according to some embodiments of the present disclosure. It is to be expressly understood, the operations of the flowcharts may be implemented not in order. Conversely, the operations may be implemented in an inverted order, or simultaneously. Moreover, one or more other operations may be added to the flowcharts. One or more operations may be removed from the flowcharts.
In some embodiments, a video processing system 100 may be applied to a video compression system, such as an air television broadcasting system, a cable television transmission system, a satellite television transmission system, an Internet video transmission system, a digital video stored in media, or the like. As used herein, video compression refers to a process of reducing the amount of data required to present a video. The purpose of the video compression may be to reduce redundant information in the video data so as to store and transmit the video data effectively.
As shown in
In some embodiments, the source signal 110 may refer to a video signal (also referred to as a video source or a video source signal). In some embodiments, the video source signal may refer to uncompressed dynamic images, for example, dynamic images in a digital video format.
In some embodiments, the encoder 120 may refer to a signal compression standard completed by software and/or hardware applications. The encoder 120 may be configured to compress the video source signal at a sending end to obtain an encoded video source signal (i.e., an encoded source signal).
In the video encoding process, an image frame may be input. When an image frame is encoded, the image frame may be divided into several largest coding units (LCUs), and then each of the several LCUs may be divided into multiple coding units (CUs). The video coding may be performed on the CUs.
In some embodiments, the decoder 140 may refer to a signal compression standard completed by software or hardware applications. The decoder 140 may be configured to generate an approximation of the video source signal in a decoding end for playback.
In some embodiments, the encoder 120 may perform transformation and quantization operations on residual information of the video source signal generated by intra prediction technique. The residual information may be encoded through entropy coding and transmitted to the decoding end. The decoder 140 may extract the residual information from information transmitted from the encoder 120, and further determine a reconstructed value of the video source signal by combining a predicted value obtained by motion estimation.
In some embodiments, the channel 130 may transmit or store encoded video data (e.g., the compressed/encoded video source signal). The channel 130 may include a wireless channel, a wired channel, or a frequency band. The channel 130 may include a twisted pair, a cable, an optical fiber, or a medium that may propagate electromagnetic waves.
In some embodiments, the decoded signal 150 may refer to data (i.e., video data after being compressed and decompressed) reconstructed from the source signal 110 after being encoded and decoded.
In some embodiments, the encoded video data (e.g., the compressed/encoded video source signal) may be stored in a storage device (e.g., a hard disk), and the encoded video data may be read from the storage device during a subsequent decoding processing process.
In some embodiments, the video processing system 100 may further include a channel encoder. The channel encoder may refer to a device or program that may further encode the encoded video source signal before channel transmission at the sending end. The channel encoder may be configured to perform an error correction. In some embodiments, the video processing system 100 may further include a channel decoder. The channel decoder may be configured at a receiving end to detect and correct an error in data transmission. The encoded video source signal may be unzipped by the channel decoder.
It should be noted that the above description is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations and modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure.
In 210, a block to be predicted (also referred to as a block for brevity) in an image frame may be obtained. Operation 210 may be implemented by an acquisition module 910. A block may refer to a coding unit (CU). As used herein, the obtaining the block to be predicted may refer to obtaining information related to the block to be predicated. The information related to the block to be predicted may include characteristics of the block to be predicted, such as pixel values of the block to be predicted, a position of the block to be predicted in the image frame. The block to be predicted may refer to a block whose prediction mode has not been determined and has not been predicted. In some embodiments, the block to be predicted may be previously obtained and stored in a storage device (e.g., a storage 1020). The block to be predicted may be obtained from the storage device via a network.
In 220, a target division mode of the block may be determined based on a plurality of division modes of the block. Operation 220 may be implemented by a determination module 920.
A division mode of the block may be used to divide the block. In some embodiments, the division mode of the block may be defined by a division direction (e.g., a horizontal division, a vertical division), a count of sub-blocks obtained based on the division mode (or a count of division boundaries in the division mode), and a division proportion of the block. If any one of the division direction, the count of sub-blocks obtained based on the division mode (or the count of division boundaries in the division mode), and the division proportion of the division mode is different, the division mode is different. The division proportion of the block may refer to a proportion of widths of sub-blocks obtained based on the vertical division of the block or a proportion of heights of sub-blocks obtained based on the horizontal division of the block.
In some embodiments, the plurality of division modes may include an equal division mode that is configured to divide the block into multiple sub-blocks with a same size. The same size may refer to that the multiple sub-blocks have the same side length and area. A count of the multiple sub-blocks may be a natural number greater than 1. More descriptions regarding the equal division mode may be found elsewhere in the present disclosure, for example,
In some embodiments, the plurality of division modes may further include at least one derivative division mode based on an equal division mode. The at least one derivative division mode based on an equal division mode may be obtained by removing a count of division boundaries from the equal division mode. The count of division boundaries may be greater than or equal to 1 and less than a difference between a count of the multiple sub-blocks obtained based on the equal division mode and 1. More descriptions regarding the at least one derivative division mode of the equal division mode may be found elsewhere in the present disclosure, for example,
In some embodiments, the plurality of division modes may include a combination division mode. The combination division mode may include a first division mode and a second division mode that is different from the second division mode. The combination division mode may be configured to divide the block into multiple sub-blocks based on the first division mode and further divide at least one of the multiple sub-blocks based on the second division mode. In some embodiments, the first division mode and the second division mode may be equal division modes. For example, the first division mode and the second division mode may be two equal division modes. The first division mode may divide the block into 2 sub-blocks with a same size, and the second division mode may divide any one of the 2 sub-blocks into 2 sub-blocks with a same size. In some embodiments, the first division mode may be a derivative division mode of the equal division mode, and the second division mode may be an equal division mode. For example, the first division mode may be a derivative division mode based on a four equal division mode, the second division mode may be an equal division mode. More descriptions regarding the combination division mode may be found elsewhere in the present disclosure, for example,
In some embodiments, the plurality of division modes may include a step division mode with a stepped division boundary. The step division mode may include horizontal division and vertical division, which is more flexible than only horizontal division or only vertical division. Compared with a diagonal division that requires a prescribed division angle, the step division mode is simpler and has a lower cost in encoding and decoding, that is the step division mode consumes fewer bits and has a smaller amount of data. The stepped division boundary may be composed of alternate vertical boundaries and horizontal boundaries. A vertical boundary and a horizontal boundary may form a step. The stepped division boundary may be composed of multiple steps. A count of the multiple steps may be determined based on a count of the vertical boundaries or the horizontal boundaries. In some embodiments, the step division mode may be determined based on a beginning position of the division of the block or a division direction of the division of the block. The beginning position and the division direction may be preset. Specifically, a plurality of candidate starting positions and division directions may be preset, and then a beginning position and the division direction with a best prediction effect may be selected from the plurality of candidate starting positions and division directions based on the texture feature of the block. A boundary of the texture of the block may be determined by using a filter, and then the beginning position and the division direction can be determined based on the boundary of the texture of the block. More descriptions regarding the combination division mode may be found elsewhere in the present disclosure, for example,
In some embodiments, a division mode may be selected, according to a size of the block and a type of the image frame including the block, from the plurality of division modes as a target division mode of the block.
In some embodiments, costs of the plurality of division modes may be compared. A cost of a division mode may refer to a prediction cost of the intra prediction or inter prediction of the block based on the division mode. Further, a division mode with a smallest cost may be designated from the plurality of division modes as the target division mode of the block. Information (e.g., the division proportion, the division manner, etc.) associated with the target division mode of the block may be recorded in the block.
In 230, the block may be divided into a plurality of sub-blocks based on the target division mode. Operation 230 may be implemented by a division module 930. For example, the block may be divided into the plurality of sub-blocks based on the information (e.g., a division manner, a division proportion) associated with the target division mode.
In some embodiments, a division condition may be determined based on at least one of a size of the block or a type of the image frame. Further, whether the target division mode is suitable for the block may be determined based on the division condition. For example, in response to a determination that the target division mode is suitable for the block, the block may be divided into the plurality of sub-blocks based on the target division mode.
In some embodiments, the division condition of the block may be a default setting of the system 100 or set by a user manually. For example, the division condition of the block may be that the block is suitable for an arbitrary division mode, or the block is suitable for one or more specified division modes.
In some embodiments, the division condition of the block may be determined based on the size of the block. For example, whether a certain division mode may be suitable for the block may be determined based on a width and/or a height of the block. If the width and/or the height of the block satisfies a size condition, the certain division mode may be suitable for the block. If the width and/or the height of the block does not satisfy the condition, the certain division mode may not be suitable for the block. In some embodiments, if a ratio of the width and height of the block satisfies a ratio condition, the width and/or the height of the block satisfies the condition. If the ratio of the width and height of the block does not satisfy the ratio condition, the width and/or the height of the block does not satisfy the condition. For example, a vertical division mode at a division proportion of 1:3:4 may be suitable for the block when the ratio of the width and height of the block is greater than 4 and less than or equal to 8. For example, the vertical division at the division proportion of 1:3:4 may be suitable for the block with a size of 32×4 (the width of the block×the height of the block).
In some embodiments, a width and/or a height of a smallest sub-block of sub-blocks obtained by dividing the block based on a certain division mode may be determined, and then whether the certain division mode may be suitable for the block may be determined based on the width and/or the height of the smallest sub-block. In some embodiments, if the width and/or the height of the smallest sub-block is larger than or equal to a threshold, the certain division mode may be suitable for the block. If the width and/or the height of the smallest sub-block is less than the threshold, the certain division mode may not be suitable for the block. For example, when the width and/or the height of the smallest sub-block is less than 4, the certain division mode may be not suitable for the block. For example, a block with a size of 15×9 (the width of the block×the height of the block) may be divided into a sub-block with a size of 5×9 and a sub-block with a size of 10×9 based on a vertical division mode at a division proportion of 1:2 or 2:1. In such cases, the width and/or the height of the smallest sub-block (i.e., the sub-block with the size of 5×9) is larger than 4, so that the vertical division mode at the division proportion of 1:2 or 2:1 may be suitable for the block. As another example, the block with the size of 15×9 may be divided into a sub-block with a size of 15×3 and a sub-block with a size of 15×6 based on a horizontal division mode at a division proportion of 1:2 or 2:1. In such cases, the height of the smallest sub-block (i.e., the sub-block with the size of 15×3) is less than 4, so that the horizontal division mode at the division proportion of 1:2 or 2:1 may not be suitable for the block.
In some embodiments, the division condition of the block may be determined based on the type of the image frame. Whether a certain division mode may be suitable for the block may be determined based on the type of the image frame. In some embodiments, the type of the image frame may include I-frame, P-frame, or B-frame. In some embodiments, the type of the image frame may include intra frame and inter frame. Different types of image frames may be suitable for different division modes. For example, the step division mode may be suitable for blocks in the inter frame. The division condition may be set based on actual application scenarios.
According to the above embodiments in the present disclosure, the target division mode of the block is determined based on one or more division modes from rich division modes, so that the determined target division mode of the block may adapt to the image texture of the image frame more flexibly, thereby improving the efficiency of the video coding.
In some embodiments, at a codec end (e.g., the encoder 120 or the decoder 140 illustrated in
In some embodiments, whether the step division mode is used and an index of a division proportion of the step division mode may be included the codec end.
In some embodiments, multiple candidate division proportions may be set at the codec end. During a process of encoding the block, an index, in a list of the multiple candidate division proportions, of a division proportion that is selected from the multiple candidate division proportions to divide the block may be transmitted.
For example, as shown in
In 240, the block may be encoded based on the plurality of sub-blocks. In some embodiments, operation 240 may be implemented by an encoding module 940.
In some embodiments, the block may be encoded based on an index of the target division mode. The index of the target division mode may refer to data or identification that is used to point to the target division mode among the plurality of division modes. By the index of the target division mode, the codec end may directly locate the target division mode without scanning all division modes in the plurality of division modes.
In some embodiments, the index of the target division mode may be obtained by numbering the target division mode.
In some embodiments, indexes of the plurality of division modes may be obtained by numbering the plurality of division modes. An index may be selected from the indexes of the plurality of division modes and transmitted to identify the target division mode that is used to divide the block.
For example, in an audio video coding standard 3 (AVS3), a syntax “split_flag” may be used to indicate the target division mode of the block used by the codec end.
The following are three transmission manners of a syntax corresponding to the step division mode.
In the transmission manner (1), only one division proportion may be set at the codec end. When the step division mode is selected as the target division mode of the block, the codec end may divide the block using the division proportion. In such cases, a syntax that indicates whether the step division mode is selected to divide the block may be needed.
In the transmission manner (2), multiple candidate division proportions may be set at the codec end. An index, in a list of the multiple candidate division proportions, of a division proportion that is selected from the multiple candidate division proportions to divide the block may be transmitted. In such cases, indexes of the multiple candidate division proportions may be determined by numbering the multiple candidate division proportions. In addition, the syntax that indicates whether the step division mode is selected to divide the block may be needed. If the step division mode is selected to divide the block, a syntax that indicates an index corresponding to the step division mode may be transmitted.
In the transmission manner (3), an initial division proportion of the block may be obtained based on the texture feature of the block. Further, the initial division proportion may be adjusted to obtain multiple adjusted division proportions. A target division proportion of the block may be obtained by traversing the multiple adjusted division proportions, and then the target division proportion of the block may be transmitted. In such cases, the syntax that indicates whether the step division mode is selected to divide the block may be needed. If the step division mode is selected to divide the block, a syntax that indicates a count of a plurality of sub-blocks that is obtained by dividing the block along the width of the block, a syntax that indicates a count of a plurality of sub-blocks that is obtained by dividing the block along the height of the block, and a syntax that indicates the target division proportion of the block may be transmitted.
For example, a syntax “split_stairs_enable_flag” may indicate that whether the step division mode is selected to divide the block. When a value of the syntax “split_stairs_enable_flag” is 1, the step division mode may be selected to divide the block. When the value of the syntax “split_stairs_enable_flag” is 0, the step division mode may not be selected to divide the block.
In some embodiments, the multiple candidate division proportions of the width or height of the block may be set as {1:1, 1:2, 1:3, 2:1, 3:1, 1:1:1, 1:2:1, 2:1:1, 1:1:1:1}, and the corresponding indexes of the multiple candidate division proportions may be set as {0, 1, 2, 3, 4, 5, 6, 7, 8, 9}. A syntax “split_stairs_hor_flag” may indicate an index of the target division proportion of the block in a horizontal direction, that is, an index of the target division proportion of the height of the block. A syntax “split_stairs_ver_flag” may indicate an index of the target division proportion of the block in a vertical direction, that is, an index of the target division proportion of the width of the block. When the value of the syntax “split_stairs_enable_flag” is 1, the syntaxes “split_stairs_hor_flag” and “split_stairs_ver_flag” may be transmitted to record the target division proportion. According to the above description, the values of the syntax “split_stairs_enable_flag,” the syntax “split_stairs_hor_flag,” and the syntax “split_stairs_ver_flag” corresponding to the division mode of the block 620 as shown in
According to the above embodiments in the present disclosure, the division modes may enrich the division of the block, so that the division of the block may adapt to the image texture of the image frame more flexibly, thereby improving the efficiency of video coding.
It should be noted that the above description is merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For persons having ordinary skills in the art, multiple variations or modifications may be made under the teachings of the present disclosure. However, those variations and modifications do not depart from the scope of the present disclosure.
As shown in
As shown in Mode 7 in
As shown in Mode 11 in
As shown in Mode 15 in
As shown in Mode 19 in
As shown in
It should be noted that the above embodiments are merely provided for the purposes of illustration, and not intended to limit the scope of the present disclosure. For example, the count of the multiple sub-blocks obtained based on the equal division mode may also include, for example, 6, 7, 9, 10, or the like, that is, the equal division mode may also be a six equal division mode, a seven equal division mode, a nine equal division mode, or a ten equal division mode, or the like.
According to the above embodiments in the present disclosure, one or more derivative division modes may be obtained by removing one or more division boundaries from the equal division mode, which increases a count of the plurality of division modes. As a result, the target division mode of the block determined based on the plurality of division modes may adapt to the image texture of the image frame more flexibly, thereby improving the efficiency of the video coding.
In some embodiments, the combination division mode may include a first division mode and a second division mode. A dividing direction of the first division mode may be vertical to a dividing direction of the second division mode. In some embodiments, one of the first division mode and the second division mode may be a horizontal division mode that is configured to divide the block in a horizontal direction, and the other of the first division mode and the second division mode may be a vertical division mode that is configured to divide the block in a vertical direction.
For example, as shown in
For example, as shown in
For example, as shown in
According to the above embodiments in the present disclosure, the combination division mode increases the count of the plurality of division modes and improves the flexibility of block division, thereby improving the efficiency of the video coding.
In some embodiments, the division proportion of a division mode of the block may be determined based on the texture feature of the block.
According to the above embodiments in the present disclosure, the plurality of division modes include the step division mode, and the sub-blocks obtained based on the step division mode having irregular boundaries, which improves the flexibility of the block division and adapts to the image texture of the image frame better, thereby improving the efficiency of the video coding.
The acquisition module 910 may be configured to obtain a block to be predicted in an image frame. More descriptions regarding the obtaining of the block to be predicted may be found elsewhere in the present disclosure, for example, operation 210 in
The determination module 920 may be configured to determine a target division mode of the block based on a plurality of division modes of the block. More descriptions regarding the determining of the target division mode of the block may be found elsewhere in the present disclosure, for example, operation 220 in
The division module 930 may be configured to divide the block into a plurality of sub-blocks based on the target division mode. More descriptions regarding the division of the block may be found elsewhere in the present disclosure, for example, operation 230 in
The encoding module 940 may be configured to encode the block based on an index of the target division mode. More descriptions regarding the encoding of the block may be found elsewhere in the present disclosure, for example, operation 240 in
The modules in the video processing system 900 may be connected to or communicate with each other via a wired connection or a wireless connection. The wired connection may include a metal cable, an optical cable, a hybrid cable, or the like, or any combination thereof. The wireless connection may include a Local Area Network (LAN), a Wide Area Network (WAN), a Bluetooth, a ZigBee, a Near Field Communication (NFC), or the like, or any combination thereof. In some embodiments, two or more of the modules may be combined as a single module, and any one of the modules may be divided into two or more units.
As shown in
In some embodiments, the processing device 1010 may include a central processing unit (CPU). In some embodiments, the processing device 1010 may include an integrated circuit chip configured to process signals. In some embodiments, the processing device 1010 may include a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), other programmable logic device, a discrete gate, a transistor logic device, a discrete hardware component, or the like, or any combination thereof. The general-purpose processor may include a microprocessor. In some embodiments, the processing device 1010 may include any conventional processor.
In some embodiments, the video processing device 1000 may include a storage 1020. The storage 1020 may be configured to store instructions and/or data required for operations of the processing device 1010. In some embodiments, the storage 1020 may include a medium that may store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disk, or the like, or any combination thereof. In some embodiments, the storage 1020 may include terminal devices such as a computer, a server, a mobile phone, a tablet, or the like, or any combination thereof.
Having thus described the basic concepts, it may be rather apparent to those skilled in the art after reading this detailed disclosure that the foregoing detailed disclosure is intended to be presented by way of example only and is not limiting. Various alterations, improvements, and modifications may occur and are intended to those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested by this disclosure, and are within the spirit and scope of the exemplary embodiments of this disclosure.
Moreover, certain terminology has been used to describe embodiments of the present disclosure. For example, the terms “one embodiment,” “an embodiment,” and/or “some embodiments” mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment” or “one embodiment” or “an alternative embodiment” in various portions of this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined as suitable in one or more embodiments of the present disclosure.
Further, it will be appreciated by one skilled in the art, aspects of the present disclosure may be illustrated and described herein in any of a number of patentable classes or context including any new and useful process, machine, manufacture, or collocation of matter, or any new and useful improvement thereof. Accordingly, aspects of the present disclosure may be implemented entirely hardware, entirely software (including firmware, resident software, micro-code, etc.) or combining software and hardware implementation that may all generally be referred to herein as a “unit,” “module,” or “system.” Furthermore, aspects of the present disclosure may take the form of a computer program product embodied in one or more computer readable media having computer-readable program code embodied thereon.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including electromagnetic, optical, or the like, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that may communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable signal medium may be transmitted using any appropriate medium, including wireless, wireline, optical fiber cable, RF, or the like, or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present disclosure may be written in a combination of one or more programming languages, including an object oriented programming language such as Java, Scala, Smalltalk, Eiffel, JADE, Emerald, C++, C #, VB. NET, Python or the like, conventional procedural programming languages, such as the “C” programming language, Visual Basic, Fortran 2003, Perl, COBOL 2002, PHP, ABAP, dynamic programming languages such as Python, Ruby, and Groovy, or other programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider) or in a cloud computing environment or offered as a service such as a Software as a Service (SaaS).
Furthermore, the recited order of processing elements or sequences, or the use of numbers, letters, or other designations thereof, are not intended to limit the claimed processes and methods to any order except as may be specified in the claims. Although the above disclosure discusses through various examples what is currently considered to be a variety of useful embodiments of the disclosure, it is to be understood that such detail is solely for that purpose, and that the appended claims are not limited to the disclosed embodiments, but, on the contrary, are intended to cover modifications and equivalent arrangements that are within the spirit and scope of the disclosed embodiments. For example, although the implementation of various components described above may be embodied in a hardware device, it may also be implemented as a software only solution, e.g., an installation on an existing server or mobile device.
Similarly, it should be appreciated that in the foregoing description of embodiments of the present disclosure, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the various embodiments. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed subject matter requires more features than are expressly recited in each claim. Rather, claimed subject matter may lie in less than all features of a single foregoing disclosed embodiment.
Number | Date | Country | Kind |
---|---|---|---|
202110706737.5 | Jun 2021 | CN | national |
This application is a Continuation of International Application No. PCT/CN2022/081024 filed on Mar. 15, 2022, which claims priority to Chinese Patent Application No. 202110706737.5, filed on Jun. 24, 2021, the contents of each of which are incorporated herein by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
20190387226 | Lee | Dec 2019 | A1 |
20200137424 | Zhao | Apr 2020 | A1 |
20210368172 | Lim et al. | Nov 2021 | A1 |
20220360777 | Choi | Nov 2022 | A1 |
20220417511 | Li | Dec 2022 | A1 |
Number | Date | Country |
---|---|---|
110913232 | Mar 2020 | CN |
111327894 | Aug 2020 | CN |
111770340 | Oct 2020 | CN |
111988612 | Nov 2020 | CN |
3637782 | Apr 2020 | EP |
2017123980 | Jul 2017 | WO |
WO-2021032171 | Feb 2021 | WO |
2022267569 | Dec 2022 | WO |
Entry |
---|
First Office Action in Chinese Application No. 202110706737.5 mailed on Mar. 2, 2022, 19 pages. |
International Search Report in PCT/CN2022/081024 mailed on Apr. 28, 2022. 5 pages. |
Written Opinion in PCT/CN2022/081024 mailed on Apr. 28, 2022, 5 pages. |
Telecommunication Standardization Sector of ITU, ITU-T H.265, 2015, 635 pages. |
F. Le Léannec et al., Asymmetric Coding Units in QTBT, JVET Meeting, 2016, 10 pages. |
Bordes P. et al., Description of SDR, HDR and 360° Video Coding Technology Proposal by Qualcomm and Technicolor—Medium Complexity Version, JVET Meeting, 2018, 57 pages. |
Vadim Seregine et al., Exploration Experiment on Enhanced Compression Beyond VVC Capability (EE2) ,JVET Meeting, 2021, 7 pages. |
The Extended European Search Report in European Application No. 22827074.0 mailed on Aug. 2, 2023, 11 pages. |
Number | Date | Country | |
---|---|---|---|
20230209052 A1 | Jun 2023 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2022/081024 | Mar 2022 | WO |
Child | 18170518 | US |