This application pertains to the field of point cloud processing technologies, and specifically to an attribute quantization and dequantization method and apparatus, and a device.
In an attribute encoding process of point cloud compression (PCC) in the Audio Video coding Standard (AVS), attribute information is quantized by using default configurations at different bit rate points. However, in a case of a geometric loss, attribute interpolation needs to be performed on a reconstructed point cloud, namely, re-coloring. A new attribute value is calculated for each point in the reconstructed point cloud, so that an attribute error between the reconstructed point cloud and an original point cloud is minimized. This process causes a mismatch of attribute information between the reconstructed point cloud and the original point cloud, resulting in low encoding efficiency.
Embodiments of this application provide an attribute quantization and dequantization method and apparatus, and a device.
According to a first aspect, an attribute quantization method is provided, including the following steps.
A first device determines a quantization correction factor based on target information, where the target information includes at least one of geometric information or attribute information of a target point cloud, and the quantization correction factor is used to perform correction on a target quantization step size.
The first device performs correction on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size.
The first device performs quantization processing on the target point cloud based on the corrected quantization step size.
According to a second aspect, an attribute dequantization method is provided, including the following steps.
A second device obtains a quantization correction factor, where the quantization correction factor is related to target information, the target information includes at least one of geometric information or attribute information of a target point cloud, and the quantization correction factor is used to perform correction on a target quantization step size.
The second device performs correction processing on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size.
The second device performs dequantization processing on the target point cloud based on the corrected quantization step size.
According to a third aspect, an attribute quantization apparatus is provided, including:
According to a fourth aspect, an attribute dequantization apparatus is provided, including:
According to a fifth aspect, a first device is provided, where the first device includes a processor and a memory, the memory stores a program or an instruction that can be run on the processor, and when the program or the instruction is executed by the processor, steps of the method according to the first aspect are implemented.
According to a sixth aspect, an attribute quantization apparatus is provided, including a processor and a communication interface. The processor is configured to determine a quantization correction factor based on target information. The target information includes at least one of geometric information or attribute information of a target point cloud. The quantization correction factor is used to perform correction on a target quantization step size. The processor performs correction on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size, and performs quantization processing on the target point cloud based on the corrected quantization step size.
According to a seventh aspect, a second device is provided, where the second device includes a processor and a memory, the memory stores a program or an instruction that can be run on the processor, and when the program or the instruction is executed by the processor, steps of the method according to the second aspect are implemented.
According to an eighth aspect, an attribute dequantization apparatus is provided, including a processor and a communication interface. The processor is configured to obtain a quantization correction factor. The quantization correction factor is related to target information. The target information includes at least one of geometric information or attribute information of a target point cloud. The quantization correction factor is used to perform correction on a target quantization step size. The attribute dequantization apparatus performs correction processing on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size, and performs dequantization processing on the target point cloud based on the corrected quantization step size.
According to a ninth aspect, an attribute quantization system is provided, including an attribute quantization apparatus and an attribute dequantization apparatus, where the attribute quantization apparatus may be configured to perform steps of the attribute quantization method according to the first aspect, and the attribute dequantization apparatus may be configured to perform steps of the attribute dequantization method according to the second aspect.
According to a tenth aspect, a readable storage medium is provided, where the readable storage medium stores a program or an instruction, and when the program or the instruction is executed by a processor, steps of the method according to the first aspect or steps of the method according to the second aspect are implemented.
According to an eleventh aspect, a chip is provided, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement the method according to the first aspect or implement the method according to the second aspect.
According to a twelfth aspect, a computer program/program product is provided, where the computer program/program product is stored in a storage medium, and the computer program/program product is executed by at least one processor to implement steps of the method according to the first aspect or steps of the method according to the second aspect.
The following clearly describes technical solutions in the embodiments of this application with reference to the accompanying drawings in the embodiments of this application. Apparently, the described embodiments are some but not all of the embodiments of this application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of this application shall fall within the protection scope of this application.
The terms “first”, “second”, and the like in the specification and claims of this application are used to distinguish between similar objects instead of describing a specific order or sequence. It should be understood that the terms used in this way are interchangeable in appropriate circumstances such that the embodiments of this application can be implemented in other orders than the order illustrated or described herein. In addition, objects distinguished by “first” and “second” are generally of a same type, and the number of objects is not limited, for example, there may be one or more first objects. In addition, in the specification and claims, “and/or” represents at least one of connected objects, and a character “/” generally represents an “or” relationship between associated objects.
Each of the attribute quantization apparatus corresponding to the attribute quantization method and the attribute dequantization apparatus corresponding to the attribute dequantization method in the embodiments of this application may be a terminal. The terminal may also be referred to as a terminal device or a user equipment (UE). The terminal may be a terminal side device such as a mobile phone, a tablet personal computer, a laptop computer or referred to as a notebook computer, a personal digital assistant (PDA), a palmtop computer, a netbook, an ultra-mobile personal computer (UMPC), a mobile Internet device (MID), an augmented reality (AR)/virtual reality (VR) device, a robot, a wearable device or vehicle user equipment (VUE), or pedestrian user equipment (PUE). The wearable device includes a smart watch, a wristband, a headset, and glasses. It should be noted that a specific type of the terminal is not limited in the embodiments of this application.
To enable a person skilled in the art to better understand the embodiments of this application, the following first describes a framework of an AVS encoder.
As shown in
After geometric encoding is completed, geometric information is reconstructed, and attribute information is encoded by using the reconstructed geometric information. Currently, attribute encoding is mainly performed on color information and reflectance information. First, it is determined whether color space conversion is performed. If color space conversion is performed, color information is converted from an RGB color space to a YUV color space. Then, in a case of geometric loss encoding, attribute interpolation needs to be performed on a reconstructed point cloud, namely, re-coloring. A new attribute value is calculated for each point in the reconstructed point cloud, so that an attribute error between the reconstructed point cloud and an original point cloud is minimized. There are three branches in attribute information encoding: attribute prediction, attribute prediction transformation and attribute transformation. An attribute prediction process is as follows. First, a point cloud is reordered, and then differential prediction is performed. In a current framework of AVS encoding, Hilbert codes are used to reorder a point cloud. Then, attribute prediction is performed on the ordered point cloud. If geometric information of a current to-be-encoded point is the same as that of a previous encoded point, that is, the current to-be-encoded point is a duplicate point, a reconstruction attribute value of the duplicate point is used as an attribute prediction value of the current to-be-encoded point. Otherwise, the first m points of a Hilbert sequence are selected as neighbor candidate points for the current to-be-encoded point, and then a Manhattan distance between each of the neighbor candidate points and the geometric information of the current to-be-encoded point is separately calculated, to determine n points that are closest to the current to-be-encoded point as neighbors of the current to-be-encoded point. With reciprocals of distances as weights, weighted averages of attributes of all the neighbors are calculated as the attribute prediction value of the current to-be-encoded point. A prediction residual is calculated by using the attribute prediction value and an attribute value of the current to-be-encoded point. Finally, quantization and entropy coding are performed on the prediction residual to generate a binary bitstream. An attribute prediction transformation process is as follows. Point cloud sequences are first grouped based on spatial sparsity of a point cloud, and then prediction is performed on attribute information of the point cloud. Transformation is performed on an obtained prediction residual to quantize an obtained transformation coefficient. Finally, entropy coding is performed on a quantized transformation coefficient and a quantized attribute residual to generate a binary bitstream. An attribute transformation process is as follows. First, wavelet transformation is performed on an attribute of a point cloud, and a transformation coefficient is quantized. Next, an attribute reconstruction value is obtained through inverse quantization and inverse wavelet transformation. Then, a difference between an original attribute and the attribute reconstruction value is calculated to obtain an attribute residual and quantize the attribute residual. Finally, entropy coding is performed on a quantized transformation coefficient and a quantized attribute residual to generate a binary bitstream. The embodiments of this application mainly focus on quantization and dequantization processes in the figures.
The following describes in detail the attribute quantization method provided in the embodiments of this application by using some embodiments and application scenarios thereof with reference to the accompanying drawings.
As shown in
Step 201: A first device determines a quantization correction factor based on target information, where the target information includes at least one of geometric information or attribute information of a target point cloud.
Optionally, the target point cloud is a point cloud slice in a point cloud sequence or a point cloud sequence. The target point cloud is a point cloud after preprocessing is performed on a to-be-encoded target point cloud, and the preprocessing includes at least one of the following: coordinate translation, quantization processing, and duplicate point removal.
The geometric information is obtained based on dimension information of a bounding box corresponding to the target point cloud. The attribute information includes a color, a reflectance, and the like.
The first device may be used in an encoding device.
Step 202: The first device performs correction on a target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size.
Herein, the target quantization step size may be an initial quantization step size, and the initial quantization step size may be understood as a default quantization step size in a configuration file.
Optionally, the corrected quantization step size satisfies the following formula:
where
AttrQuanStepfin represents a corrected attribute quantization step size, attrQuantStep represents the target quantization step size, and Correctfactor represents the quantization correction factor.
Step 203: The first device performs quantization processing on the target point cloud based on the corrected quantization step size.
Herein, the target quantization step size is corrected based on the quantization correction factor, and the quantization processing is performed on the target point cloud based on the corrected quantization step size. The quantization processing specifically means attribute quantization processing. A process of the attribute quantization processing is the same as that in a conventional technology. Details are not described herein again.
According to the method in this embodiment of this application, the quantization correction factor is determined based on the target information, where the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the quantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves matching between an attribute quantization process and a re-coloring process, thereby improving encoding efficiency.
Optionally, the geometric information includes geometric bit depth information of the target point cloud, and the geometric bit depth information indicates precision information needed by dimension information of a bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is determined based on a maximum side length of the bounding box corresponding to the target point cloud.
In this embodiment of this application, the geometric bit depth information may be obtained through calculation based on the dimension information of the bounding box corresponding to the target point cloud, or may be directly obtained, that is, obtained based on the point cloud sequence corresponding to the target point cloud.
Optionally, the geometric bit depth information satisfies the following formula:
where
bitdepth represents the geometric bit depth information, and maxSize is the maximum side length of the bounding box corresponding to the target point cloud.
In a specific embodiment of this application, the dimension information of the bounding box may be represented by maxSize. That is, maxSize=max(boundingboxx, boundingboxy, boundingboxz), where boundingboxx represents a side length corresponding to the bounding box in an x direction, boundingbox, represents a side length corresponding to the bounding box in a y direction, and boundingbox, represents a side length corresponding to the bounding box in a z direction. The maximum side length maxSize is selected from the side lengths of the bounding box in the three directions, and then the geometric bit depth information is obtained by using the foregoing formula.
Optionally, the attribute information of the target information further includes the target quantization step size.
Optionally, the quantization correction factor satisfies at least one of the following.
The quantization correction factor is proportional to the geometric bit depth information, that is, greater geometric bit depth information indicates a larger quantization correction factor.
The quantization correction factor is inversely proportional to the target quantization step size, that is, a larger target quantization step size indicates a smaller quantization correction factor.
The quantization correction factor is proportional to precision information of the attribute information, that is, greater precision information of the attribute information indicates a larger quantization correction factor.
Optionally, the quantization correction factor satifies the following formula:
where
Correctfactor represents the quantization correction factor, bitdepth represents the geometric bit depth information, attrQuantStep represents the precision information of the attribute information, and m, n, p, and q are respectively preset values. “>>” indicates a right shift operation. bitdepth>>m represents a right shift of bitdepth by m bits, and attrbitdepth>>q represents a right shift of attrbitdepth by q bits.
Certainly, the quantization correction factor may alternatively be obtained through calculation by using another formula based on the foregoing parameters.
Optionally, in this embodiment of this application, after the quantization correction factor is obtained, the quantization correction factor may be added to a target bitstream, so that a decoder side directly obtains the quantization correction factor from the target bitstream, and performs dequantization processing based on the quantization correction factor. The target bitstream is obtained by performing encoding processing on a node in the target point cloud.
According to the method in this embodiment of this application, the quantization correction factor is determined based on the target information, where the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the quantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves matching between an attribute quantization process and a re-coloring process, thereby improving encoding efficiency.
As shown in
Step 301: A second device obtains a quantization correction factor, where the quantization correction factor is related to target information, the target information includes at least one of geometric information or attribute information of a target point cloud, and the quantization correction factor is used to perform correction on a target quantization step size.
Optionally, the target point cloud is a point cloud slice in a point cloud sequence or a point cloud sequence. The target point cloud is a point cloud after preprocessing is performed on a to-be-encoded target point cloud, and the preprocessing includes at least one of the following: coordinate translation, quantization processing, and duplicate point removal.
The geometric information is obtained based on dimension information of a bounding box corresponding to the target point cloud.
The second device may be used in a decoding device.
Step 302: The second device performs correction processing on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size.
The target quantization step size is explained in the foregoing embodiment. Details are not described herein again.
Step 303: The second device performs dequantization processing on the target point cloud based on the corrected quantization step size.
Herein, the target quantization step size is corrected based on the quantization correction factor, and the dequantization processing is performed on the target point cloud based on the corrected quantization step size. The dequantization processing specifically means attribute dequantization processing. A process of the attribute dequantization processing is the same as that in a conventional technology. Details are not described herein again.
According to the attribute dequantization method in this embodiment of this application, the quantization correction factor is obtained, where the quantization correction factor is related to the target information, and the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the dequantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves a matching degree between attribute quantization and re-coloring, thereby improving decoding efficiency.
Optionally, that the quantization correction factor is obtained includes:
performing decoding processing on a target bitstream to obtain the quantization correction factor Correctfactor, and the target bitstream is obtained by performing encoding processing on a node in the target point cloud.
Herein, an attribute dequantization apparatus directly obtains the quantization correction factor from the target bitstream. Optionally, that the quantization correction factor is obtained includes:
determining the quantization correction factor based on the target information.
Herein, the attribute dequantization apparatus determines the quantization correction factor based on the target information.
Geometric bit depth information is obtained based on the target bitstream.
Optionally, the geometric information includes geometric bit depth information of the target point cloud, and the geometric bit depth information indicates precision information needed by dimension information of a bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information satisfies the following formula:
where
bitdepth represents the geometric bit depth information, and maxSize is a maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the target information further includes the target quantization step size. Optionally, the quantization correction factor satisfies at least one of the following.
The quantization correction factor is proportional to the geometric bit depth information, that is, greater geometric bit depth information indicates a larger quantization correction factor.
The quantization correction factor is inversely proportional to the target quantization step size, that is, a larger target quantization step size indicates a smaller quantization correction factor.
The quantization correction factor is proportional to precision information of the attribute information, that is, greater precision information of the attribute information indicates a larger quantization correction factor.
Optionally, the quantization correction factor satisfies the following formula:
where
Correctfactor represents the quantization correction factor, bitdepth represents the geometric bit depth information, attrQuantStep represents the precision information of the attribute information, and m, n, p, and q are respectively preset values. “>>” indicates a right shift operation. bitdepth>>m represents a right shift of bitdepth by m bits, and attrbitdepth>>q represents a right shift of attrbitdepth by q bits.
Optionally, the corrected quantization step size satisfies the following formula:
where
AttrQuanStepfin represents a corrected attribute quantization step size, attrQuantStep represents the target quantization step size, and Correctfactor represents the quantization correction factor.
According to the attribute dequantization method in this embodiment of this application, the quantization correction factor is obtained, where the quantization correction factor is related to the target information, and the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the dequantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves a matching degree between attribute quantization and re-coloring, thereby improving decoding efficiency.
The first device and the second device in the embodiments of this application may be a same device, or may be different devices. The first device and the second device may be specifically terminals.
According to the foregoing methods in the embodiments of this application, a more suitable quantization correction factor is selected for different types of attribute information by using the geometric information and the attribute information of the target point cloud, and the attribute quantization is performed based on the quantization correction factor, thereby further improving coding efficiency.
Experimental results show that encoding performance can be improved by using the solution in this application. As shown in Table 1, in various test conditions, compression efficiency of this application is higher than that of PCRMV5.0. (PSNR is an objective standard for image evaluation. A larger PSNR indicates better image quality.) End-to-End BD-AttrReate is a parameter used to measure encoding performance of attribute information. When BD-AttrReate is negative, it indicates that performance is improved. On this basis, a larger absolute value of BD-AttrReate indicates a larger performance gain. Limit-lossy means an encoding condition of a geometric loss or an attribute loss. Luma, Chroma Cb, and Chroma Cr represent three components of a color channel, and reflectance represents reflectance information. They are all attribute information of a point cloud. For a currently tested point cloud sequence, at least one piece of the foregoing attribute information is included.
The attribute quantization method provided in this embodiment of this application may be executed by an attribute quantization apparatus. The attribute quantization apparatus provided in this embodiment of this application is described by using an example in which the attribute quantization apparatus performs the attribute quantization method.
As shown in
a first determining module 401, configured to determine a quantization correction factor based on target information, where the target information includes at least one of geometric information or attribute information of a target point cloud, and the quantization correction factor is used to perform correction on a target quantization step size;
a first correction module 402, configured to perform correction on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size; and
a first processing module 403, configured to perform quantization processing on the target point cloud based on the corrected quantization step size.
According to the apparatus in this embodiment of this application, the quantization correction factor is determined based on the target information, where the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the quantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves matching between an attribute quantization process and a re-coloring process, thereby improving encoding efficiency.
Optionally, the geometric information includes geometric bit depth information of the target point cloud, and the geometric bit depth information indicates precision information of dimension information of a bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is determined based on a maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information satisfies the following formula:
where
bitdepth represents the geometric bit depth information, and maxSize is the maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is obtained based on a point cloud sequence corresponding to the target point cloud.
Optionally, the attribute information of the target information further includes the target quantization step size.
Optionally, the quantization correction factor satisfies at least one of the following.
The quantization correction factor is proportional to the geometric bit depth information.
The quantization correction factor is inversely proportional to the target quantization step size.
The quantization correction factor is proportional to precision information of the attribute information.
Optionally, the quantization correction factor satisfies the following formula:
where
Correctfactor represents the quantization correction factor, bitdepth represents the geometric bit depth information, attrQuantStep represents the precision information of the attribute information, m, n, p, and q are respectively preset values, bitdepth>>m represents a right shift of bitdepth by m bits, and attrbitdepth>>q represents a right shift of attrbitdepth by q bits.
Optionally, the corrected quantization step size satisfies the following formula:
where
AttrQuanStepfin represents a corrected attribute quantization step size, attrQuantStep represents the target quantization step size, and Correctfactor represents the quantization correction factor.
According to the apparatus in this embodiment of this application, the quantization correction factor is determined based on the target information, where the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the quantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves matching between an attribute quantization process and a re-coloring process, thereby improving encoding efficiency.
The attribute quantization apparatus in this embodiment of this application may be an electronic device, for example, an electronic device having an operating system, or may be a component in an electronic device, for example, an integrated circuit or a chip. The electronic device may be a terminal, or another device other than the terminal. For example, the another device may be a server, a network attached storage (NAS), or the like. This is not specifically limited in this embodiment of this application.
According to the attribute quantization apparatus provided in this embodiment of this application, processes implemented in the method embodiment of
Optionally, as shown in
An embodiment of this application further provides an attribute quantization apparatus, including a processor and a communication interface. The processor is configured to determine a quantization correction factor based on target information. The target information includes at least one of geometric information or attribute information of a target point cloud. The quantization correction factor is used to perform correction on a target quantization step size. The processor performs correction on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size, and performs quantization processing on the target point cloud based on the corrected quantization step size. This apparatus embodiment corresponds to the foregoing attribute quantization method embodiment. Implementation processes and implementations of the foregoing method embodiment are all applicable to this apparatus embodiment, and a same technical effect can be achieved. Specifically,
The attribute quantization apparatus includes but is not limited to at least a part of components such as a radio frequency unit 601, a network module 602, an audio output unit 603, an input unit 604, a sensor 605, a display unit 606, a user input unit 607, an interface unit 608, a memory 609, and a processor 610.
A person skilled in the art may understand that the attribute quantization apparatus may further include a power supply (such as a battery) that supplies power to each component. The power supply may be logically connected to the processor 610 by using a power supply management system, to implement functions such as charging and discharging management, and power consumption management by using the power supply management system. The structure of the apparatus shown in
It should be understood that in this embodiment of this application, the input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042. The graphics processing unit 6041 processes image data of a static picture or a video obtained by an image capture apparatus (for example, a camera) in a video capture mode or an image capture mode. The display unit 606 may include a display panel 6061. The display panel 6061 may be configured in a form of liquid crystal display or organic light-emitting diode. The user input unit 607 includes at least one of a touch panel 6071 and another input device 6072. The touch panel 6071 is also referred to as a touchscreen. The touch panel 6071 may include a touch detection apparatus and a touch controller. The another input device 6072 may include but is not limited to a physical keyboard, a functional button (such as a volume control button or a power on/off button), a trackball, a mouse, and a joystick. Details are not described herein.
In this embodiment of this application, after receiving downlink data from a network side device, the radio frequency unit 601 may transmit the downlink data to the processor 610 for processing. In addition, the radio frequency unit 601 may send uplink data to the network side device. Generally, the radio frequency unit 601 includes but is not limited to an antenna, an amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
The memory 609 may be configured to store a software program or an instruction and various data. The memory 609 may mainly include a first storage area for storing a program or an instruction and a second storage area for storing data. The first storage area may store an operating system, and an application or an instruction needed by at least one function (for example, a sound playing function or an image playing function). In addition, the memory 609 may be a volatile memory or a non-volatile memory, or the memory 609 may include both a volatile memory and a non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchlink dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 609 in this embodiment of this application includes but is not limited to these memories and any memory of another proper type.
The processor 610 may include one or more processing units. Optionally, an application processor and a modem processor are integrated into the processor 610. The application processor mainly processes an operating system, a user interface, an application, or the like. The modem processor mainly processes a wireless communication signal, for example, a baseband processor. It may be understood that the modem processor may alternatively not be integrated into the processor 610.
The processor 610 is configured to determine a quantization correction factor based on target information. The target information includes at least one of geometric information or attribute information of a target point cloud. The quantization correction factor is used to perform correction on a target quantization step size. The processor 610 performs correction on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size, and performs quantization processing on the target point cloud based on the corrected quantization step size.
According to the apparatus in this embodiment of this application, the quantization correction factor is determined based on the target information, where the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the quantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves matching between an attribute quantization process and a re-coloring process, thereby improving encoding efficiency.
Optionally, the geometric information includes geometric bit depth information of the target point cloud, and the geometric bit depth information indicates precision information of dimension information of a bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is determined based on a maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information satisfies the following formula:
where
bitdepth represents the geometric bit depth information, and maxSize is the maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is obtained based on a point cloud sequence corresponding to the target point cloud.
Optionally, the attribute information of the target information further includes the target quantization step size.
Optionally, the quantization correction factor satisfies at least one of the following.
The quantization correction factor is proportional to the geometric bit depth information.
The quantization correction factor is inversely proportional to the target quantization step size.
The quantization correction factor is proportional to precision information of the attribute information.
Optionally, the quantization correction factor satisfies the following formula:
where
Correctfactor represents the quantization correction factor, bitdepth represents the geometric bit depth information, attrQuantStep represents the precision information of the attribute information, m, n, p, and q are respectively preset values, bitdepth>>m represents a right shift of bitdepth by m bits, and attrbitdepth>>q represents a right shift of attrbitdepth by q bits.
Optionally, the corrected quantization step size satisfies the following formula:
where
AttrQuanStepfin represents a corrected attribute quantization step size, attrQuantStep represents the target quantization step size, and Correctfactor represents the quantization correction factor.
According to the apparatus in this embodiment of this application, the quantization correction factor is determined based on the target information, where the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the quantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves matching between an attribute quantization process and a re-coloring process, thereby improving encoding efficiency.
The attribute dequantization method provided in this embodiment of this application may be executed by an attribute dequantization apparatus. The attribute dequantization apparatus provided in this embodiment of this application is described by using an example in which the attribute dequantization apparatus performs the attribute dequantization method.
As shown in
According to the apparatus in this embodiment of this application, the quantization correction factor is obtained, where the quantization correction factor is related to the target information, and the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the dequantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves a matching degree between attribute quantization and re-coloring, thereby improving decoding efficiency.
Optionally, the first obtaining module is configured to perform decoding processing on a target bitstream to obtain the quantization correction factor Correctfactor, and the target bitstream is obtained by performing encoding processing on a node in the target point cloud.
Optionally, the first obtaining module is configured to determine the quantization correction factor based on the target information.
Optionally, the geometric information includes geometric bit depth information of the target point cloud, and the geometric bit depth information indicates precision information of dimension information of a bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is determined based on a maximum side length of the bounding box corresponding to the target point cloud. Optionally, the geometric bit depth information satisfies the following formula:
where
bitdepth represents the geometric bit depth information, and maxSize is the maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is obtained based on the target bitstream.
Optionally, the target information further includes the target quantization step size.
Optionally, the quantization correction factor satisfies at least one of the following.
The quantization correction factor is proportional to the geometric bit depth information.
The quantization correction factor is inversely proportional to the target quantization step size.
The quantization correction factor is proportional to precision information of the attribute information.
Optionally, the quantization correction factor satisfies the following formula:
where
Correctfactor represents the quantization correction factor, bitdepth represents the geometric bit depth information, attrQuantStep represents the precision information of the attribute information, m, n, p, and q are respectively preset values, bitdepth>>m represents a right shift of bitdepth by m bits, and attrbitdepth>>q represents a right shift of attrbitdepth by q bits.
Optionally, the corrected quantization step size satisfies the following formula:
where
AttrQuanStepfin represents a corrected attribute quantization step size, attrQuantStep represents the target quantization step size, and Correctfactor represents the quantization correction factor.
According to the apparatus in this embodiment of this application, the quantization correction factor is obtained, where the quantization correction factor is related to the target information, and the target information includes the geometric information or the attribute information of the target point cloud. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the dequantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves a matching degree between attribute quantization and re-coloring, thereby improving decoding efficiency.
The attribute dequantization apparatus in this embodiment of this application may be an electronic device, for example, an electronic device having an operating system, or may be a component in an electronic device, for example, an integrated circuit or a chip. The electronic device may be a terminal, or another device other than the terminal. For example, the another device may be a server, a network attached storage (NAS), or the like. This is not specifically limited in this embodiment of this application.
According to the attribute dequantization apparatus provided in this embodiment of this application, processes implemented in the method embodiment of
Optionally, an embodiment of this application further provides a second device (for a schematic diagram of a structure of the second device, refer to
An embodiment of this application further provides an attribute dequantization apparatus, including a processor and a communication interface. The processor is configured to obtain a quantization correction factor. The quantization correction factor is related to target information, and the target information includes geometric information and attribute information of a target point cloud. The attribute dequantization apparatus performs dequantization processing on the target point cloud based on the quantization correction factor and the target quantization step size. This apparatus embodiment corresponds to the foregoing attribute dequantization method embodiment. Implementation processes and implementations of the foregoing method embodiment are all applicable to this apparatus embodiment, and a same technical effect can be achieved.
An embodiment of this application further provides an attribute dequantization apparatus. For a schematic diagram of a hardware structure of the attribute quantization apparatus, refer to
A person skilled in the art may understand that the attribute dequantization apparatus may further include a power supply (such as a battery) that supplies power to each component. The power supply may be logically connected to the processor 610 by using a power supply management system, to implement functions such as charging and discharging management, and power consumption management by using the power supply management system. The structure of the apparatus shown in
It should be understood that in this embodiment of this application, the input unit 604 may include a graphics processing unit (GPU) 6041 and a microphone 6042. The graphics processing unit 6041 processes image data of a static picture or a video obtained by an image capture apparatus (for example, a camera) in a video capture mode or an image capture mode. The display unit 606 may include a display panel 6061. The display panel 6061 may be configured in a form of liquid crystal display or organic light-emitting diode. The user input unit 607 includes at least one of a touch panel 6071 and another input device 6072. The touch panel 6071 is also referred to as a touchscreen. The touch panel 6071 may include a touch detection apparatus and a touch controller. The another input device 6072 may include but is not limited to a physical keyboard, a functional button (such as a volume control button or a power on/off button), a trackball, a mouse, and a joystick. Details are not described herein.
In this embodiment of this application, after receiving downlink data from a network side device, the radio frequency unit 601 may transmit the downlink data to the processor 610 for processing. In addition, the radio frequency unit 601 may send uplink data to the network side device. Generally, the radio frequency unit 601 includes but is not limited to an antenna, an amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
The memory 609 may be configured to store a software program or an instruction and various data. The memory 609 may mainly include a first storage area for storing a program or an instruction and a second storage area for storing data. The first storage area may store an operating system, and an application or an instruction needed by at least one function (for example, a sound playing function or an image playing function). In addition, the memory 609 may be a volatile memory or a non-volatile memory, or the memory 609 may include both a volatile memory and a non-volatile memory. The non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchlink dynamic random access memory (SLDRAM), and a direct rambus random access memory (DRRAM). The memory 609 in this embodiment of this application includes but is not limited to these memories and any memory of another proper type.
The processor 610 may include one or more processing units. Optionally, an application processor and a modem processor are integrated into the processor 610. The application processor mainly processes an operating system, a user interface, an application, or the like. The modem processor mainly processes a wireless communication signal, for example, a baseband processor. It may be understood that the modem processor may alternatively not be integrated into the processor 610.
The processor 610 is configured to obtain a quantization correction factor. The quantization correction factor is related to target information. The target information includes at least one of geometric information or attribute information of a target point cloud. The quantization correction factor is used to perform correction on a target quantization step size. The processor 610 performs correction processing on the target quantization step size based on the quantization correction factor, to obtain a corrected quantization step size, and performs quantization processing on the target point cloud based on the corrected quantization step size.
According to the apparatus in this embodiment of this application, the quantization correction factor is obtained, where the quantization correction factor is related to the target information, and the target information includes the geometric information or the attribute information of the target point cloud. The dequantization processing is performed on the target point cloud based on the quantization correction factor and the target quantization step size. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the dequantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves a matching degree between an attribute quantization process and a re-coloring process, thereby improving decoding efficiency.
Optionally, the processor 610 is further configured to:
perform decoding processing on a target bitstream to obtain the quantization correction factor Correctfactor, and the target bitstream is obtained by performing encoding processing on a node in the target point cloud.
Optionally, the processor 610 is further configured to:
determine the quantization correction factor based on the target information.
Optionally, the geometric information includes geometric bit depth information of the target point cloud, and the geometric bit depth information indicates precision information of dimension information of a bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is determined based on a maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information satisfies the following formula:
where
bitdepth represents the geometric bit depth information, and maxSize is the maximum side length of the bounding box corresponding to the target point cloud.
Optionally, the geometric bit depth information is obtained based on the target bitstream.
Optionally, the target information further includes the target quantization step size.
Optionally, the quantization correction factor satisfies at least one of the following.
The quantization correction factor is proportional to the geometric bit depth information.
The quantization correction factor is inversely proportional to the target quantization step size.
The quantization correction factor is proportional to precision information of the attribute information.
Optionally, the corrected quantization step size satisfies the following formula:
where
Correctfactor represents the quantization correction factor, bitdepth represents the geometric bit depth information, attrQuantStep represents the precision information of the attribute information, m, n, p, and q are respectively preset values, bitdepth>>m represents a right shift of bitdepth by m bits, and attrbitdepth>>q represents a right shift of attrbitdepth by q bits.
Optionally, the corrected quantization step size satisfies the following formula:
where
AttrQuanStepfin represents a corrected attribute quantization step size, attrQuantStep represents the target quantization step size, and Correctfactor represents the quantization correction factor.
According to the apparatus in this embodiment of this application, the quantization correction factor is obtained, where the quantization correction factor is related to the target information, and the target information includes the geometric information or the attribute information of the target point cloud. The dequantization processing is performed on the target point cloud based on the quantization correction factor and the target quantization step size. In this way, the target quantization step size can be corrected by using the quantization correction factor, and the dequantization processing can be performed on the target point cloud by using the corrected quantization step size. This improves a matching degree between an attribute quantization process and a re-coloring process, thereby improving decoding efficiency.
An embodiment of this application further provides a readable storage medium, where the readable storage medium stores a program or an instruction, and when the program or the instruction is executed by a processor, processes of the foregoing attribute quantization method embodiment or attribute dequantization method embodiment are implemented, and a same technical effect can be achieved. To avoid repetition, details are not described herein again.
The processor is a processor in the apparatus in the foregoing embodiments. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk, or an optical disc.
An embodiment of this application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run a program or an instruction to implement processes of the foregoing attribute quantization method embodiment or attribute dequantization method embodiment, and achieve a same technical effect. To avoid repetition, details are not described herein again.
It should be understood that the chip mentioned in this embodiment of this application may also be referred to as a system-level chip, a system chip, a chip system, or a system on chip.
An embodiment of this application further provides a computer program/program product, where the computer program/program product is stored in a storage medium, and the computer program/program product is executed by at least one processor to implement processes of the foregoing attribute quantization method embodiment or attribute dequantization method embodiment, and achieve a same technical effect. To avoid repetition, details are not described herein again.
An embodiment of this application further provides an attribute quantization system, including an attribute quantization apparatus and an attribute dequantization apparatus, where the attribute quantization apparatus may be configured to perform steps of the attribute quantization method, and the attribute dequantization apparatus may be configured to perform steps of the attribute dequantization method.
It should be noted that, in this specification, the term “include”, “comprise”, or any other variant thereof is intended to cover a non-exclusive inclusion, so that a process, a method, an article, or an apparatus that includes a list of elements not only includes those elements but also includes other elements which are not expressly listed, or further includes elements inherent to this process, method, article, or apparatus. In absence of more constraints, an element preceded by a statement “includes a . . . ” does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element. In addition, it should be noted that the scope of the method and apparatus in the implementations of this application is not limited to performing functions in an illustrated or discussed sequence, and may further include performing the functions in a basically simultaneous manner or in a reverse sequence based on the functions concerned. For example, the described method may be performed in an order different from the described order, and steps may be added, omitted, or combined. In addition, features described with reference to some examples may be combined in other examples.
Based on the descriptions of the foregoing implementations, a person skilled in the art may clearly understand that the method in the foregoing embodiment may be implemented by software in addition to a necessary universal hardware platform or by hardware only. In most circumstances, the former is a preferred implementation. Based on such an understanding, the technical solutions of this application essentially or the part contributing to the prior art may be implemented in a form of a computer software product. The computer software product is stored in a storage medium (for example, a ROM/RAM, a floppy disk, or an optical disc), and includes several instructions for instructing a terminal (which may be a mobile phone, a computer, a server, an air conditioner, a network device, or the like) to perform the methods described in the embodiments of this application.
The embodiments of this application are described above with reference to the accompanying drawings. However, this application is not limited to the foregoing specific implementations. The foregoing specific implementations are only illustrative and not restrictive. Under the enlightenment of this application, a person of ordinary skill in the art can make many forms without departing from the purpose of this application and the protection scope of the claims, all of which fall within the protection of this application.
Number | Date | Country | Kind |
---|---|---|---|
202111465429.4 | Dec 2021 | CN | national |
This application is a Bypass continuation application of PCT International Application No. PCT/CN2022/135908 filed on Dec. 1, 2022, which claims priority to Chinese Patent Application No. 202111465429.4 filed in China on Dec. 3, 2021, which are incorporated herein by reference in their entireties.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2022/135908 | Dec 2022 | WO |
Child | 18678522 | US |