Image encoder, image decoder, image encoding method, and image decoding method

Abstract

The present invention provides a technique capable performing encoding with a high image quality and a low bit rate. An image encoder according to the present inventions includes: an image separation unit for separating a skeleton image and a texture image from an inputted image; a skeleton image encoding unit for encoding the skeleton image separated; a texture image encoding unit for encoding the texture image separated; a parameter adjustment unit for adjusting a parameter used in encoding processing of the skeleton image and the texture image; a parameter encoding unit for encoding the parameter; and a code multiplexing unit for multiplexing the skeleton image, the texture image, and the parameter which have been encoded.

Description

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an image encoder according to a present embodiment.

FIG. 2 is a detailed block diagram of the image encoder according to the present embodiment.

FIG. 3 is a detailed block diagram of the image encoder according to the present embodiment.

FIG. 4 is a block diagram of the image encoder according to the present embodiment.

FIG. 5 is a detailed block diagram of the image encoder according to the present embodiment.

FIG. 6 is a detailed block diagram of the image encoder according to the present embodiment.

FIG. 7 is a block diagram of another image encoder according to the present embodiment.

FIG. 8 is a block diagram of another image encoder according to the present embodiment.

FIG. 9 is a diagram showing the concept of encoding processing according to the present embodiment.

FIG. 10 is a flowchart of the image encoding method according to the present embodiment.

FIG. 11 is a flowchart of the image encoding method according to the present embodiment.

FIG. 12 shows an image quality evaluation result when H.264/AVC is used for encoding both of the skeleton image and the texture image.

Claims

1. An image encoder comprising: an image separation unit for separating an inputted image into a first image containing a first edge and a second image containing a frequency component lower than the first image and containing a second edge component larger than the first edge component and a flat portion;a first image encoding unit for encoding the skeleton image separated;a second image encoding unit for encoding the texture image separated;a parameter encoding unit for encoding a parameter used for encoding of the skeleton image and the texture image; anda code multiplexing unit for multiplexing the encoded first and second image and the encoded parameter.

2. An image encoder comprising: an image separation unit for separating an inputted image into a skeleton image and a texture image;a first image encoding unit for encoding the separated skeleton image;a second encoding unit for encoding the separated texture image;a parameter adjustment unit for adjusting an encoding parameter used for encoding of the skeleton image and the texture image;a parameter encoding unit for encoding the parameter; anda code multiplexing unit for multiplexing the encoded skeleton image, the texture image, and the parameter.

3. The image encoder as claimed in claim 2, wherein the parameter adjustment unit adjusts an encoding parameter in the first image encoding unit and the second encoding unit by using information obtained from the code multiplexing unit.

4. The image encoder as claimed in claim 1, further comprising: an original image memory for storing the inputted image;a skeleton image memory for storing the skeleton image separated by the image separation unit; anda texture image memory for storing the texture image separated by the image separation unit.

5. The image encoder as claimed in claim 1, wherein the image separation unit separates the texture image from the inputted image by using a total variation filter.

6. The image encoder as claimed in claim 1, wherein the second image encoding unit has a region division/texture extraction unit for dividing an inputted image into a plurality of regions and extracting a texture, a texture analysis unit for analyzing the extracted texture, and a texture encoding unit for encoding the analyzed texture and a parameter.

7. The image encoder as claimed in claim 1, wherein the first image encoding unit has a resolution conversion unit for converting a resolution of the inputted skeleton image and an image encoding unit for encoding the skeleton image which has been subjected to the resolution conversion.

8. The image encoder as claimed in claim 1, wherein the image separation unit divides the input image into blocks and separates each of the blocks into a skeleton image and a texture image, and the first and the second image encoding unit respectively perform encoding in the block unit.

9. The image encoder as claimed in claim 8, further comprising: a skeleton image decoding unit for decoding the skeleton image which has been encoded by the first image encoding unit;a skeleton reference image memory for holding the decoded skeleton image as a reference image for the skeleton image;a texture image decoding unit for decoding the texture image which has been encoded by the second image encoding unit;a texture reference image memory for holding the decoded texture image as a reference image for the texture image; anda prediction and motion search unit for performing motion compensation in the block unit and creating a motion-predicted image by using the reference image held for the skeleton image and the reference image held for the texture image;wherein the first and the second image encoding unit respectively perform encoding in the block unit by using the predicted image created by the prediction and motion search unit.

10. An image encoder comprising: a code separation nit for separating a skeleton image stream and a texture image stream from a stream inputted;a skeleton image decoding unit for decoding the skeleton image separated;a texture image decoding unit for decoding the texture image separated; andan image synthesis unit for synthesizing the skeleton image and the texture image which have been decoded;wherein the skeleton image and the texture image which have been separately decoded are synthesized to obtain a finally decoded image.

11. The image encoder as claimed in claim 10, wherein the code separation unit divides the inputted image into blocks and separate a skeleton image and a texture image in the block unit, and the skeleton image decoding unit and the texture image decoding unit respectively perform decoding in the block unit.

12. The image encoder as claimed in claim 11, further comprising: a skeleton reference image memory for holding the skeleton image decoded by the skeleton image decoding unit as a reference image for the skeleton image;a texture reference image memory for holding the texture image decoded by the texture image decoding unit as a reference image for the texture image;a prediction and motion search unit for performing motion compensation in the block unit and creating a motion-predicted image by using the reference image held for the skeleton image and the reference image held for the texture image;wherein the skeleton image decoding unit and the texture image decoding unit respectively perform decoding in the block unit by using the predicted image created by the prediction and motion search unit.

13. An image encoding method comprising steps of: separating an inputted image into a skeleton image and a texture image;encoding the separated skeleton image;encoding the separated texture image;adjusting an encoding parameter used in encoding of the skeleton image and the texture image;encoding the parameter; andmultiplexing the encoded skeleton image, the texture image, and the parameter.

14. An image decoding method comprising steps of: separating a skeleton image stream and a texture image stream from an inputted stream;decoding the separated skeleton image;decoding the separated texture image; andsynthesizing the skeleton image and the texture image which have been separately encoded, so as to obtain a finally decoded image.

15. An image encoding stream obtained by encoding an image, comprising: first encoded data obtained by encoding a skeleton image separated from an original image; andsecond encoded data obtained by encoding a texture image separated from the original image;wherein the first encoded data is multiplexed with the second encoded data.

16. The encoding stream as claimed in claim 15, wherein each of the first encoded data and the second encoded data has a flag to distinguish encoded data on the skeleton image from the encoded data on the texture image.