The present invention contains subject matter related to Japanese Patent Applications JP 2006-327159 filed in the Japanese Patent Office on Dec. 4, 2006, the entire contents of which being incorporated herein by reference.
1. Field of the Invention
The present invention relates to an amount-of-data control method for controlling the compression rate such that the amount of compressed data can be equal to a target amount of data in a case where still image data is to be compressed and transmitted or recorded and to an image data compressing apparatus applying the amount-of-data control.
2. Description of the Related Art
Various standardization methods such as JPEG have been proposed for standardization of still image encoding.
A difference is obtained between the direct current (DC) component of the quantized DCT coefficient and the DC component quantized in the previous block, and Huffman encoding is performed on the number of bits of the difference. Zigzag scan is performed on the alternate current (AC) component within each of the blocks to convert to a one-dimensional progression, and two-dimensional Huffman encoding is performed thereon with the number of bits of the valid coefficient and the number of serial zeros (invalid coefficient) (steps P3 and P4).
Notably, in the quantization in step P2, each threshold value of the quantization matrix is multiplexed by a certain coefficient (scale factor) and is then divided by a DCT coefficient. The scale factor is a value expressed by “2^S” (where S=0, ±1, ±2 . . . , and ^ is a power). The multiplication of each threshold value of the quantization matrix by 2^S is equivalent to the bit shift of the data of each threshold value. The image quality and compression rate of a compressed image may be adjusted by the scale factor.
The thus compressed data is expanded by the reverse steps of steps P1 to P4. In other words, Huffman decoding in step P5, the decoding of the DC component and AC component in step P6, the inverse quantization in step P7 and the inverse DCT (IDCT) in step P8 are performed.
By the way, since this system uses Huffman codes, which are variable length codes, for data compression, it is difficult to know the entire amount of compressed data until the end of the compression process (steps P1 to P4). Therefore, some control over the amount of data is desirable for encoding within a predetermined range of amounts of data. In the past, multiple kinds of scale factor are used for compression, and the amount of compressed data is measured for each case, and the relationships between the scale factors and the amounts of compressed data are obtained. Then, the scale factor corresponding to a given amount of compressed data is inferred from analogy, and data compression is performed with the scale factor by analogy.
Based on measurement results on many images, the relationship between an amount of compressed data and a scale factor is verified as:
[Amount of Data]=A·log [Scale Factor]+B
(where A and B: constants determined by a measurement point)
Therefore, A and B are obtained from a measurement result, and the scale factor to the target amount of compressed data can be estimated therefrom (refer to JP-A-3-224362 (Patent Document 1)).
By the way, the amount-of-data control method has a problem in recording compressed data to a recording medium or transmitting compressed data through a communication path that the compressed data to be recorded does not fit into a predetermined storage area or may not be transmitted in a predetermined transmission band if the amount of data based on the estimated scale factor has a plus error in a case where the amount of data is larger or smaller than planned. Conversely, it is difficult to estimate the recording time and/or transmission time if the error is minus and large though no problems may occur regarding the recording area and/or transmission band.
Further increases of the error in amount of data may occur since it is difficult for a compressor having a characteristic not expressible by a single relational expression to estimate an optimum scale factor though the processing above uses a single relational expression to estimate a scale factor.
The scale factor varies since the amount of data with an estimated scale factor may increase or decrease every time the data is compressed even in a case where one same image is continuously compressed as in a still-image serial recording device or a still image serial transmitter, which is used in the processing above, where images are serially compressed. As a result, the amount of data varies, which prevents stable image quality.
Accordingly, it is desirable to provide control over an amount of compressed data such that the amount of compressed data can be securely within a predetermined range of a target amount of data.
The invention is applicable to image data compression processing performing quantization by dividing one digital image into multiple blocks each having n×n pixels, performing discrete cosine transform on each block, and dividing n×n conversion coefficients resulting from the conversion by each threshold value of a quantization matrix including n×n threshold values each resulting from the multiplication of a predetermined coefficient S (where S is a positive real number) and variable-length encoding the quantized data.
The processing allows the amount of compressed data to fit within a predetermined range by performing the quantization and encoding by defining a specific value as the coefficient S, obtaining a new coefficient S by predetermined processing based on the amount of compressed data obtained therewith, performing quantization and encoding again, repeating these steps until the amount of compressed data fits within the predetermined range.
Alternatively, quantization and encoding may be performed by defining a specific value as the coefficient S, and a new coefficient S may be obtained by predetermined processing based on the amount of compressed data obtained therewith. Then, quantization and encoding may be performed by applying the coefficient S to the image to be compressed next such that the amount of compressed data of the next and subsequent images can fit within a predetermined range.
The predetermined processing here is assumed as including defining a relational expression between the amount of compressed data and a scale factor for each of multiple intervals of the scale factor, and estimating the scale factor.
Alternatively, the predetermined processing can correct the estimation error of the scale factor by defining the relational expression between the amount of compressed data and the scale factor along with an array that corrects the amount of compressed data corresponding to each value of the scale factor.
Alternatively, the predetermined processing may minimize the variation of the amount of data by using, for quantization, the scale factor with a variation minimized by smoothing in time the estimated values of the scale factor obtained from the relationship between the amount of compressed data and the scale factor.
Thus, the amount of compressed data can securely fit within a predetermined range, which prevents the problem that the amount of compressed data does not fit within a planned recording area or transmission band. The recording time and/or transmission time can also be estimated easily. The image quality after compression is also stabilized.
According to embodiments of the invention, the value of a scale factor is adjusted by using the relationship between an amount of compressed data and the scale factor, which is defined for each of multiple Intervals of the scale factor. Thus, a more proper scale factor can be estimated than that of the case using a single relationship, and the amount of compressed data can fit within a predetermined range of a target amount of data.
According to embodiments of the invention, since means for correcting a scale factor is provided, a proper scale factor can be estimated, and the amount of compressed data can fit within a predetermined range of a target amount of data.
According to embodiments of the invention, since means for smoothing scale factors, the variation of the scale factor is minimized, and the amount of compressed data can fit within a predetermined range of a target amount of data.
With reference to
First of all, input image data is divided into multiple blocks each having n×n pixels such as 8×8 pixels horizontally and vertically, and two dimensional discrete cosine transform (DCT) is performed on each of the blocks (process P1).
The DCT is a kind of orthogonal transform in a frequency region and is defined by:
where the conversion coefficient is F(u,v), and the input image data of each one block is f(i,j).
The obtained conversion coefficient F(u,v) indicates the component resulting from the decomposition of input image data of each one block into spatial frequencies.
The conversion coefficient F(0,0) indicates the value (DC component) proportional to the average value of the n×n pixels of input image data f(i,j). F(u,v) exhibits a component (AC component) having a spatial frequency increasing as u and/or v increase/increases.
The quantization is performed by dividing the thus obtained two-dimensional DCT coefficient by the value resulting from the multiplication of each threshold value of a quantization matrix including n×n threshold values by a scale factor S (process P2). The multiplication processing on each threshold value of a quantization matrix by a scale factor S is equivalent to the expansion/contract of each threshold value of the quantization matrix, and the increase/decrease in amount of compressed data can be adjusted by the scale factor.
Next, for the DC component, a difference is obtained between the quantized conversion coefficient F′ (u,v) and the DC component quantized on the previous block (process P3). Then, Huffman encoding is performed on the number of bits of the difference (process P4). The AC component is zigzag scanned in the order shown in
Huffman encoding is performed on the number of bits for expressing a value where the Huffman encoding does not use the DC component and the AC component and the quantized coefficients directly. Then, the value of the number of bits is added as added information separately from the Huffman codes. For example, a quantized coefficient 2 (in base 10) is expressed as “000 . . . 010” in base 2. The number of bits 2 for expressing this is Huffman encoded as a representative value, and the data of 2 bits “10” is added as added bits.
On the other hand, the data resulting from the subtraction of “1” from the added bits is added if the quantized coefficient is negative. For example, if the quantized coefficient is −2 (in base 10) and is expressed as “111 . . . 110” in base 2 (which is a complement number of two), the last two bits are added bits. Then, “01” resulting from the subtraction of “1” from “10” is added as the added bits. Thus, the added bits start with “1” if the quantized coefficient is positive and with “0” if negative, which allows easy determination of positive or negative.
Next, after measuring the amount of compressed data and obtaining a new coefficient S based on a predetermined method, quantization and encoding are performed thereon again. These processes are repeated until the amount of compressed data fits within a predetermined range such that the amount of compressed data can fit with in a predetermined range. Alternatively, after measuring the amount of compressed data and obtaining a new coefficient S based on a predetermined method, quantization and encoding may be performed by applying the coefficient S to the image to be compressed next such that the amount of compressed data of the next and subsequent images can fit within a predetermined range (process P10).
Describing the operation of the predetermined method with reference to the flowchart in
Next, whether the amount of data compressed with the selected value S0 is within a predetermined range of the target amount of data V (step T3), and processing ends if within the predetermined range of the amount of data V. If not, the value of the scale factor allowing the amount of compressed data V to fit within the predetermined range is calculated based on the relationship between the scale factor divided into multiple intervals and the amounts of compressed data, as shown in
Alternatively, as shown in the flowchart in
The calculation of the “S” in step T4 may include dividing each of the scale factors for various sample images into multiple intervals, finding the relationships between the scale factors and the amount of compressed data in advance, and calculating the value of the scale factor among them that allows the amount of compressed data to fit within a predetermined range of the amount of data V by setting the scale factor, as shown in
[Amount of Data]=B0/[Scale Factor] (Expression 2)
for Interval 1;
[Amount of Data]=√(B1/[Scale Factor]) (Expression 3)
for Interval 2; and
[Amount of Data]=A·log [Scale Factor]+B2 (Expression 4)
for Interval 3,
(where A, B0, B1 and B2: constants determined by measurement points, and “log” indicates the logarithm in base 2). The equation for calculating the scale factor to a target amount of compressed data is given by:
[Scale Factor]=(B0/[Target Amount of Data]) (Expression 5)
for Interval 1;
[Scale Factor]=B1/([Target Amount of Data]^2) (Expression 6)
for Interval 2; and
[Scale Factor]=2^{([Target Amount of Data]−B2)/A} (Expression 7)
for Interval 3,
(where A, B0, B1 and B2: constants determined by measurement points, and x^y indicates x raised to the yth power).
With reference to
Next, whether the selected value S0 allows the amount of compressed data within a predetermined range of target amount of data V or not is determined (step T3), and the processing ends if so. If not, the value of the scale factor allowing the amount of compressed data V within the predetermined range is calculated from the relationship between the scale factor and the amount of compressed data and the conversion array for the correction, as shown in
Alternatively, the value of the scale factor allowing the amount of compressed data V within a predetermined range may be calculated from the relationship between the scale factor divided into multiple intervals and the amount of compressed data, as shown in
The calculation of the “S” in step T4 may include finding the relationships between the scale factors and the amount of compressed data, as shown in
[Amount of Data]=√(B1/[Scale Factor]) (Expression 8)
(where B1: a constant determined by a measurement point). The equation for calculating the scale factor to a target amount of compressed data is given by:
[Provisional Scale Factor]=(B1/[Target Amount of Data]^2) (Expression 9);
and
[Scale Factor]=F[Provisional Scale Factor] (Expression 10)
(where B1: a constant determined by a measurement point, x^y indicates x raised to the yth power, and F is a conversion array that corrects the scale factor). In the conversion array, the provisional scale factor before the conversion is substituted into the subscript in the array within [ ], and the converted scale factor is obtained.
In order to adjust the amount of compressed data to V, the provisional scale factor S′ is calculated which is on a straight extension of the relationship between the current scale factor S0 and the amount of compressed data, as shown in
Next, a third embodiment of the invention will be described. The outline of this embodiment is the same as that of the first embodiment but is different in that a specific value S0 first is defined as the value of a scale factor S (step T1), and the data compression processing in steps P2 to P4 is performed (step T2), describing with reference to the flowchart in
Next, whether the selected value S0 allows the amount of compressed data within a predetermined range of target amount of data V or not is determined (step T3), and processing ends if so. If not, the value of the scale factor allowing the amount of compressed data V within the predetermined range is calculated from the relationship between the scale factor and the amount of compressed data (step T4). Then, the data compression processing in processes P2 to P4 is performed again (step T2), and whether the amount of compressed data fits within the predetermined amount of data V or not is determined again (step T3). The processing in steps T2 to T4 is repeated in this way, and the processing ends when the amount of compressed data fits within the predetermined range of the target amount of data V.
Alternatively, the value of the scale factor allowing the amount of compressed data V within a predetermined range may be calculated from the relationship between the scale factor and the amount of compressed data (step T4), and the processing may end, without determining whether the amount of compressed data fits within a predetermined range of the amount of data V or not, as shown in
The calculation of the “S” in step T4 may include finding the relationships between the scale factors and the amount of compressed data for various sample images in advance and calculating the value of the scale factor among them that allows the amount of compressed data to fit within a predetermined range of the amount of data V by setting the scale factor. For example, the relationship between the amount of compressed data and the scale factor may be defined as:
[Amount of Data]=√(B1/[Scale Factor]) (Expression 11)
(where B1: a constant determined by a measurement point). The equations for calculating the scale factor to a target amount of compressed data are:
[Provisional Scale Factor]=(B1/[Target Amount of Data]^2) (Expression 12)
(where B1: a constant determined by a measurement point, and x^y indicates x raised to the yth power); and
(where r: Attenuation Coefficient 0≦r≦1)
In this case, the attenuation coefficient r may be a predetermined fixed value or may be changed every time the compression operation is performed. For example, by defining that r increases as the distance between the scale factor used for the previous compression and the provisional scale factor decreases and decreases as the distance increases, the variation of the scale factor can be minimized upon convergence, and, at the same time, quick response can be provided for a longer distance.
In the three embodiments, the obtained value of the scale factor is used as the scale factor for the compression on the next image, without determining whether the amount of compressed data fits within a predetermined range of the amount of data V, as shown in
Having described the three embodiments including a compressor that can adjust the amount of data with a scale factor, a compressor currently exists that adjusts an amount of data with a given image quality parameter, without showing the scale factor itself. Such a compressor has a relationship, for example:
[Image Quality Parameter]={(65536−[Scale Factor])/65536}·100 (Expression 14)
(where 1≦[Scale Factor]≦65535; and 0≦[Image Quality Parameter]≦100).
Therefore, the invention is applicable to a compressor in which the parameter for adjusting an amount of data is not the scale factor itself. The invention may further fully support a compressor having a complicated relationship between the image quality parameter and the scale factor by dividing the scale factor into multiple intervals and defining the relationship between the amount of compressed data and the scale factor or by correcting the value of the scale factor with the conversion array, as described above. Therefore, the invention is also applicable to a compressor that adjusts an amount of data with a given image quality parameter.
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
Number | Date | Country | Kind |
---|---|---|---|
P2006-327159 | Dec 2006 | JP | national |
Number | Name | Date | Kind |
---|---|---|---|
5206884 | Bhaskar | Apr 1993 | A |
6600836 | Thyagarajan et al. | Jul 2003 | B1 |
6657576 | Matsuura | Dec 2003 | B2 |
6693963 | Taniguchi | Feb 2004 | B1 |
7570827 | Yang et al. | Aug 2009 | B2 |
20030202707 | Thyagarajan et al. | Oct 2003 | A1 |
20040151253 | Bossen | Aug 2004 | A1 |
Number | Date | Country |
---|---|---|
03-224362 | Oct 1991 | JP |
2000-114980 | Apr 2000 | JP |
2001-061148 | Mar 2001 | JP |
2004-056680 | Feb 2004 | JP |
2004056680 | Feb 2004 | JP |
Number | Date | Country | |
---|---|---|---|
20080131015 A1 | Jun 2008 | US |