Claims
- 1. A method of reducing the bit rate of a video bitstream to meet bandwidth constraints, the method comprising:identifying transform coefficients representing video content in a frame or a portion of frame of the video bitstream; identifying a cut-off index using rate control information, wherein the rate control information comprises an average reduction ratio and a current reduction ratio, the cut-off index calculated by using the average reduction ratio and the current reduction ratio; and filtering selected transform coefficients from the video bitstream by using the cut-off index to thereby reduce the bit rate of the video bitstream.
- 2. The method of claim 1, wherein the transform coefficients are discrete cosine transform coefficients.
- 3. The method of claim 1, wherein the transform coefficients selected for filtering are selected based upon their impact on human vision.
- 4. The method of claim 1, wherein the transform coefficients selected for filtering are selected based upon frequency considerations.
- 5. The method of claim 4, wherein transform coefficients representing high frequency components of the video content are selected for filtering.
- 6. A method for determining a cut-off index for a plurality of transform coefficients, the method comprising:identifying a plurality of transform coefficients associated with a macroblock; identifying a cut-off index using rate control information, wherein the rate control information comprises a current reduction ratio for the macroblock, the current reduction ratio for the macroblock calculated by considering the number of outputs bits for the macroblock and the number of input bits for the macroblock; filtering the plurality of transform coefficients using the cut-off index to provide modified transform coefficients; and adjusting the rate control information using information associated with transform coefficients and the modified transform coefficients.
- 7. The method of claim 6, wherein the transform coefficients are DCT coefficients.
- 8. The method of claim 6, wherein the transform coefficients are associated with a block.
- 9. The method of claim 8, wherein the block is 8×8 pixels.
- 10. The method of claim 6, wherein the cut-off index is a cut-off frequency.
- 11. The method of claim 10, wherein the cut-off frequency is associated with a low pass filter.
- 12. The method of claim 11, wherein the low pass filter is an ideal low pass filter.
- 13. The method of claim 6, wherein the rate control information further comprises a total reduction ratio, an average reduction ratio, and an average cut-off index.
- 14. The method of claim 6, wherein the rate control information further comprises a decay factor, a spreading factor, and a scaling parameter.
- 15. The method of claim 13, wherein the current reduction ratio is calculated using the equation:R′m(n)=Δout(n)/Δin(n) whereΔout(n) is the number of output bits of the nth macroblock; and Δin(n) is the number of input bits of the nth macroblock.
- 16. The method of claim 13, wherein the average reduction ratio is calculated using the equations:R′avem(n)=Δaveout(n)/Δavein(n) Δavein(n)=α*Δavein(n−1)+(1−α)*Δin(n) Δaveout(n)=α*Δaveout(n−1)+(1−α)*Δout(n) whereΔin(n) is the input bits of the nth macroblock; Δout(n) is the output bits of the nth macroblock; and α is a decay factor.
- 17. The method of claim 13, wherein the cut-off index is calculated using the equation:Ic(n)=Iavec(n−1)−k*(R′avem(n−1)−Rm(n)) wherek is a scaling factor.
- 18. The method of claim 13, wherein the average cut-off index is calculated using the equation:Iavec(n)=α*Iavec(n−1)+(1−α)*Ic(n) whereIc(n) is the cut-off index for the nth macroblock; and α is a decay factor.
- 19. The method of claim 18, wherein the decay factor is between 0.8 and 0.9.
- 20. An apparatus for filtering transform coefficients to provide modified transform coefficients, the apparatus comprising:a filter stage for receiving transform coefficients associated with a macroblock, the filter stage associated with a cut-off index, wherein the filter stage selectively filters transform coefficients using the cut-off index; and a rate control stage coupled to the output of the filter stage, the rate control stage providing feedback to the filter stage for adjusting the cut-off index using rate control information, wherein the rate control information comprises an average reduction ratio across a plurality of macroblocks, the average reduction ratio for the plurality of macroblocks calculated by considering the average number of outputs bits for the plurality of macroblocks and the average number of input bits for the plurality of macroblocks.
- 21. The apparatus of claim 20, wherein the coefficients are DCT coefficients.
- 22. The apparatus of claim 20, wherein transform coefficients are associated with a block.
- 23. The apparatus of claim 22, wherein the block is 8×8 pixels.
- 24. The apparatus of claim 20, wherein the filter stage is a low pass filter.
- 25. The apparatus of claim 24, wherein the filter is an ideal low pass filter.
- 26. The apparatus of claim 20, wherein the rate control stage maintains rate control information for the transform coefficients.
- 27. The apparatus of claim 20, wherein the rate control information further comprises a total reduction ratio, a current reduction ratio, and an average cut-off index.
- 28. The apparatus of claim 27, wherein the rate control information further comprises a decay factor, a spreading factor, and a scaling parameter.
- 29. The apparatus of claim 27, wherein the current reduction ratio is calculated using the equation:R′m(n)=Δout(n)/Δin(n) whereΔout(n) is the number of output bits of the nth macroblock; and Δin(n) is the number of input bits of the nth macroblock.
- 30. The apparatus of claim 27, wherein the average reduction ratio is calculated using the equations:R′avem(n)=Δaveout(n)/Δavein(n) Δavein(n)=α*Δavein(n−1)+(1−α)*Δin(n) Δaveout(n)=α*Δaveout(n−1)+(1−α)*Δout(n) whereΔin(n) is the input bits of the nth macroblock; Δout(n) is the output bits of the nth macroblock; and α is a decay factor.
- 31. The apparatus of claim 27, wherein the cut-off index is calculated using the equation:Ic(n)=Iavec(n−1)−k*(R′avem(n−1)−Rm(n)) wherek is a scaling factor.
- 32. The apparatus of claim 27, wherein the average cut-off index is calculated using the equation:Iavec(n)=α*Iavec(n−1)+(1−α)*Ic(n) whereIc(n) is the cut-off index for the nth macroblock; and α is a decay factor.
- 33. The apparatus of claim 31, wherein the decay factor is between 0.8 and 0.9.
- 34. The apparatus of claim 27, wherein the total reduction ratio is predetermined.
- 35. An apparatus for filtering transform coefficients to provide modified transform coefficients, the apparatus comprising:filter means for receiving transform coefficients associated with a macroblock, the filter means associated with a cut-off index, wherein the filter means selectively filters transform coefficients using the cut-off index; and rate control means coupled to the output of the filter means, the rate control means providing feedback to the filter means for adjusting the cut-off index using rate control information, wherein the rate control information comprises an average cut-off index, the average cut-off index calculated by using a plurality of cut-off indices for a plurality of macroblocks.
- 36. The apparatus of claim 35, wherein the coefficients are DCT coefficients.
- 37. The apparatus of claim 35, wherein transform coefficients are block.
- 38. The apparatus of claim 37, wherein the block is 8×8 pixels.
- 39. The apparatus of claim 35, wherein the filter means is a low pass filter.
- 40. The apparatus of claim 39, wherein the filter is an ideal low pass filters.
- 41. The apparatus of claim 35, wherein the rate control means maintains rate control information for the transform coefficients.
- 42. The apparatus of claim 35, wherein the rate control information further comprises a total reduction ratio, an average reduction ratio, and a current reduction ratio.
- 43. The apparatus of claim 42, wherein the rate control information further comprises a decay factor, a spreading factor, and a scaling parameter.
- 44. The apparatus of claim 42, wherein the current reduction ratio is calculated using the equation:R′m(n)=Δout(n)/Δin(n) whereΔout(n) is the number of output bits of the nth macroblock; and Δin(n) is the number of input bits of the nth macroblock.
- 45. The apparatus of claim 42, wherein the average reduction ratio is calculated using the equations:R′avem(n)=Δaveout(n)/Δavein(n) Δavein(n)=α*Δavein(n−1)+(1−α)*Δin(n) Δaveout(n)=α*Δaveout(n−1)+(1−α)*Δout(n) whereΔin(n) is the input bits of the nth macroblock; Δout(n) is the output bits of the nth macroblock; and α is a decay factor.
- 46. The apparatus of claim 42, wherein the cut-off index is calculated using the equation:Ic(n)=Iavec(n−1)−k*(R′avem(n−1)−Rm(n)) wherek is a scaling factor.
- 47. The apparatus of claim 42, wherein the average cut-off index is calculated using the equation:Iavec(n)=α*Iavec(n−1)+(1−α)*Ic(n) whereIc(n) is the cut-off index for the nth macroblock; and α is a decay factor.
- 48. The apparatus of claim 47, wherein the decay factor is between 0.8 and 0.9.
- 49. The apparatus of claim 42, wherein the total reduction ratio is predetermined.
- 50. A computer readable medium comprising computer code for reducing the bit rate of a video bitstream to meet bandwidth constraints, the computer readable medium comprising:computer code for identifying transform coefficients representing video content in a frame or a portion of frame of the video bitstream; computer code for identifying a cut-off index using rate control information, wherein the rate control information comprises an average reduction ratio and a current reduction ratio, the cut-off index calculated by using the average reduction ratio and the current reduction ratio; and computer code for filtering selected transform coefficients from the video bitstream by using a cut-off index to thereby reduce the bit rate of the video bitstream.
- 51. The computer readable medium of claim 50, wherein the transform coefficients are DCT coefficients.
- 52. The computer readable medium of claim 50, wherein the transform coefficients are associated with a block.
- 53. The computer readable medium of claim 52, wherein the block is 8×8 pixels.
- 54. The computer readable medium of claim 50, wherein the cut-off index is a cut-off frequency.
- 55. The computer readable medium of claim 54, wherein the cut-off frequency is associated with a low pass filter.
- 56. The computer readable medium of claim 55, wherein the low pass filter is an ideal low pass filter.
- 57. The apparatus of claim 50, wherein the rate control information further comprises a total reduction ratio, and an average cut-off index.
- 58. The computer readable medium of claim 50, wherein the rate control information further comprises a decay factor, a spreading factor, and a scaling parameter.
- 59. The computer readable medium of claim 57, wherein the current reduction ratio is calculated using the equation:R′m(n)=Δout(n)/Δin(n) whereΔout(n) is the number of output bits of the nth macroblock; and Δin(n) is the number of input bits of the nth macroblock.
- 60. The computer readable medium of claim 57, wherein the average reduction ratio is calculated using the equations:R′avem(n)=Δaveout(n)/Δavein(n) Δavein(n)=α*Δavein(n−1)+(1−α)*Δin(n) Δaveout(n)=α*Δaveout(n−1)+(1−α)*Δout(n) whereΔin(n) is the input bits of the nth macroblock; Δout(n) is the output bits of the nth macroblock; and α is a decay factor.
- 61. The computer readable medium of claim 57, wherein the cut-off index is calculated using the equation:Ic(n)=Iavec(n−1)−k*(R′avem(n−1)−Rm(n)) wherek is a scaling factor.
- 62. The computer readable medium of claim 57, wherein the average cut-off index is calculated using the equation:Iavec(n)=α*Iavec(n−1)+(1−α)*Ic(n) whereIc(n) is the cut-off index for the nth macroblock; and α is a decay factor.
- 63. The computer readable medium of claim 62, wherein the decay factor is between 0.8 and 0.9.
CROSS-REFERENCE TO RELATED APPLICATIONS
The present application is related to U.S. patent application Ser. No. 09/867,966 by Wu et al., and titled Methods and Apparatus for Transform Coefficient Filtering and U.S. patent application Ser. No. 09/867,967 by Shen et al., and titled Methods and Apparatus for Updating a Reduction Ratio, both filed on the same day as the present application. Each of the above patent applications is incorporated herein by reference for all purposes.
US Referenced Citations (8)
Number |
Name |
Date |
Kind |
5005076 |
Stroppina et al. |
Apr 1991 |
A |
6002801 |
Strongin et al. |
Dec 1999 |
A |
6181711 |
Zhang et al. |
Jan 2001 |
B1 |
6236749 |
Satonaka et al. |
May 2001 |
B1 |
6335990 |
Chen et al. |
Jan 2002 |
B1 |
6359999 |
Moriwaki et al. |
Mar 2002 |
B1 |
6516096 |
Yokose et al. |
Feb 2003 |
B2 |
6556624 |
Orchard et al. |
Apr 2003 |
B1 |
Non-Patent Literature Citations (3)
Entry |
G. Keesman, R. Hellinghuizen, F. Hoeksema, G. Heideman, “Transcoding of MPEG bitstreams”, Signal Processing: Image Communication, vol. 8 (1996), pp. 481-500. |
Brian C. Smith, “A Survey of Compressed Domain Processing Techniques,” downloaded from www.uky.edu, Mar. 20, 2001, 10 pages. |
Anthony Vero, “MPEG-4 Rate Control for Multiple Video Objects,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 1, Feb. 1999, pp. 186-199. |