Claims
- 1. A method of encoding uncompressed video data to form compressed video data wherein the video data comprises a sequence of a plurality of image frames wherein at least some of the frames are encoded as nonkey frames that are encoded with reference to content of other, reference frames and segmentation of the reference frames, segmentation being an assignment of some or all of the pixels of the reference frame to segments based on at least one of pixel color values of the pixels and location of the pixels in the reference frame, the method comprising:
encoding a first reference frame; segmenting the first reference frame into a first segmentation; matching segments of the first reference frame to pixels of the first nonkey frame; determining translations of segments from the first reference frame to the first nonkey frame using results of the step of matching; for at least one segment that is matched from first reference frame to the first nonkey frame, determining at least one other kinetic information element selected from a z-order, a deformation and a lighting change; encoding into the compressed video data a representation of the translation results from the step of determining translations; and encoding into the compressed video data a representation of the results of the step of determining at least one other kinetic information element.
- 2. The method of claim 1, wherein the compressed video data includes a partial segmentation of at least one reference frame.
- 3. The method of claim 1, wherein the compressed video data includes a segmentation of each reference frame.
- 4. The method of claim 1, wherein the at least one other kinetic information element includes relative z-ordering indicative of relative z-order between two or more segments based on changes of the two or more segments between the reference frame and the current frame.
- 5. The method of claim 1, wherein the at least one other kinetic information element includes absolute z-ordering indicative of z-order between each matched segments based on changes of the matched segments between the reference frame and the current frame.
- 6. The method of claim 1, wherein the at least one other kinetic information element is an indication of a rotation of a matched segment between the reference frame and the current frame.
- 7. The method of claim 1, wherein the at least one other kinetic information element is an indication of a dilation of a matched segment between the reference frame and the current frame.
- 8. The method of claim 1, wherein the at least one other kinetic information element is an indication of an affine transformation of a matched segment between the reference frame and the current frame.
- 9. The method of claim 1, wherein the at least one other kinetic information element is an indication of a nonlinear transformation of a matched segment between the reference frame and the current frame defined by a set of deformation parameters.
- 10. The method of claim 1, wherein the at least one other kinetic information element is an indication of a lighting change of a matched segment between the reference frame and the current frame.
- 11. The method of claim 10, wherein the lighting change is represented as an additive offset in one, two or three color planes.
- 12. The method of claim 10, wherein the lighting change is represented as an additive offset in a luminance plane.
- 13. The method of claim 10, wherein the lighting change is represented as a multiplicative offset in one, two or three color planes.
- 14. The method of claim 10, wherein the lighting change is represented as a multiplicative offset in a luminance plane.
- 15. The method of claim 1, wherein the at least one other kinetic information element is an indication of a residue of a matched segment.
- 16. The method of claim 1, wherein the at least one other kinetic information element is an indication of a pixel color value offset of a matched segment between the reference frame and the current frame.
- 17. The method of claim 16, wherein the pixel color value offset is a linear pixel color value offset.
- 18. The method of claim 16, wherein the pixel color value offset is a nonlinear pixel color value offset.
CROSS-REFERENCES TO RELATED APPLICATIONS
[0001] This application is a continuation-in-part of U.S. application Ser. No. 09/550,705, filed on Apr. 17, 2000, the complete disclosure of which is incorporated herein by reference for all purposes.
Continuation in Parts (1)
|
Number |
Date |
Country |
Parent |
09550705 |
Apr 2000 |
US |
Child |
10105045 |
Mar 2002 |
US |