1. Field of the Invention
The present invention relates to a video watermarking apparatus and method. More particularly, the present invention relates to an apparatus and method of watermarking a video in a compression domain, substantially resisting recompression of the video.
2. Description of the Related Art
Generally, due to the widespread use of digital media and various multimedia data transmission and storage devices, and the development of authoring tools, multimedia data may be easily copied and distributed via a network. Therefore, new services are being provided. However, a problem of adequately protecting the copyright of the digital media has seriously escalated.
Watermarking is used for protecting the copyright of digital media. Watermarking is a method of inserting a watermark, which is a signature of an author or information identifying the author, into the digital media. The watermark is to solve the problem of protecting the copyright of the digital media by inserting the watermark into the digital media so that when a problem of proving copyright infringement occurs, the watermark may be extracted to show proof of copyright ownership.
Methods of watermarking may be classified into a method of watermarking in a spatial domain, and a method of watermarking in a compression domain.
Since various algorithms may be applied to conventional methods of watermarking in the spatial domain, it has the merit of substantially resisting various attacks.
However, most video is encoded while stored and transmitted. Therefore, to apply the method of watermarking in the spatial domain, an entire encoded video has to be decoded and the decoded video has to be encoded again after inserting a watermark into the decoded video. This presents a cumbersome problem of inserting the watermark and encoding the decoded video again. Also, there is a large amount of computation required by a process of decoding the entire video.
As a method of reducing the large amount of computation, watermarking in the compression domain is provided, which operates in a bit stream of the compression domain. However, in conventional methods of watermarking in the compression domain, since a watermark is directly inserted into/extracted from an encoded discrete cosine transform (DCT) coefficient, there is a problem of being relatively ineffective against a recompression attack of a video.
As representative examples of conventional methods of watermarking in a compression domain, there are Hartung, Cox, and Langelaar methods. The Hartung method, disclosed in U.S. Pat. No. 5,915,027, has a disadvantage of requiring a large amount of computation because a very complex circuit is required for preventing error propagation and an increase of bit rates.
In the Cox method, disclosed in U.S. Pat. No. 5,915,027, since an inserted watermark affects only frequency features of data in a compression domain, it is subject to a simple and effective attack when there is a change in bit rates and frame structures. Also, recompression of a video and additional computation caused by shaping of the watermark is required.
In the Langelaar method, mentioned in U.S. Pat. Nos. 6,768,980 and 6,748,362, very quick computation is possible in a compression domain but there is a disadvantage of having a structure that is very weak in a recompression of a video.
Accordingly, there is a need for an improved apparatus and method for inserting a video watermark in a compression domain.
Exemplary embodiments of the present invention address at least the above problems and/or disadvantages and provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide an apparatus and method of watermarking a video in a compression domain, capable of substantially resisting against a recompression attack.
An aspect of the present invention also provides an apparatus and method of watermarking a video, capable of inserting a watermark resisting against recompression, by causing a change in a certain feature by operation of a bit stream in a compression domain.
An aspect of the present invention also provides an apparatus and method of watermarking a video, capable of directly inserting a watermark in a compression domain.
An aspect of the present invention also provides an apparatus and method of watermarking a video, in which there is a decreased load on memory.
According to an aspect of the present invention, there is provided a video watermarking apparatus including a spatial domain information analyzer receiving a bit stream encoded by a video encoder and extracting information from a spatial domain of an image with respect to code words forming the bit stream, a domain classifier grouping the code words for each segmented domain, based on the information from the spatial domain, a domain sign determiner determining a sign of the each segmented domain and a watermark bit inserter inserting a watermark in the each segmented domain according to the sign determined by the domain sign determiner.
In this case, the spatial domain of the image may be segmented into the same form or may be segmented into two or more mutually different forms.
In this case, the sign of each segmented domain may be determined according to a bit of the watermark.
In an exemplary embodiment, the encoder may be an MPEG-2 encoder.
According to another aspect of the present invention, there is provided a video watermark detection apparatus including a parameter extractor receiving an compressed digital video data and providing spatial information of an image, a bit stream grouping unit grouping the received compressed digital video data based on the spatial information of the image of the compressed digital video data, a domain classifier receiving a decoded digital video and classifying spatial domain data of an image and a watermark detector extracting a watermark bit inserted for each domain, from data of each domain grouped into a spatial domain by the bit stream grouping unit and the domain classifier.
According to still another aspect of the present invention, there is provided a video watermarking apparatus including a spatial domain information analyzer receiving a bit stream encoded by a video encoder and extracting information from a spatial domain of an image with respect to code words forming the bit stream, a spatial domain classifier grouping the code words for each segmented domain, based on the information with respect to the spatial domain, a domain sign determiner determining a sign of the each segmented domain, a watermark bit inserter inserting a watermark in the each segmented domain according to the sign determined by the domain sign determiner, a parameter extractor receiving a compressed digital video data and providing spatial information of an image, a bit stream grouping unit grouping the received compressed digital video data based on the spatial information of the image of the compressed digital video data, a domain classifier receiving a decoded digital video and classifying spatial domain data of an image and a watermark detector extracting a watermark bit inserted for each domain, from data of each domain grouped into a spatial domain by the bit stream grouping unit and the domain classifier.
According to yet another aspect of the present invention, there is provided a video watermarking method including grouping encoded video bit streams for each certain domain in a spatial domain, inserting a watermark into each of the grouped bit streams and recombining the each of the grouped bit streams group including the watermark.
In an exemplary embodiment, the operation of grouping encoded video bit streams may include extracting information from the spatial domain of an image with respect to code words forming the encoded video bit stream and grouping the encoded video bit stream for the each certain domain in the spatial domain, based on the information with respect to the spatial domain.
In an exemplary embodiment, the operation of inserting a watermark may include determining a sign for each of the grouped certain domains and inserting the watermark into each domain according to the determined sign.
In an exemplary embodiment, when the bit stream is an MPEG-2 bit stream, the watermark may be inserted into a discrete cosine transform (DCT) DC coefficient.
In an exemplary embodiment, the watermark may be inserted into a part of or all of the code words forming the grouped bit stream.
In an exemplary embodiment, the watermark insertion may be performed according to an equation as below,
Code′i(k)=Codei(k)+s(i)w(k),
wherein Codei is a group of code words included in a segmented domain i, s(i) is a sign of the domain i, w(k) is a watermark gain factor, and Code′i is a group of code words including a watermark of the domain i.
According to a further aspect of the present invention, there is provided a video watermark detection method including extracting spatial information of an image in a bit stream including a watermark, grouping the bit stream including the watermark, based on the spatial information and extracting the included watermark from the grouped bit stream.
In an exemplary embodiment, the watermark included in the bit stream may be detected in a luminance component of the bit stream.
In an exemplary embodiment, an equation with respect to the luminance component of the bit stream and an equation with respect to a watermark signal with respect to each domain may be as below,
wherein I′(x,y) is an image including a watermark, I(x,y) is an original image, L′(1) is a luminance component of 1th 8×8 blocks of I′(x,y), L(1) is a luminance component of 8×8 blocks of I(x,y), and wi is a watermark signal of i domain.
The above and/or other aspects and advantages of the present invention will become apparent and more readily appreciated from the following detailed description, taken in conjunction with the accompanying drawings of which:
Throughout the drawings, the same drawing reference numerals will be understood to refer to the same elements, features, and structures.
The matters defined in the description such as a detailed construction and elements are provided to assist in a comprehensive understanding of the embodiments of the invention and are merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted for clarity and conciseness. Reference will now be made in detail to exemplary embodiments of the present invention.
The video encoder 10 encodes external analog video data to reduce an amount of data of the analog video data. In this case, the encoded data is stored in the storage apparatus 20 or transmitted.
The watermarking apparatus 30 inserts a watermark into the encoded data, namely an encoded bit stream, to prepare against intentional attacks such as recompression of the video and an attack when the video is in a compressed digital video data form or analog form. The watermarking apparatus 30 segments the encoded bit stream of an image into bit stream groups with respect to a spatial domain, inserts a watermark of one bit into each bit stream group, recombines each bit stream group including the watermark, and transmits corresponding video contents including the watermark.
The watermark detection apparatus 40 detects a watermark from an intentionally attacked digital video content or normally received digital video content. In this case, the watermark detection apparatus 40 detects the watermark regardless of a video form such as video content deformed by the intentional attack or normally received video content.
A watermark-key, input to the watermarking apparatus 30 and the watermark detection apparatus 40, is used for more securely inserting a watermark by using a key when the watermark is inserted, such as scrambling. The watermark-key is well known to those skilled in the art and may be applied to exemplary embodiments of the present invention. Accordingly, hereinafter, a configuration of the watermark key will be omitted.
The spatial domain information analyzer 31 receives an encoded bit stream transformed by the video encoder 10 and extracts information on a spatial domain of an image, such as width, length, and size of the image, from code words forming the encoded bit stream. Namely, in order to segment and group the encoded bit stream into the spatial domain of the image, the information on the spatial domain of the image is extracted from the code words.
The spatial domain classifier 32 receives the bit stream encoded by the video encoder 10 and the information on the spatial domain from the code words forming the bit stream, extracted by the spatial domain information analyzer 31. The spatial domain classifier 32 classifies the encoded bit stream into domains or sub-images based on the information on the spatial domain from the code words received from the spatial domain information analyzer 31. Namely, to show respectively segmented domains in the spatial domain, the encoded bit stream is grouped according to domains or sub-images of the spatial domain. In this case, grouping the encoded bit stream by the domain classifier 32 varies with a segmented form and a number of sub-images in the spatial domain, and will be described referring to
Referring to
The spatial domain classifier 32 groups a bit stream corresponding to each domain or sub-image of an image based on segmentation information in a spatial domain, such as the examples shown in
The domain sign determiner 33 determines a sign with respect to each domain or sub-image of the image in the spatial domain grouped by the domain classifier 32. The sign is determined according to a bit of a watermark that will be inserted. For example, when a watermark that will be inserted into a certain domain is “1”, a sign of a corresponding domain is determined to be “+”. When a watermark that will be inserted is “0”, a sign of a corresponding domain is determined to be “−”. Of course, a value of the watermark and a sign corresponding to the value is not limited to the one case. Namely, when a watermark is “1”, a sign of a corresponding domain may be determined to be “−”, and when a watermark is “0”, a sign of a corresponding domain may be determined to be “+”. Hereinafter, it is described assuming as a watermark “1” is inserted when a sign of a domain is “+” and a watermark “0” is inserted when a sign of a domain is “−”.
When the domain sign determiner 33 determines the sign of each domain or sub-image segmented from the spatial domain, the watermark bit inserter 34 inserts a watermark with respect to a corresponding sign into a part of or an entire bit stream grouped for each domain or sub-image, according to the sign of each domain. This will be described referring to
When the watermark is inserted into some or all of the code words forming the bit stream grouped into the segmented domain, the bit stream including the watermark is recombined in the form of an encoded bit stream and video contents are transmitted to a desired place. In an exemplary embodiment, the video encoder 10 may recombine the bit stream to form an encoded bit stream.
In the case of an MPEG-2 bit stream, a DCT DC coefficient indicating spatial data, for example luminance, of an intra-encoded frame becomes an object of an operation k for a watermark. Accordingly, in an exemplary embodiment, a watermark signal is inserted into the DCT DC coefficient of a luminance component of the image in a compression domain to provide an effect of the watermark in the spatial domain.
Referring to
Via the process, a watermark may be inserted into a DCT DC coefficient, a bit stream having the DCT DC coefficient including the watermark may be recombined, and contents may be transmitted to a desired place.
As described above, the watermark bit inserter 34 inserts a watermark into a grouped bit stream, which may be shown as Equation 1.
Code′i(k)=Codei(k)+s(i)w(k) [Equation 1]
In this case, Code′i is a group of code words including a watermark of the domain i, Codei is a group of code words included in a segmented domain i, s(i) is a sign, −1 or +1, of the domain i, and w(k) is a watermark gain factor, in which w(k)≧0. In this case, since w(k) includes “0”, a watermark signal may be inserted into only a part of the code words of one domain.
The watermarking apparatus 30 inserts a watermark into some or all code words of each domain segmented from a spatial domain, using Equation 1. When the bit stream including the watermark is recombined and transmitted, the watermark detection apparatus 40 detects the watermark inserted in to contents.
In an exemplary case, all kinds of video forms, such as compressed digital video data, decoded digital video, and analog video, may be input to the watermark detection apparatus 40.
The parameter extractor 41 receives compressed digital video data and provides spatial information of an image, required by the bit stream grouping unit 42, such as information on width, length, and size of the image.
The bit stream grouping unit 42 groups the compressed digital video data based on the spatial information of the image of the compressed digital video data, extracted by the parameter extractor 41.
In an exemplary case, the parameter extractor 41 and the bit stream grouping unit 42 may perform operations similar to the spatial domain information analyzer 31 and the spatial domain classifier 32 shown in
In an exemplary case, the compressed digital video data may be expressed as digital data decoded by the decoder 43.
The spatial domain classifier 44 receives the decoded digital video and classifies spatial domain data of the image. In an exemplary embodiment, the spatial domain data may comprise pixels of the image.
The ADC 45 receives, digitalizes, and outputs an analog video to the spatial domain classifier 44. The spatial domain classifier 44 classifies the digitalized analog video data into each domain.
The watermark bit detector 46 detects a watermark bit inserted for each domain or sub-image, from data of each domain grouped into a spatial domain by the bit stream grouping unit 42 or the spatial domain classifier 44.
In an exemplary embodiment, grouping the bit stream in the compression domain may be included in a certain domain in the spatial domain, as shown in
When the image is encoded by an MPEG-2 encoder, the watermark detection apparatus 40 detects a watermark by using a DCT DC coefficient including the watermark. In an exemplary embodiment, the DCT DC coefficient indicates a luminance component.
The luminance component and a watermark signal with respect to each domain of the image, detected by the watermark detection apparatus 40 are expressed by Equation 2 and Equation 3, respectively.
In this case, I′(x,y) is an image including a watermark, I(x,y) is an original image, L′(1) is a luminance component of 1th 8×8 blocks of I′(x,y), and L(1) is a luminance component of 1th 8×8 blocks of I(x,y).
In this case, i indicates each segmentation domain of the segmented image. When the image is segmented into n number of domains, 0≦i≦n, and wi is a watermark signal.
As described above, the present invention may be applied to various fields such as broadcasting monitoring, preventing illegal copying and distribution of videos, enhancing medical images, and interactive TV.
In an exemplary case of broadcasting monitoring, message information such as a name of a company and a broadcasting time may be inserted as a watermark, for an automatic monitoring system with respect to contents of broadcasting programs or televising advertisements.
In an exemplary case of preventing the illegal copying and distribution of videos, a unique watermark may be inserted into each copied video to prevent illegal copying and distribution, thereby recognizing a pirate copy of the video by extracting a watermark of a corresponding video when an illegally copied and distributed video is found.
In an exemplary case of medical images, a serious medical mistake caused by losing, missing, and/or switching an image may be prevented by recording a name, age, name of a disease, and/or condition of a patient as a watermark.
In an exemplary case of interactive TV, a caption requiring an additional channel may be processed without the additional channel by watermarking. When features of all broadcasted things, such as a price, a place of origin, or a maker of a dress worn on a certain person, are inserted as a watermark, home shopping may be performed in real time without an additional channel.
When an original video is encoded by a video encoder, such as an MPEG-2 encoder, an encoded bit stream is transmitted by transmission media.
The bit stream is transmitted to user1, user2, user3, user4, and user5 via set-top boxes (STBs). In this case, the STB inserts a serial number of the set-top box as a watermark into a corresponding image. The serial number of the set-top box is inserted by the watermarking apparatus 30 included in the set-top box. The watermarking apparatus 30 groups code words forming the bit stream into each segmented domain and inserts the serial number of the set-top box into some or all of the code words grouped into each segmented domain, as a watermark.
The serial number of the set-top box is inserted into the bit stream in a compression domain as the watermark. When a video is illegally copied and distributed via the transmission media by the user5, a contents provider providing the original video may detect that the user5 illegally copied and distributed the video by detecting the serial number of the set-top box from the watermark detected from the illegally copied and distributed video.
An exemplary aspect of the present invention provides an apparatus and method of watermarking a video in a compression domain, capable of substantially resisting against a recompression attack by grouping an encoded bit stream into domains segmented from a spatial domain and inserting a watermark into some or all of grouped code words.
An exemplary aspect of the present invention also provides an apparatus and method of watermarking in a compression domain, capable of watermarking in a spatial domain.
An exemplary aspect of the present invention also provides an apparatus and method of watermarking a video, capable of substantially resisting against recompression after changing a size of a group of images and an encoding parameter, and recompression into other formats such as MPEG-4, since a watermark in a compression domain has an effect on a spatial domain of an image.
An exemplary aspect of the present invention also provides an apparatus and method of watermarking a video, capable of being applied to an encoded video by other encodings in addition to MPEG.
Certain exemplary embodiments of the present invention can also be embodied as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can store data which can thereafter be read by a computer system. Examples of the computer-readable recording medium include, but are not limited to, read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and carrier waves (such as data transmission through the Internet). The computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Also, functional programs, codes, and code segments for accomplishing the present invention can be easily construed as within the scope of the invention by programmers skilled in the art to which the present invention pertains.
Although a few exemplary embodiments of the present invention have been shown and described, the present invention is not limited to the described embodiments. Instead, it should be appreciated by those skilled in the art that changes may be made to these exemplary embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their full scope of equivalents.
Number | Date | Country | Kind |
---|---|---|---|
10-2006-0053638 | Jun 2006 | KR | national |
This application is a divisional of U.S. patent application Ser. No. 11/711,680 filed on Feb. 28, 2007, now U.S. Pat. No. 8,094,871, which claims the benefit under 35 U.S.C. §119(a) of Korean Patent Application No. 10-2006-0053638, filed on Jun. 14, 2006, in the Korean Intellectual Property Office, the entire disclosure of which is hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5475434 | Kim | Dec 1995 | A |
5915027 | Cox et al. | Jun 1999 | A |
6154571 | Cox et al. | Nov 2000 | A |
6310962 | Chung et al. | Oct 2001 | B1 |
6332030 | Manjunath et al. | Dec 2001 | B1 |
6332194 | Bloom et al. | Dec 2001 | B1 |
6553150 | Wee et al. | Apr 2003 | B1 |
6556689 | Xia et al. | Apr 2003 | B1 |
6621933 | Chung et al. | Sep 2003 | B2 |
6738493 | Cox et al. | May 2004 | B1 |
6748362 | Meyer et al. | Jun 2004 | B1 |
6768980 | Meyer et al. | Jul 2004 | B1 |
6809792 | Tehranchi et al. | Oct 2004 | B1 |
6973130 | Wee et al. | Dec 2005 | B1 |
7496197 | Troyansky et al. | Feb 2009 | B2 |
7707422 | Shin et al. | Apr 2010 | B2 |
7779271 | Langelaar | Aug 2010 | B2 |
7933407 | Keidar et al. | Apr 2011 | B2 |
20010021260 | Chung et al. | Sep 2001 | A1 |
20020129253 | Langelaar | Sep 2002 | A1 |
20020146123 | Tian | Oct 2002 | A1 |
20020178368 | Yin et al. | Nov 2002 | A1 |
20030174858 | Kim et al. | Sep 2003 | A1 |
20040022444 | Rhoads | Feb 2004 | A1 |
20040125952 | Alattar et al. | Jul 2004 | A1 |
20040258243 | Shin et al. | Dec 2004 | A1 |
20070291980 | Kim et al. | Dec 2007 | A1 |
20100146284 | Geyzel et al. | Jun 2010 | A1 |
20100177891 | Keidar et al. | Jul 2010 | A1 |
20130272522 | Keidar et al. | Oct 2013 | A1 |
Number | Date | Country |
---|---|---|
2002-152742 | May 2002 | JP |
2002-171494 | Jun 2002 | JP |
2004-166018 | Jun 2004 | JP |
2004-304834 | Oct 2004 | JP |
10-2001-0024001 | Mar 2001 | KR |
10-2001-0074604 | Aug 2001 | KR |
10-2002-0088086 | Nov 2002 | KR |
WO 2005004493 | Jan 2005 | WO |
WO 2005004494 | Jan 2005 | WO |
Number | Date | Country | |
---|---|---|---|
20110311098 A1 | Dec 2011 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 11711680 | Feb 2007 | US |
Child | 13217131 | US |