The present invention relates to a watermark detection method; in particular, the invention relates to a watermark detection method utilizing a pre-filtering step before the detection step. The invention further relates to a computer readable code for implementing the method and to a system for watermark detection.
Digital watermarking has proven an effective deterrent against illegal distribution of copyrighted material in digital form for instance over computer networks, electronic content distribution (ECD) applications or hand-to-hand public distribution.
Generally digital watermarking consists in altering an original data signal by embedding information in the original data signal, which might be used to identify the content creator or owner and/or to protect the copyright of the creator or owner of the original data signal. Digital watermarks are designed to alter insignificantly the original data signal in a way that the digital watermark is imperceptible to humans or a computer analysing the watermarked signal. Watermarking is implemented generally by a pre-coding stage where a watermark is generated and a transcoding watermark embedding stage where the watermark is added to the original data signal in a single or a series of locations within the original data signal, the location or locations where the watermark is embedded are generally accessible with previous knowledge of a secret key. Finally a watermark detector extracts the watermark from the watermarked data signal allowing copyright identification.
In order to efficiently track re-distribution of original data signals within a computer network, e.g. the Internet or an specific number of servers within the Internet, it is necessary to scan through a very high number of data signals, physically located in a number of computers and/or servers, detecting and decoding the embedded watermarks, if present, in order to track the originality of the digital content of the object and its distribution transactions. This process is extremely time consuming and an effective system for watermark detection that reduces the required time and simplifies tracking of original digital content within a computer network will be of great interest and can be used as an effective deterrents against illegal distribution of copyrighted material.
A method that allows for selective downloading of data signals in relation to an illegal contents tracing system has been described in the article by Ho Woo Jang et. Al, “An illegal contents tracing system based on web robot and fingerprinting scheme”, IEEE International Conference on Information Reuse and Integration 2003, IRI 2003, pages 415-419. The method allows for a pre-selective elimination of data signals, files, according to the size of the file or its file extension, as a previous step to a watermark detection process over the remaining downloaded files. Eliminating in forehand files with a certain extension without checking the actual contents of the file, can lead to not consider files on which a malicious user has changed the extension in order to camouflage the contents of the file. Observing an improvement in processing time by eliminating in forehand small sized files, less than 10 Kb, can require that a vast majority of the files within an investigated computer network are of that size, this condition being unrealistic considering the evolution of the size of data signals and the increased communication speeds within a computer network.
Hence, an improved and more efficient method that provides forensic tracking watermark detection would be advantageous.
The present invention seeks to provide improved means for efficient watermark detection. Preferably, the invention alleviates, mitigates or eliminates one or more of the above or other disadvantages singly or in any combination. Especially, it may be seen as an object of the invention to provide a method and a system for forensic tracking watermark detection that overcomes the problems of the prior art in a time and cost effective way.
Accordingly there is provided, in a first aspect, a method for watermark detection, the method being based on a goal descriptor, the method comprising a pre-filtering step and a detection step, wherein:
the pre-filtering step comprising the steps of:
receiving a data signal;
deriving a signal descriptor from the data signal;
comparing the signal descriptor to the goal descriptor so as to determine whether or not the data signal is a signal to be considered as candidate data signal in the watermark detection; and
the detection step comprising the steps of: detecting the watermark in the candidate data signal, otherwise disregarding the data signal.
The present invention is based on the observation that a particular copyright or content owner has the rights for only a fraction of the contents available on a computer network or an electronic content distribution (ECD) application. As a result the copyright or content owner can exclude the majority of data signals, files, on an investigated computer network or ECD application in a pre-filtering step to the actual watermark extraction step.
Furthermore the present invention is also based on the observation that watermark detection within a particular file is often feasible only on parts of the contents of the file that bear certain characteristics, e.g. have enough power in the mid-frequency bands when watermarking an audio file. Therefore, parts of the contents within a file may also be excluded, reducing even further the amount of data that finally needs to be investigated for watermark detection.
In the following description data signals, data carrying signals and files should be understood as a single concept referring to an amount of organized digital data being temporarily or permanently stored in, and/or accessed from, a hard disk, diskette, DVD, CD-ROM, USB-Key or any other similar read-only or read-and-write memory elements.
In the following description presented in this application the term watermark will refer to any kind of information embedded within a data signal, for instance with the purpose of copyright protection and/or identification of the owner of the content of the data signal, or with the purpose of providing additional info relating to the data signal.
The invention is particularly but not exclusively advantageous for a number of reasons. An important advantage is that the invention allows discarding the data signals in which a copyright owner has no rights on according to a user based predefined list of goal descriptors. This will reduce the number of data signals the watermark detector needs to actually process, allowing for a faster evaluation of a predetermined group of data signals mistaken to carry the watermark searched by the copyright owner.
The optional features as defined in claim 2 are advantageous since the pre-filtering step includes actions that can allow to reduce the amount of data on which final watermark detection process has to be applied to, by dividing the candidate data signals into one or more segments and selecting the segments that match certain predefined characteristics.
The optional features as defined in claims 3, 4 and 5 disclose advantageous embodiments according to possible derivations of the descriptor of the data signal. In claim 3 the descriptor of the data signal may be derived from the meta-data associated with the data signal. In claim 4 the descriptor of the data signal may be derived from properties of the data signal. In claim 5 the descriptor of the data signal may be derived from the representation of the data signal.
The optional features as defined in claim 6 are advantageous since by performing two or more pre-filtering steps successively the number of candidate data signals may be reduced significantly including data signals with a high probability of containing the watermark searched by the copyright owner.
The optional feature as defined in claim 7 discloses advantageous embodiments according to possible grouping of steps of the method wherein the derivation of a descriptor from the data signals and the descriptor of the segments of the data signal is done simultaneously in a single step before any comparison to a goal descriptor or a goal segment descriptor.
The optional features as defined in claim 8 are advantageous since the watermark detection step includes decoding a payload encoded in the watermark.
The optional features as defined in claim 9 are advantageous as the user may find a list of possible goal descriptors in a database and choose the goal descriptor in accordance to the type of pre-filtering needed.
The optional features as defined in claim 10 disclose advantageous embodiments according to the possible content of the data signal. The data signal may comprise at least one of: audio, video, images, multimedia software, multidimensional graphical models, software structures.
In a second aspect of the invention is provided a computer readable code for implementing the method of the first aspect.
In a third aspect of the invention there is provided an input module for receiving the data signal, a computing unit for storing or for providing access to a goal descriptor and detecting a watermark in the received data signal, and an output module system for outputting a signal representing whether or not a watermark is present in the data signal;
and wherein the computing unit further conducts a pre-filtering step and a detection step:
the pre-filtering step comprising the steps of:
receiving a data signal;
deriving a signal descriptor from the data signal;
comparing the signal descriptor to the goal descriptor so as to determine whether or not the data signal is a signal to be considered as candidate data signal in the watermark detection.
In general the various aspects of the invention may be combined and coupled in any way possible within the scope of the invention.
The method of the first aspect of the invention may be implemented for an input module, a computing unit and an output module of the third aspect of the invention.
These and other aspects, features and/or advantages of the invention will be apparent from and elucidated with reference to the embodiments described hereinafter.
The present invention will now be explained, by the way of example only, with reference to the accompanying Figures wherein:
The present invention utilizes the fact that a typical copyright or content owner has the rights for only a fraction of the contents available on a computer network or an electronic content distribution (ECD) application. This is conceptually illustrated in
Furthermore, the copyright owner has access and/or knowledge of the method used in the watermark generation process and therefore will be able to identify if only certain parts of the data signals should be considered in the watermark extraction process. Each data signal for which the copyright owner has rights for can be divided into parts or segments estimated to contain watermark information and parts or segments estimated to contain no watermark information. The total amount of data signals for which the copyright owner has rights for 110 comprises a group of data signal parts 102 which are not relevant for the particular watermark extraction process and a group of data signal parts 103 which are relevant and considered in the watermark extraction process.
A flow chart presenting the main steps of a method for watermark detection is indicated generally by 200 in
In another possible implementation of the method the user accesses the computer or/and servers within the computer network or EDC in which it is allowed access and accesses the data signals available within these computers and/or servers. The total amount of data signals accessed are then pre-filtered in order to determine contents of the data signals in which the user of the method has a final interest in and that match the specific watermark object of the search. Finally the actual watermark extraction is applied to the contents of the data signals remaining from the pre-filtering step, and a list of data signals in which the watermark was identified is presented to the user, who may then decide whether to take any further action.
In
From a list of possible data signal goal descriptors and/or segment goal descriptors a particular goal descriptor and/or segment goal descriptor is/are selected 310 according to the user's considerations. The copyright owner might specify a specific number of computers and/or servers to be investigated and their location in the computer network or ECD under investigation. The computer/servers are then accessed and relevant data signals are accessed and may be downloaded to a local memory for future processing 320. A specific data signal may be accessed from the memory and a descriptor derived from it 330 according to its current definition, possibly more than one descriptor may be derived. The goal descriptor, Gd, and the derived descriptor, Cd, are then compared in 340. If the derived descriptor does not match the goal descriptor the data signal is discarded and a next data signal will be accessed 330. If the derived descriptor matches the goal descriptor the data signal is added to a database 350 of possible data signals containing the watermark being investigated. The data signal can then be divided into one or more potentially overlapping segments 360. Each of the segments is sequentially accessed and its descriptor derived 370. The goal segment descriptor, Gs, and the derived segment descriptor, Csi, are then compared in 380. If the derived segment descriptor does not match the goal segment descriptor, the data signal is discarded and a next segment of the data signal will be accessed 370. If the derived descriptor matches the goal descriptor, the data signal is added to a database 390 of possible segments of data signals containing the watermark being investigated.
Particular implementations of the method can consist in implementing the pre-filtering step only on the basis of a goal descriptor, only on the basis of a goal segment descriptor or both o basis of a goal descriptor and a goal segment descriptor.
In another possible implementation of the method a single individual data signal is downloaded at a time from the computer network or ECD application being investigated. The steps of descriptor derivation from the data signal, comparison to goal descriptor, segmenting the data signal and segment descriptor comparison to goal segment descriptor being executed on the downloaded data signal before another data signal is downloaded from the computer network or ECD application.
Different embodiments of the invention can be implemented according to the source in which the descriptor for the data signal is based on.
In an embodiment of the invention the descriptors are derived from the meta-data associated with the content. For instance, the user might be interested in investigating data signals that contain songs from a particular artist or record house. In this case, the meta-data tags may be used in the pre-filtering stage 220 for eliminating data signals that contain songs from other artists or record houses.
In another embodiment of the invention the descriptor may be associated with the particular representation of the data signal. For instance, the user might be interested in detecting watermarks included in data signals of high-quality content only. In that case, the bit-rate (sampling rate) of the song, which is a property of its compressed representation, may be defined as the descriptor used in the pre-filtering stage 220 for eliminating data signals that are of low quality.
In another embodiment of the invention the descriptor may be associated with the signal itself and its properties, not particularly its representation. For instance, the descriptor may be a fingerprint computed from the data signal. In this case, the matching between the goal descriptor and the descriptor obtained for an specific data signal 340 requires a search in a database of desired fingerprints. This kind of descriptor may be derived from the compressed bit-stream or the current signal representation. The fingerprint may be for example computed as a function of the Modified Discrete Cosine Transform (MDCT) coefficients which are readily available in the bit-stream of the data signal.
Furthermore different embodiments of the invention can be implemented according to the source in which the descriptor for the segments of the data signal is based on.
In one embodiment of the invention the goal segment descriptor may be associated with the certain characteristics of the segment. For instance, it could be based on the necessary existence of certain energy level in the mid-frequencies of the spectral representation of the data signal, e.g. from a Discrete Cosine Transform (DCT). Thus the goal segments descriptor may extract from the data signal those segments with a certain amount of energy in the mid-frequency coefficients of the DCT representation of the signal.
The pre-filter 220 may be composed of multiple stages of filters each successively eliminating more content for which the owner the copyright under investigation has no rights for. A schematic representation of a multi-stage pre-filter is shown in
In
The watermark detection system 550 comprises among other elements:
an input module for receiving a data signal (552).
a computing unit for storing or for providing access to a goal descriptor, and for detecting a watermark in the received data signal (554).
an output module for outputting a signal representing whether or not a watermark is present in the data signal (556).
The computing unit (554) may conduct the pre-filtering step (220) and the detection step (240).
In the context of the application a server might be a computer with a series of specific functionalities, e.g. security control and content access.
In one embodiment of the invention all the functions, software and hardware that allow implementing the watermark detection system are placed physically within the watermark detection system 550.
In another embodiment of the invention the pre-filter function may enclose a database or list of goal descriptors that correspond to all the contents that are to be considered in an investigation. The database in this embodiment may be located at a server 520 within the computer network 510 different to the one the watermark detection system uses for access to the network, while the pre-filtering functionality and the final watermark detection functionality are located within the watermark detection system 550. Each time a descriptor is derived from a digital content and needs to be compared to a specific goal descriptor a connection is established between the local server to which the watermark detection system is connected to and the remote server where the goal descriptor database is located at.
Although the present invention has been described above with reference to specific embodiments, it is not intended to be limited to the specific form set forth herein. Rather, the invention is limited only by the accompanying claims and, other embodiments than the specific above are equally possible within the scope of these appended claims, e.g. different distribution systems that those described above.
The invention can be implemented in any suitable form including hardware, software, firmware or any combination of these. However, preferably, the invention is implemented as computer software running on one or more data processors and/or digital signal processors. The elements and components of an embodiment of the invention may be physically, functionally and logically implemented in any suitable way. Indeed, the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the invention may be implemented in a single unit, or may be physically and functionally distributed between different units and processors.
In this section, certain specific details of the disclosed embodiment are set forth for purposes of explanation rather than limitation, so as to provide a clear and thorough understanding of the present invention. However, it should be understood readily by those skilled in this art, that the present invention may be practised in other embodiments which do not conform exactly to the details set forth herein, without departing significantly from the spirit and scope of this disclosure. Further, in this context, and for the purposes of brevity and clarity, detailed descriptions of well-known apparatus, circuits and methodology have been omitted so as to avoid unnecessary detail and possible confusion.
Reference signs are included in the claims, however the inclusion of the reference signs is only for clarity reasons and should not be construed as limiting the scope of the claims.
Number | Date | Country | Kind |
---|---|---|---|
05109511.5 | Oct 2005 | EP | regional |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/IB06/53659 | 10/6/2006 | WO | 00 | 4/10/2008 |