Patent Grant
9323902
The present application generally relates to the field of content management. More particularly, the disclosed embodiments relate to conditionally accessing a marked content that is subject to copy control enforcement policies.
This section is intended to provide a background or context to the disclosed embodiments that are recited in the claims. The description herein may include concepts that could be pursued, but are not necessarily ones that have been previously conceived or pursued. Therefore, unless otherwise indicated herein, what is described in this section is not prior art to the description and claims in this application and is not admitted to be prior art by inclusion in this section.
Digital watermarks have been proposed and used for copyright protection of audio, video, images and other types of media. In a typical watermarking scenario an auxiliary information signal is hidden within a host content in such a way that it is substantially imperceptible, and at the same time, difficult to remove without damaging the host content. In some applications, the auxiliary information that is hidden within the host content is used to provide copy control for the host media content. For example, the detection of an embedded watermark that includes copy control information (CCI) (hereinafter referred to as a CCI watermark) may stop the playback of an unauthorized content.
In other applications, digital watermarks may be used to carry other information, such as the identity of the content itself, the content owner, the distribution channel, the content format, and the like. Typically such information is embedded into the content using watermarks that have a larger payload (hereinafter referred to as an Extended Payload (EP) watermark) than the CCI watermarks. For example, while a watermark payload of 8 bits may suffice for carrying CCI, an extended payload of, for example, 20 to 100 bits may be required to embed non-copy control information. In some applications, EP watermarks may have different performance and reliability requirements than CCI watermarks.
Historically, CCI and EP watermarks have been used for distinct applications and, therefore, have been developed and implemented separately often using distinct watermarking techniques. Independent embedding and extraction of such watermarks can, however, result in unwanted artifacts in the host content and result in additional penalties in terms of watermark robustness and computational complexity of embedding and extraction operations.
This section is intended to provide a summary of certain exemplary embodiments and is not intended to limit the scope of the embodiments that are disclosed in this application.
Some of the disclosed embodiments enable embedding and extraction of multiple watermark messages in a coordinated fashion to improve watermark transparency, robustness against impairments, security, and computational complexity of embedding and extraction of watermarks. These improved aspects of the watermarking system provide significant value to content owners, content distributors, and consumers at a small incremental cost. The disclosed embodiments further facilitate embedding and extraction of watermarks by maintaining and updating a database to contain associations between the embedded watermarks and metadata related to such watermarks. Moreover, the disclosed embodiments facilitate conditional access to a content embedded with watermarks when copy control rules associated with an embedded watermark message prohibits unconditional access to the content.
One aspect of the disclosed embodiments relates to a method of embedding watermarks into a host content that comprises obtaining a payload of a first watermark message for embedding into the host content, obtaining a payload of a second watermark message for embedding into the host content, and embedding the first and the second watermark messages into the host content in a coordinated fashion such that the embedded first watermark message has a pre-defined relationship with the embedded second watermark message in a particular domain. The embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain. In one embodiment, the particular domain is at least one of a spatial, temporal and frequency domains.
According to an embodiment, the embedding of the first and the second watermark messages is conducted in a single watermark embedding session, whereas in another embodiment, the embedding of the first watermark message is conducted in a different embedding session than the embedding of the second watermark message. According to another embodiment, different watermarking technologies are used for embedding each of the first and the second watermark messages. In an alternate embodiment, the same watermarking technologies are used for embedding each of the first and the second watermark messages.
In another embodiment, one or more symbols of the second watermark message are embedded into the host content in a multiplexed fashion with one or more symbols of the first watermark messages. For example, the multiplexed fashion comprises multiplexing in at least one of a frequency, time and spatial domains. In still another embodiment, embedding of one or more symbols of the first watermark message is skipped, and a space vacated by skipping the one or more symbols of the first watermark message is used for embedding at least one symbol of the second watermark message.
In one embodiment, the above noted method further comprises performing a single watermark masking operation. In another embodiment, the first watermark message is embedded into a first component of the host content and the second watermark message is embedded into a second component of the host content. In one example, the first component is an audio component and the second component is a video component. In yet another embodiment, the first watermark message is a copy control information watermark and the second watermark message is an extended payload watermark. In another embodiment, embedding the first and the second watermark messages includes the following operations: identifying all embedding opportunities within the host content based on a content perceptual criterion, allocating a first subset of identified embedding opportunities for embedding of the first watermark message, and allocating a second subset of identified embedding opportunities for embedding of the second watermark message.
Another aspect of the disclosed embodiments relates to a method for extracting watermarks that includes extracting a first watermark message from a host content, and obtaining a predefined relationship between symbols of the extracted first watermark message and symbols of a second watermark message in a particular domain. Such a method for extracting watermarks further includes extracting the second watermark message based on the predefined relationship, where embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain. In one embodiment, the particular domain is at least one of a spatial, temporal and frequency domains.
According to an embodiment, the predefined relationship is a multiplexing relationship between one or more symbols of the first watermark message and one or more symbols of the second watermark message. For instance, the multiplexing can include multiplexing in at least one of a frequency, time and spatial domains. In another embodiment, the first watermark message is extracted from a first component of the host content and the second watermark message is extracted from a second component of the host content. In a particular example, the first component is an audio component and the second component is a video component.
In one embodiment where the second watermark message comprises a time-code, extracting the second watermark message includes extracting the time-code from the second watermark message, determining content timing information from the extracted time code, and determining accuracy of the content timing information. In another embodiment where the second watermark message also comprises a time-code, extracting the second watermark message further includes determining content timing information based on time-codes in a plurality of extracted second watermark messages, determining an error value associated with the content timing information, and setting a new reference timing information if the determined error value is at or below a target error value. In one variation, the time-codes are further used to detect content manipulations.
Another aspect of the disclosed embodiments relates to a device for embedding watermarks, where the device includes a watermark packet generator that is configured to obtain a payload of a first watermark message and a payload of a second watermark message for embedding into a host content. The device also includes a watermark embedder that is configured to embed the first and the second watermark messages into the host content in a coordinated fashion such that the embedded first watermark message has a pre-defined relationship with the embedded second watermark message in a particular domain. Further, the embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain.
In one example embodiment, the watermark embedder is configured to embed the first and the second watermark messages in a single watermark embedding session, whereas in another example embodiment, the watermark embedder is configured to embed the first and the second watermark messages in different embedding sessions. In yet another embodiment, the watermark embedder is configured to embed one or more symbols of the second watermark message into the host content in a multiplexed fashion with one or more symbols of the first watermark messages. In another example embodiment, the watermark embedder is configured to skip the embedding of one or more symbols of the first watermark message, and use a space vacated by skipping the one or more symbols of the first watermark message for embedding at least one symbol of the second watermark message.
Another aspect of the disclosed embodiments relates to a device that includes a processor and a memory that comprises processor executable code. The processor executable code when executed by the processor configures the device to obtain a payload of a first watermark message for embedding into the host content, obtain a payload of a second watermark message for embedding into the host content, and embed the first and the second watermark messages into the host content in a coordinated fashion such that the embedded first watermark message has a pre-defined relationship with the embedded second watermark message in a particular domain. The embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain.
Another aspect of the disclosed embodiments relates to a computer program product, embodied on a non-transitory computer readable medium. The computer program product includes program code for obtaining a payload of a first watermark message for embedding into the host content, program code for obtaining a payload of a second watermark message for embedding into the host content, and program code for embedding the first and the second watermark messages into the host content in a coordinated fashion such that the embedded first watermark message has a pre-defined relationship with the embedded second watermark message in a particular domain. The embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain.
Another aspect of the disclosed embodiments relates to a device that includes a watermark extractor that is configured to extract a first watermark message from a host content, and a data processing component that is configured to obtain a predefined relationship between the symbols of the extracted first watermark message and symbols of a second watermark message in a particular domain. The watermark extractor is further configured to extract the second watermark message based on the predefined relationship, where the embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain.
In one embodiment where the second watermark message comprises a time-code, the watermark extractor is configured to extract the second watermark message, at least in-part, by extracting the time-code from the second watermark message, determining content timing information from the extracted time code, and determining accuracy of the content timing information. In another exemplary embodiment where the second watermark message comprises a time-code, the watermark extractor is configured to extract the second watermark message, at least in-part, by determining content timing information based on time-codes in a plurality of extracted second watermark messages, determining an error value associated with the content timing information, and setting a new reference timing information if the determined error value is at or below a target error value. In yet another exemplary embodiment, the watermark extractor is further configured to use the time-code to detect content manipulations.
Another aspect of the disclosed embodiments relates to a non-transitory computer-readable storage medium with a host content embodied thereupon. The host content comprises one or more watermarks that are imperceptibly embedded in the host content, wherein reception of the host content by a content handling device equipped with a watermark extractor triggers the watermark extractor to extract a first watermark message from the host content, obtain a predefined relationship between symbols of the extracted first watermark message and symbols of a second watermark message in a particular domain, and extract the second watermark message based on the predefined relationship. The embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain.
Another aspect of the disclosed embodiments relates to a device that includes a processor and a memory. The memory comprise processor executable code such that the processor executable code when executed by the processor configures the device to extract a first watermark message from a host content, obtain a predefined relationship between symbols of the extracted first watermark message and symbols of a second watermark message in a particular domain, and extract the second watermark message based on the predefined relationship. The embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain.
Another aspect of the disclosed embodiments relates to a computer program product, embodied on a non-transitory computer readable medium. The computer program product includes program code for extracting a first watermark message from a host content, program code for obtaining a predefined relationship between symbols of the extracted first watermark message and symbols of a second watermark message in a particular domain, and program code for extracting the second watermark message based on the predefined relationship. The embedded symbols of the first watermark message are substantially non-overlapping with embedded symbols of the second watermark message in the particular domain.
Another aspect of the disclosed embodiments relates to a method that includes embedding a watermark into a host content, where at least a portion of payload of the embedded watermark is generated automatically by a watermark embedder. This method further comprises updating a database to contain an association between the automatically generated portion of the payload and metadata, where the metadata includes one or more identifiers of the host content. By the way of example, and not by limitation, these identifiers can include an International Standard Audiovisual Number (ISAN), a stock keeping unit (SKU), a Uniform Recourse Identifier (URI), a Universal Product Code (UPC), an Advanced Television Systems Committee (ATSC) content identifier, and/or other identifiers in either standard or proprietary numbering systems, as well as descriptive information about the content such as original name, release year, producer, director, cast, genre, story and the like.
In one embodiment, updating the database includes obtaining a copy of the embedded host content after the embedded host content has been publicly distributed, extracting the embedded watermarks, determining the automatically generated portion of the payload from the extracted watermarks, and associating the determined value of the automatically generated portion of the payload with the one or more identifiers of the host content. In another exemplary embodiment, updating the database comprises manually associating the automatically generated portion of the payload with the one or more identifiers of the host content.
According to one embodiment, updating the database comprises obtaining association information between the automatically generated portion of the payload and at least one content identifier that resides at a second database. In one example, information indicative of the association is produced during embedding of the watermark. In another example, information indicative of the association is produced during a watermark verification operation, where the watermark verification operation comprises examining the host content to determine a presence and a value of the embedded watermark.
In another embodiment, updating the database comprises associating the automatically generated portion of the payload with the corresponding metadata that reside at the database and using the corresponding metadata to identify the one or more identifiers of the host content. In yet another embodiment, the above noted method further includes associating the automatically generated portion of the payload with the one or more identifiers of the host content as part of watermark embedding operation, storing the association in an embedder log, and uploading the embedder log information to the database. In one embodiment, the automatically generated portion of the payload is a serial number that is changed for each watermark embedding session.
Another aspect of the disclosed embodiments relates to a device that includes a watermark embedder that is configured to embed a watermark into a host content, the watermark embedder is further configured to generate at least a portion of payload of the embedded watermark automatically. Such a device also includes a communication component configured to communicate updates to a database such that the database contains an association between the automatically generated portion of the payload and metadata, where the metadata includes one or more identifiers of the host content.
In one embodiment, the watermark embedder is configured to associate the automatically generated portion of the payload with the one or more identifiers of the host content and store the association in an embedder log, and the communication component is configured to upload the embedder log information to the database.
Another aspect of the disclosed embodiments relates to a device that includes a processor and a memory that comprises processor executable code. The processor executable code, when executed by the processor, configures the device to embed a watermark into a host content, where the device is further configured to automatically generate at least a portion of payload of the embedded watermark is generated. The processor executable code, when executed by the processor, further configures the device to update a database to contain an association between the automatically generated portion of the payload and metadata at the database, where the metadata includes one or more identifiers of the host content.
Another aspect of the disclosed embodiments relates to a computer program product, embodied on a non-transitory computer readable medium. The computer program product comprises program code for embedding a watermark into a host content, where at least a portion of payload of the embedded watermark is generated automatically by a watermark embedder. The computer program product also includes program code for updating a database to contain an association between the automatically generated portion of the payload and metadata at the database, where the metadata comprising one or more identifiers of the host content.
Another aspect of the disclosed embodiments relates to a method that includes extracting an embedded first watermark message from a content, where the embedded first watermark message is a copy control watermark and copy control rules associated with the extracted first watermark message prohibits unconditional access to the content. This method further includes extracting an embedded second watermark from the content, based on the extracted second watermark message, determining whether or not an exception to the copy control rules exists, and if an exception to the copy control rules exists, and enabling conditional access to the content. The method also includes extracting additional watermark messages while the content is being conditionally accessed, and based on the additionally extracted watermark messages, verifying that conditional access to the content has been fulfilled.
In one embodiment, each of the extracted second watermark message and the additionally extracted watermark messages comprises a time-code. In this embodiment, verifying that the conditional access has been fulfilled includes determining if substantially all time-codes associated conditionally accessible portions of the content have been extracted.
In another embodiment, each of the extracted second watermark message and the additionally extracted watermark messages comprises a time-code. In this embodiment, the exception to the copy control rules comprises allowing access to the content in exchange for viewing of an advertisement that is played back simultaneously with the content during a specific time interval as determined by the time-codes of the extracted second watermark message and the additionally extracted watermark messages. In one example, the advertisement is selected based on the subject matter of the content during the specific time interval.
According to another embodiment, conditional access to the content is determined based on elapsed time from public release of the content. In another embodiment where an exception to the copy control rules does not exist, an alternative to accessing the content is offered to a user. For example, such an alternative can include at least one of: directing the user to a web site where a version of the content can be obtained, informing the user of content show times at one or more movie theatres, a recommendation of similar content and a date on which the content becomes available for sale or rent.
In another embodiment, determining whether or not an exception to the copy control rules exists includes obtaining an identification value associated with the extracted second watermark message, and obtaining information indicative of available exceptions to the copy control rules from a database that comprises metadata associated with the identification value. In one example, the metadata is further used to carry out at least one of: accessing additional information about the content using the Internet, playing games, interacting with other consumers of the content using a social network and purchasing merchandise related to the content.
Another aspect of the disclosed embodiments relates to a device that includes a watermark extractor that is configured to extract an embedded first watermark message from a content, where the embedded first watermark message is a copy control watermark and copy control rules associated with the extracted first watermark message prohibits unconditional access to the content. The watermark extractor further configured to extract an embedded second watermark from the content, and if an exception to the copy control rules exists, enable conditional access to the content. The watermark extractor is also configured to extract additional watermark messages while the content is being conditionally accessed, and based on the additionally extracted watermark messages, verify that conditional access to the content has been fulfilled. This device also includes a watermark assessment component that is configured to determine, based on the extracted second watermark message, whether or not an exception to the copy control rules exists.
In one embodiment where each of the extracted second watermark message and the additionally extracted watermark messages comprises a time-code, the watermark extractor is configured to verify that the conditional access has been fulfilled by, at least in-part, determining if substantially all time-codes associated conditionally accessible portions of the content have been extracted.
In another embodiment where each of the extracted second watermark message and the additionally extracted watermark messages comprises a time-code, the exception to the copy control rules comprises allowing access to the content in exchange for viewing of an advertisement that is played back simultaneously with the content during a specific time interval as determined by the time-codes of the extracted second watermark message and the additionally extracted watermark messages.
In one embodiment, the watermark extractor is configured to determine whether or not an exception to the copy control rules exists by, at least in-part, obtaining an identification value associated with the extracted second watermark message, and obtaining information indicative of available exceptions to the copy control rules from a database that comprises metadata associated with the identification value.
Another aspect of the disclosed embodiments relates to a non-transitory computer-readable storage medium with a content embodied thereupon. The content comprises one or more watermarks that are imperceptibly embedded in the content. The reception of the content by a content handling device equipped with a watermark extractor triggers the watermark extractor to extract an embedded first watermark message from a content, where the embedded first watermark message is a copy control watermark and copy control rules associated with the extracted first watermark message prohibits unconditional access to the content. The watermark extractor is further triggered to extract an embedded second watermark from the content, then based on the extracted second watermark message, determine whether or not an exception to the copy control rules exists, and if an exception to the copy control rules exists, enable conditional access to the content. The watermark extractor is also triggered to extract additional watermark messages while the content is being conditionally accessed, and based on the additionally extracted watermark messages, verify that conditional access to the content has been fulfilled.
Another aspect of the disclosed embodiments relates to a device that includes a processor and a memory that comprises processor executable code. The processor executable code, when executed by the processor, configures the device to extract an embedded first watermark message from a content, where the embedded first watermark message is a copy control watermark and copy control rules associated with the extracted first watermark message prohibits unconditional access to the content. The processor executable code, when executed by the processor, also configures the device to extract an embedded second watermark from the content, then based on the extracted second watermark message, determine whether or not an exception to the copy control rules exists, and if an exception to the copy control rules exists, enable conditional access to the content. The processor executable code, when executed by the processor, further configures the device to extract additional watermark messages while the content is being conditionally accessed, and based on the additionally extracted watermark messages, verify that conditional access to the content has been fulfilled.
Another aspect of the disclosed embodiments relates to computer program product, embodied on a non-transitory computer readable medium. The computer program product includes program code for extracting an embedded first watermark message from a content, where the embedded first watermark message is a copy control watermark and copy control rules associated with the extracted first watermark message prohibits unconditional access to the content. The computer program product also includes program code for extracting an embedded second watermark from the content, program code for, based on the extracted second watermark message, determining whether or not an exception to the copy control rules exists, and if an exception to the copy control rules exists, program code for enabling conditional access to the content. The computer program produce further includes program code for extracting additional watermark messages while the content is being conditionally accessed, and program code for, based on the additionally extracted watermark messages, verifying that conditional access to the content has been fulfilled.
These and other advantages and features of disclosed embodiments, together with the organization and manner of operation thereof, will become apparent from the following detailed description when taken in conjunction with the accompanying drawings.
In the following description, for purposes of explanation and not limitation, details and descriptions are set forth in order to provide a thorough understanding of the disclosed embodiments. However, it will be apparent to those skilled in the art that the present invention may be practiced in other embodiments that depart from these details and descriptions.
Additionally, in the subject description, the word “exemplary” is used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word exemplary is intended to present concepts in a concrete manner. It should be further noted that to facilitate the understanding of the disclosed principals, copy control information (CCI) and extended payload (EP) watermarks are used as exemplary watermark messages. It is, however, understood that the disclosed embodiments are equally applicable to other watermark messages than can be embedded and extracted from multimedia content.
As noted earlier, CCI watermarks traditionally use a small payload to convey copy control information. For example, CCI watermarks can communicate several of a handful of copy management states that include “Copy Once,” “No More Copies,” “No Home Use,” “Trusted Source” and/or other similar states that can be encoded using relatively few bits of information. CCI watermarks typically require a very low false positive detection rate, such as one false detection per 100,000 years of continuous playback of content. Furthermore, CCI watermarks must be designed to provide certain level of immunity against intentional and/or unintentional removal attempts. Such attempts can, for example, include perceptual compression of a content, analog capture and various signal processing operations. Since copy control operations typically occur in consumer devices, CCI watermark extractors must be designed to operate with computational efficiency and low memory and/or footprint configurations. Another consideration for designing CCI watermarks relates to the transparency of embedded watermarks. In typical copy control watermarking applications, it is important that the CCI watermarks are substantially imperceptible when embedded in premium content, such as movies, music, images, and the like.
CCI watermarks are typically embedded redundantly (i.e., repeatedly embedded with the same payloads) throughout a content. This way, the likelihood of successful watermark detection increases even if the content is attacked by, for example, breaking it up into multiple segments. In the so-called mosaic attack, the content is broken up by an attacker and presented to the watermark extractor as multiple segments or files in an attempt to prevent the detection of watermarks. At the output of the watermark extractor, the content is then reassembled for consumption by the users. The redundant embedding of CCI watermarks provides additional benefits when the content is accessed and consumed sequentially. In such a scenario, the copy control policy associated with the CCI watermarks can be enforced upon the detection of a single (or an adequate number of) CCI watermarks, well before the entire content is presented. Furthermore, the redundant embedding of CCI watermarks can be used to improve watermark robustness against additional noise and other impairments that are due to unintentional and/or intentional content processing operations.
Other watermark messages, such as messages that are conveyed using EP watermarks, may require a different set of performance and reliability characteristics. In particular, an EP watermark that is used for content identification may require a false positive detection rate, robustness to standard signal processing operations, immunity against intentional attempts to forge or remove the watermarks, computational complexity of embedding and/or extraction and transparency (i.e. perceptibility) that are different from those required for a CCI watermark. As noted earlier, an EP watermark may be used for different purposes including, but not limited to, identifying one or more of the following: the content itself, the content owner, the distribution channel(s) of the content, the content format, additional features associated with the content, the recipient of the content, a transaction associated with the content, the device that receives, plays or processes the content, a domain or an account which a content belongs to, an entity, such as a person or organization, which owns certain rights associated with the content, and the like. EP watermarks may further include additional commands that control other device or trigger actions of devices, provide content integrity verification, detect content manipulation, or provide auxiliary information for interaction with devices and users.
The differences between performance requirements and intended applications of EP and CCI watermarks have traditionally led to the development and optimization of disparate watermarking technologies for embedding multimedia content with a particular type of watermark. As a result, when multiple watermark messages, such as CCI, EP and other types, are needed to be embedded within a content, these watermarks have been traditionally embedded independently from one another.
The disclosed embodiments provide improvements in watermark transparency, robustness, security, computational complexity of embedding and extraction of watermarks when multiple watermark messages are embedded within the same content. These and other improvements are achieved by coordinating the embedding and/or extraction of different watermarks messages within a content. In some embodiments, coordination of the embedding and extraction of different watermark messages is accomplished by maintaining predefined relationships between the payloads of various watermarks in time, space, frequency and/or other domains. For example, the predefined relationships may be achieved by coordinating the selection of watermark embedding parameters associated with different watermark messages. Such watermark embedding parameters can include, but are not limited to, the media type, payload scrambling or encryption keys, watermark temporal, spatial, and/or band of frequency locations within the content, type of embedding algorithm, frequency and/or phase shift associated with the embedding algorithm, pseudorandom sequence (e.g., in spread-spectrum watermarking systems), and the like.
The watermark embedder 100 of
The watermark embedder 100 can further include time-code generation components 108 and content identification generation components 110 that are responsible for generating time-codes, content ID, serial numbers, and other information that can be formed as part of the payload of watermarks.
Referring back to
The watermark embedders that operate in accordance with the disclosed embodiments can utilize the same or different types of watermarking technologies for embedding multiple watermark messages. In some embodiments, CCI and EP watermarks are embedded in two or more separate embedding operations, regardless of whether or not the same watermarking technology is used. Compared to a single embedding operation, multiple embeddings of watermarks (sometimes also referred to as embedding of multiple watermark layers) can introduce additional perceptual artifacts that negatively impact the transparency of the embedded watermarks within the host content. According to some embodiments, the perceptual impact associated with embedding of multiple watermark messages is reduced by utilizing coordinated embedding techniques that generate both CCI and EP watermark bits according to the same watermarking algorithm, but with a distinct stego key that allows for orthogonal (i.e., mutually non-interfering) embedding of watermarks. Stego key can, for example, include parameters that are associated with the watermarking technology such as particular autocorrelation delay values, frequency shifts, and the like. In one example, after a set of embedding locations are identified, CCI watermarks are embedded into the first subset of these locations and the EP watermarks are embedded in the second subset of these locations which is exclusive from the first subset. In some examples, the adverse impact on the transparency of watermarks due to the presence of multiple layers is mitigated by maintaining the total watermarking energy associated with all layers the same as the watermarking energy associated with a single watermark layer. In some embodiments, the perceptual impact associated with embedding of multiple watermark message is reduced by utilizing one or more coordinated embedding techniques which embeds watermarks in domains that are mutually orthogonal.
At 204, the energy associated with the embedding of the first watermark message is obtained. In one example, the energy is computed as the square value of the difference between content samples with watermark and content samples without watermarks. The operations at 204 can, therefore, include computing a watermark signal associated with watermark packet bits of step 202 as embedded into host content according to a particular watermarking algorithm. Once such a watermark signal is determined, the energy associated with the watermark signal can be determined by, for example, computing a square value of the watermark signal. The determination in step 202 can be conducted for the entire content or for particular segments of the content (e.g., on a segment-by-segment basis). The watermarking energy that is determined at 204 can provide a target watermarking energy for subsequent embeddings of additional watermark messages.
Referring back to
At 208, the bits of the first and the second watermark messages are embedded while maintaining the total watermarking energy below the target energy. To create non-interfering watermarking layers, the embedding of the first and the second watermark messages at 208 may be carried out in accordance with different embedding parameters. The operations at 208 ensure that the embedding of different watermark messages is conducted by maintaining an appropriate level of transparency.
While embedding of multiple layers according to the above noted exemplary embodiment maintains a desirable level of watermark transparency, it may adversely affect the robustness of embedded watermarks due to the reduced energy associated with each watermark message. In some cases, such as embedding of CCI watermarks in audiovisual content, the number of individual marks can be very large. For example, hundreds or even thousands of CCI watermarks can coexist in the same host content. Not all of these watermarks are essential for fulfilling the associated copy control objective. In some embodiments, some of the potential CCI-watermark embedding opportunities are skipped without producing a significant negative impact on the overall performance of the CCI watermarks. In these embodiments, the watermarking space vacated by skipping a fraction of CCI watermarks can be used, instead, for embedding one or more EP watermark bits, with no impact on transparency of embedded watermarks.
In accordance with some embodiments, different watermark messages are embedded within the same content in a time, space and/or frequency-multiplexed fashion.
As illustrated in
It should be further noted that the simplified diagram of
In one experiment that was conducted in accordance with the disclosed embodiments, CCI and EP watermarks were embedded with a symbol ratio of 1-to-1 in time-multiplexed fashion within an audio content. The results obtained from the analysis of a 30-minute audio content with additive white Gaussian noise illustrate a robustness penalty of about 0.56 dB. On the other hand, the results obtained from the analysis of same audio content that is embedded with multiple layers of CCI and EP watermarks with a 50/50 split in watermark energy illustrate a robustness penalty of about 3.69 dB. These results demonstrate the advantage of time-division multiplexing over layering of different of watermarks. Further, the robustness penalty associated with time-division multiplexing decreases as the content during increases, while the penalty associated with layering of watermarks remains about the same.
In some embodiments, all embedding opportunities within a content are first identified based on a particular perceptual criterion. For example, one perceptual criterion may require an extremely high transparency of watermarks for a content that is released for theatrical release. In contrast, another perceptual criterion that is targeted for content distributed over the Internet, rather than requiring absolute transparency, may require the watermarks to be unobjectionable to a casual viewer. Once the embedding opportunities are identified in view of the perceptual criterion, the identified embedding opportunities may be divided among the various watermark types. In other embodiment, the identification of the embedding opportunities may be carried out in view of other criteria, such as computational complexity of watermark extraction, security (i.e., how well particular watermarks can be detected and/or manipulated by unauthorized parties), reliability (e.g., false positive rate) of watermark detection, and the like.
Once the embedding opportunities are identified, the division of embedding opportunities amongst different watermark messages may be based on achieving a one or more of the following: desired security, transparency computational complexity, reliability of watermark detections, content duration, size of watermark payload, application (i.e., usage) of watermarks and other factors. For example, if the detection of CCI messages with high reliability is important, a high CCI-to-EP symbol ratio may be used. In another example, where the detection of content serial numbers is important, a low CCI-to-EP symbol ratio (even a ratio of less than 1) may be used.
According to the disclosed embodiments, embedding of multiple watermark messages can be carried out in a coordinated way, in either a single embedding session or in separate sessions. When multiple watermark messages are embedded in separate sessions at various points during content production, delivery, archive and consumption, additional knowledge is required to be shared among these separate embedding sessions to achieve the same results as if they were embedded in a single embedding session. Such knowledge is often obtained in earlier sessions and passed to the later sessions of embedding.
Alternatively, or additionally, each embedding session may use a predefined template of embedding locations (e.g., in time, space and/or frequency domain) that endures a desired relationship between different payloads. The integrity of the content between separate embeddings must be maintained, at least to some extent, in order to achieve the desired relationship between payloads of the embedded watermarks. In one example embodiment that involves embedding the different watermark messages in different embedding sessions, the first watermark message (e.g., CCI bits) are embedded in a first watermarking session, leaving gaps (e.g., time gaps, space gaps, etc,) within the host content where the second watermark message (e.g., the EP watermark bits) can be embedded. In this example embodiment, during the second embedding session, the symbols (e.g., bits) of the second watermark message are embedded in some or all of the gaps that were not embedded during the first embedding session. In some examples, certain pre-processing operations, such as modification of the host content to effect masking, are carried out only once during one of the embedding sessions. For example, a masking operation may be carried out only during the first embedding session. In some examples, the first and second watermark messages are embedded at the same locations in two separate sessions in such a way that the level of modifications (e.g. watermark energies) introduced by each watermark message is predefined in value or proportion.
In some embodiments, the host content that is produced in a single-session embedding is identical to the host content that is produced in a multi-session embedding operation. In another embodiment, the host content that is produced in a single-session embedding is not identical to the host content that is produced in a multi-session embedding operation. For example, in a two-session embedding, if masking operations are carried out during each of the embedding sessions, the resulting host content would not be identical to the host content that is produced in a single-embedding session that uses a single masking operation. In this example, however, the embedded host content that is generated pursuant to a multi-session embedding is substantially similar to the host content that is generated pursuant to a single-session embedding.
Referring back to
At 408, the first watermark message is embedded and, at 410, the second watermark message is embedded. It should be noted that both watermark messages can be embedded in a single session, or in separate embedding sessions. Moreover, in some embodiments, the operations at 404, 406 and 410 are carried out separate from, and at a later time than, the operations at 402 and 408. In an alternate embodiment, the operations at 402, 406 and 408 are carried out separate from, and at a later time than, the operations at 404 and 410.
Besides coordinated embedding across time, space and/or frequency domains, in some embodiments, embedding coordination across different watermarking technologies is also maintained. In particular, certain watermarking technologies that are robust against synchronization attacks can be embedded in a predefined relationship to watermarking technologies that are particularly suitable for carrying large payloads. The utilization of different types of watermarking technologies further facilitates coordinated extraction of watermarks, where, for example, the detection of a watermark with superior synchronization characteristics can precede the detection of the a watermark that carries a large payload.
Furthermore, the watermark embedding coordination that is carried out in accordance with the disclosed embodiments can be carried across different elementary components of a multimedia content. For example, for an audiovisual content, the embedding of audio and video watermarks can be coordinated based on the disclosed embodiments. In one example, the detection of audio watermarks precedes the detection of video watermarks. The information obtained from the detection of audio watermarks can then be used to facilitate the detection of video watermarks that often require a larger processing load.
Another important aspect of a watermarking system is the security of watermarks (i.e., how easily the embedded watermarks can be detected, altered and/or removed by unauthorized parties). In some attack scenarios, security of watermarks can be compromised through differential analysis of the content before and after embedding of watermarks. In other scenarios, an attacker may attempt to perform differential analysis on two contents that are embedded with different watermark values. Certain techniques are available to thwart such analysis by, for example, masking the watermark signal to resemble random (and potentially) large phase variations. However, such masking techniques often involve manipulation of the content, which can create perceptible artifacts when such masking operations are repeated as additional watermarks are embedded into the content during different embedding sessions.
In accordance with the disclosed embodiments, coordinated embedding of different watermark messages can be carried out by embedding the bits associated with different watermark bits and applying a single masking operation. As such, security features associated with applying the masking operation are maintained without compromising the transparency of the embedded watermarks.
Another important advantage of coordinated embedding of the disclosed embodiments relates to facilitating the workflow of operations in a content production facility. Typically content production is associated with tight schedules and resources. Under these conditions, independent embedding of multiple watermark layers, the associated quality assurance operations, and equipment and storage maintenance can be burdensome. The coordinated watermark embedding operations of the disclosed embodiments reduce the number of embedding operations, as well as the associated workflow and maintenance requirements. Such workflow-related improvements are particularly advantageous if the embedding process must be repeated a multiple number of times on the same content. For example, a particular watermark embedding may be required to designate a content as a theatrical release versus a home video, while different embeddings may be needed to differentiate a high-definition release from a standard definition release, an electronic distribution versus a hard copy release, a pre-screener, region code, etc.
In order to further streamline the embedding workflow and minimize the potential for human error during the content production, it is important to minimize user interaction with the embedder engine. When an EP watermark is designed for content identification, the selection of EP values for embedding and associating the selected EP values with the metadata of the particular content can be prone to errors in the final stages of content production.
In accordance with some embodiments, this burden is alleviated in-part by using self-assigned EP values created automatically by the embedder. It is important to ensure that all embedded EP values are unique, i.e. the same EP value doesn't appear in two distinct contents. In one example embodiment, the set of all possible EP values is divided into separate distinct sets and each set of EP values is assigned to a particular embedder. In this example embodiment, each embedder uses a new EP value whenever a new content is submitted for embedding. For example, an embedder running in file mode (i.e., an embedder that operates on a content that is stored in a file) may assume that each file contains a single content and may assign a single EP value per file. Note that a long content may be broken into multiple files, e.g. a feature movie may be broken into reels. According to some embodiments, a user may instruct the embedder to use the same EP value on multiple files. However, in other embodiments, distinct EP values are used for each file, and later, the content is associated with a list of EP values.
According to some embodiments, an EP watermark payload that is designed for content identification contains two fields: Embedder Identification (EID) and Serial Number (SN). The EID field ensures that distinct embedders always create distinct EP values. The SN field is used to distinguish different files embedded with the same embedder. It is essential that the SN field is changed from one input file to another (or more generally, for each embedding session that may include embedding of only portion of the content) in a predefined manner, so that it is not used twice by the same embedder. It is also important that the SN value is saved in, for example, an embedder log file prior to deactivation of the embedder. This way, the embedder can read the embedder log file and continue the orderly process of creating a new SN value upon its next activation. In one example, the SN field is simply incremented by one after each file is processed by the embedder. In other examples, more complex algorithms can be used to ensure that a unique SN value per file is generated. In some embodiments, the embedder can also detect when an allocated set of SN values is exhausted. In such scenarios, the embedder may request additional set of SN values from a higher entity in the decision making hierarchy. For example, the embedder may transmit a request to a central authority to obtain the needed allocation of additional SN values.
When a self-assigned EP value is detected by a content handling device (e.g., a user device), the detected EP value can be used to access certain metadata that is stored at a database. The metadata may, for example, identify the content, the filename, the size of content, and the like. By the way of example, and not by limitation, the metadata includes a content name, content owner, content maker (e.g., artist, director, producer, etc.), content serial number, an industry-standard content identification code, dates corresponding to generation and last modification of the content, content length and content copyright status. The disclosed embodiments further facilitate the generation and retrieval of such metadata. As discussed earlier, it is desirable to avoid manual entry of metadata into the database during the embedding process. According to one example embodiment, the metadata database can be automatically populated, at least in-part, by associating a self-assigned EP value with the filename and/or part of the data fields that may reside in the file header. In some embodiments, the associating can be carried out by the embedder, by a module or entity that resides at the database, or by a separate module or entity. In an alternate embodiment, the association may established cooperatively by entities or modules that reside at different locations (e.g., at the embedder, at the database, and elsewhere).
In embodiments that the association is established outside of the database, the association information may then be stored in an embedder log and subsequently uploaded to the database without any interruption of the embedding workflow. By reference to
In one embodiment, providing an association between the EP values and metadata includes establishing the association after a content has been embedded and finalized, or even after the embedded content has been distributed to the public. In such embodiments, the association of the EP values may be based on information such as title, owner, release date, etc., of the content that is publicly available after the release of a content. Such information can, therefore, be readily uploaded from public sources. The finalized or released content can then be subjected to a watermark extraction process in order to obtain the value of the embedded EP watermarks, including the automatically generated portion of the embedded watermarks. The detected EP watermark can subsequently be associated with one or more identifiers of the host content (e.g., the title, owner, etc.) and then stored at a database. By the way of example, and not by limitation, these identifiers can include an International Standard Audiovisual Number (ISAN), a stock keeping unit (SKU), a Uniform Recourse Identifier (URI), a Universal Product Code (UPC), an Advanced Television Systems Committee (ATSC) content identifier, and/or other identifiers in either standard or proprietary numbering systems, as well as descriptive information about the content such as original name, release year, producer, director, cast, genre, story and the like.
In some embodiments, updating the database to include the association between the watermarks and the corresponding metadata can be done manually to establish such an association between at least the automatically-generated portion of the payload with the one or more identifiers of the host content. In some embodiments, the content identifier(s) may reside at a separate database. In such scenarios, the database can be updated (e.g., populated) by looking up the EP watermark payloads in a third-party registry where EPs are registered and associating with one or more content identifiers. For instance, the association can be established during embedding of EP watermarks or during a watermark verification process. The watermark verification process is conducted to ascertain whether or not the host content includes embedded watermarks, and in some applications, whether or not the embedded watermarks have the proper embedded payload values and/or can be detected in sufficient quantities from the content.
In some embodiments, updating the database can be carried out as a two-step process, in which, the first step includes associating the watermark payloads (e.g., the automatically generated portion of the payload) with some metadata. Then as a second step, the associated metadata is used to look up one or more content identifiers.
In some embodiments, the locations of each detected EP watermark within a finalized or released content may also be saved. This information can later be used to analyze the extent and nature of the processing of the content in subsequent to the initial embedding of the watermarks. For example, a failure to detect a significant portion of the embedded EP watermarks may indicate poor quality of the content, for example, due to camcordering, even if the content is saved in high-definition format. During piracy attempts, a content may undergo significant distortions that are due to, for example, camcorder captures, perceptual compression, and other processing operations that are intended to remove the embedded watermarks. As a result, some of the embedded watermarks may be distorted beyond recognition while other watermarks may still survive.
In some embodiments, devices in the field that are equipped with watermark detectors may report various information, such as the locations of extracted watermarks, the type and extent of error correction and distortion compensation techniques used to enable recovery of embedded watermarks, and other information related to the detected EP watermarks. The reported information can be collected and analyzed to assess the effectiveness of different piracy channels and to devise appropriate countermeasures.
According to the disclosed embodiments, self-assigned EP watermark values may also include a time-code. In one example, such a time-code indicates the offset of the EP watermark with respect to the beginning of the content. This approach may be useful if a user chooses to submit for embedding a file that contains a set of distinct contents, e.g. a number of files are concatenated before embedding. If the concatenated files are embedded using the embedder ID and serial number only, all the files (i.e. distinct contents) will carry the same watermark payload and cannot be distinguished. However, if time codes are embedded in the concatenated file, even if the same embedder ID and serial number are embedded, it is possible in post embedding analysis to associate a different set of EP values, having distinct time codes, with each of distinct contents, thereby providing a mechanism for uniquely identifying each content.
Embedded time-codes can be used to identify partial reproductions of a content within a distinct work, or to identify out of order reproduction of the content (as in a mash-up). Similarly, time-code information may be used to identify spurious capture of a content during, for example, creating a home video while a content marked with audio watermarks plays in the background. In particular, a home video that contains spurious recordings of a watermarked content usually does not include the time-codes from the beginning or ending of a watermarked content. Further, such a home video is likely to contain a broken timeline of watermarks that is indicative of frequent record-stop record actions. In contrast, a pirated content is expected to contain an uninterrupted timeline of watermarks that spans the entire content.
In some cases, it is desirable to know which portions of a content are being currently played (e.g. which scenes, dialog portions, tunes, etc.). Such information can further enable external special effects (outside the playback) that are provided in synchronization with the content that is being currently played back. For examples, such special effects can include external sounds, visual effects, controlled access to switches, buttons or keys, and the like, that may enhance the user experience, or may entertain, educate, or advertise. The detection of time-codes that are embedded in accordance with the disclosed embodiments enable the extraction of timing information that is necessary to enable interaction with outside entities (e.g. remote servers) to, for example, provide audio-visual special effects or metadata that are contextually relevant.
In the case real-time embedding, such as the case where a live event is embedded on-the-fly, the self-assigned codes may not have the SN field at all, and the content identification may be solely achieved using the EID and time-codes. The time-code value that is embedded in each segment of a content may be referenced to the beginning of the embedding process. The time code may, additionally, or alternatively, be associated with the absolute date-and-time saved in the embedder log. In one example, the time-code may represent the minute count from the beginning of the 21st Century. Such a time-code can be provided by using a 26-bit field that can uniquely identify each minute of this century. Using such an absolute time-code, in scenarios where SN field is not used (or is not present), the detected EID value can be used to identify the transmission source (e.g., the broadcast station) and detected time-code can be used to determine the particular programming of the transmission source, without retrieving the embedder logs. For example, publicly available station schedules can be used to obtain programming information.
It should be noted that, in some embodiments, each segment of a content can carry multiple watermarks with the same time-code information. This approach is beneficial since it increases the likelihood that at least some, if not all, watermarks can be embedded within a content even if certain sections of the content are not able to support the embedding of watermarks. Moreover, the embedding of multiple watermarks produces a level of redundancy that enables the recovery of a time-code even if some of the embedded watermarks are distorted or degraded due to content processing.
In the sections that follow, example procedures for determining the playback timeline of a content based on self-assigned time-codes are provided. The required accuracy for timeline identification can vary based on the particular application of the timeline identification. In one example, the detection of embedded watermarks triggers the insertion of certain advertisements during a specific scene within the content. While, in this example, it is important that the scene is properly identified, the timing accuracy of the delivery of the advertisement may not be critical. In contrast, the accuracy of timing information identification may be critical in other applications, such as when the detection of an embedded watermark triggers the playback of a prerecorded tune that must be played back in synchronization with the original content.
Consider the case where the time-code is sequentially increased after every time-code interval, Tc, while the EID and the (optional) SN are left unchanged. Further, assume that every watermark embedded within the interval [(N−1)*Tc, N*Tc], for N=1, 2, 3, . . . , carries the time-code N. Now assume that the watermark extractor finds a watermark with time-code N located within bounds [T1, T2], where T2−T1<Tc (i.e. the watermark duration is shorter than the time-code interval). In some embodiments, Tc is known to both the embedder and the extractor. T1 and T2 are time values designating the start and end of the time-code N that are measured at the extractor. In one example embodiment, T1 and T2 are measured relative to the beginning of the playback of the content (i.e., the time elapsed since the start of content playback). In another example embodiment, T1 and T2 are measured relative to the beginning the activation of the extractor. In still another example embodiment, T1 and T2 are time values that are produced by a real-time clock at the extractor. Regardless of how T1 and T2 are measured, in some embodiments, the reference value (e.g., the zero time point) for T1 and T2 measurements is not critical as long as the same time measurement technique is used for relevant actions of the device, such as contextual advertisement, enforcement actions and the like. Using the above information, it can be estimated that the Nth time-code interval has started at:
T(N)=(T1+T2−Tc)/2 (1).
In Equation (1), T(N) represents the start of the Nth time-code interval. The timing error, Te, associated with T(N) is given by:
Te=±(Tc+T1−T2)/2 (2).
If multiple watermarks with identical time-code, N, and identical EP values are detected, the interval [T1, T2] can be adjusted so that T1 corresponds to the beginning of the first such watermark, and T2 corresponds to the end of the last such watermark. Note that, in the best case, we could obtain T2−T1=Tc, T(N)=T1, and Te=0.
Now consider one or more watermarks that are detected with the next time-code value, N+1, located within bounds [T3, T4], all having the same EID and (optionally) SN values. With this information, it can be estimated that the (N+1)st time-code interval has started at:
T(N+1)=(T3+T2)/2 (3).
In Equation (3), T(N+1) represents the start of the (N+1)st time-code interval. The timing error, Te, associated with T(N+1) is given by:
Te=±(T3−T2)/2 (4).
Note that the best accuracy is achieved when T3=T2, i.e. Te=0. In the case that is illustrated by Equations (3) and (4), the timing information is extracted by observing the transition between two time-codes, while case that is illustrated by Equations (1) and (2), the timing information is obtained by observing the range of a particular time-code.
In some embodiments, the watermark extractor, or a component therein, continually calculates, and keeps track of, the start times of the time-code intervals and the associated errors. Based on the error value, a new Tc start-time can be set as a reference time-code interval start time and used for further time measurements. For example, an error value below a threshold, an error value of zero, a minimum error value within a range of possible error values, and the like, can trigger the setting of the new start-time. Alternatively, or additionally, any error value that is smaller than the one associated with the current Tc start-time can trigger the setting of a new Tc start-time. The selection of a new Tc start-time allows the measurement of time, with accuracy Te, by measuring playback time of the content by, for example, counting video frames or audio samples.
The extracted time-codes can also be used to detect content manipulation, such as cuts, insertions, and/or content reordering. For example, consider a detection of time codes N and M in intervals [T1, T2] and [T3, T4], respectively, where T3>T2. Content reordering can be established if M<N. Insertions can be established if:
T(4)−T(1)>(M−N+1)Tc, (5).
Cuts can be established if:
T(3)−T(2)<(M−N−1)Tc, (6).
At 508, it is determined if the target (or desired) accuracy has been obtained. Such a target accuracy can, for example, correspond to a zero-valued timing information error that is computed using Equations (2) or (4). In other examples, the target accuracy may correspond to a timing information error that is lower than previously computed timing information errors. In still other examples, the target accuracy can correspond to the minimum timing information error value computed for several consecutive extracted watermarks. If the determination at 508 indicates that the target accuracy is obtained, the operations 500 continue at 510, where a new reference timing information is set. For example, a new time-code interval start-time can be set as a reference time-code interval start time and used for further time measurements. Upon setting the new reference timing information at 510, the operations 500 can return to 502 to extract another embedded watermark.
If the determination, at 508, indicates that the target accuracy is not obtained, the operations 500 continue to 502, where a new watermark is extracted. The timing information, as well as the associated accuracy, may be reported, at 512, to a user and/or to other entities or components that are interested in obtaining the timing information.
In some embodiments, the extraction of multiple watermark messages is conducted in such a way that certain knowledge (such as locations and embedding methods) associated with each extracted watermark is shared during the extraction of other types and/or the same type of watermark. The coordinated extraction operations that are conducted in accordance with the disclosed embodiments can be performed in a single watermark extraction session (sometimes referred to as a single-pass extraction), or in multiple passes or sessions. In multi-pass or multi-session extraction, the information associated with the extraction of watermarks in a first pass can be used during the subsequent extraction sessions.
Some of the disclosed embodiments are described in the context of coordinated extraction of CCI and EP watermarks. However, it should be understood that the disclosed embodiments are equally applicable to the extraction of other watermark messages.
CCI watermarks illustrate a practical use case for the implementation of the disclosed embodiments since some content owners presently require CCI watermark extractors (also sometimes referred to as watermark detectors) as a precondition for access to the premium content (such as high-definition content, new releases, content in 3D format, content with additional features such as director's commentary, etc.). In one example, such a mandate for having watermark extractors is implemented by providing content decryption keys only to devices or software applications that are compliant, i.e., those devices or software applications that implement CCI watermark detectors and observe CCI enforcement policies.
EP watermarks, as noted earlier, may serve various purposes such content identification and/or forensic tracking. In forensic tracking applications, the payload of an EP watermark can be used to uniquely identify each copy of a content that has been received by a particular recipient, or has been distributed through a particular distribution channel. If the content is misused, e.g. copied and redistributed without permission, the responsible party can be identified. Typically, this type of application requires a large watermark payload, which negatively affects the watermark robustness. Furthermore, the attacker may obtain multiple copies of the same content that is embedded with different watermarks and combine them (e.g., cutting-and-spicing different segments from different copies, averaging the content across all copies, etc.) in order to prevent watermark extraction, which is often called collusion attack. Coordinated embedding of a payload that is not copy-dependent and thus not susceptible to collusion attack, can be used for automatic identification of the presence of forensic watermarks, which can trigger forensic analysis of the watermarked content. Since forensic watermarks are often less robust than copy independent watermarks, such as CCI watermarks, the presence of robust copy-independent marks can facilitate the identification forensic marks in a content that has been subjected to collusion attack. Forensic analysis of the attacked content may include additional, and often computationally expensive, operations that can lead to the extraction of embedded forensic marks. For example, such additional operations can include, but are not limited to, comparison of a received content to the original content, comparison of the candidate extracted watermarks to a list of possible embedded forensic marks (e.g., using template matching techniques) and utilizing more powerful error correction techniques (e.g., iterative decoding, soft error correction, etc.). These additional operations can be justified only if there is a strong confirmation that forensic marks are indeed present in the content. Such a confirmation can be provided by the detection of copy-independent watermarks in the content.
The extraction of EP watermarks in a consumer device can provide additional benefits such as enabling automatic recognition of a song title or a product when alternate methods of identification, such as printed name or a bar code, are unavailable or unsuitable. As noted earlier, EP watermarks can also be used to enable interactions with outside entities or to provide enhanced viewing experiences by triggering the insertion of special effects into the content. The implementation of a stand-alone EP watermark extractor, however, implies significant cost increases in terms of development effort and processing resources at the consumer devices. In some scenarios, EP watermarks may coexist with CCI watermarks within the same content. In these scenarios, EP watermarks may need to be extracted in the same extraction session as CCI watermarks and/or in a different session (or even at a different location) during the content lifecycle. The disclosed embodiments further facilitate the inclusion of EP watermark detectors in consumer devices by coordinating the operations associated with the extraction of EP and CCI watermarks, thereby reducing the processing load that would have been required if stand-alone CCI and EP extractors were deployed.
According to the disclosed embodiments, the extraction of EP watermarks can be facilitated based on a predefined relationship between the embedded EP and CCI watermarks. Such a predefined relationship can, for example, prescribe a pre-defined arrangement of the EP and CCI watermark bits relative to one another in spatial, temporal and/or frequency domains.
Referring back to
According to the disclosed embodiments, the inclusion of an EP watermark extractor in addition to an existing CCI watermark extractor is effected at a small incremental cost. As described earlier, the EP watermarks can be embedded as a symbol-replacement of a fraction of CCI watermarks without a change in watermarking technology. Therefore, the certain operations (and the associated components) that are needed for the extraction of individual watermark bits, such as filtering and correlation computations, can be carried out once to enable coordinated detection of both CCI and EP watermark symbols. The only additional processing that is required pertains to pattern recognition (e.g., packet formation and decoding) of EP watermarks, and subsequent interpretation of the detection results. The additional processing operations are typically carried out with little additional cost.
Referring back to
In embodiments that utilize the same technology for embedding both the CCI and EP watermarks, coordinated extraction of multiple watermark messages can be efficiently carried out by conducting all or a portion of the back-end processing operations only once. In these embodiments, all or a portion of the front-end processing operations may be carried out for each type of embedded watermark message. However, the front-end processing operations typically do not require a significant processing load. Front-end processing operations are further streamlined when some of the front-end processing operations associated with one type of watermark message, such as an EP watermark, are carried out based on a predefined relationship with the bits of other types of watermark messages, such as a CCI watermark.
The watermark extractor 700 of
The watermark extractor 700 also includes a communication component 712 that enables the watermark extractor 700 to communicate with other entities and components, such as the database 722, through the communication link 724. The database 722 can, for example, include metadata associated with a particular content. In some embodiments, the communications between the watermark extractor 700 and the database 722 includes the transmission of extracted watermark bits and the reception of information such as enforcement rules, enforcement rule alternatives and other information. In some embodiments, watermark assessment components 728 can be responsible, at least in-part, for assessing the enforcement policies associated with the extracted watermark bits, presenting a particular enforcement policy to the user and determining if an exception to the watermark enforcement policies exists. The watermark assessment components 728 can be configured to communicate with internal storage units 714, and/or external entities, such as database 722, through, for example, communication link 724.
According to some embodiments, the extraction of CCI watermarks is used as the first step in the process of coordinated extraction of CCI and EP watermarks. Due to having a smaller payload, the CCI watermarks are inherently more robust than EP watermarks. As such, when CCI watermarks are successfully extracted, the extraction of EP watermarks can be attempted is a subsequent procedure. In these embodiments, the full processing load associated with the extraction of independent EP watermarks is only rarely scheduled. Moreover, in an unmarked content (e.g., a content that does not include CCI watermarks), the EP watermark extractor may never be invoked. The latter example scenario related to an unmarked content is important since it can preserve memory, time and computational resources. More specifically, some user devices automatically initiate a search for embedded watermarks for all new content that is received by that user device. In such devices, the EP extraction operations are not triggered since the content does not include CCI watermarks.
Another benefit of the disclosed embodiments associated with utilizing a predefined relationship between the CCI and EP watermarks subsequent to the successful detection of CCI watermarks is that the probability of false EP watermark extraction becomes small. This, in turn, enables the embedding of EP watermarks to be done more efficiently by including no (or a reduced amount of) overhead bits associated with, for example, error detection codes, error correction codes and the like. In one example embodiment, EP watermark packets are designed without a packet header that would be normally used to establish the beginning and/or the end of the watermark payload. In such example embodiments, CCI watermarks that are extracted prior to the extraction of EP watermarks fulfill the role of synchronization headers. In fact, in those embodiments, the reliability of CCI watermark extraction can be significantly better than the reliability of typical synchronization header extraction operations. In particular, a well-designed CCI extraction system may produce one false positive per 100,000 years of continuous extraction operation, while a well-designed synchronization header may produce a false synchronization header detection every 10 hours. While the detection of a CCI watermark with high reliability (i.e., with a low false detection probability) can strongly signal the presence of a non-CCI watermark, the detection of a CCI watermark with a false detection probability rate that is higher than what would typically be desired for CCI applications can also trigger an extraction attempt for recovery of the associated EP watermarks. In other examples, a synchronization header is included in the EP watermark packets to further improve the robustness of EP watermark extraction, and/or to allow the extraction of EP watermarks independently from CCI watermarks.
Successful extraction of an EP watermark following a successful CCI watermark extraction provides further assurances that the extraction of the preceding CCI watermark(s) were successful, and improves false watermark detection probability of the CCI watermarks. As such, in some embodiments, CCI watermark packets may be designed to produce a higher false detection probability rate than is required for the copy control system. However, in these embodiments, coordinated detection of the EP and CCI watermarks can collectively achieve the desired false positive detection probability rate. In another embodiment, the detection of an EP watermark may trigger the watermark extractor (or an associated component or entity) to access a database. If a match to the detected EP watermark is obtained within the database, the associated CCI payload can be reported to the extractor (or an associated component or entity) to trigger the appropriate copy control enforcement action. This mechanism can provide a confirmation procedure for verification of the extracted CCI watermark value. In addition, it can allow the application of CCI enforcement policies without the detection of the CCI watermark from the content.
In some embodiments where a CCI watermark is extracted and the EP watermark is not, the coordinated CCI and EP watermark extractor can determine the expected location and payload of the EP watermark. In one example, the watermark extractor assumes that there are no cuts or insertions in the content since the last extracted EP watermark. The extractor can then determine the expected EP watermark value (e.g., the EID, SN or time-code) at the expected location of EP watermark. Once a candidate EP watermark value from the expected EP watermark location is extracted, the candidate value can be compared to the expected EP watermark value in order to ascertain if a match with sufficient confidence level exists. In other examples, the extractor may anticipate some cuts or insertions in the content and predict a set of possible EP watermarks that can be detected when such cuts and insertions are present. The extractor may then ascertain which of the possible EP watermarks provides the best match to the detected candidate watermark value. In case of a match with the sufficient confidence level, the extractor can use this information to proceed with updating timing extraction and content integrity verification (i.e. detection of cuts or inserts).
Note that, according to the disclosed embodiments, the playback timeline can be established using embedded time-codes even if the playback of the content is interrupted. Such an interruption can occur due to, for example, activating a pause or stop button, and then resuming the normal playback of the content at some time in the future. In one embodiment, information extracted from earlier playback sessions of the content are recorded in, for example, an extractor log. The stored information can be restored when playback resumes. With the restored EP information, the precise timing within actual playback (excluding pause and stop intervals) can quickly be achieved.
In some embodiments, a successful extraction of a payload embedded in one component of a content (such as an audio component of a multimedia content) facilitates the detection of a watermark that is embedded in another component (such as a video component) of the multimedia content. In one example, the detection of an audio watermark at a particular temporal location within the content triggers the detection of a video watermark that is located at a predefined position with respect to the detected temporal location. The coordinated watermark embedding and extraction operations across different content components can provide significant savings in computational operations. In particular, video watermark extraction is typically more computationally expensive than audio watermark extraction. On the other hand, video watermarks often can carry more information than audio watermarks and, therefore, can contain important information that cannot be carried by audio watermarks. Coordinated embedding and extraction of video and audio watermarks that is described in the above example embodiment triggers the expensive video processing operations that are needed for the extraction of video watermarks only upon the detection of the associated audio watermarks. It should be noted that the above-noted coordination among components of a content is not limited to audio and video components. For example, the extraction of watermarks in the center channel (i.e., high activity channel) of a multi-channel audio content may be triggered only upon the detection of an audio watermark in a low-activity channel (e.g., Left or Right channel) or a channel with limited frequency content (e.g., the sub-woofer).
The coordinated embedding and extraction of watermarks in accordance with the disclosed embodiments can enable a wide range of applications either individually or collectively in the fields of copy management and protection, content identification and/or forensic tracking of content delivery transaction.
In some embodiments, coordinated detection of the EP watermarks enhances the experience of the content user. As noted earlier, the primary objective of typical CCI watermarks is to limit unauthorized access to the content. For example, Advanced Access Content System (AACS) specifications indicate that if a No Home Use (NHU) mark is detected in a content accessed on a consumer device, the playback and copying of that content must be stopped. The AACS specifications further provide that in case of Trusted Source (TS) mark detection in audiovisual content in the clear (no encryption), the audio component of the content must be muted during the playback, after a predefined time interval (or grace period). Coordinated CCI and EP watermark extraction that are carried out in accordance with the disclosed embodiments further improve the consumer experience by offering some options beyond the strict enforcement of the CCI rules.
In one embodiment, a CCI enforcement operation is overruled when a specific set of conditions approved by the content owner is met. In one example, restrictive CCI enforcement operations are removed upon payment of a fee to the appropriate entity. For instance, upon the detection of a CCI and an associated EP watermark, a database is accessed and the information regarding the payment receiving entity is retrieved. In one variation, a portion of the EP watermark payload, such as the EID field, or the EID field and a range of SN values, is used to identify the content owner. To further enhance the user experience, in one example embodiment, the extractor monitors the embedded time-code information to verify that the entire content is correctly played back before closing the transaction and charging the customer account.
In other embodiments, restrictive CCI enforcement operations may be lifted without a payment, if the customer agrees to view (or listen to) a certain amount of advertisement during playback of the content. In one example, the advertisement is targeted (i.e., it is content-based). The content can be identified, for example, based on the extracted EP watermark information. Further, the advertisement can be inserted in particular segments of the content based on the detected value of the embedded time-codes. The inserted advertisements can be related in some way to the content with embedded watermarks. For example, if the content belongs to a particular studio, the advertisement can be a trailer about another movie from the same studio. In another example, the advertisement can be based on subject matter of the content. For instance, if the content is a movie about martial arts, the inserted trailer can be about another content belonging to the martial art genre. In still another example, during the movie scenes that relate to a tropical island, an advertisement about a tropical island resort may be inserted.
In some embodiments, the advertisements are streamed or downloaded from remote servers, while in other embodiments the advertisements are prepackaged with the content on a DVD, Blu-ray disc or Electronic Sell Through (EST) package. The advertisements can be inserted at the beginning, at the end, or in the middle of the content. When ads are placed in the middle of a content, they are typically inserted during the scene change and/or at a place where specific ads are considered appropriate by advertisement sponsors or agency. Time-codes that are carried by the EP watermarks in accordance with the disclosed embodiments can identify the precise insertion locations (e.g., with an accuracy of within a single video frame) of the advertisements. Furthermore, each time-code may associate a metadata describing the characteristics and categories of the content around the place where an advertisement may be inserted. The metadata may also describe what advertisements are appropriate for insertion into the content, and even specify a list of candidate advertisements.
It should be noted that the placement of advertisement within a content may require manual intervention that includes the selection of the insertion locations, the particular advertisements that are suitable for insertion and manual association of the relevant metadata during the coordinated embedding operations. For example, the embedder may allow the user to manually specify the places for advertisements as a starting point to embed a time-code. The embedder may further ask the user to enter the metadata associated with the time-code in a database for later use.
According to another embodiment, conditional access to the content is determined based on a content's age, such as elapsed time from public release of the content. For example, the enforcement of NHU mark may be lifted if the content is no longer shown in the theaters. Information related to a content's age can be accessed, for example, over the Internet from a database based on the extracted EP watermark values. In other embodiments, a pending CCI enforcement operation is lifted based on a content's quality (e.g. content resolution). For example, enforcement of a detected TS mark may be lifted if the content is presented in a standard-resolution format rather than a high-resolution format. In yet another embodiment, a pending CCI enforcement operation is lifted based on the region where the content is distributed, how the content is distributed and/or who distributed the content (the distribution channel or content source). For example, CCI enforcement may be lifted if the content is accessed from a specific location for promotion and marketing or other purposes. In another case, CCI enforcement may be lifted if the content comes from a specific content source where all contents in such source are legitimately licensed, or have been screened against CCI and fulfilled the CCI enforcement obligations prior to being distributed. Such policy of conditional access may be dynamically specified at any time when such CCI enforcement is performed in a networked environment, such as in a Content Distribution Network (CDN), a cloud distribution network, a networked device, or a Internet Service Provider (ISP).
In still other embodiments, instead of complete lifting of the CCI enforcement actions, the extraction of an EP watermark can lead to a delay of an enforcement action for the benefit of the consumers. For example, a feature movie may be distributed on Blu-ray discs with an audio track that is embedded with TS watermarks. During the playback of the movie, a user may start shooting a home video and inadvertently capture part of the movie's audio track. During the playback of the home video using a media player that is equipped with a watermark extractor, some TS watermarks may be extracted, thereby triggering a TS enforcement action. In order to mitigate this situation, AACS Licensing Authority (AACS LA) requires repeated TS detections over an extended interval (i.e. TS watermark detections should be found in at least seven out of nine consecutive 200-second long intervals). This requirement can, therefore, result in an uninterrupted playback of content with embedded TS marks for at least a 20-minute grace period. Note that this enforcement logic ensures that a new grace period is allowed when unmarked content is played for 10 minutes, which is known as the grace period reset interval. This solution reduces the likelihood of TS enforcements on home videos.
According to the disclosed embodiments, the likelihood of erroneous CCI enforcements can be further reduced if the extractors also observe time-codes and detect discontinuities, such as cuts or insertions in the content. The detection of discontinuities may, for example, trigger an extension of the grace period, or restart the grace period. In one example, if the detected discontinuity is larger than the grace period reset interval, the grace period can be restarted. However, if the detected discontinuity is smaller than the grace period reset interval, the enforcement logic may assume that unmarked content has been played for the period of time equal to the size of the detected discontinuity. The reduction of the likelihood of having erroneous enforcement actions based on discontinuity detection can further enable a reduction in the grace intervals, or otherwise allow adjustments to the enforcement logic to achieve better content protection.
The watermark extraction components 802 provide extraction results, such as the CCI and EP watermark values, user and device information, and other information, to the content and advertisement provision components 806 through the communication channel 814. The communication channel 814 may comprise wired or wireless communication channels. The content and advertisement provision components 806, in return, provide the watermark extraction components 802 with information such as metadata related to the content with embedded watermarks, recommendations on subsequent user and/or device actions, offers to purchase authorized copies of the content that is being played, referrals to other sources of content, targeted and/or contextual advertising, and other information. The content and advertisement provision components 806 may include one or more servers, general computing devices and/or specific devices and the associated software that are configured to receive and process information and commands from the watermark extraction components 802 and provide the appropriate response.
Referring back to
If at 908, the determination indicates that no exceptions are possible, the operations 900 continue to 912, where the existing enforcement policy is enforced. If, on the other hand, the determination at 908 indicates the existence of at least one exception to the enforcement rules, the operations 900 continue at 910, where the enforcement rules are modified. By the way of example, and not by limitation, such modifications can include providing the user with a payment option that allows the user to view the content, enabling the viewing of the content based on the content's age, modifying the quality of the content, enabling the user to view the content upon the user's agreement to view certain advertisements, and other operations. In some embodiments, extraction of additional watermark messages continues while the content is being conditionally accessed. Based on the additionally extracted watermark messages, it can be verified whether or not conditional access to the content has been fulfilled. For example, each of the second watermark message and the additionally extracted watermark messages can each include a time-code that can be used to determine if all, or substantially all of the time-codes associated conditionally accessible portions of the content have been extracted. This way, the consumer can be charged only upon viewing/receiving the entire content, or offered a refund or other incentives if the content is not fully received and/or viewed by the user.
The disclosed embodiments further provide a significantly improved user experience even in scenarios where CCI enforcement rules are left intact. In one example, the user may be informed that the content is available for free downloading at certain distributor sites if the user is willing to enter into a trial subscription. Alternatively, the user may be provided with information as to how the content can be best accessed through legitimate channels, such as play times in nearby theaters, the release date of the content on cable and DVD formats, and other renting or purchasing opportunities on the web. Further, the customer may be offered alternate, legitimate content that closely matches the identified content. The customer may also be offered with critics' ratings and comments, review, trailers, behind scene stories of the content and the like. Such enhanced response associated with CCI enforcement rules may be customized based on one or more sources of information. For example, such enhanced responses may be provided based on one or more of the following: 1) the content handling device information such as device manufacturer, model and/or firmware version; 2) geographic information of the user (e.g., based on registered account information) or device (e.g., IP address for a networked device); 3) user profile such as age, preference, and history; 4) the subject matter of the content; and 5) content release information such as release date, format, languages, etc.
In accordance with some embodiments, the extraction of EP watermarks can be valuable to the consumer even if no CCI enforcement action is pending. For example, the TS mark may be detected in a content that is encrypted and protected with an approved digital rights management (DRM) technology. As such, the content is not subject to a CCI enforcement action. However, the metadata associated with the content may be lost in the content distribution channel, for example, during various format conversions, or the device may not be capable of locating the metadata in each content container. Since watermark data persistently stays with the content, it may be simpler to use the extracted EP watermarks to access the needed metadata from a database, regardless of the content container type and format conversion protocols. The retrieved metadata can be used to access additional information about the content over the Internet, to play games, socialize with other content users or fans, purchase related merchandise, get behind-the scene stories, and the like.
It is understood that the various embodiments of the present invention may be implemented individually, or collectively, in devices comprised of various hardware and/or software modules and components. These devices, for example, may comprise a processor, a memory unit, an interface that are communicatively connected to each other, and may range from desktop and/or laptop computers, to consumer electronic devices such as media players, mobile devices and the like. For example,
Various embodiments described herein are described in the general context of methods or processes, which may be implemented in one embodiment by a computer program product, embodied in a computer-readable medium, including computer-executable instructions, such as program code, executed by computers in networked environments. A computer-readable medium may include removable and non-removable storage devices including, but not limited to, Read Only Memory (ROM), Random Access Memory (RAM), compact discs (CDs), digital versatile discs (DVD), Blu-ray Discs, etc. Therefore, the computer-readable media described in the present application comprise non-transitory storage media. Generally, program modules may include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps or processes. A content that is embedded with watermarks in accordance with the disclosed embodiments may be stored on a storage medium. In some embodiments, such a stored content that includes one or more imperceptibly embedded watermarks, when accessed by a content handling device (e.g., a software or hardware media player) that is equipped with a watermark extractor, can trigger a watermark extraction process, the associated signal processing operations, as well as subsequent operations by the watermark extractor and/or the content handling device.
The foregoing description of embodiments has been presented for purposes of illustration and description. The foregoing description is not intended to be exhaustive or to limit embodiments of the present invention to the precise form disclosed, and modifications and variations are possible in light of the above teachings or may be acquired from practice of various embodiments. The embodiments discussed herein were chosen and described in order to explain the principles and the nature of various embodiments and its practical application to enable one skilled in the art to utilize the present invention in various embodiments and with various modifications as are suited to the particular use contemplated. The features of the embodiments described herein may be combined in all possible combinations of methods, apparatus, modules, systems, and computer program products.
| Number | Name | Date | Kind |
|---|---|---|---|
| 3406344 | Hopper | Oct 1968 | A |
| 3842196 | Loughlin | Oct 1974 | A |
| 3885217 | Cintron | May 1975 | A |
| 3894190 | Gassmann | Jul 1975 | A |
| 3919479 | Moon et al. | Nov 1975 | A |
| 3973206 | Haselwood et al. | Aug 1976 | A |
| 4048562 | Haselwood et al. | Sep 1977 | A |
| 4176379 | Wessler et al. | Nov 1979 | A |
| 4199788 | Tsujimura | Apr 1980 | A |
| 4225967 | Miwa et al. | Sep 1980 | A |
| 4230990 | Lert, Jr. et al. | Oct 1980 | A |
| 4281217 | Dolby | Jul 1981 | A |
| 4295128 | Hashemian et al. | Oct 1981 | A |
| 4425578 | Haselwood et al. | Jan 1984 | A |
| 4454610 | Sziklai | Jun 1984 | A |
| 4464656 | Nakamura | Aug 1984 | A |
| 4497060 | Yang | Jan 1985 | A |
| 4512013 | Nash et al. | Apr 1985 | A |
| 4547804 | Greenberg | Oct 1985 | A |
| 4564862 | Cohen | Jan 1986 | A |
| 4593904 | Graves | Jun 1986 | A |
| 4639779 | Greenberg | Jan 1987 | A |
| 4669089 | Gahagan et al. | May 1987 | A |
| 4677466 | Lert, Jr. et al. | Jun 1987 | A |
| 4686707 | Iwasaki et al. | Aug 1987 | A |
| 4703476 | Howard | Oct 1987 | A |
| 4706282 | Knowd | Nov 1987 | A |
| 4723302 | Fulmer et al. | Feb 1988 | A |
| 4729398 | Benson et al. | Mar 1988 | A |
| 4739398 | Thomas et al. | Apr 1988 | A |
| 4750173 | Bluthgen | Jun 1988 | A |
| 4755871 | Morales-Garza et al. | Jul 1988 | A |
| 4755884 | Efron et al. | Jul 1988 | A |
| 4764608 | Masuzawa et al. | Aug 1988 | A |
| 4764808 | Solar | Aug 1988 | A |
| 4789863 | Bush | Dec 1988 | A |
| 4805020 | Greenberg | Feb 1989 | A |
| 4807013 | Manocha | Feb 1989 | A |
| 4807031 | Broughton et al. | Feb 1989 | A |
| 4840602 | Rose | Jun 1989 | A |
| 4843562 | Kenyon et al. | Jun 1989 | A |
| 4876617 | Best et al. | Oct 1989 | A |
| 4876736 | Kiewit | Oct 1989 | A |
| 4930011 | Kiewit | May 1990 | A |
| 4931871 | Kramer | Jun 1990 | A |
| 4937807 | Weitz et al. | Jun 1990 | A |
| 4939515 | Adelson | Jul 1990 | A |
| 4943963 | Waechter et al. | Jul 1990 | A |
| 4945412 | Kramer | Jul 1990 | A |
| 4967273 | Greenberg | Oct 1990 | A |
| 4969041 | O'Grady et al. | Nov 1990 | A |
| 4972471 | Gross et al. | Nov 1990 | A |
| 4972503 | Zurlinden | Nov 1990 | A |
| 4979210 | Nagata et al. | Dec 1990 | A |
| 5057915 | Von Kohorn | Oct 1991 | A |
| 5073925 | Nagata et al. | Dec 1991 | A |
| 5080479 | Rosenberg | Jan 1992 | A |
| 5113437 | Best et al. | May 1992 | A |
| 5116437 | Yamamoto et al. | May 1992 | A |
| 5161251 | Mankovitz | Nov 1992 | A |
| 5191615 | Aldava et al. | Mar 1993 | A |
| 5200822 | Bronfin et al. | Apr 1993 | A |
| 5210820 | Kenyon | May 1993 | A |
| 5210831 | Emma et al. | May 1993 | A |
| 5213337 | Sherman | May 1993 | A |
| 5214792 | Alwadish | May 1993 | A |
| 5237611 | Rasmussen et al. | Aug 1993 | A |
| 5251041 | Young et al. | Oct 1993 | A |
| 5270480 | Hikawa | Dec 1993 | A |
| 5294962 | Sato et al. | Mar 1994 | A |
| 5294982 | Salomon et al. | Mar 1994 | A |
| 5319453 | Copriviza et al. | Jun 1994 | A |
| 5319735 | Preuss et al. | Jun 1994 | A |
| 5351304 | Yamamoto | Sep 1994 | A |
| 5379345 | Greenberg | Jan 1995 | A |
| 5402488 | Karlock | Mar 1995 | A |
| 5404160 | Schober et al. | Apr 1995 | A |
| 5404377 | Moses | Apr 1995 | A |
| 5408258 | Kolessar | Apr 1995 | A |
| 5414729 | Fenton | May 1995 | A |
| 5424785 | Orphan | Jun 1995 | A |
| 5425100 | Thomas et al. | Jun 1995 | A |
| 5432799 | Shimpuku et al. | Jul 1995 | A |
| 5436653 | Ellis et al. | Jul 1995 | A |
| 5450490 | Jensen et al. | Sep 1995 | A |
| 5452901 | Nakada et al. | Sep 1995 | A |
| 5473631 | Moses | Dec 1995 | A |
| 5481294 | Thomas et al. | Jan 1996 | A |
| 5497372 | Nankoh et al. | Mar 1996 | A |
| 5502576 | Ramsay et al. | Mar 1996 | A |
| 5504518 | Ellis et al. | Apr 1996 | A |
| 5508754 | Orphan | Apr 1996 | A |
| 5519454 | Willis | May 1996 | A |
| 5523794 | Mankovitz et al. | Jun 1996 | A |
| 5526427 | Thomas et al. | Jun 1996 | A |
| 5537484 | Kobayashi | Jul 1996 | A |
| 5579124 | Aijala et al. | Nov 1996 | A |
| 5581658 | O'Hagan et al. | Dec 1996 | A |
| 5581800 | Fardeau et al. | Dec 1996 | A |
| 5592553 | Guski et al. | Jan 1997 | A |
| 5612729 | Ellis et al. | Mar 1997 | A |
| 5613004 | Cooperman et al. | Mar 1997 | A |
| 5636292 | Rhoads | Jun 1997 | A |
| 5664018 | Leighton | Sep 1997 | A |
| 5687191 | Lee et al. | Nov 1997 | A |
| 5687236 | Moskowitz et al. | Nov 1997 | A |
| 5699427 | Chow et al. | Dec 1997 | A |
| 5719619 | Hattori et al. | Feb 1998 | A |
| 5719937 | Warren et al. | Feb 1998 | A |
| 5737329 | Horiguchi | Apr 1998 | A |
| 5752880 | Gabai et al. | May 1998 | A |
| 5761606 | Wolzien | Jun 1998 | A |
| 5764763 | Jensen et al. | Jun 1998 | A |
| 5778108 | Coleman, Jr. | Jul 1998 | A |
| 5787334 | Fardeau et al. | Jul 1998 | A |
| 5805635 | Andrews, Jr. et al. | Sep 1998 | A |
| 5809064 | Fenton et al. | Sep 1998 | A |
| 5809139 | Girod et al. | Sep 1998 | A |
| 5819289 | Sanford, II et al. | Oct 1998 | A |
| 5822360 | Lee et al. | Oct 1998 | A |
| 5822432 | Moskowitz et al. | Oct 1998 | A |
| 5825892 | Braudaway et al. | Oct 1998 | A |
| 5828325 | Wolosewicz et al. | Oct 1998 | A |
| 5832119 | Rhoads | Nov 1998 | A |
| 5841978 | Rhoads | Nov 1998 | A |
| 5848155 | Cox | Dec 1998 | A |
| 5850249 | Massetti et al. | Dec 1998 | A |
| 5850481 | Rhoads | Dec 1998 | A |
| 5862260 | Rhoads | Jan 1999 | A |
| 5870030 | DeLuca et al. | Feb 1999 | A |
| 5887243 | Harvey et al. | Mar 1999 | A |
| 5889868 | Moskowitz et al. | Mar 1999 | A |
| 5892900 | Ginter et al. | Apr 1999 | A |
| 5893067 | Bender et al. | Apr 1999 | A |
| 5901178 | Lee et al. | May 1999 | A |
| 5905800 | Moskowitz et al. | May 1999 | A |
| 5930369 | Cox et al. | Jul 1999 | A |
| 5933798 | Linnartz | Aug 1999 | A |
| 5937000 | Lee et al. | Aug 1999 | A |
| 5940124 | Janko et al. | Aug 1999 | A |
| 5940134 | Wirtz | Aug 1999 | A |
| 5940135 | Petrovic et al. | Aug 1999 | A |
| 5940429 | Lam et al. | Aug 1999 | A |
| 5943422 | Van Wie et al. | Aug 1999 | A |
| 5945932 | Smith et al. | Aug 1999 | A |
| 5949885 | Leighton | Sep 1999 | A |
| 5960081 | Vynne et al. | Sep 1999 | A |
| 5963909 | Warren et al. | Oct 1999 | A |
| 5986692 | Logan et al. | Nov 1999 | A |
| 6021432 | Sizer, II et al. | Feb 2000 | A |
| 6031914 | Tewfik et al. | Feb 2000 | A |
| 6035171 | Takaya et al. | Mar 2000 | A |
| 6035177 | Moses et al. | Mar 2000 | A |
| 6037984 | Isnardi et al. | Mar 2000 | A |
| 6044156 | Honsinger et al. | Mar 2000 | A |
| 6061793 | Tewfik et al. | May 2000 | A |
| 6067440 | Diefes | May 2000 | A |
| 6078664 | Moskowitz et al. | Jun 2000 | A |
| 6094228 | Ciardullo et al. | Jul 2000 | A |
| 6101310 | Terada et al. | Aug 2000 | A |
| 6128597 | Kolluru et al. | Oct 2000 | A |
| 6145081 | Winograd et al. | Nov 2000 | A |
| 6154571 | Cox et al. | Nov 2000 | A |
| 6160986 | Gabai et al. | Dec 2000 | A |
| 6173271 | Goodman et al. | Jan 2001 | B1 |
| 6175627 | Petrovic et al. | Jan 2001 | B1 |
| 6189123 | Anders Nystrom et al. | Feb 2001 | B1 |
| 6209092 | Linnartz | Mar 2001 | B1 |
| 6209094 | Levine et al. | Mar 2001 | B1 |
| 6222932 | Rao et al. | Apr 2001 | B1 |
| 6229572 | Ciardullo et al. | May 2001 | B1 |
| 6233347 | Chen et al. | May 2001 | B1 |
| 6246775 | Nakamura et al. | Jun 2001 | B1 |
| 6246802 | Fujihara et al. | Jun 2001 | B1 |
| 6249870 | Kobayashi et al. | Jun 2001 | B1 |
| 6252972 | Linnartz | Jun 2001 | B1 |
| 6253113 | Lu | Jun 2001 | B1 |
| 6253189 | Feezell et al. | Jun 2001 | B1 |
| 6268866 | Shibata | Jul 2001 | B1 |
| 6278792 | Cox et al. | Aug 2001 | B1 |
| 6282299 | Tewfik et al. | Aug 2001 | B1 |
| 6285774 | Schumann et al. | Sep 2001 | B1 |
| 6289108 | Rhoads | Sep 2001 | B1 |
| 6290566 | Gabai et al. | Sep 2001 | B1 |
| 6330335 | Rhoads | Dec 2001 | B1 |
| 6330672 | Shur | Dec 2001 | B1 |
| 6332031 | Rhoads et al. | Dec 2001 | B1 |
| 6332194 | Bloom et al. | Dec 2001 | B1 |
| 6353672 | Rhoads | Mar 2002 | B1 |
| 6353974 | Graf | Mar 2002 | B1 |
| 6363159 | Rhoads | Mar 2002 | B1 |
| 6373974 | Zeng | Apr 2002 | B2 |
| 6374036 | Ryan et al. | Apr 2002 | B1 |
| 6381341 | Rhoads | Apr 2002 | B1 |
| 6385330 | Powell et al. | May 2002 | B1 |
| 6388712 | Shinohara et al. | May 2002 | B1 |
| 6389152 | Nakamura et al. | May 2002 | B2 |
| 6389538 | Gruse et al. | May 2002 | B1 |
| 6400826 | Chen et al. | Jun 2002 | B1 |
| 6400827 | Rhoads | Jun 2002 | B1 |
| 6404781 | Kawamae et al. | Jun 2002 | B1 |
| 6404898 | Rhoads | Jun 2002 | B1 |
| 6411725 | Rhoads | Jun 2002 | B1 |
| 6415040 | Linnartz et al. | Jul 2002 | B1 |
| 6415041 | Oami et al. | Jul 2002 | B1 |
| 6424726 | Nakano et al. | Jul 2002 | B2 |
| 6427012 | Petrovic | Jul 2002 | B1 |
| 6430301 | Petrovic | Aug 2002 | B1 |
| 6430302 | Rhoads | Aug 2002 | B2 |
| 6442285 | Rhoads et al. | Aug 2002 | B2 |
| 6449367 | Van Wie et al. | Sep 2002 | B2 |
| 6449496 | Beith et al. | Sep 2002 | B1 |
| 6473560 | Linnartz et al. | Oct 2002 | B1 |
| 6477431 | Kalker et al. | Nov 2002 | B1 |
| 6487301 | Zhao | Nov 2002 | B1 |
| 6490355 | Epstein | Dec 2002 | B1 |
| 6496591 | Rhoads | Dec 2002 | B1 |
| 6505160 | Levy et al. | Jan 2003 | B1 |
| 6510233 | Nakano | Jan 2003 | B1 |
| 6510234 | Cox et al. | Jan 2003 | B1 |
| 6512837 | Ahmed | Jan 2003 | B1 |
| 6523113 | Wehrenberg | Feb 2003 | B1 |
| 6529506 | Yamamoto et al. | Mar 2003 | B1 |
| 6530021 | Epstein et al. | Mar 2003 | B1 |
| 6535617 | Hannigan et al. | Mar 2003 | B1 |
| 6550011 | Sims, III | Apr 2003 | B1 |
| 6553127 | Kurowski | Apr 2003 | B1 |
| 6556688 | Ratnakar | Apr 2003 | B1 |
| 6557103 | Boncelet, Jr. et al. | Apr 2003 | B1 |
| 6570996 | Linnartz | May 2003 | B1 |
| 6571144 | Moses et al. | May 2003 | B1 |
| 6574350 | Rhoads et al. | Jun 2003 | B1 |
| 6577744 | Braudaway et al. | Jun 2003 | B1 |
| 6584138 | Neubauer et al. | Jun 2003 | B1 |
| 6590996 | Reed et al. | Jul 2003 | B1 |
| 6590997 | Rhoads | Jul 2003 | B2 |
| 6591365 | Cookson | Jul 2003 | B1 |
| 6592516 | Lee | Jul 2003 | B2 |
| 6598162 | Moskowitz | Jul 2003 | B1 |
| 6614914 | Rhoads et al. | Sep 2003 | B1 |
| 6618484 | Van Wie et al. | Sep 2003 | B1 |
| 6625297 | Bradley | Sep 2003 | B1 |
| 6628729 | Sorensen | Sep 2003 | B1 |
| 6633653 | Hobson et al. | Oct 2003 | B1 |
| 6636615 | Rhoads et al. | Oct 2003 | B1 |
| 6636967 | Koyano | Oct 2003 | B1 |
| 6647128 | Rhoads | Nov 2003 | B1 |
| 6647129 | Rhoads | Nov 2003 | B2 |
| 6654501 | Acharya et al. | Nov 2003 | B1 |
| 6661905 | Chupp et al. | Dec 2003 | B1 |
| 6665419 | Oami | Dec 2003 | B1 |
| 6668068 | Hashimoto | Dec 2003 | B2 |
| 6671376 | Koto et al. | Dec 2003 | B1 |
| 6671388 | Op De Beeck et al. | Dec 2003 | B1 |
| 6674861 | Xu et al. | Jan 2004 | B1 |
| 6674876 | Hannigan et al. | Jan 2004 | B1 |
| 6675146 | Rhoads | Jan 2004 | B2 |
| 6678389 | Sun et al. | Jan 2004 | B1 |
| 6681029 | Rhoads | Jan 2004 | B1 |
| 6683958 | Petrovic | Jan 2004 | B2 |
| 6697944 | Jones et al. | Feb 2004 | B1 |
| 6700990 | Rhoads | Mar 2004 | B1 |
| 6704431 | Ogawa et al. | Mar 2004 | B1 |
| 6707926 | Macy et al. | Mar 2004 | B1 |
| 6721439 | Levy et al. | Apr 2004 | B1 |
| 6728390 | Rhoads et al. | Apr 2004 | B2 |
| 6737957 | Petrovic et al. | May 2004 | B1 |
| 6738495 | Rhoads et al. | May 2004 | B2 |
| 6744906 | Rhoads et al. | Jun 2004 | B2 |
| 6748360 | Pitman et al. | Jun 2004 | B2 |
| 6751337 | Tewfik et al. | Jun 2004 | B2 |
| 6757405 | Muratani et al. | Jun 2004 | B1 |
| 6757908 | Vogel | Jun 2004 | B1 |
| 6760463 | Rhoads | Jul 2004 | B2 |
| 6768807 | Muratani | Jul 2004 | B1 |
| 6771797 | Ahmed | Aug 2004 | B2 |
| 6785399 | Fujihara | Aug 2004 | B2 |
| 6785401 | Walker et al. | Aug 2004 | B2 |
| 6785815 | Serret-Avila et al. | Aug 2004 | B1 |
| 6792542 | Lee et al. | Sep 2004 | B1 |
| 6798893 | Tanaka | Sep 2004 | B1 |
| 6801999 | Venkatesan et al. | Oct 2004 | B1 |
| 6810527 | Conrad et al. | Oct 2004 | B1 |
| 6823455 | Macy et al. | Nov 2004 | B1 |
| 6829368 | Meyer et al. | Dec 2004 | B2 |
| 6829582 | Barsness | Dec 2004 | B1 |
| 6834344 | Aggarwal et al. | Dec 2004 | B1 |
| 6834345 | Bloom et al. | Dec 2004 | B2 |
| 6850555 | Barclay | Feb 2005 | B1 |
| 6850619 | Hirai | Feb 2005 | B1 |
| 6850626 | Rhoads et al. | Feb 2005 | B2 |
| 6856693 | Miller | Feb 2005 | B2 |
| 6871180 | Neuhauser et al. | Mar 2005 | B1 |
| 6880082 | Ohta | Apr 2005 | B2 |
| 6888943 | Lam et al. | May 2005 | B1 |
| 6891958 | Kirovski et al. | May 2005 | B2 |
| 6912010 | Baker et al. | Jun 2005 | B2 |
| 6912294 | Wang et al. | Jun 2005 | B2 |
| 6912315 | Wong et al. | Jun 2005 | B1 |
| 6915002 | Gustafson | Jul 2005 | B2 |
| 6915422 | Nakamura | Jul 2005 | B1 |
| 6915481 | Tewfik et al. | Jul 2005 | B1 |
| 6928233 | Walker et al. | Aug 2005 | B1 |
| 6931536 | Hollar | Aug 2005 | B2 |
| 6944313 | Donescu | Sep 2005 | B1 |
| 6944771 | Epstein | Sep 2005 | B2 |
| 6947571 | Rhoads et al. | Sep 2005 | B1 |
| 6947893 | Iwaki et al. | Sep 2005 | B1 |
| 6952774 | Kirovski et al. | Oct 2005 | B1 |
| 6954541 | Fan et al. | Oct 2005 | B2 |
| 6961854 | Serret-Avila et al. | Nov 2005 | B2 |
| 6973195 | Matsui | Dec 2005 | B1 |
| 6993154 | Brunk | Jan 2006 | B2 |
| 6996249 | Miller et al. | Feb 2006 | B2 |
| 7007166 | Moskowitz et al. | Feb 2006 | B1 |
| 7020304 | Alattar et al. | Mar 2006 | B2 |
| 7024018 | Petrovic | Apr 2006 | B2 |
| 7043049 | Kuzma | May 2006 | B2 |
| 7043536 | Philyaw et al. | May 2006 | B1 |
| 7043638 | McGrath et al. | May 2006 | B2 |
| 7046808 | Metois et al. | May 2006 | B1 |
| 7054461 | Zeller et al. | May 2006 | B2 |
| 7054462 | Rhoads et al. | May 2006 | B2 |
| 7058809 | White et al. | Jun 2006 | B2 |
| 7058815 | Morin | Jun 2006 | B2 |
| 7068809 | Stach | Jun 2006 | B2 |
| 7072492 | Ogawa et al. | Jul 2006 | B2 |
| 7103678 | Asai et al. | Sep 2006 | B2 |
| 7107452 | Serret-Avila et al. | Sep 2006 | B2 |
| 7111169 | Ripley et al. | Sep 2006 | B2 |
| 7113613 | Echizen et al. | Sep 2006 | B2 |
| 7123718 | Moskowitz et al. | Oct 2006 | B1 |
| 7142691 | Levy | Nov 2006 | B2 |
| 7162642 | Schumann et al. | Jan 2007 | B2 |
| 7164778 | Nakamura et al. | Jan 2007 | B1 |
| 7167560 | Yu | Jan 2007 | B2 |
| 7167599 | Diehl | Jan 2007 | B1 |
| 7171020 | Rhoads et al. | Jan 2007 | B2 |
| 7177429 | Moskowitz et al. | Feb 2007 | B2 |
| 7197368 | Kirovski et al. | Mar 2007 | B2 |
| 7206649 | Kirovski et al. | Apr 2007 | B2 |
| 7224819 | Levy et al. | May 2007 | B2 |
| 7231061 | Bradley | Jun 2007 | B2 |
| 7289643 | Brunk et al. | Oct 2007 | B2 |
| 7298865 | Lubin et al. | Nov 2007 | B2 |
| 7319759 | Peinado et al. | Jan 2008 | B1 |
| 7321666 | Kunisa | Jan 2008 | B2 |
| 7334247 | Finseth et al. | Feb 2008 | B1 |
| 7336802 | Kunisa | Feb 2008 | B2 |
| 7346514 | Herre et al. | Mar 2008 | B2 |
| 7369677 | Petrovic et al. | May 2008 | B2 |
| 7369678 | Rhoads | May 2008 | B2 |
| 7389421 | Kirovski et al. | Jun 2008 | B2 |
| 7409073 | Moskowitz et al. | Aug 2008 | B2 |
| 7430670 | Horning et al. | Sep 2008 | B1 |
| 7450727 | Griesinger | Nov 2008 | B2 |
| 7454019 | Williams | Nov 2008 | B2 |
| 7562392 | Rhoads et al. | Jul 2009 | B1 |
| 7581103 | Home et al. | Aug 2009 | B2 |
| 7587601 | Levy et al. | Sep 2009 | B2 |
| 7616776 | Petrovic et al. | Nov 2009 | B2 |
| 7617509 | Brunheroto et al. | Nov 2009 | B1 |
| 7630497 | Lotspiech et al. | Dec 2009 | B2 |
| 7644282 | Petrovic et al. | Jan 2010 | B2 |
| 7660991 | Nakamura et al. | Feb 2010 | B2 |
| 7664332 | Wong et al. | Feb 2010 | B2 |
| 7693297 | Zhang et al. | Apr 2010 | B2 |
| 7698570 | Schumann et al. | Apr 2010 | B2 |
| 7756272 | Kocher et al. | Jul 2010 | B2 |
| 7788684 | Petrovic et al. | Aug 2010 | B2 |
| 7788693 | Robbins | Aug 2010 | B2 |
| 7818763 | Sie et al. | Oct 2010 | B2 |
| 7840006 | Ogawa et al. | Nov 2010 | B2 |
| 7979881 | Wong et al. | Jul 2011 | B1 |
| 7983922 | Neusinger et al. | Jul 2011 | B2 |
| 7986806 | Rhoads | Jul 2011 | B2 |
| 7991995 | Rabin et al. | Aug 2011 | B2 |
| 8005258 | Petrovic et al. | Aug 2011 | B2 |
| 8015410 | Pelly et al. | Sep 2011 | B2 |
| 8055013 | Levy et al. | Nov 2011 | B2 |
| 8059815 | Lofgren et al. | Nov 2011 | B2 |
| 8059858 | Brundage et al. | Nov 2011 | B2 |
| 8106744 | Petrovic et al. | Jan 2012 | B2 |
| 8106745 | Petrovic et al. | Jan 2012 | B2 |
| 8138930 | Heath | Mar 2012 | B1 |
| 8151113 | Rhoads | Apr 2012 | B2 |
| 8155463 | Wong et al. | Apr 2012 | B2 |
| 8189861 | Rucklidge | May 2012 | B1 |
| 8194803 | Baum et al. | Jun 2012 | B2 |
| 8249992 | Harkness et al. | Aug 2012 | B2 |
| 8259938 | Petrovic et al. | Sep 2012 | B2 |
| 8301893 | Brundage | Oct 2012 | B2 |
| 8315835 | Tian et al. | Nov 2012 | B2 |
| 8346532 | Chakra et al. | Jan 2013 | B2 |
| 8346567 | Petrovic et al. | Jan 2013 | B2 |
| 8451086 | Petrovic et al. | May 2013 | B2 |
| 8467717 | Croy et al. | Jun 2013 | B2 |
| 8538066 | Petrovic et al. | Sep 2013 | B2 |
| 8589969 | Falcon | Nov 2013 | B2 |
| 8681978 | Petriovic et al. | Mar 2014 | B2 |
| 8791789 | Petrovic et al. | Jul 2014 | B2 |
| 20010001159 | Ford | May 2001 | A1 |
| 20010021926 | Schneck et al. | Sep 2001 | A1 |
| 20010022786 | King et al. | Sep 2001 | A1 |
| 20010025341 | Marshall | Sep 2001 | A1 |
| 20010044899 | Levy | Nov 2001 | A1 |
| 20010051996 | Cooper et al. | Dec 2001 | A1 |
| 20010054146 | Carro et al. | Dec 2001 | A1 |
| 20020007403 | Echizen et al. | Jan 2002 | A1 |
| 20020010684 | Moskowitz | Jan 2002 | A1 |
| 20020012443 | Rhoads et al. | Jan 2002 | A1 |
| 20020019769 | Barritz et al. | Feb 2002 | A1 |
| 20020033844 | Levy et al. | Mar 2002 | A1 |
| 20020044659 | Ohta | Apr 2002 | A1 |
| 20020052885 | Levy | May 2002 | A1 |
| 20020053026 | Hashimoto | May 2002 | A1 |
| 20020054089 | Nicholas et al. | May 2002 | A1 |
| 20020068987 | Hars | Jun 2002 | A1 |
| 20020078356 | Ezaki et al. | Jun 2002 | A1 |
| 20020080964 | Stone et al. | Jun 2002 | A1 |
| 20020080976 | Schreer | Jun 2002 | A1 |
| 20020082731 | Pitman et al. | Jun 2002 | A1 |
| 20020095577 | Nakamura et al. | Jul 2002 | A1 |
| 20020097873 | Petrovic | Jul 2002 | A1 |
| 20020120849 | McKinley et al. | Aug 2002 | A1 |
| 20020120854 | LeVine et al. | Aug 2002 | A1 |
| 20020126842 | Hollar | Sep 2002 | A1 |
| 20020126872 | Brunk et al. | Sep 2002 | A1 |
| 20020138734 | David et al. | Sep 2002 | A1 |
| 20020154144 | Lofgren et al. | Oct 2002 | A1 |
| 20020168087 | Petrovic | Nov 2002 | A1 |
| 20020178368 | Yin et al. | Nov 2002 | A1 |
| 20020199106 | Hayashi | Dec 2002 | A1 |
| 20030009671 | Yacobi et al. | Jan 2003 | A1 |
| 20030012098 | Sako et al. | Jan 2003 | A1 |
| 20030012403 | Rhoads et al. | Jan 2003 | A1 |
| 20030016825 | Jones | Jan 2003 | A1 |
| 20030021439 | Lubin et al. | Jan 2003 | A1 |
| 20030021441 | Levy et al. | Jan 2003 | A1 |
| 20030028796 | Roberts et al. | Feb 2003 | A1 |
| 20030031317 | Epstein | Feb 2003 | A1 |
| 20030033321 | Schrempp et al. | Feb 2003 | A1 |
| 20030037075 | Hannigan et al. | Feb 2003 | A1 |
| 20030053655 | Barone et al. | Mar 2003 | A1 |
| 20030056213 | McFaddin et al. | Mar 2003 | A1 |
| 20030061489 | Pelly et al. | Mar 2003 | A1 |
| 20030063570 | Katayama et al. | Apr 2003 | A1 |
| 20030063747 | Petrovic | Apr 2003 | A1 |
| 20030070075 | Deguillaume et al. | Apr 2003 | A1 |
| 20030072468 | Brunk et al. | Apr 2003 | A1 |
| 20030076955 | Alve et al. | Apr 2003 | A1 |
| 20030078891 | Capitant | Apr 2003 | A1 |
| 20030081780 | Kim | May 2003 | A1 |
| 20030081809 | Fridrich et al. | May 2003 | A1 |
| 20030112974 | Levy | Jun 2003 | A1 |
| 20030112997 | Ahmed | Jun 2003 | A1 |
| 20030115504 | Holliman et al. | Jun 2003 | A1 |
| 20030131350 | Peiffer et al. | Jul 2003 | A1 |
| 20030152225 | Kunisa | Aug 2003 | A1 |
| 20030174862 | Rhoads et al. | Sep 2003 | A1 |
| 20030177359 | Bradley | Sep 2003 | A1 |
| 20030179901 | Tian et al. | Sep 2003 | A1 |
| 20030185417 | Alattar et al. | Oct 2003 | A1 |
| 20030187679 | Odgers et al. | Oct 2003 | A1 |
| 20030188166 | Pelly et al. | Oct 2003 | A1 |
| 20030190054 | Troyansky et al. | Oct 2003 | A1 |
| 20030190055 | Kalker et al. | Oct 2003 | A1 |
| 20030191941 | Terada et al. | Oct 2003 | A1 |
| 20030200438 | Kirovski et al. | Oct 2003 | A1 |
| 20030223584 | Bradley et al. | Dec 2003 | A1 |
| 20040005076 | Hosaka et al. | Jan 2004 | A1 |
| 20040008864 | Watson et al. | Jan 2004 | A1 |
| 20040009763 | Stone et al. | Jan 2004 | A1 |
| 20040010692 | Watson | Jan 2004 | A1 |
| 20040015400 | Whymark | Jan 2004 | A1 |
| 20040025023 | Yamada et al. | Feb 2004 | A1 |
| 20040025176 | Franklin et al. | Feb 2004 | A1 |
| 20040028255 | Miller | Feb 2004 | A1 |
| 20040042635 | Epstein et al. | Mar 2004 | A1 |
| 20040042636 | Oh | Mar 2004 | A1 |
| 20040073916 | Petrovic et al. | Apr 2004 | A1 |
| 20040078575 | Morten et al. | Apr 2004 | A1 |
| 20040088556 | Weirauch | May 2004 | A1 |
| 20040091111 | Levy et al. | May 2004 | A1 |
| 20040093202 | Fischer et al. | May 2004 | A1 |
| 20040093523 | Matsuzaki et al. | May 2004 | A1 |
| 20040098593 | Muratani | May 2004 | A1 |
| 20040101160 | Kunisa | May 2004 | A1 |
| 20040103293 | Ryan | May 2004 | A1 |
| 20040111740 | Seok et al. | Jun 2004 | A1 |
| 20040120544 | Eguchi et al. | Jun 2004 | A1 |
| 20040133794 | Kocher et al. | Jul 2004 | A1 |
| 20040136531 | Asano et al. | Jul 2004 | A1 |
| 20040151316 | Petrovic | Aug 2004 | A1 |
| 20040169581 | Petrovic et al. | Sep 2004 | A1 |
| 20040174996 | Tewfik et al. | Sep 2004 | A1 |
| 20040202324 | Yamaguchi et al. | Oct 2004 | A1 |
| 20040204943 | Kirovski et al. | Oct 2004 | A1 |
| 20040216157 | Shain et al. | Oct 2004 | A1 |
| 20040250078 | Stach et al. | Dec 2004 | A1 |
| 20040258274 | Brundage et al. | Dec 2004 | A1 |
| 20040260930 | Malik et al. | Dec 2004 | A1 |
| 20050008190 | Levy et al. | Jan 2005 | A1 |
| 20050010779 | Kobayashi et al. | Jan 2005 | A1 |
| 20050013462 | Rhoads | Jan 2005 | A1 |
| 20050025332 | Seroussi | Feb 2005 | A1 |
| 20050050332 | Serret-Avila et al. | Mar 2005 | A1 |
| 20050071283 | Randle et al. | Mar 2005 | A1 |
| 20050071669 | Medvinsky et al. | Mar 2005 | A1 |
| 20050120220 | Oostveen et al. | Jun 2005 | A1 |
| 20050144632 | Mears et al. | Jun 2005 | A1 |
| 20050154891 | Skipper | Jul 2005 | A1 |
| 20050177861 | Ma et al. | Aug 2005 | A1 |
| 20050196051 | Wong et al. | Sep 2005 | A1 |
| 20050202781 | Steelberg et al. | Sep 2005 | A1 |
| 20050242568 | Long et al. | Nov 2005 | A1 |
| 20050251683 | Levy et al. | Nov 2005 | A1 |
| 20050267928 | Anderson et al. | Dec 2005 | A1 |
| 20060005029 | Petrovic et al. | Jan 2006 | A1 |
| 20060056653 | Kunisa | Mar 2006 | A1 |
| 20060062426 | Levy et al. | Mar 2006 | A1 |
| 20060075424 | Talstra et al. | Apr 2006 | A1 |
| 20060104477 | Isogai et al. | May 2006 | A1 |
| 20060190403 | Lin et al. | Aug 2006 | A1 |
| 20060227968 | Chen et al. | Oct 2006 | A1 |
| 20060239501 | Petrovic et al. | Oct 2006 | A1 |
| 20070003103 | Lemma et al. | Jan 2007 | A1 |
| 20070005500 | Steeves et al. | Jan 2007 | A1 |
| 20070033146 | Hollar | Feb 2007 | A1 |
| 20070039018 | Saslow et al. | Feb 2007 | A1 |
| 20070100483 | Kentish et al. | May 2007 | A1 |
| 20070110237 | Tehranchi et al. | May 2007 | A1 |
| 20070143617 | Farber et al. | Jun 2007 | A1 |
| 20070150418 | Ben-Menahem et al. | Jun 2007 | A1 |
| 20070168673 | Van Der Veen et al. | Jul 2007 | A1 |
| 20070177761 | Levy | Aug 2007 | A1 |
| 20070192261 | Kelkar et al. | Aug 2007 | A1 |
| 20070208711 | Rhoads et al. | Sep 2007 | A1 |
| 20070214049 | Postrel | Sep 2007 | A1 |
| 20070223708 | Villemoes et al. | Sep 2007 | A1 |
| 20080002854 | Tehranchi et al. | Jan 2008 | A1 |
| 20080016360 | Rodriguez et al. | Jan 2008 | A1 |
| 20080031463 | Davis | Feb 2008 | A1 |
| 20080037825 | Lofgren | Feb 2008 | A1 |
| 20080209219 | Rhein | Aug 2008 | A1 |
| 20080219643 | Le Buhan et al. | Sep 2008 | A1 |
| 20080228733 | Davis et al. | Sep 2008 | A1 |
| 20080250240 | Celik et al. | Oct 2008 | A1 |
| 20080273861 | Yang et al. | Nov 2008 | A1 |
| 20080281448 | Uhrig et al. | Nov 2008 | A1 |
| 20080298632 | Reed | Dec 2008 | A1 |
| 20080301304 | Chitsaz et al. | Dec 2008 | A1 |
| 20080310629 | Van Der Veen et al. | Dec 2008 | A1 |
| 20080310673 | Petrovic et al. | Dec 2008 | A1 |
| 20080313741 | Alve et al. | Dec 2008 | A1 |
| 20090031134 | Levy | Jan 2009 | A1 |
| 20090033617 | Lindberg et al. | Feb 2009 | A1 |
| 20090100492 | Hicks, III et al. | Apr 2009 | A1 |
| 20090136082 | Zandifar et al. | May 2009 | A1 |
| 20090158318 | Levy | Jun 2009 | A1 |
| 20090172405 | Shiomi et al. | Jul 2009 | A1 |
| 20090175594 | Ann et al. | Jul 2009 | A1 |
| 20090177674 | Yoshida | Jul 2009 | A1 |
| 20090208008 | Lubin | Aug 2009 | A1 |
| 20090262932 | Petrovic | Oct 2009 | A1 |
| 20090319639 | Gao et al. | Dec 2009 | A1 |
| 20090326961 | Petrovic et al. | Dec 2009 | A1 |
| 20100011217 | Tachibana et al. | Jan 2010 | A1 |
| 20100023489 | Miyata et al. | Jan 2010 | A1 |
| 20100034513 | Nakano et al. | Feb 2010 | A1 |
| 20100069151 | Suchocki | Mar 2010 | A1 |
| 20100111355 | Petrovic et al. | May 2010 | A1 |
| 20100115267 | Guo et al. | May 2010 | A1 |
| 20100121608 | Tian et al. | May 2010 | A1 |
| 20100146286 | Petrovic et al. | Jun 2010 | A1 |
| 20100159425 | Hamlin | Jun 2010 | A1 |
| 20100162352 | Haga et al. | Jun 2010 | A1 |
| 20100214307 | Lee et al. | Aug 2010 | A1 |
| 20100226525 | Levy et al. | Sep 2010 | A1 |
| 20100228632 | Rodriguez | Sep 2010 | A1 |
| 20100228857 | Petrovic et al. | Sep 2010 | A1 |
| 20100287579 | Petrovic et al. | Nov 2010 | A1 |
| 20100287609 | Gonzalez et al. | Nov 2010 | A1 |
| 20100332723 | Lin et al. | Dec 2010 | A1 |
| 20110016172 | Shah | Jan 2011 | A1 |
| 20110068898 | Petrovic et al. | Mar 2011 | A1 |
| 20110091066 | Alattar | Apr 2011 | A1 |
| 20110103444 | Baum et al. | May 2011 | A1 |
| 20110123063 | Delp et al. | May 2011 | A1 |
| 20110173210 | Ahn et al. | Jul 2011 | A1 |
| 20110194727 | Guo et al. | Aug 2011 | A1 |
| 20110202687 | Glitsch et al. | Aug 2011 | A1 |
| 20110202844 | Davidson et al. | Aug 2011 | A1 |
| 20110209191 | Shah | Aug 2011 | A1 |
| 20110214044 | Davis et al. | Sep 2011 | A1 |
| 20110214143 | Rits et al. | Sep 2011 | A1 |
| 20110216936 | Reed et al. | Sep 2011 | A1 |
| 20110219229 | Cholas et al. | Sep 2011 | A1 |
| 20110225427 | Wood et al. | Sep 2011 | A1 |
| 20110235908 | Ke et al. | Sep 2011 | A1 |
| 20110255690 | Kocher et al. | Oct 2011 | A1 |
| 20110286625 | Petrovic et al. | Nov 2011 | A1 |
| 20110293090 | Ayaki et al. | Dec 2011 | A1 |
| 20110311056 | Winograd | Dec 2011 | A1 |
| 20110320627 | Landow et al. | Dec 2011 | A1 |
| 20120017091 | Petrovic et al. | Jan 2012 | A1 |
| 20120023595 | Speare et al. | Jan 2012 | A1 |
| 20120026393 | Petrovic et al. | Feb 2012 | A1 |
| 20120072729 | Winograd et al. | Mar 2012 | A1 |
| 20120072730 | Winograd et al. | Mar 2012 | A1 |
| 20120072731 | Winograd et al. | Mar 2012 | A1 |
| 20120084870 | Petrovic | Apr 2012 | A1 |
| 20120122429 | Wood et al. | May 2012 | A1 |
| 20120129547 | Andrews, III et al. | May 2012 | A1 |
| 20120130719 | Petrovic et al. | May 2012 | A1 |
| 20120203556 | Villette et al. | Aug 2012 | A1 |
| 20120203734 | Spivack et al. | Aug 2012 | A1 |
| 20120216236 | Robinson et al. | Aug 2012 | A1 |
| 20120265735 | McMillan et al. | Oct 2012 | A1 |
| 20120272012 | Aronovich et al. | Oct 2012 | A1 |
| 20120272327 | Shin et al. | Oct 2012 | A1 |
| 20120300975 | Chalamala et al. | Nov 2012 | A1 |
| 20120300977 | Petrovic et al. | Nov 2012 | A1 |
| 20120304206 | Roberts et al. | Nov 2012 | A1 |
| 20120308071 | Ramsdell et al. | Dec 2012 | A1 |
| 20130007462 | Petrovic et al. | Jan 2013 | A1 |
| 20130011006 | Petrovic et al. | Jan 2013 | A1 |
| 20130031579 | Klappert | Jan 2013 | A1 |
| 20130060837 | Chakraborty et al. | Mar 2013 | A1 |
| 20130073065 | Chen et al. | Mar 2013 | A1 |
| 20130108101 | Petrovic et al. | May 2013 | A1 |
| 20130114847 | Petrovic et al. | May 2013 | A1 |
| 20130114848 | Petrovic et al. | May 2013 | A1 |
| 20130117570 | Petrovic et al. | May 2013 | A1 |
| 20130117571 | Petrovic et al. | May 2013 | A1 |
| 20130129303 | Lee et al. | May 2013 | A1 |
| 20130132727 | Petrovic | May 2013 | A1 |
| 20130142382 | Petrovic et al. | Jun 2013 | A1 |
| 20130151855 | Petrovic et al. | Jun 2013 | A1 |
| 20130152210 | Petrovic et al. | Jun 2013 | A1 |
| 20130283402 | Petrovic | Oct 2013 | A1 |
| 20130339029 | Petrovic et al. | Dec 2013 | A1 |
| 20140029786 | Winograd | Jan 2014 | A1 |
| 20140067950 | Winograd | Mar 2014 | A1 |
| 20140071342 | Winograd et al. | Mar 2014 | A1 |
| 20140074855 | Zhao et al. | Mar 2014 | A1 |
| 20140075465 | Petrovic et al. | Mar 2014 | A1 |
| 20140075466 | Zhao | Mar 2014 | A1 |
| 20140075469 | Zhao | Mar 2014 | A1 |
| 20140229963 | Petrovic et al. | Aug 2014 | A1 |
| 20140237628 | Petrovic | Aug 2014 | A1 |
| 20140267907 | Downes et al. | Sep 2014 | A1 |
| 20140270337 | Zhao et al. | Sep 2014 | A1 |
| 20140270338 | Zhao et al. | Sep 2014 | A1 |
| 20140279296 | Petrovic et al. | Sep 2014 | A1 |
| 20140279549 | Petrovic et al. | Sep 2014 | A1 |
| 20140325550 | Winograd et al. | Oct 2014 | A1 |
| 20140325673 | Petrovic | Oct 2014 | A1 |
| 20140355817 | Wong et al. | Dec 2014 | A1 |
| 20140376723 | Petrovic | Dec 2014 | A1 |
| 20150016228 | Petrovic et al. | Jan 2015 | A1 |
| 20150016663 | Tehranchi et al. | Jan 2015 | A1 |
| 20150030200 | Petrovic et al. | Jan 2015 | A1 |
| 20150036873 | Petrovic et al. | Feb 2015 | A1 |
| 20150121534 | Zhao et al. | Apr 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 2276638 | Jan 2000 | CA |
| 1447269 | Oct 2003 | CN |
| 1556987 | Dec 2004 | CN |
| 101001354 | Jul 2007 | CN |
| 282734 | Sep 1988 | EP |
| 372601 | Jun 1990 | EP |
| 581317 | Feb 1994 | EP |
| 2166725 | Mar 2010 | EP |
| 2605485 | Jun 2013 | EP |
| 2653964 | Oct 2013 | EP |
| 2782337 | Sep 2014 | EP |
| 2260246 | Apr 1993 | GB |
| 2292506 | Feb 1996 | GB |
| 2358313 | Jul 2001 | GB |
| 2363027 | Dec 2001 | GB |
| 10-150548 | Jun 1998 | JP |
| 11-086435 | Mar 1999 | JP |
| 11-284516 | Oct 1999 | JP |
| 11-284516 | Oct 1999 | JP |
| 11-346302 | Dec 1999 | JP |
| 11-346302 | Dec 1999 | JP |
| 2000-069273 | Mar 2000 | JP |
| 2000-174628 | Jun 2000 | JP |
| 2000163870 | Jun 2000 | JP |
| 2000174628 | Jun 2000 | JP |
| 2001022366 | Jan 2001 | JP |
| 2001-119555 | Apr 2001 | JP |
| 2001-188549 | Jul 2001 | JP |
| 2001-216763 | Aug 2001 | JP |
| 2001-218006 | Aug 2001 | JP |
| 2001245132 | Sep 2001 | JP |
| 2001257865 | Sep 2001 | JP |
| 2001-312570 | Nov 2001 | JP |
| 2001-527660 | Dec 2001 | JP |
| 2001339700 | Dec 2001 | JP |
| 2002-010057 | Jan 2002 | JP |
| 2002-024095 | Jan 2002 | JP |
| 2002-027223 | Jan 2002 | JP |
| 2002-027223 | Jan 2002 | JP |
| 2002-091465 | Mar 2002 | JP |
| 2002091712 | Mar 2002 | JP |
| 2002100116 | Apr 2002 | JP |
| 2002125205 | Apr 2002 | JP |
| 2002135557 | May 2002 | JP |
| 2002-165191 | Jun 2002 | JP |
| 2002176614 | Jun 2002 | JP |
| 2002-519916 | Jul 2002 | JP |
| 2002-232693 | Aug 2002 | JP |
| 2002319924 | Oct 2002 | JP |
| 2002354232 | Dec 2002 | JP |
| 2003-008873 | Jan 2003 | JP |
| 2003-039770 | Feb 2003 | JP |
| 2003-091927 | Mar 2003 | JP |
| 2003134461 | May 2003 | JP |
| 2003-230095 | Aug 2003 | JP |
| 2003-244419 | Aug 2003 | JP |
| 2003-283802 | Oct 2003 | JP |
| 2003316556 | Nov 2003 | JP |
| 2003348324 | Dec 2003 | JP |
| 2004-023786 | Jan 2004 | JP |
| 2004023786 | Jan 2004 | JP |
| 2004070606 | Mar 2004 | JP |
| 2004-163855 | Jun 2004 | JP |
| 2004-193843 | Jul 2004 | JP |
| 2004194233 | Jul 2004 | JP |
| 2004-328747 | Nov 2004 | JP |
| 2004328747 | Nov 2004 | JP |
| 2005051733 | Feb 2005 | JP |
| 2005-094107 | Apr 2005 | JP |
| 2005094107 | Apr 2005 | JP |
| 2005525600 | Aug 2005 | JP |
| 20080539669 | Nov 2008 | JP |
| 20100272920 | Dec 2010 | JP |
| 5283732 | Jul 2013 | JP |
| 1020080087047 | Sep 2008 | KR |
| 20100009384 | Jan 2010 | KR |
| 1020120128149 | Nov 2012 | KR |
| 94-10771 | May 1994 | WO |
| 95-14289 | May 1995 | WO |
| 97-09797 | Mar 1997 | WO |
| 97-33391 | Sep 1997 | WO |
| 98-53565 | Nov 1998 | WO |
| 99-03340 | Jan 1999 | WO |
| 99-39344 | May 1999 | WO |
| 99-45706 | Oct 1999 | WO |
| 99-62022 | Dec 1999 | WO |
| 00-00969 | Jan 2000 | WO |
| 00-13136 | Mar 2000 | WO |
| 00-56059 | Sep 2000 | WO |
| 01-54035 | Jul 2001 | WO |
| 0150665 | Jul 2001 | WO |
| 01-55889 | Aug 2001 | WO |
| 0197128 | Dec 2001 | WO |
| 0213138 | Feb 2002 | WO |
| 02-23883 | Mar 2002 | WO |
| 0219589 | Mar 2002 | WO |
| 03-052598 | Jun 2003 | WO |
| 03102947 | Dec 2003 | WO |
| 2005017827 | Feb 2005 | WO |
| 2005-027501 | Mar 2005 | WO |
| 2005038778 | Apr 2005 | WO |
| 2006051043 | May 2006 | WO |
| 2006116394 | Nov 2006 | WO |
| 2009031082 | Mar 2009 | WO |
| 2010073236 | Jul 2010 | WO |
| 2010135687 | Nov 2010 | WO |
| 2011116309 | Sep 2011 | WO |
| 2013067439 | May 2013 | WO |
| 2013090462 | Jun 2013 | WO |
| 2013090466 | Jun 2013 | WO |
| 2013090467 | Jun 2013 | WO |
| 2013163921 | Nov 2013 | WO |
| 2014144101 | Sep 2014 | WO |
| 2014153199 | Sep 2014 | WO |
| 2014160324 | Oct 2014 | WO |
| 2015013419 | Jan 2015 | WO |
| Entry |
|---|
| A watermarking infrastructure for enterprise document management, Cheung et al, IEEE, 2003. |
| Digital rights management and watermarking of multimedia content for m-commerce applications, Hartung et al, IEEE, 2000. |
| Lacy, C., et al., “Intellectual Property Protection Systems and Digital Watermarking,” Proceedings: Information Hiding, Second International Workshop, Portland, OR, pp. 158-168, 1998. |
| Lin et al., “Detection of image alterations using semi-fragile watermarks”, Proceedings of the SPIE International Conference on Security and Watermarking of Multimedia Contents II, vol. 3971, USA, Jan. 2000 (12 pages). |
| Lin, P.L., “Robust transparent image watermarking system with spatial mechanisms,” The Journal of Systems and Software, vol. 50, Feb. 2000, pp. 107-116. |
| Lotspeich, J., “The Advanced Access Content System's Use of Digital Watermarking,” MCPS '06, Oct. 28, 2006, pp. 19-21. |
| Lu, Chun-Shien et al., “Oblivious Cocktail Watermarking by Sparse Code Shrinkage: A Regional- and Global-Based Scheme”, ICIP, 2000 (vol. III: 13-16). |
| Mason, A., et al., “User Requirements for Watermarking in Broadcast Applications”, IEEE Conference Publication, International Broadcasting Convention (!BC 2000), Amsterdam, Sep. 8-12, 2000 (7 pages). |
| “Microsoft Response to CfP for Technology Solutions to Screen Digital Audio Content for LCM Acceptance,” Microsoft Corp., May 23, 1999. |
| Mintzer, et al., “An Invisible Watermarking Technique for Image Verification,” 1997, pp. 680-683. |
| Mintzer et al., “If one watermak is good, are more better?”, Acoustics, Speech, and Signal Processing, 1999. ICASSP'99., Publication Date Mar. 15-19, 1999, vol. 4, on pp. 2067-2069. |
| Mobasseri. B.G .. et al. “Content Authentication and Tamper Detection in Digital Video”. Image Processing. 2000. Proceedings. 2000 International Conference. vol. 1.2000. p. 458-461. |
| Moulin, P., et al., “Detection-Theoretic Analysis of Desynchronization Attacks in Watermarking,” Tech. Rep. MSR-TR-2002-24, Microsoft Research (Mar. 2002). |
| Muranoi, R., et al., “Video Retrieval Method using ShotID for Copyright Protection Systems,” Proc. SPIE vol. 3527: Multimedia Storage and Archiving Systems III, Nov. 1998, pp. 245-252. |
| Nikolaidis et al., Watermark Detection: Benchmarking Perspectives, 2002 IEEE Conference on Multimedia and Expo (ICME 2002). |
| Office action dated Jul. 21, 2011 in Japanese Application 2008-508985. |
| Office Action dated Mar. 18, 2011 in European Application 03774648.4. |
| Park et al, “Robust and Fragile Watermarking Techniques for Documents Using Bidirectional Diagonal Profiles”, Information and Communications Security: Third International Conference, ICICS 2001, Xian, China, Nov. 13-16, 2001, pp. 483-494. |
| Perez-Gonzalez, et al., “Approaching the capacity limit in image watermarking a perspective on coding techniques for data hiding applications”, Signal Processing, vol. 81, No. 6, Jun. 2001, pp. 1215-1238 (24). |
| Petitcolas, F. A. P.., et al., “Attacks on Copyright Marking Systems” Second Workshop on Informa tion . Hiding, vol. 1525 of Lecture Notes in Computer Science, pp. 218-238, Apr. 1998. |
| Philips Research Liquid Audio Fraunhofer Institute, “Digital Audio Screening Technology for Phased Rollout,” v. 1.0, May 23, 1999. |
| Pytlak, John P. “Anti-Piracy Coding,” URL: http://www.tele.com/pipermail/tig/2003-November/003842.html; Nov. 13, 2003 (2 pages). |
| RSA Laboratory, “Frequently Asked Questions About Today's Cryptography,” Version 4.1, May 2000, pp. 1; 20-33; 54-58; 74-75; 87-88; 101-102; 106-110 and 113-118. |
| Schneier, B., “Applied Cryptography, Second Edition: Protocols, Algorithms and Source Code in C,” Oct. 1995, pp. 9-10, 29-31, 79-80. |
| Shih et al., “Combinational, image watermarking in the spatial and frequency domains”, Pattern Recognition Society 36 pp. 969-975 (2002). |
| Solanki et ai, “Robust Image-Adaptive Data Hiding: Modeling, Source Coding, and Channel Coding”, 41st Allerton Conference on Communications, Control, and Computing, Oct. 2003. |
| Steinebach, M., et al., “StirMark Benchmark: Audio Watermarking Attacks”, Int. Conference on Information Technology: Coding and Computing (ITCC 2001), Apr. 2-4, Las Vegas, Nevada, pp. 49-54, ISBN 0/7695-1062-0, 2001. |
| Tanaka, K. et al. “Secret transmission method of character data in motion picture communication”, SPIE vol. 1605, Visual Communications and Image Processing '91, Visual Communication. pp. 646-649, 1991. |
| TASK AC122—Copy Protection for Distribution Services, Jul. 1, 1997, Http://acad.bg/WISE/english/rd/partners/acts/arealtac122-thtml. |
| Tsai, et al., “Wavelet packet and adaptive spatial transformation of watermark for digital image authentication”, IEEE, Image Processing, 2000, Proceedings. 2000 International Conference on, Publication Date: 2000, vol. 1, on pp. 450-453 vol. 1, abstract, p. 452, section 2, pp. 450-452, section 2. |
| Verance Corporation, “Confirmedia”, PowerPoint presentation made to National Association of Broadcasters; Apr. 24, 2001 (40 pages). |
| Xu, C., et al., “Applications of digital watermarking technology in audio signals”, J. Audio Eng. Soc., vol. 47, No. 10, pp. 805-812, Oct. 1999. |
| Yeung, et al., “An Invisible Watermarking Technique for Image Verification,” 1997, pp. 680-683. |
| Zhao, J., “Applying Digital Watermarking Techniques to Online Multimedia Commerce,” Proc. Int. Conf. on Imaging Science, Systems and Applications (CISSA'97), Jun./Jul. 1997, 7 pages. |
| Zhao, J., “A WWW Service to Embed and Prove Digital Copyright Watermarks,” Proc. European Conf. on Multimedia Applications, Services and Techniques (ECMAST'96), May 1996, pp. 695-710. |
| Adelsbach, A., et al., “Proving Ownership of Digital Content,” Proc. 3rd Int. Workshop on Information Hiding, LNCS vol. 1768, Sep./Oct. 1999, pp. 117,133. |
| Advanced Access Content System (AACS), Pre-recorded Video Book, Revision 0.951, Sep. 28, 2009, 88 pages total. |
| Aggarwal, et al., “Multi-Layer Grid Embeddings,” IEEE, 1985, pp. 186-196. |
| “Audio Watermarking System to Screen Digital Audio Content for LCM Acceptance,” Aris Technologies, Inc., May 23, 1999. |
| Barreto, et al. “Toward Secure Public-Key Blockwise Fragile Authentication Watermarking”, IEEE Proceedings—Vision, Image, and Signal Processing—Apr. 2002, vol. 149, Issue 2, p. 57-62. |
| Boney, L., et al., “Digital Watermarks for Audio Signals,” Dept. of Electrical Engineering, Univ. of Minnesota, Mar. 27, 1996. |
| Caronni, Germano,“Assuring Ownership Rights for Digital Images”, Proceedings of ‘reliable IT systems’ VIS 95, H.H. Bruggermann and W. Gerhardt-Hackl (Ed.), Vieweg Publishing Company, Germany, 1995. |
| Chen, B. and G.W. Wornell, “Quantization index modulation: a class of provably good methods for digital watermarking and information embedding,” IEEE Transactions on Information Theory, vol. 47, No. 4, pp. 1423-1443, 2001. |
| Chou, J. et al., “A Robust Optimization Solution to the Data Hiding Problem using Distributed Source Coding Principles”, Pro. SPIE, vol. 3971, San Jose, CA (Jan. 2000) (10 pages). |
| Chou, J., et al., “A Robust Blind Watermarking Scheme based on Distributed Source Coding Principles”, ACM Multimedia 2000 Los Angeles, CA USA. |
| Cinea Inc., “Forensic watermarking”, 2004. [http://www.cinea.com/whitepapers/forensic—watermarking.pdf] (9 pages). |
| International Search Report for PCT Application No. PCT/US98/09587 dated Aug. 14, 1998. |
| International Search Report for PCT Application No. PCT/US01/26505 dated Feb. 14, 2002. |
| International Search Report for PCT Application No. PCT/US03/31816 dated May 19, 2004. |
| International Search Report for PCT Application No. PCT/US06/31267 dated Aug. 22, 2007. |
| International Search Report for PCT/US2006/015615 dated Jan. 4, 2008. |
| International Search Report for PCT Application No. PCT/US06/25090 dated May 13, 2008. |
| International Search Report for PCT Application No. PCT/US06/15410 dated May 29, 2008. |
| International Search Report for PCT Application No. PCT/US07/16812 dated Sep. 26, 2008. |
| M. Costa, “Writing on Dirty Paper” IEEE Trans. on Info. Theory, IT-29, No. 3, pp. 439-441 (May 1983) (3 pages). |
| Cox, I. J. and J. P. M. G. Linnartz, “Some General Methods for Tampering with Watermarks” IEEE Journal on Selected Areas in Communications, vol. 16, No. 4, May 1998, pp. 587-593. |
| Coxford, A., et al., “Advanced Mathematics: A Preparation for Calculus, Second Edition,” 1978, pp. 35-46. |
| Davidson, M.F., “Music File Filter,” Sony Music, New York, May 23, 1999. |
| Das, et al., “Distributed Priority Queues on Hybercube Architectures,” IEEE, 1996, pp. 620-627. |
| Digimarc®Watermarking Guide, ©1999 Digimarc Corporation, 22 pages. |
| Dittmann, J., “Combining digital watermarks and collusion secure fingerprints for digital images,” Proc. SPIE vol. 3657: Security and Watermarking of Multimedia Contents, Jan. 1999, pp. 171-182. |
| Dittmann, J., “Combining digital watermarks and collusion secure fingerprints for customer copy monitoring”, Proc. IEEE Seminar on Secure Images and Image Authentication, Apr. 2000, pp. 6/1-6/6. |
| Epp et al., “Generalized Scattering Matrices for Unit Cell Characterization of Grid Amplifiers and Device De-Embedding”, IEEE vol. 2, Jun. 1995, pp. 1288-1291. |
| European Search Report for European Application No. 03774648.4 dated Nov. 10, 2010. |
| Furon, T. and P. Duhamel, “An asymmetric watermarking method”, IEEE Trans. Signal Processing, vol. 51, No. 4, Apr. 2003, pp. 981-995. |
| Guth, H. J. et al., “Error- and Collusion-Secure Fingerprinting for Digital Data,” Proc. 3rd Int. Workshop on Information . Hiding, LNCS vol. 1768, Sep./Oct. 1999, pp. 134-145. |
| Hartung, F., et al., “Watermarking of MPEG-2 encoded video without decoding and re-coding,” Proc. SPIE vol. 3020: Multimedia Computing and Networking 97, Feb. 1997, pp. 264-274. |
| Hartung, F., et al., “Digital Watermarking of MPEG-2 Coded Video in the Bitstream Domain,” Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing, Apr. 1997, pp. 2621-2624. |
| Hartung, F., et al., “Watermarking of uncompressed and compressed video,” Signal Processing, vol. 66, May 1998, pp. 283-301. |
| Heegard, C. et al., “On the Capacity of Computer Memory with Defects”, IEEE Trans. Info. Theory, vol. IT-29, No. 5, pp. 731-739 (Sep. 1983) (9 pages). |
| http://www.cryptography.com/technology/spdc/index.html. |
| International Search Report for PCT/US06/015615 dated Jan. 4, 2008. |
| International Search Report for PCT/US06/015410 dated May 29, 2008. |
| Jacobsmeyer, Jay, “Introduction to Error-Control Coding,” Pericle Communications Company, 2004 (16 pages). |
| Kalker, T., “A security risk for publicly available watermark detectors”, Proc. Benelux Info. Theory Symp., Veldhoven, The Netherlands, May 1998. |
| Kalker T., “System Issues in Digital Image and Video Watermarking for Copy Protection,” Proc. IEEE Int. Conf. on Multimedia Computing and Systems, Jun. 1999, pp. 562-567. |
| Kang et al, “A DWT-DFT Composite Watermarking Scheme Robust to 80th Affine Transform and JPEG Compression”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, No. 8, Aug. 2003 |
| Kim, T.Y., et al. “An Asymmetric Watermarking System With Many Embedding Watermarks Corresponding to One Detection Watermark”, IEEE signal processing letters, vol. 11, No. 3, Mar. 2004. |
| Kirovski et al., “Multimedia Content Screening using a Dual Watermarking and Fingerprinting System”, Proceedings of the tenth ACM international conference, pp. 372-381, 2002. |
| D. Kirovski and F.A.P. Petitcolas, “The blind pattern matching attack on watermark systems,” IEEE Trans. Signal Processing, Apr. 2003. |
| Kirovski et al., “Randomizing the replacement attack”, ICASSP, 2004, pp. 381-384. |
| Kirovski, et al., “Multimedia Content Screening using a Dual Watermarking and Fingerprinting System”, Tech. Rep. MSR-TR-2001-57, Microsoft Research Jun. 2001). |
| Kocher, P., et al., “Self-Protecting Digital Content: A Technical Report from the CRI Content Security Research Initiative,” Cryptography Research, Inc. (CRI), 2002-2003 pp. 1-14 |
| Kutter, et al., “The watermark copy attack”, Proc. of the SPIE: Security and Watermarking of Multimedia Content II, vol. 3971, Jan. 2000. |
| Kuznetsov, A.V. et al., An Error Correcting Scheme for Defective Memory, IEEE Trans. Inf. Theory, vol. 4, No. 6, pp. 712-718 (Nov. 1978) (7 pages). |
| “Civolution's 2nd screen synchronisation solution wins CSI product of the year 2011 award at IBC,” IBC Press Release, Hall 2—Stand C30, Sep. 2011 (2 pages). |
| “Content Protection—Self Protecting Digital Content,” http://www.cryptography.com/technology/spdc/index.html, May 2010 (1 page). |
| “Red Bee and Civolution develop companion app for FX UK,” http://www.digitaltveurope.net/19981/red-bee-and-civolution-develop-companion-app-for-fx-uk, Jan. 2012 (2 pages). |
| Bangaleea, R., et al., “Performance improvement of spread spectrum spatial-domain watermarking scheme through diversity and attack characterisation,” IEEE Africon, pp. 293-298, 2002. |
| Cappellini, V., et al. “Robust Frame-based Watermarking for Digital Video,” Proceedings of the 12th International Workshop on Database and Expert Systems Applications, Sep. 2001 (5 pages). |
| European Search Report dated Apr. 12, 2012 for European Patent Application No. 07836262.1 filed Jul. 25, 2007 (12 pages). |
| European Search Report dated Jul. 3, 2012 for European Patent Application No. 12150742.0, filed Oct. 7, 2003 (5 pages). |
| European Search Report dated Nov. 8, 2012 for European Patent Application No. 06785709.4, filed Jun. 27, 2006 (5 pages). |
| European Search Report dated Oct. 24, 2012 for European Patent Application No. 06758537.2, filed Apr. 21, 2006 (6 pages). |
| European Search Report dated Oct. 31, 2012 for European Patent Application No. 06758577.8, filed Apr. 25, 2006 (6 pages). |
| International Search Report and Written Opinion dated Sep. 12, 2014 for International Application No. PCT/US2014/035474, filed Apr. 25, 2014 (17 pages). |
| International Search Report and Written Opinion dated Sep. 15, 2014 for International Application No. PCT/US2014/035539, filed Apr. 25, 2014 (16 pages). |
| International Search Report and Written Opinion dated Apr. 24, 2012 for International Application No. PCT/US2011/051857, filed Sep. 15, 2011 (9 pages). |
| International Search Report and Written Opinion dated Apr. 8, 2013 for International Application No. PCT/US2012/069306, filed Dec. 12, 2012 (12 pages). |
| International Search Report and Written Opinion dated Aug. 25, 2014 for International Application No. PCT/US2014/029564, filed Mar. 14, 2014 (10 pages). |
| International Search Report and Written Opinion dated Aug. 25, 2013 for International Application No. PCT/US2014/026322, filed Aug. 25, 2014 (12 pages). |
| International Search Report and Written Opinion dated Aug. 8, 2014 for International Application No. PCT/US2014/028372, filed Mar. 14, 2014 (18 pages). |
| International Search Report and Written Opinion dated Feb. 28, 2013 for International Application No. PCT/US2012/066138, filed Nov. 20, 2012 (11 pages). |
| International Search Report and Written Opinion dated Mar. 14, 2013 for International Application No. PCT/US2012/069308, filed Dec. 12, 2012 (10 pages). |
| International Search Report and Written Opinion dated Mar. 18, 2013 for International Application No. PCT/US2012/063431, filed Nov. 2, 2012 (10 pages). |
| International Search Report and Written Opinion dated Mar. 25, 2013 for International Application No. PCT/US2012/069302, filed Dec. 12, 2012 (22 pages). |
| International Search Report and Written Opinion dated Mar. 28, 2012 for International Application No. PCT/US2011/051855, filed Sep. 15, 2011 (8 pages). |
| Kirovski, D., et al., “Robust spread-spectrum audio watermarking,” IEEE International Conference on Acoustics, Speech, and Signal Processing, 3:1345-1348, 2001. |
| Maehara, F., et al., “A proposal of multimedial home education terminal system based on flash-squeak OS,” Technical report of the institute of image information and television engineers, 28(43):21-24, Jul. 2004. |
| Office Action dated Jan. 20, 2014 for Japanese Patent Application No. 2013-036990 (6 pages). |
| Office Action dated Jul. 21, 2011 for Japanese Patent Application No. 2008-508985 (6 pages). |
| Office Action dated Mar. 16, 2012 for Japanese Patent Application No. 2008-508985 (8 pages). |
| Office Action dated May 1, 2013 for Japanese Patent Application No. 2011-114667 (6 pages). |
| Office Action dated May 8, 2012 for Japanese Patent Application No. 2009-522802 (4 pages). |
| Office Action dated Nov. 26, 2012 for Japanese Patent Application No. 2011-114667 (8 pages). |
| Office Action dated Nov. 28, 2012 for Japanese Patent Application No. 2011-114666 (8 pages). |
| Seok, J., et al., “A novel audio watermarking algorithm for copyright protection of digital audio,” ETRI Journal, 24(3):181-189, Jun. 2002. |
| Spangler, T., “Social Science,” http://www.multichannel.com/content/social-science, Sep. 2011 (5 pages). |
| Wang, X, et al., “Robust correlation of encrypted attack traffic through stepping stones by manipulation of interpacket delays,” Proceedings of the 10th ACM conference on computer communications security, Oct. 27-30, 2003, Washington D.C., USA. |
| Wolfgang, R., et al., “Perceptual watermarks for digital images and video,” Proceedings of the IEEE, 87(7):1108-1126, Jul. 1999. |
| “ATSC-3.0 Automatic Content Recognition Watermarking Solutions,” ATSC Technology Group, Advanced Television Systems Committee, Inc., Jan. 2014 (6 pages). |
| Baudy, S., et al., “Estimation of geometric distortions in digital watermarking,” IEEE International Conference on Watermarking, (2):885-888, Sep. 2002. |
| European Search Report dated Oct. 14, 2014 for European Patent Application No. 14173053.1, filed Oct. 7, 2003 (5 pages). |
| European Search Report dated Apr. 23, 2015 for European Patent Application No. 12846172.0, filed Nov. 2, 2012 (8 pages). |
| European Search Report dated May 28, 2015 for European Patent Application No. 11825990.2, filed Sep. 15, 2011 (6 pages). |
| European Search Report dated May 29, 2015 for European Patent Application No. 11825992.8 filed Sep. 15, 2011 (6 pages). |
| International Search Report and Written Opinion dated May 28, 2015 for International Application No. PCT/US2015/020282, filed Mar. 12, 2015 (7 pages). |
| International Search Report and Written Opinion dated May 1, 2015 for International Application No. PCT/US2014/052973, filed Aug. 27, 2014 (16 pages). |
| International Search Report and Written Opinion dated Nov. 11, 2014 for International Application No. PCT/US2014/047840, filed Jul. 23, 2014 (15 pages). |
| International Search Report and Written Opinion dated Feb. 25, 2015 for International Application No. PCT/US2014/041166, filed Jun. 5, 2014 (10 pages). |
| Miller, M.L. et al. “Computing the probability of false watermark detection,” Published in the Proceedings of the Workshop on Information Hiding, Dresden, Germany, Sep. 29-Oct. 1, 1999. |
| Miller, M.L. et al. “Informed embedding: exploiting image and detector information during watermark insertion,” IEEE Conference Publication, Image Processing, (3):1-4, Sep. 2000. |
| Office Action dated Dec. 29, 2014 for Chinese Patent Application No. 201180051690.8 (14 pages). |
| Office Action dated Oct. 30, 2014 for Korean Patent Application No. 10-2013-7009718 (8 pages). |
| Office Action dated Mar. 30, 2015 for Korean Patent Application No. 10-2014-7015220 (19 pages). |
| Office Action dated Feb. 3, 2015 for Chinese Patent Application No. 201180051678.7 (27 pages). |
| Wang, H., “Communication-resource-aware adaptive watermarking for multimedia authentication in wireless multimedia sensor networks,” J Supercomput, 64:883-897, 2013. |
| Number | Date | Country | |
|---|---|---|---|
| 20130151856 A1 | Jun 2013 | US |
