The present invention generally relates to content security, and more particularly, to a method, apparatus and system for providing anti-camcorder content for digital cinema media.
Piracy concerns in connection with the theatrical exhibition of motion picture films are well known. For example, in the regular course of exhibiting the film, a customer in the theater may surreptitiously record the film using, e.g., a hand held camcorder. To date, piracy of movie content due to illegal recording is estimated to cost billions in lost revenue.
Current methods of protecting the content include: 1) transmitting patterns in the near-IR spectrum, and 2) modifying the content intended for Digital Cinema projectors to implement visible light anti-camcorder methods.
The first method of a system for protection of movie content (both film and digital) is the method of transmitting near IR images to the screen. The near-IR images may be sensed by a camcorder device, but are not visible to the naked eye. In addition, there is also proposed a system including infrared sensors which senses whether an anti-camcorder system is being used and reports non-usage of the system to assist in enforcement and reporting of an anti-piracy system. While this system is independent of the projection method, the weakness of this system is its reliance on near-IR transmission, for which it is speculated that the use of a specialized near IR filter would render this technique less effective than required for content protection. That is, while one advantage of the near-IR method is that it is display independent, it is speculated that specialized near-IR filters for camcorders might render this technique less than effective.
The second method of modifying the content intended for Digital Cinema projectors is based on the fact that the human eye is not a sampling system whereas a camcorder system is. It proposes high temporal frequency displays which can be modulated with an interfering frequency. Thus, by transmitting frames at other than the standard of 24 Hz, one can take advantage of aliasing and produce various beating patterns in the passband of the camcorder invisible to the naked eye. In addition to modulating the luma of the visible signal, one can also modulate the chroma of the visible signal, and still not be visible.
In addition, others have proposed display blanking intervals that are variable in phase to produce moving or still patterns. However, the above methods are difficult to accomplish in a Digital Light Processing (DLP) display. Still others have proposed multiple primaries chosen to be incompatible with camcorders. This is also difficult and may not work well.
Accordingly, a method, apparatus and system for preventing unauthorized piracy of movie content which avoids the limitations and deficiencies of the previous solutions is highly desirable.
The system and method described herein is applicable to digital cinema projection techniques. The term “anti-piracy content” or “anti-sampling system content” used herein may comprise, for example, content used to thwart camcorders or any other video sampling system used to record content displayed/projected on-screen.
According to one embodiment, a system and method for disrupting an unauthorized sampling system (e.g., camcorder) recording of displayed movie content is provided wherein a ‘disruptive’ display frequency which is capable of producing a disruption (e.g., a brightness flicker) in the unauthorized recorded content is selected. In one embodiment, this disruption may be applied to a selected first set or region of pixels. The actual display frequency comprises a multiple N of the selected disruptive display frequency. For example, N=the number of output frames that is displayed per input frame. To illustrate, in one example where the multiple N=2, pixels of low brightness less than 1/Nth (e.g., if N=2, then 50%) of maximum brightness) will be displayed in every Nth frame, resulting in the disruptive display frequency.
Additional anti-piracy content in the form of, for example, a message or other disruptive pattern (a ‘second disruption’) can further be provided in the displayed image by modulating the brightness in different frames of the every-Nth-frame in a second selected set of pixels. Accordingly, this causes differences in the amount of brightness of the first set of pixels and the second set of pixels as captured by a camcorder, thus making the pattern/message of the second set of pixels visible in a video recording.
Advantageously, a system and method according to embodiments of the present invention provide resultant displayed movie images which include anti-piracy content that is virtually invisible to the naked human eye, yet effective in preventing a useful video sequence from being recorded by a camcorder or other video camera device during playing of the movie. In addition, the anti-piracy content can include a customizable message clearly readable in the pirated content indicating, for example, the theater location, origination, time of presentation, etc., so as to perform effective ‘fingerprinting’ of the pirated content.
In one embodiment of the present invention, a digital cinema anti-piracy system is provided comprising a modulator configured to convert an input signal to a desired disruptive frequency and to analyze a brightness B of each input pixel in an input frame of the signal, the modulator for determining at least the amount of brightness Bj of each pixel to be displayed in each frame j of a set of N frames, wherein the average of all the brightness values Bj in the N set of frames is substantially equal to B, and N is substantially equal to the number of frames output for each input frame.
According to another embodiment, a method for providing anti-piracy content for digital cinema is provided comprising the steps of determining at least one pixel region in an input frame, determining a multiple N of a desired sampling system disruptive frequency, analyzing the brightness B of each pixel in the frame, and determining at least the amount of brightness Bj of each pixel to be displayed in each frame j of a set of N frames, wherein the average of all the brightness values Bj in the N set of frames is substantially equal to B, and N is substantially equal to the number of frames output for each input frame.
The teachings of the present invention can be readily understood by considering the following detailed description in conjunction with the accompanying drawings, in which:
It should be understood that the drawings are for purposes of illustrating the concepts of the invention and are not necessarily the only possible configuration for illustrating the invention. To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures.
Embodiments of the present invention provide a method, apparatus and system for providing anti-piracy content for digital cinema. Although the present principles will be described primarily within the context of a specific digital cinema system, the specific embodiments of present principles should not be treated as limiting the scope of the invention. It will be appreciated by those skilled in the art and informed by the teachings of the present principles that the concepts of the present principles can be advantageously applied in other environments in which anti-piracy content is desired.
The functions of the various elements shown in the figures can be provided through the use of dedicated hardware as well as hardware capable of executing software in association with appropriate software. When provided by a processor, the functions can be provided by a single dedicated processor, by a single shared processor, or by a plurality of individual processors, some of which can be shared. Moreover, explicit use of the term “processor” or “controller” should not be construed to refer exclusively to hardware capable of executing software, and can implicitly include, without limitation, digital signal processor (“DSP”) hardware, read-only memory (“ROM”) for storing software, random access memory (“RAM”), and non-volatile storage. Moreover, all statements herein reciting principles, aspects, and embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future (i.e., any elements developed that perform the same function, regardless of structure).
According to the embodiment of the present invention of
The modulator 107 can further include a pixel identifier 113 for determining on which region (e.g., Region 1, Region 2, or a transition region) of a frame the pixel is located. The modulator 107 can further include an amplitude modulator 111 configured to provide modulated brightness values, Bj, of each selected pixel in accordance with a determined multiple, N, of a desired disruptive frequency and relative to a brightness, B, of each pixel. In various embodiments of the present invention, the amplitude modulator 111 can also function as a frame repeater. For example, the amplitude modulator 111 can be configured to perform the steps of the processes as described in
The modulator 107 can further include a database (not shown) for storing, for example, anti-piracy content in the form of pre-determined images, letters, numbers, designs, logos, etc., for creating identifiable messages in pirated content. Such messages can inform a viewer of the pirated material of the origins, location, nature, etc. of the pirated material. Such database can also be externally provided on a server accessible via a network (e.g., the Internet). In various embodiments of the present invention, the amplitude modulator 111 can further include the ability to create new or customized anti-piracy content.
For example, according to an aspect of the present invention, anti-sampling system content can comprise modulated visible light, wherein the luma value (quantity representative of luminance information) of each pixel is temporally modulated. Such modulation is virtually invisible to the naked human eye, yet readily detectable on a recording of modulated content made by a sampling system such as a camcorder.
Camcorders typically operate on a few discrete temporal frequencies (e.g., 60 Hz, 50 Hz, 24 Hz, etc). According to an embodiment of the present invention, a digital cinema system is provided which is arranged to operate on a different frequency than a camcorder frequency, which causes a disruptive flicker to appear in the camcorder recording. Thus, a “normal” digital cinema display (e.g., at 110 Hz) using effectively a 100% duty cycle which is caused to operate at a multiple, N, of the disruptive different frequency, can be implemented to disrupt camcorder recording. For example, for a multiple N=2, if the brightness of a particular pixel in a first region (‘Region 1’) incoming frame is less than 50%, double of that pixel's light can be displayed in every other frame with in-between frames displaying zero brightness. This is depicted by square wave 205 in the graph of
N is defined as the number of times each frame gets displayed. That is, an N number of frames are displayed within substantially the same amount of time as one input frame, such that N is substantially equal to the number of frames output for each input frame.
In the same example where multiple N=2, pixels having a brightness level greater than 50% will result in maximum brightness every other frame, with some additional brightness in the in-between frames. That is, if the brightness of a pixel is greater than 50%, then the maximum brightness (100%) is displayed every other frame, with in-between frames displaying some level of brightness greater than zero (which is determined according to the value between 50 and 100%).
Advantageously, this results in an effective display frequency of a disruptive frequency (e.g., 55 Hz) in combination with a duty cycle of 50%. While such displayed content will appear normal to the human viewer, a recording of such modulated displayed content made by a camcorder or other sampling system device would exhibit a disruptive ‘flicker’ effect, thus rendering the recording useless.
In accordance with various embodiments of the present invention, anti-piracy capability can be included which can assist in tracking, identifying, ‘fingerprinting’, etc., the digital cinema movie content. That is, in accordance with various embodiments of the present invention, a customized “message” or other additional discernable pattern is added to the content such that is becomes visible and readily identifiable in a camcorder recording. That is, a separate region(s) (e.g., ‘Region 2’) in the frame is selected for carrying a ‘message.’ For pixels in the pattern/message, any light is displayed during the in-between frames of the Region 1 pixels. This creates flicker in the camcorder recording in the Region 2 areas of each frame which is out of phase with the Region 1 flicker, thus making the message/pattern of Region 2 clearly visible and identifiable in the camcorder recording.
To reduce the probability that the added message/pattern might be visible to a human viewer, the out-of-phase message/pattern of Region 2 can be reduced in contrast with the ‘background’ Region 1 by, in one embodiment, “feathering” the edges of the message/pattern so as to transition the level of light displayed between Region 1 to Region 2. That is, in accordance with embodiments of the present invention a transition region can be created between Region 1 and Region 2 which gradually changes over from having light in one set of frames (e.g., Region 1) to having light in the other set (e.g., Region 2).
Referring to
In cases in which the brightness level of the pixels is below 50% of maximum, Pixel set 1 is displayed in the display frames 209 as shown by the solid square wave. That is, the brightness is fluctuated from a level that is two times the actual pixel brightness to zero brightness in every other frame. To illustrate, for a pixel in Region 1 having a brightness of 40%, the brightness would be modulated and output as shown in Table 1, below.
The example in Table 1 is depicting an input signal in a scene in which there is no motion, and Frame 1 and Frame 2 comprise two output frames created from one input frame. Thus, for the example where N=2, each pixel is effectively displayed at half the main display frequency, which causes a disruptive flicker in a camcorder recording.
To generate the out-of-phase flicker, Pixel set 2 is displayed in the display frames as shown by the broken-line square wave 401 of
Accordingly, in both Regions 1 and 2 and in the case where N=2, each pixel is effectively displayed at half the main display frequency, thus causing disruptive flickering in a camcorder recording of the modulated content.
The above described example in which the actual display frequency is a multiple N=2 of the disruptive frequency, and in which two regions (Region 1 and Region 2) are selected is an exemplary embodiment. For example, where the actual display frequency=110 Hz, the disruptive frequency=55 Hz and the flicker induced in a 60 Hz camcorder=5 Hz.
However, it is to be noted that the timing of the display of each pixel's light can be altered such that the actual display frequency can comprise any multiple N (e.g., N=3, 4, 5 . . . etc.). Depending on whether N comprises an even or odd integer, a different formula is applied to produce the desired ‘out-of-phase’ effect, as shown below. However, regardless of the value of the multiple N that is selected, the average brightness output over the total of N frames is not changed, and thus, the overall light levels of the image content appears unchanged to the human eye. That is, where B=brightness of an incoming pixel, and Bj=brightness of incoming pixel in display frame j in a group of N frames to be displayed, the average of all the brightness values Bi is substantially equal to B. For example:
(B1+B2+ . . . BN)/N=B
At the same time, a modulation technique in accordance with various embodiments of the present principles provides effective and disruptive anti-piracy flickering effects in any video recording made of the display.
Exemplary formulae which can be used for determining specific amounts of brightness to be output, for example, in Region 1 and Region 2 for each frame Bj and Bf(j), respectively, of N frames are described as follows:
To Implement the Method for a Pixel in Region 1:
For a Pixel in Region 2:
That is,
Similarly,
With reference to
A pixel located in an area of the transition region 805 between the outer edge 807 and midpoint 811 can have a waveform similar or closer to the solid line wave 301 in
In step 902, an incoming signal 102 can be converted to the desired disruptive frequency. The method then proceeds to step 903.
In step 903 a multiple N of the desired disruptive frequency is selected. The method then proceeds to step 905.
In step 905, at least one pixel region(s) within each frame is determined. However, it should be noted that any number of pixel regions can be determined in accordance with various embodiments of the present invention. For example, if a plurality of regions (e.g., Region 1 and Region 2) is determined, than a width D of a transition region may also be determined between the separate regions (e.g., a width D of a transition region between Region 1 and Region 2). The remaining steps are performed individually for each color component (e.g., each primary color, such as RGB) of each pixel of each frame. For example, the method then proceeds to step 907.
In step 907, an input pixel is analyzed, for example, to determine its region location. If the pixel is determined to be located in a Region 1, then the method proceeds to step 909. If the incoming pixel is determined to be in a Region 2, the method proceeds to step 1003 of
In step 909, a brightness B of each pixel color component is examined. The method then proceeds to step 911.
In step 911, the amount of brightness, Bj, (e.g., percentage of maximum possible brightness that the display is capable of) of each component of the pixel that is to be displayed in each frame, j, of the N frames is determined. The results can be stored in memory and updated as needed.
The precise amount of brightness, B1, that is to be displayed in each frame, j, can be determined by the formula provided above with respect to B1. Advantageously, while the amount of brightness of each frame, j, in the group of N frames is changed thus causing a disruptive flicker effect in a camcorder recording, the overall brightness output for the pixel remains unchanged throughout the display period of at least the group of N frames. Accordingly, overall light levels are unchanged and the human eye will not detect any noticeable difference in picture quality and appearance. The method then proceeds to step 913.
Step 913 is a loop back to step 907 to assure that each pixel of the frame is processed. If all pixels of one of the input frames have been processed, in one exemplary embodiment, the stored frames can be displayed, in order, after all the calculations are completed for one of the input frames in step 915. In alternate embodiments, the first calculated output frame are displayed before all the output pixels for that input frame are calculated, if the calculation can be completed before the display of the Nth display frame is performed.
The method of
In step 1005, the amount of brightness Bf(j) of each component of the pixel in region 2 that is to be displayed in each frame f(j) of the N frames is determined. Preferably, according to one aspect of the present principles, the brightness of the region 2 pixel is determined in each frame f(j) so as to be displayed ‘out of phase’ with the brightness as output for the region 1 pixels. That is, to illustrate using the example where two regions are selected, the pixels in region 2 will be configured to display greater brightness during those display frame intervals in which the pixels in region 1 are displaying a lesser brightness, and vice versa. The precise amount of brightness Bf(j) that is to be displayed in each frame j may be determined by the formula provided above with respect to Bf(j). This creates flicker in the camcorder recording in the Region 2 areas of each frame which is out of phase with the Region 1 flicker, thus making the message/pattern of Region 2 clearly visible and/or readable in the recording. The method then proceeds to step 1009.
Step 1009 is a loop back to step 907 to assure that each pixel of the frame is processed.
It should be noted that d and D comprise linear distances. That is, d comprises how far across the width of D the pixel is located.
To calculate the brightness of the pixel located at d, the same formula above apply, except they are solved using a different maximum brightness value (e.g., the maximum is not =to 100). That is:
For the area of transition region 0<d<D/2:
F
1(d)=(d/D)*(2B−200)+100
For area of transition region D/2<d<D:
F
2(d)=((d−D)/(D))*(2*B−200)+200.
The method of
Step 1109 is a loop back to step 907 of
Having described various embodiments for a method, apparatus and system for providing anti-piracy content for digital cinema (which are intended to be illustrative and not limiting), it is noted that modifications and variations can be made by persons skilled in the art in light of the above teachings. It is therefore to be understood that changes may be made in the particular embodiments of the invention disclosed which are within the scope and spirit of the invention as outlined by the appended claims. While the forgoing is directed to various embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US2008/006232 | 5/15/2008 | WO | 00 | 11/8/2010 |