Patent Application
20200221073
This application claims the benefit of priority of Korean Patent Application No. 10-2019-0001116 filed on Jan. 4, 2019, all of which are incorporated by reference in their entirety herein.
The present invention relates to a method for inserting additional data into digital content and detecting the additional data and, more specifically, to a method for efficiently detecting additional data inserted for preventing forgery of content.
As digital content is increasingly provided through the Internet due to recent development of communication technology, a risk of illegal access and forgery of content is encountered. Although content security through digital right management (DRM) is mainly used in conventional content provision services, authentication through code security such as code access security (CAS) is technically inadequate to cope with illegal access and forgery with respect to authenticated users.
Furthermore, Internet connection through which content is transmitted from content providers to clients is relatively vulnerable to security and thus has a high risk of illegal leak, forgery and illegal access.
Watermarking, which is a technique for preventing such illegal access and forgery, identifies a person who accesses or forges content by inserting specific data into the content and detecting the data after the content is accessed.
However, conventional watermarking techniques simply insert data into content and identify a person who accesses the content according to whether the data is detected after the content is accessed, and thus it is difficult to accurately determine forgery and illegal access. Furthermore, in the case of content displayed to public, it is difficult to prevent illegal access of the content beforehand because a person who accesses the content is identified after the content is displayed.
An object of one aspect of the present invention is to provide a display apparatus, a display method and a system capable of preventing display of video content according to forgery and illegal access by detecting additional data included in the video content and performing filtering with respect to display.
According to one aspect of the present invention to accomplish the object of the present invention, an apparatus for detecting additional data for preventing forgery of video content and displaying the video content may include: a content input unit for receiving the video content (the video content including the additional data); a display unit for displaying the video content; an additional data detector for detecting the additional data from the video content (the additional data including a watermark); and a display controller for controlling a display screen of the video content according to an additional data detection result.
The display controller may (i) normally display the video content in response to normal detection of the additional data from the video content and (ii) restrict normal output of the display screen displaying the video content in response to abnormal detection of the additional data from the video content.
The display controller may turn off the display screen in response to abnormal detection of the additional data.
The display controller may process the display screen into a monochrome screen in response to abnormal detection of the additional data.
The display controller may use a first display control manner in response to abnormal detection of a first element of a plurality of elements of the additional data and use a second display control manner in response to abnormal detection of a second element of the plurality of elements of the additional data.
A matching relationship between a plurality of elements of abnormally detected additional data and display control manners corresponding thereto may be stored in the form of a lookup table.
The display controller may control rendering of the video content on the basis of control information from a rendering apparatus interoperating with the apparatus, and the control information may be generated on the basis of whether the additional data is normally detected in the rendering apparatus.
The additional data detector may determine whether the additional data is normally detected on the basis of at least one of a period in which content can be played, content right holder information, purchaser information and distribution attribute information related to the additional data.
The video content may be content input through off-line.
According to another aspect of the present invention to accomplish the object of the present invention, a method for detecting additional data for preventing forgery of video content and displaying the video content may include: a content input unit receiving the video content (the video content including the additional data); a display unit displaying the video content; an additional data detector detecting the additional data from the video content (the additional data including a watermark); and a display controller controlling a display screen of the video content according to an additional data detection result.
According to another aspect of the present invention to accomplish the object of the present invention, a system for detecting additional data for preventing forgery of video content and displaying the video content may include: a content rendering apparatus for receiving video content including additional data through a wired or wireless network, detecting the additional data included in the video content and determining whether to play the video content through a display apparatus according to a first detection result of the additional data (the additional data including a watermark); and the display apparatus connected to the content rendering apparatus in a wired or wireless manner to receive video content from the content rendering apparatus and display the video content and configured to detect the additional data from the video content and control a display screen of the video content according to a second detection result of the additional data.
The content rendering apparatus may provide the first detection result to the display apparatus and the display apparatus may determine whether the video content is played according to the first detection result.
The display apparatus may turn off the display screen of the video content according to the second detection result even when the first detection result indicates rendering of the video content.
The content rendering apparatus may generate the first detection result using a first additional data detection manner and the display apparatus may generate the second detection result using a second additional data detection manner.
The first additional data detection manner may be a manner of extracting a watermark value using a least significant bit (LSB) of a quantized wavelet coefficient of a watermark-inserted region among wavelet coefficients of a first region of the video content, and the second additional data detection manner may be a manner of extracting a watermark value using an LSB of a quantized DCT coefficient of the watermark-inserted region among DCT coefficients of the first region of the video content.
According to another aspect of the present invention to accomplish the object of the present invention, a rendering apparatus interoperating with a display apparatus may include: a communication unit communicating with a wired or wireless network; a content input unit for receiving video content through the wired or wireless network using the communication unit, the video content including additional data; an additional data detector for detecting the additional data included in the video content, the additional data including a watermark; and a content rendering controller for determining whether the video content is played in the display apparatus according to a first detection result of the additional data and instructing control information with respect to rendering of the video content to be provided to the display apparatus.
The rendering apparatus may further include a user interface through which at least one of a first filtering option for determining whether the video content is played through the display apparatus on the basis of the first detection result of the rendering apparatus and a second filtering option for determining on or off of a display screen of the video content in the display apparatus according to a second detection result of the additional data in the display apparatus is selectable.
The content rendering controller may generate control information for causing the video content to be unable to be played through the display apparatus in response to abnormal detection of the additional data as the first detection result, and generate control information indicating rendering of the video content in the display apparatus in response to normal detection of the additional data as the first detection result.
According to another aspect of the present invention to accomplish the object of the present invention, a video content rendering method in a rendering apparatus interoperating with a display apparatus may include: receiving video content through a wired or wireless network, the video content including additional data; detecting the additional data included in the video content, the additional data including a watermark; and determining whether the video content is played in the display apparatus according to a first detection result of the additional data and instructing control information with respect to rendering of the video content to be provided to the display apparatus.
The present invention can be modified in various forms, and specific embodiments thereof will be described and shown in the drawings. However, the embodiments are not intended for limiting the invention to specific embodiments and the scope of the present invention should be understood to include modifications, equivalents and substitutions that can realize the technical ideas.
The terms “first” and “second” may be used to describe various components, but such components are not limited by these terms. The terms are used to discriminate one component from another component. Accordingly, a first component mentioned in the following description may be a second component within the technical spirit of the present invention. For example, a first element may be called a second element and the second element may be called the first element without departing from the scope of the present invention. The term “and/or” includes a combination of a plurality of related stated items or any of a plurality of related stated items.
When an element is “coupled” or “connected” to another element, it should be understood that a third element may be present between the two elements although the element may be directly coupled or connected to the other element. When an element is “directly coupled” or “directly connected” to another element, it should be understood that no element is present between the two elements.
The terms used in the application are merely used to describe specific embodiments and do not limit the present invention. An element described in the singular form is intended to include a plurality of elements unless the context clearly indicates otherwise. In the specification of the present invention, it will be understood that the terms “comprise” and “include” specify the presence of stated features, integers, steps, operations, elements, components, and/or combinations thereof, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or combinations.
Unless particularly defined otherwise, all terms including technological or scientific terms used herein should be construed as a meaning that is generally understood by those having ordinary skill in the art to which the invention pertains. In addition, general terms used in this invention should be construed based on the definition of dictionary, or the context, and should not be construed too broadly or too narrowly.
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. The same elements are designated with the same numeral references and their redundant description will be omitted.
The content providing server 140 receives content from users. The received content is various types of multimedia content including video content and audio content. An insertion unit of the content providing server 140 inserts additional data for preventing forgery and external access of digital content into received content. The additional data may include a key value, an ID, a watermark, a fingerprint, and the like. Here, the watermark may include a Forensic watermark, an index watermark and the like.
The insertion unit also inserts rights attribute information necessary to generate a watermark as additional data. The rights attribute information may include one or more of information on a license period in which corresponding content can be played and displayed, distribution attribute/distribution channel information, right holder information, a purchaser information, user information and provider information. Additional data information generated in the aforementioned manner is generated as a hash code and inserted into content. The content providing server 140 provides the content having the additional data included therein to the rendering apparatus 120 through the network 130 using a specific website or other radio communication channels.
The network 130 may include communication networks and/or broadcast networks. The network 130 includes a wired or wireless network. The rendering apparatus 120 may be realized as a set-top box. The rendering apparatus may be called a player. The rendering apparatus 120 can receive content from the server through the network. The rendering apparatus 120 can receive user input from a user input device and request content from the server 140 on the basis of the received information. The rendering apparatus 120 includes a detector. The detector is a module that detects the additional data inserted by the content providing server 140. The detector extracts the additional data and determines whether the extracted additional data is normal additional data. The corresponding content is played when the extracted additional data is normal additional data and rendering of the content is stopped if not. The rendering apparatus 120 is connected to the display apparatus 110 in a wired manner and/or a wireless manner such that the display apparatus 110 renders the content. Otherwise, the rendering apparatus 120 instructs the display apparatus 110 not to render the content.
The display apparatus 110 is a device interoperating with the rendering apparatus 120. Alternatively, the display apparatus 110 may be a device that displays input content without interoperating with the rendering apparatus 120. The display apparatus 110 may include a monitor, a TV, a touch panel, a transparent display panel and the like. When the display apparatus 110 is connected to the rendering apparatus 120, the display apparatus 110 receives a rendering command from the rendering apparatus 120 and renders content received from the rendering apparatus 120. When the display apparatus 110 is not connected to the rendering apparatus 120, the display apparatus 110 can receive content off-line. For example, the display apparatus 110 can receive content through storage media such as a CD, a DVD and a USB. Then, the display apparatus 110 can render the received content according to user input from a user input device.
The display apparatus 110 includes a detector that detects additional data. The detector of the display apparatus 110 detects additional data and determines whether content will be displayed. Irrespective of whether the display apparatus 110 is connected to the rendering apparatus 120, the display apparatus 110 can detect additional data when content is played and determine that the content is forged or illegally accessed content when the detected additional data is not consistent with an inserted data value to block display of the content. Blocking display may include screen off, processing display into monochrome display, processing a partial region into a black box, stripe processing and screen deterioration. When the display apparatus 110 is connected to the rendering apparatus 120, additional data can be detected by the detector of the rendering apparatus 120 and the detector of the display apparatus 110 up to twice and it can be determined whether the additional data is normal. Accordingly, it is possible to improve the efficiency of defending against attacks of illegal users by double-blocking the attacks of the illegal users. Particularly, the rendering apparatus 120 exposed to online is highly likely to be exposed to attacks from illegal users, such as attacks on the server 140 and attacks on the network 130, whereas the display apparatus 110 operates without being connected to a network and thus processing of additional data through the detector of the display apparatus 110 may have considerably important meaning. That is, even if an illegal user attacks the rendering apparatus 120 through the network 130 and the insertion unit of the rendering apparatus 120 does not detect the attack, the detector of the display apparatus 110 secondarily detects additional data of content and determines whether the additional data is normal before the content is displayed, and thus it is possible to detect an attack on the rendering apparatus 120 and block display to prevent rendering of illegal advertisements or inappropriate content.
Referring to
The display unit 220 is a component that constitutes display screens. The display unit 220 can be realized as a monitor, a TV and other various panels (LCD, PDP, LED and OLED).
The processor 230 is a component that controls rendering and display of content. The processor 230 may include an additional data detector 232 and a display controller 234. The additional data detector 232 is a module that detects additional data included in content. The display controller 234 is a module that controls display of content through the display unit 220 according to an additional data detection result of the additional data detector 232. These two modules will be described in more detail with reference to
Referring to
The additional data detector 232 determines whether the extracted watermark is a normal watermark (S330). The additional data detector 232 can determine whether the additional data is normal on the basis of whether the watermark value is identical to the hash value. In addition, the additional data detector 232 can determine whether the additional data is normal on the basis of at least one of license period information, distribution attribute/distribution channel information, right holder information, purchaser information, user information and provider information. For example, it is possible to compare information on the current time that is known to the apparatus with license period information included in the additional data and determine that the additional data is normal when the current time is included in the license period. Further, it is possible to determine whether the additional data is normal additional data on the basis of whether an ID that is not associated with purchase is present on the distribution channel. Moreover, it is possible to detect the watermark value on the basis of a key value associated with the content and then determine whether the detected water mark is normal.
The display controller 234 normally displays the input content when it is determined that the additional data is normal (S340).
However, when it is determined that the additional data is not normal, the display controller 234 can turn off the display screen with respect to the input content (S350). Here, the display controller 234 does not necessarily turn off the display screen according to the detection result representing that the additional data is not normal. The display controller 234 may process a predetermined region of the display screen into a black box, process the screen into a monochrome screen or control only pixels in columns or rows in a predetermined order to be displayed in a stripe form. Alternatively, the display controller 234 may control a screen with respect to a part of or entire region to be displayed in a deteriorated manner. Settings associated with display screen processing with respect to abnormal additional data may be arbitrarily set and changed through user setting.
According to another embodiment of the present invention, when a result representing that one of a plurality of elements (a license period, a distribution channel, a distribution attribute, purchaser information and right holder information) of additional data is abnormal is derived, a control method for preventing display corresponding to the abnormal element can be performed. For example, a display screen can be turned off when an abnormal result related to a first element (license period) is derived and the display screen can be processed into a monochrome screen when an abnormal result related to a second element (distribution channel) is derived. A matching relationship between a specific element of additional data and a control method associated with blocking of normal display may be prestored in the memory 250 in the form of a lookup table. The display controller 234 restricts output of a display that matches an abnormal element of additional data with reference to the matching relationship.
Referring back to
The memory 250 is a storage device that stores commands associated with the operation of the processor 230. The memory 250 may store at least a part of input content and the processor 230 may display content on the basis of a selection command for one of the content stored in the memory 250. The selection command can be input through the user interface 260.
The user interface 260 includes devices through which user input is received, such as a keyboard, a mouse and a touchscreen.
Referring to
The user interface 420 includes devices through which user input is received, such as a keyboard, a mouse and a touchscreen. A user can check settings while viewing a setting screen displayed through the display unit 220 of the display apparatus (refer to
The processor 430 is a component for controlling rendering of content. The processor 430 may include an additional data detector 432 and a content rendering controller 434. The additional data detector 432 is a module that detects additional data included in content. The content rendering controller 434 is a module that controls rendering of content in a display apparatus according to an additional data detection result in the additional data detector 432. These two modules will be described in detail with reference to
Referring to
The additional data detector 432 determines whether the extracted watermark is a normal watermark (S530). Here, the additional data detector 432 of the rendering apparatus can detect additional data using a manner similar to that used by the additional data detector of the display apparatus. Fundamentally, the additional data detector 432 can determine whether the additional data is normal on the basis of whether the watermark value is the same as the hash value. Further, the additional data detector 432 can determine whether the additional data is normal on the basis of at least one of license period information, distribution attribute/distribution channel information, right holder information, purchaser information, user information and provider information.
According to another embodiment of the present invention, the additional data detector 432 may detect the additional data through a method different from that used by the additional data detector 232. For example, since the additional data detector 432 operates in connection with a network, the apparatus can be configured such that a first detection result is output through a first additional data detection manner (requesting handshaking with the outside) for detecting additional data in association with the server 140 (refer to
Furthermore, the additional data detector 432 and the additional data detector 232 may use the same detection manner for the first element of additional data, such as license period information, and use different detection manners for the second element of the additional data, such as distribution channel information. Such additional data detection manners can be set through the display unit of the display apparatus and the user interfaces of the rendering apparatus and/or the display apparatus.
When it is determined that the additional data is normal, the content rendering controller 434 provides instruction information related to rendering to the display apparatus such that the input content is normally rendered through the display apparatus (S540).
On the other hand, when it is determined that the additional data is not normal, the content rendering controller 434 can stop rendering of the input content in the display apparatus (S550). That is, the content rendering controller 434 can provide control information for instructing rendering to be stopped to the display apparatus.
Referring back to
The memory 450 is a storage device that stores commands associated with the operation of the processor 430. The memory 450 may store at least a part of input content.
Referring to
In the case of (i), the system operates according to filtering settings in which content is instructed to be played when the rendering apparatus primarily detects normal additional data and normal display of the content is performed when the display apparatus secondarily detects normal additional data.
In the case of (ii), filtering settings (ii)-(a) include settings in which only the rendering apparatus detects additional data and filtering with respect to content rendering is performed and filtering settings (ii)-(b) include settings in which only the display apparatus detects additional data and filtering with respect to content display is performed.
With respect to such a setting screen, the rendering apparatus and/or the display apparatus can provide a user interface for selecting one of the aforementioned three settings (i), (ii)-(a) and (ii)-(b). When the rendering apparatus selects one of the aforementioned three settings, the apparatus provides information related to the selection to the display apparatus such that the display apparatus performs or does not perform filtering according to a set filtering manner. For example, additional data detection in the display apparatus and display control according to a detection result may be required in the case of the filtering settings (i) and (ii)-(b) but may not be required in the filtering settings (ii)-(a).
As the present features may be embodied in several forms without departing from the characteristics thereof, it should also be understood that the above-described embodiments are not limited by any of the details of the foregoing description, unless otherwise specified, but rather should be considered broadly within its scope as defined in the appended claims, and therefore all changes and modifications that fall within the metes and bounds of the claims, or equivalents of such metes and bounds, are therefore intended to be embraced by the appended claims.
According to the apparatus for detecting additional data for preventing forgery of video content and displaying the video content according to the present invention, illegal access, forgery through hacking and distribution of unauthorized content at relatively vulnerable content transmission side can be prevented or blocked.
Furthermore, it is possible to determine illegal access with respect to a specific user by using a conventional watermarking technique and block illegal advertisements of video content providers such as Youtube and Twitch and illegal Internet site advertisements (banners).
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2019-0001116 | Jan 2019 | KR | national |
