The disclosed teaching generally relates to classification of packets transmitted in a network, more specifically to the determination of content to be stored in storage located along the network based on the type of data transferred in the packet, and even more specifically to ensuring proper handling of content requiring use authorization.
Service providers worldwide are facing a mounting problem of flattening revenues coupled with increasing costs brought forth by increasing usage of bandwidth, growing churn, subscriber saturation and competitive price pressures. These mobile and broadband providers are facing challenges in delivering new revenue generating services while seeing their over the top (OTT) counterparts reaping rewards with content delivered over the networks they built and maintained over the years.
The vast majority of these OTT services are delivered over hypertext transfer protocol (HTTP), the de-facto protocol for application development and delivery. Be it video, social networking, search, or advertising, over fixed line as well as mobile applications, it is most likely running on top of HTTP. However, this protocol is also the most processing intensive protocol for network devices. Hence practically any increase in usage results in an increase in the pressure on the service providers.
Certainly one way to control traffic on the Internet requires various levels of understanding of the traffic that flows through the network which is also increasing in its level of sophistication. Various systems and solutions have been offered to enable deep-packet-inspection (DPI) to enable an ever sophisticated ability to shape the traffic on the network. This ability allows the service providers to better manage the network and its related resources, provide a higher level of quality of service (QoS) in the hopes to increase revenues and profits. However, the rapid increase in the delivery of heavy bandwidth consuming data, such as video, and consumption thereof, requires a new level of handling that is not available today in prior art solutions. A known problem is the access of a user node to a content source and subsequently the access by another user node to the same content, resulting in additional load on the content provider and on the entire network. When, for example, popular video clips are accessed there is a significant and noticeable degradation of the network performance that may even lead to a network failure. Some prior art solutions attempt to store all the data in caches, however, with the huge amounts of data and the need to inspect each and every packet, regardless of its source, makes this a daunting and impractical task.
It would be advantageous to provide service providers with a solution that will enable them to effectively manage and control the delivery of heavy bandwidth consuming data such that the overall bandwidth requirements are loaded and better shared across the network in general, and in particular within the network of a specific service provider.
According to an aspect of the present invention, there is provided an apparatus including a network interface, a deep inspection (DPI) unit, a storage, and a content delivery unit. The DPI unit identifies at least a source of content and inspects one or more packets provided from the identified at least a source of content, each packet having at least a specific source address and a specific destination address. The storage stores at least a portion of the content for a predetermined time period. The content delivery unit is configured to: identify a request from a client for content from the identified at least a source of content, determine whether the content requires an access authorization by the identified at least a source of content, receive an authorization from the at least a source of content, generate a random identification (ID) associated uniquely with the client, provide at least the random ID to the client, and store in a table the random ID and at least another parameter associated with the random ID.
The apparatus can use the network interface to connect to a network in one of: a ‘bump-in-the-wire’ mode and a sniffing mode.
The apparatus can provide data from the storage to the client from a dedicated network port.
The parameters associated with the random ID can be at least one of: an identifier of the content, a name of the content, a description of the content, an expiration time, a start time, a received token, and a client identifier.
The expiration time can be periodically checked by the content delivery unit and when the expiration time has elapsed, the content delivery unit removes from the table an entry associated with the random ID having an expired time.
The expiration time can be periodically extended in response to continued requests from the client for content from the identified at least a source of content.
The content can be one of: a video stream, a video clip, an audio stream, an audio clip, a video frame, combinations thereof, and any portion thereof.
The content delivery unit can, responsive to receiving a client random ID from the client, verify that the client random ID exists in the table and if the client random ID does not exist in the able, the content delivery unit can decline to provide content from the apparatus to the client.
The content delivery unit can, upon validating the existence of the client random ID in the table, validate at least one parameter associated with the random ID, and upon failure to pass validation of the at least one parameter, the content delivery unit can decline to provide content from the apparatus to the client.
Additional aspects of the present invention can be provided by way of a method implementing the operations of the apparatus and a computer readable medium storing a program for executing the functions carried out by the apparatus.
The above discussed advantages of the disclosed teachings will become more apparent by describing in detail some exemplary implementations thereof with reference to the attached drawings in which:
Techniques for efficient usage of network bandwidth are disclosed. Specifically, the disclosed system samples packets from a plurality of content sources and identifies those content sources providing predetermined types of data, for example, video clips. Upon identification of such content sources, any data that arrives from such a content source is subject to a deep-packet-inspection (DPI) process to positively identify the content and the need to store it in cache storage such that when a subsequent request for the same content is received there is no need to transmit the content from the content source and rather deliver it from the system's storage. This results in at least less traffic passing on the entire network, faster service, and lower operational costs. Furthermore, it is recognized that even though content is delivered from the apparatus, in certain cases, to ensure proper operation it is necessary to properly authorize the client receiving such content. Therefore, upon receipt of a request for a content, or a portion thereof, from a client the apparatus inspects whether the client is authorized to receive the requested content and if necessary, implements one or more validation techniques for the client with respect to the apparatus and with respect to the server providing the content originally. A preferably random identifier (ID) may be used in conjunction with the requested content. When a subsequent request for the content is received from the authorized client, the requested content can be delivered directly from the apparatus' storage unit. The content includes various types of data, including but not limited to, a video stream, a video clip, an audio stream, an audio clip, a video frame, combinations thereof, and portions thereof.
Reference is now made to
While DPI unit 210 operates on the packets that arrive from CSs 140, the CDU 230 operates with respect to requests for content received from the UNs 150 of the service provider network 130. Upon receipt of such a request, the DPI 210 first checks if content from the requested CS 140 actually resides in the storage 220 by first checking that the CS 140 identification is known to the apparatus 110. If that is the case then the storage 220 is checked for the possibility of delivery of the content or portions thereof. If the entire content or portions thereof are found, then these are delivered to the requesting UN 150. If the entire content is missing, or certain portions thereof are missing, then the request is forwarded to the appropriate CS 140. Storage 220 may be semiconductor media, magnetic media, or any other type of storage media appropriate for the storage of content.
Reference is now made to
Reference is now made to
Reference is now made to
In some cases content requires authorization to be viewed and it is required that the SDA 110 adheres to such requirements even when it has a copy of the desired content stored therein. Typically, in the prior art, as part of the request and acknowledge exchange between the UN 150 and the CS 140, authorization is achieved by exchanging, for example, a hypertext transfer protocol (HTTP) protocol cookie and/or a data token also referred to as a token. Other means could be also used, for example and without limitation, the use of a random session identification (ID) in the universal resource locator (URL). According to a non-limiting embodiment the invention the transfer would take place through, or otherwise by data tapping, the SDA 110 and the UN 150 identifies itself periodically to the SDA 110 to ensure the content is delivered to the appropriate location. A problem may arise, however, if for some reason one UN 150, for example UN 150-2, gets a hold of a content identifier provided to UN 150-1. The SDA 110 would just start sending content to the UN 150-2 even though it is not in fact authorized to receive such content. Therefore, a solution is suggested where instead of using a content identifier for such verification, a data token, preferably a random ID, is generated by the SDA 110, the random ID being a string. The random ID is provided to the appropriate UN 150 uniquely, and the SDA 110 manages a table key that is associated with the random ID (also referred to by Applicants as a brownie or brownie ID) as well as additional parameters that may include, e.g., the content description, name or identifier, desired destination, start time of the delivery of content to the UN 150, segments provided to the UN 150, and expiration time. When a random ID is returned for validation purposes the SDA 110 checks that the random ID is returned from an expected destination, that it is for a non-expired data and so on, based on the parameters stored in the table, and thereby prevents providing the content to a destination that has erroneously or maliciously received the cookie and/or a token for the content. Even if for some reason the random ID is provided still, based on the stored parameters the SDA 110, and preferably the content delivery unit 230 therein, is enabled to distinguish a valid destination from an invalid destination for the content and avoid providing of content to an invalid destination. Specifically, the embodiment described hereinabove allows the SDA 110 to identify the case where an unauthorized UN attempts to request data from the SDA 110.
Reference is now made to
Typically, the destination, i.e., a specific UN 150, is requested or initiates a validation process when additional content or segments thereof are requested. Reference is therefore now made to
In one embodiment of the invention an expiration time is provided as part of an entry of a random ID. Such an expiration time is periodically checked and if the time has expired, that random ID is invalidated, for example, by its removal from the table. Thereupon, if a destination desires to access such content again, a new cookie and/or token or random ID, i.e., a new authorization process with the CS 140 must take place in order to validate the eligibility of such destination to receive such protected content. Furthermore, in one embodiment the expiration time is continuously updated, or otherwise extended, for as long as the authorized destination continues to request content from the SDA 110.
In one alternate implementation, when detecting that a portion of the requested content is in the storage 220 and deliverable to the requesting UN 150, such content is delivered immediately to the UN 150 while only the missing portions of the content is requested from the CS 140. Hence a request from the CDU 230 may be for the requested content or portions thereof. It should be further understood that in a typical implementation, once the DPI unit 210 determines that a CS 140 may contain content that should be stored in storage 220, the packets from such a CS 140 are consistently inspected for determination of popular content.
The disclosed teachings are implemented as hardware, firmware, software, or any combination thereof. Moreover, the software is preferably implemented as an application program tangibly embodied on a program storage unit or non-transitory computer readable medium or a non-transitory machine-readable storage medium that can be in a form of a digital circuit, an analogy circuit, a magnetic medium, or combination thereof. The application program may be uploaded to, and executed by, a machine comprising any suitable architecture. Preferably, the machine is implemented on a computer platform having hardware such as one or more central processing units (“CPUs”), a memory, and input/output interfaces. The computer platform may also include an operating system and microinstruction code. The various processes and functions described herein may be either part of the microinstruction code or part of the application program, or any combination thereof, which may be executed by a CPU, whether or not such computer or processor is explicitly shown. In addition, various other peripheral units may be connected to the computer platform such as an additional data storage unit and a printing unit.
All examples and conditional language recited herein are intended for pedagogical purposes to aid the reader in understanding the principles of non-limiting embodiments of the invention and the concepts contributed by the inventor to furthering the art, and are to be construed as being without limitation to such specifically recited examples and conditions. Moreover, all statements herein reciting principles, aspects, and non-limiting embodiments of the invention, as well as specific examples thereof, are intended to encompass both structural and functional equivalents thereof. Additionally, it is intended that such equivalents include both currently known equivalents as well as equivalents developed in the future, i.e., any elements developed that perform the same function, regardless of structure.
This application claims priority from U.S. provisional patent application No. 61/722,205, entitled “A System and Methods Thereof for Detection of Content Servers, Caching Popular Content Therein, and Providing Support for Proper Authentication”, filed on 4 Nov. 2012, and this application is a continuation-in-part of U.S. patent application Ser. No. 13/006,785 entitled “A System for Detection of Content Servers and Caching Popular Content Therein”, filed on 14 Jan. 2011, which claims priority from U.S. provisional patent application 61/375,836, entitled “A System for Detection of Content Servers and Caching Popular Content Therein”, filed on 22 Aug. 2010, all of the above-identified applications assigned to a common assignee and all of the above-identified applications are hereby incorporated by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
5933603 | Vahalia et al. | Aug 1999 | A |
6049530 | Petersen et al. | Apr 2000 | A |
6363413 | Kidder | Mar 2002 | B2 |
6700889 | Nun | Mar 2004 | B1 |
6772193 | Igawa et al. | Aug 2004 | B1 |
6831893 | Ben Nun et al. | Dec 2004 | B1 |
7281260 | Puente et al. | Oct 2007 | B2 |
7310480 | Maciocco et al. | Dec 2007 | B2 |
7436830 | Ben-Nun et al. | Oct 2008 | B2 |
7606314 | Coleman et al. | Oct 2009 | B2 |
7719966 | Luft et al. | May 2010 | B2 |
20020006124 | Jimenez et al. | Jan 2002 | A1 |
20020062372 | Hong et al. | May 2002 | A1 |
20060129697 | Vange et al. | Jun 2006 | A1 |
20060271972 | Pai et al. | Nov 2006 | A1 |
20070124781 | Casey et al. | May 2007 | A1 |
20090083279 | Hasek | Mar 2009 | A1 |
20090307757 | Groten | Dec 2009 | A1 |
20090313437 | Sofman et al. | Dec 2009 | A1 |
20100054257 | Dolganow et al. | Mar 2010 | A1 |
20100082774 | Pitts | Apr 2010 | A1 |
20110141887 | Klein et al. | Jun 2011 | A1 |
20110153937 | Annamalaisami et al. | Jun 2011 | A1 |
20120011271 | Zhao et al. | Jan 2012 | A1 |
20120030212 | Koopmans et al. | Feb 2012 | A1 |
20120047224 | Shemesh et al. | Feb 2012 | A1 |
Entry |
---|
Non-final Office Action dated Sep. 25, 2012 in U.S. Appl. No. 13/006,785. |
Non-final Office Action dated Jul. 26, 2012 in U.S. Appl. No. 13/006,875. |
Number | Date | Country | |
---|---|---|---|
20130212708 A1 | Aug 2013 | US |
Number | Date | Country | |
---|---|---|---|
61375836 | Aug 2010 | US | |
61722205 | Nov 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13006785 | Jan 2011 | US |
Child | 13838506 | US |