Patent Application
20200220909
The present invention relates generally to combining content stream messages (e.g., ad break information associated with a live video stream) with manifest files to be delivered to and processed by client devices for insertion of targeted advertisements in Over-the-top (“OTT”), Internet Protocol Television (“IPTV”), or other streaming content.
Traditionally, television programming is distributed through terrestrial, satellite, and cable television formats. In this regard, a content stream containing television shows, movies, advertisements, public service announcements, etc. is continuously transmitted and viewed in a substantially real-time manner as scheduled (in a “live” or “linear” manner) at a viewer's television.
In recent years, with the proliferation of digital television, alternative conduits for accessing television programming have emerged. Some of these are linear, in which the content stream is viewed in real-time similar to traditional systems, and others are non-linear (e.g., time-shifted viewing using a digital video recorder or “DVR”, video-on-demand, etc.). OTT and IPTV have both gained widespread appeal as delivery methods utilizing the Internet protocol over a packet-switched network. Generally, the difference between the two protocols is that OTT typically utilizes open internet channels whereas IPTV generally is offered over a dedicated infrastructure. Notably, both may be linear or non-linear. Furthermore, the present invention may be applicable in the context of any streaming format but for clarity is discussed primarily with reference to OTT and IPTV.
In the context of linear OTT and linear IPTV, a viewer may receive and view a content stream at substantially the same time as a viewer receiving the content stream in a traditional fashion. For example, a viewer receiving a satellite broadcast may be tuned into NBC to watch a television program while an OTT user may watch an identical NBC broadcast on an internet-enabled device (e.g., smartphone, tablet computer, PC, Smart TV, game console, etc.) at the same time. In this regard, television shows may be synchronized across thousands of devices accessing the stream via the internet.
Generally, in digital television, a content stream is embodied in a digital container format for transmission and storage. Although a variety of digital container formats exist and may be applicable in the context of the present invention (e.g., 3GP, AVI, Flash, etc.), MPEG-2 transport stream (“MPEG-TS”) is widely used as a standard container for digital broadcasting, Blu-Ray, etc. and therefore the present invention is discussed primarily in the context of MPEG-TS. An MPGE-TS may be simultaneously distributed via traditional means and alternative channels such as OTT and IPTV. In the latter regard, the MPEG-TS may be segmented into file chunks (e.g., 5-10 seconds each) for individual download to end-user devices. A manifest file may be created and subsequently accessed by or downloaded to the devices. Such a manifest file may provide the devices with addresses at which the file chunks may be retrieved as well as presentation time stamps (“PTSs”) for synchronization. In this regard, the manifest file is used by the client device to enable streaming playback of a content stream.
Broadcast network content or programming is commonly provided in conjunction with associated informational content or assets. These assets include advertisements, associated programming, public-service announcements, ad tags, trailers, weather or emergency notifications and a variety of other content, including paid and unpaid content. In this regard, asset providers (e.g., advertisers) who wish to convey information (e.g., advertisements) regarding services and/or products to users of the broadcast network often pay for the right to insert their information into programming of the broadcast network. For instance, advertisers may provide ad content to a network operator such that the ad content may be interleaved with a content stream during one or more ad breaks.
In order to achieve a better return on their investment, asset providers often try to target their assets to a selected audience that is believed to be interested in the goods or services of the asset provider. The case of advertisers on a cable television network is illustrative. For instance, an advertiser or a cable television network may target its ads to certain demographic groups based on, for example, geographic location, gender, age, income etc. Accordingly, once an advertiser has created an ad that is targeted to a desired group of viewers (e.g., targeted group) the advertiser may attempt to procure insertion times in the network programming when the targeted group is expected to be among the audience of the content stream.
In some broadcast networks (e.g., such as those in the United States), one or more ad cues (e.g., SCTE 35 or 104) may also be incorporated into the content stream. Such ad cues have allowed network platforms (e.g., local head ends) to identify upcoming ad breaks in the programming contained in the national feed. Accordingly, such local head ends may replace content within the national feed with an asset that is better suited for a local audience.
In recent years, technological advancements have enabled advertisers to target advertisements to more specific levels of granularity. In the case of addressable environments such as OTT or IPTV, different viewers of a given program, even within a particular network subdivision, may receive different ads while viewing the same channel and program. This allows ads to be targeted based on location parameters independent of network topology, demographics, psychographics, or other targeting parameters of interest to an advertiser. Households or an individual user or users may be targeted based on classification parameters inferred from interaction with a device, an identity or characteristics determined by sensors, information from network or third-party databases and/or other information sources including, but not limited to, past purchase data, browser history, credit report, income, gender, personal interests, etc. (collectively, “consumer data”).
In the context of OTT or IPTV, an ad cue which may be included in a manifest file may signal a device streaming an MPEG-TS to send a request to an ad decision engine. The ad decision engine may evaluate consumer data associated with the device to determine an appropriate asset for insertion during an upcoming ad break. In some instances, a selected advertisement may then be downloaded to the device. In other instances, a plurality of assets may be downloaded to the device in advance and the ad decision engine may instruct the device which asset to display and which assets to ignore or discard. In yet other instances, an ad decision engine may instruct the device to stream a particular asset by providing an address at which the asset may be streamed.
There are currently no known scalable solutions or standards that reliably enable targeted audio and/or video advertising in linear OTT and linear IPTV systems. For example, as mentioned above, current OTT client players will issue playlist requests to ad decision engines at the time of the ad break. Given the large number of devices that may be simultaneously streaming the same content stream, this can cause the ad decision server to become inundated with requests at or near the time of an ad break. Given the volume of requests, responses may not be served for an extended period or rejected altogether (e.g., timed-out). This presents a problem for live streaming in that targeted ad placement opportunities may be lost. Therefore, a scalable solution to ensure adequate and reliable responses from an ad decision engine is desirable.
The present invention is directed to a method and apparatus for preparing program data for delivery to internet-enabled client devices implementing a targeted advertising scheme. A system is disclosed that separates an MPEG-TS into data messages and A/V content, modifies data messages, and combines modified content stream message data and content stream manifest files into combined manifest files (containing, inter alia, presentation time stamps or “PTSs”, ad break cues, etc.) based on relevant timestamps. The combined manifest files can be accessed and processed by client devices to download content and synchronize streaming of the content. Importantly, the present invention may enable the delivery of targeted audio/video advertisements to digital client devices in OTT and IPTV systems without overwhelming ad decision engines. In practice this invention may be utilized in other digital systems such as traditional digital cable or satellite delivery systems.
In an embodiment of the present invention, a system for modifying content stream messages for incorporation into manifest files is described. The system may comprise a demultiplexer configured to separate a content stream embodied in a transport stream into data messages (e.g., ad break cue metadata) and audio/video (“A/V”) content. The demultiplexer may be operatively connected to a data message handler and an A/V segmenter. The data message handler may receive the data messages separated from the transport stream by the demultiplexer and generate a data message file containing the relevant source metadata and PTSs. The data message file may contain data messages as originally received in the transport stream or the data message handler may modify the data messages. For example, the data message handler may modify the time stamp associated with an ad break cue or may insert an advance notice for a device to send a request to an ad decision engine. Such an advance notice may instruct a client device to send a request at a random time selected from within a window of specified times. In this regard, various client devices streaming the same content stream may select different random times such that requests are transmitted to the ad decision engine at different times. Alternatively, the data message handler may generate a plurality of data message files, each containing different times at which a request is to be sent. In this regard, different client devices may receive different data message files and may therefore send requests to the ad decision engine at different times.
The A/V segmenter may parse the A/V content into segments and generate a manifest file including PTSs. The system may further comprise a manifest and metadata combiner which is operatively interconnected to the data message handler and A/V segmenter. In this regard, the manifest and metadata combiner may receive a data message file and a manifest file and combine the data into a combined manifest file structured in accordance with the PTSs. Combined manifest files may be stored in a memory device of the system. Remote client devices (e.g., computers, wireless devices, televisions, set top boxes, etc.) may send a request to the system for a combined manifest file, in which case the combined manifest file may be accessed by or sent to the client device. Notably, the various features described as distinct components of the system may be combined into multifunctional components. For example, the functions of an A/V segmenter and data message handler may be performed by a single component. Additionally, various features and components may be embodied in hardware devices or the functions thereof may be performed by software-implemented modules disposed on a non-transient computer readable memory.
As mentioned above, in some instances, data messages may comprise ad break cues. Ad break cues may be received as a part of a content stream (e.g. MPEG-TS), processed by a cue handler and then combined, based on PTSs, with corresponding manifest files (that are generated by an A/V segmenter) to create new manifest files (i.e., combined manifest files). The combined manifest files may include both relevant ad break information and references to the associated A/V content.
In an aspect, combined manifest files may be processed by a client device completely within the context of a web browser or alternatively by a native application. Also, in some embodiments, instructions regarding request messages (e.g., video ad serving template or “VAST”) may be combined into a combined manifest file as described above so as to direct client devices to request ad playlists from a remote ad decision engine at random times based on the information provided in a combined manifest file. Alternatively or additionally, combined manifest files may altered between subsequent downloads to different client devices in order to specify staggered assigned times at which particular client devices are to send a VAST request message. In other words, a combined manifest file received at one client device may specify a different time for sending a VAST request message than a combined manifest file received by another client device.
In yet another embodiment, the present invention may include a method to combine metadata with manifest files to create combined manifest files for use by client devices. Initially, a demultiplexer may receive a transport stream including content stream content and associated data message(s) (e.g., metadata, ad break cues, etc.). The demultiplexer may separate the stream to pass metadata messages to one or more corresponding metadata handlers and to pass content data (e.g., A/V content) to an A/V segmenter. The metadata handler may create and update a metadata file to include relevant metadata including ad break cues source timestamps. The A/V segmenter may process the content data into file chunks and generate a manifest file that includes the source timestamps associated with each file chunk. A client device may request a combined manifest file from a combined manifest server. A manifest and metadata combiner may generate a combined manifest file that includes data regarding A/V file chunks and metadata aligned in sequence based on the source timestamps. Notably, the combined manifest file may be generated before or after the client device sends the request. The combined manifest server may send the combined manifest file to the client device. The client device may process the combined manifest file and request updated manifest files as needed.
For a more complete understanding of the present invention and further advantages thereof, reference is now made to the following Detailed Description, taken in conjunction with the drawings, in which:
While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown by way of example in the drawings and are herein described in detail. It should be understood, however, that it is not intended to limit the invention to the particular form disclosed, but rather, the invention is to cover all modifications, equivalents, and alternatives falling within the scope of the invention as defined by the claims.
A/V segmenter 303 may be operable to parse the A/V content 307 into A/V file chunks 311. The A/V segmenter 303 or a separate component in operative communication therewith with may generate a manifest file 310 which includes PTS data. The A/V content file chunks 311 may be stored locally on a memory device or may be transferred to a remote storage location. The manifest file 310 may also contain storage addresses associated with each A/V file chunk 311. Cue files 309 and manifest files 310 may be processed by manifest and cue combiner 304 to generate combined manifest files. Combined manifest files may be stored locally or remotely for access and/or retrieval by a client device 312 at a later time. Additionally or alternatively, a manifest and cue combiner 304 may act responsive to a request 313 sent from a client device 312, at which point the manifest and cue combiner 304 may retrieve a cue file 309 and a manifest file 310 from local or remote storage and generate a combined manifest file. One or more cue file 309 or manifest file 310 may be utilized in generation of a combined manifest file.
Upon receiving an input (e.g., user input via an input device such as a touchscreen), a client device 312 may initiate playback of selected content. A request 313 may be sent to the manifest and cue combiner 304 requesting a combined manifest file. Notably, a request 313 need not be sent directly to a manifest and cue combiner 304 but may be sent to a component of the system 300 in operative communication therewith. One or more combined manifest files may be transferred 314 (or generated and transferred) to the client device 312 in response to receipt of the request 304.
The client device 312 may access the contents of a combined manifest file to locate storage addresses associated with A/V file chunks 311. The client device 312 may then send requests 315 for A/V file chunks. Upon receipt of a request 315, one or more A/V file chunks may be transmitted 316 to the client device 312. In some embodiments, A/V file chunks 311 may be stored on a remote database, in which case the client device 312 may access the database to retrieve the file chunks.
Ad break cue data within a combined manifest file may instruct a client device 312 to send a VAST request message 318 to an ad decision engine 317. Instructions to send a VAST request message 318 may include a predetermined time at which the client device 312 is to send the VAST request message 318, such time being before an associated ad break, or the client device 312 may be instructed to send the VAST request message 318 at a random or predetermined time before the ad break. Upon receipt of a VAST request message 318, ad decision engine 317 may select an advertisement or advertisement package (or an advertisement may have previously been selected) based upon consumer data available to or stored at the decision engine 317 associated with the client device 312 and/or a user thereof and transmit the advertisement 319 or a list containing the advertisement 319 to the client device 312 for insertion into the A/V content at the associated ad break.
As shown in string 402b, a client device may be operable to splice advertisements into ad breaks. Although shown as mp4 files, it is contemplated that ad and programming content may be received in any suitable format for playback of A/V content. In accordance with PTSs contained in combined manifest files, the client device may display advertisements 403a,b during ad breaks scheduled into the network programming. Some advertisements may be underlying network ads, e.g., 403a, which are received as A/V file chunks with the programming content while other advertisements, e.g., 403b, may be received from an ad decision engine or downloaded from another location in accordance with a list received from an ad decision engine.
The foregoing description of the present invention has been presented for purposed of illustration and description. Furthermore, the description is not intended to limit the invention to the form disclosed herein. Consequently, variations and modifications commensurate with the above teachings, and skill and knowledge of the relevant art are within the scope of the present invention. The embodiments described herein above are further intended to explain best modes known of practicing the invention and to enable others skilled in the art to utilize the invention in such or other embodiments and with various modifications required by the particular application(s) or use(s) of the present invention. It is intended that the appended claims be construed to include alternative embodiments to the extent permitted by the prior art.
This application is a non-provisional of U.S. Provisional Application No. 62/744,535, entitled, “METHOD AND APPARATUS FOR COMBINING METADATA AND CONTENT STREAM MANIFEST FILES FOR PROCESSING ON CLIENT DEVICES,” filed on Oct. 11, 2018. The contents of the above-noted application are incorporated by reference herein as if set forth in full and priority to this application is claimed to the full extent allowable under U.S. law and regulations.
| Number | Date | Country | |
|---|---|---|---|
| 62744535 | Oct 2018 | US |
