Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels

Information

  • Patent Grant
  • 10931982
  • Patent Number
    10,931,982
  • Date Filed
    Wednesday, February 12, 2020
    4 years ago
  • Date Issued
    Tuesday, February 23, 2021
    3 years ago
Abstract
Systems and methods for streaming and playing back video having a variety of resolutions, frame rates, and/or sample aspect ratios, where the video streams are encoded at one of a number of maximum bit rate levels, in accordance with embodiments of the invention are disclosed. One embodiment includes a processor, and storage containing data relating combinations of resolution and frame rates to maximum bitrates, where a plurality of resolution and frame rates that are related to the same maximum bitrate form a maximum bitrate level. In addition, an encoding application configures the processor to encode a video stream as a plurality of video streams having different resolutions and frame rates, where the target maximum bitrate used during the encoding is selected based upon the maximum bitrate levels of the resolution and frame rate combinations indicated within the data relating combinations of resolution and frame rates to maximum bitrates.
Description
FIELD OF THE INVENTION

The present invention relates to the delivery of multimedia content, specifically streaming video content encoded at a variety of recommended maximum bitrates optimized for a variety of scaled display resolutions and network connection maximum data rates of playback devices receiving the streams.


BACKGROUND OF THE INVENTION

The term streaming media describes the playback of media on a playback device, where the media is stored on a server and continuously sent to the playback device over a network during playback. Typically, the playback device stores a sufficient quantity of media in a buffer at any given time during playback to prevent disruption of playback due to the playback device completing playback of all the buffered media prior to receipt of the next portion of media. Adaptive bitrate streaming or adaptive streaming involves detecting the present streaming conditions (e.g. the user's network bandwidth and CPU capacity) in real time and adjusting the quality of the streamed media accordingly.


In adaptive streaming systems, the source media is typically stored on a media server as a top level index file pointing to a number of alternate streams that contain the actual video and audio data. Each stream is typically stored in one or more container files. Different adaptive streaming solutions typically utilize different index and media containers. The Matroska container is a media container developed as an open standard project by the Matroska non-profit organization of Aussonne, France. The Matroska container is based upon Extensible Binary Meta Language (EBML), which is a binary derivative of the Extensible Markup Language (XML). Decoding of the Matroska container is supported by many consumer electronics (CE) devices. The DivX Plus file format developed by DivX, LLC of San Diego, Calif. utilizes an extension of the Matroska container format, including elements that are not specified within the Matroska format.


SUMMARY OF THE INVENTION

Systems and methods in accordance with embodiments of the invention stream and play back video having a variety of resolutions, frame rates, and/or sample aspect ratios, where the video streams are encoded at one of a limited number of maximum bit rate levels. One embodiment includes a processor, and storage containing an encoding application and data relating combinations of resolution and frame rates to maximum bitrates, where a plurality of resolution and frame rates that are related to the same maximum bitrate form a maximum bitrate level. In addition, the encoding application configures the processor to encode a video stream as a plurality of video streams having different resolutions and frame rates, where the target maximum bitrate used during the encoding of the video streams is selected based upon the maximum bitrate levels of the resolution and frame rate combinations indicated within the data relating combinations of resolution and frame rates to maximum bitrates.


In a further embodiment, the resolution and frame rates within a maximum bitrate level have optimal target maximum bitrates that are within a predetermined percentage of the highest optimal target maximum bitrate of a resolution and frame rate combination within the maximum bitrate level.


In another embodiment, the optimal target maximum bitrate of a resolution and frame rate combination is determined using a formula.


In a still further embodiment, the optimal target maximum bitrate of a resolution and frame rate combination is determined using experimentation.


In still another embodiment, the resolution and frame rates within a maximum bitrate level have optimal target maximum bitrates that are within a predetermined percentage of the optimal target maximum bitrate of at least one other resolution and frame rate combination within the maximum bitrate level.


In a yet further embodiment, the data relating combinations of resolution and frame rates to maximum bitrate levels relates the resolution and frame rates to maximum bitrates in the manner illustrated in FIG. 5.


Yet another embodiment includes a plurality of playback devices, where the playback devices have different display aspect ratios and utilize different types of network connections, and a streaming system comprising a plurality of servers on which a plurality of video streams are stored, where the plurality of video streams are encoded at different resolutions and frame rates. In addition, video streams stored on the streaming system are encoded using one of a plurality of maximum bitrate levels, where video streams having different resolutions and frame rates are encoded at the same maximum bitrate level, the playback devices are configured to support playback of video data encoded at maximum bitrates corresponding to a plurality of the maximum bitrate levels, the playback devices are configured to request video data from at least one video stream from the streaming system encoded at a maximum bitrate level supported by the playback device, and the playback devices are configured to playback video data encoded at a supported maximum bitrate level received from the streaming system.


A further embodiment again also includes a source encoder including storage containing data relating combinations of resolution and frame rates to maximum bitrate levels. In addition, the source encoder is configured to encode a video stream as a plurality of video streams having different resolutions and frame rates, where the target maximum bitrate used during the encoding of the video streams is selected based upon the maximum bitrate levels of the resolution and frame rate combinations indicated within the data relating combinations of resolution and frame rates to maximum bitrates levels.


In another embodiment again, the data relating combinations of resolution and frame rates to maximum bitrate levels relates the resolution and frame rates to maximum bitrate levels in the manner illustrated in FIG. 5.


A further additional embodiment includes a machine readable medium containing processor instructions, where execution of the instructions by a processor causes the processor to perform a process for determining a set of maximum bitrate levels for encoding video data for use in a streaming system including playback devices having different display aspect ratios and network connections. In addition, the process includes selecting a set of resolution and frame rate combinations, determining the optimal target maximum bitrate for encoding a stream of video data at each resolution and frame rate combination, grouping the resolution and frame rate combinations into maximum bitrate levels based upon the optimal target maximum bitrates of the resolution and frame rate combinations utilizing at least one grouping criterion, and determining a target maximum bitrate for the resolution and frame rate combinations in a maximum bitrate level.


In another additional embodiment, the optimal target maximum bitrate of a resolution and frame rate combination is determined using a formula.


In a still yet further embodiment, the optimal target maximum bitrate of a resolution and frame combination is determined using experimentation.


In still yet another embodiment, the at least one grouping criterion groups resolution and frame rates within a maximum bitrate level that have optimal target maximum bitrates that are within a predetermined percentage of the highest optimal target maximum bitrate of a resolution and frame rate combination within the maximum bitrate level.


In a still further embodiment again, the at least one grouping criterion groups resolution and frame rates within a maximum bitrate level that have optimal target maximum bitrates that are within a predetermined percentage of the optimal target maximum bitrate of at least one other resolution and frame rate combination within the maximum bitrate level.


In still another embodiment again, determining a target maximum bitrate for the resolution and frame rate combinations in a maximum bitrate level includes selecting the maximum optimal target bitrate of a resolution and frame rate combination within the maximum bitrate level.


In a still further additional embodiment, determining a target maximum bitrate for the resolution and frame rate combinations in a maximum bitrate level includes selecting the minimum optimal target bitrate of a resolution and frame rate combination within the maximum bitrate level.


In still another additional embodiment, determining a target maximum bitrate for the resolution and frame rate combinations in a maximum bitrate level includes selecting the average optimal target bitrate of the resolution and frame rate combinations within the maximum bitrate level.


A yet further embodiment again also includes rounding the average optimal target bitrate using a predetermined rounding function.


In yet another embodiment again, determining a target maximum bitrate for the resolution and frame rate combinations in a maximum bitrate level includes selecting one of a plurality known network data rates based upon the optimal target data rate of at least one of the resolution and frame rate combinations within the maximum bitrate level.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a network diagram of a level bitrate adaptive streaming system in accordance with an embodiment of the invention.



FIG. 2 conceptually illustrates a playback device configured to deliver video data encoded utilizing target maximum bitrate levels in accordance with an embodiment of the invention.



FIG. 3 is a flow chart illustrating a process for determining a set of bitrates given video data in accordance with an embodiment of the invention.



FIG. 4 is a flow chart illustrating a process for determining a set of encoding maximum bitrate levels in accordance with an embodiment of the invention.



FIG. 5 is a table illustrating an example of a set of resolutions with encoded bitrates matched to maximum profile bitrates in accordance with an embodiment of the invention.



FIG. 6 is a table illustrating an example of sets of resolutions for different aspect ratios, where the resolutions in each set are encoded so that each aspect ratio is encoded at a resolution falling within each of the maximum bitrate levels in accordance with an embodiment of the invention.





DETAILED DISCLOSURE OF THE INVENTION

Turning now to the drawings, systems and methods for streaming and playing back video having a variety of resolutions, frame rates, and/or sample aspect ratios, where the video streams are encoded at one of a limited number of maximum bit rate levels, in accordance with embodiments of the invention are illustrated. Video data is typically encoded to achieve a target maximum bitrate. The quality of video encoded with a specific resolution, and frame rate typically does not improve appreciably beyond a specific maximum bitrate threshold. Beyond that threshold, increasing the resolution of the encoded video can increase video quality. A formula can be used to recommend an optimal target maximum bitrate at which to encode video content at a specific resolution and frame rate efficiently and with the highest video quality achievable at the selected resolution. Alternatively, the bitrate threshold at which video quality does not appreciably improve can be determined through testing. While it can be beneficial to determine the optimal maximum bitrate at which to encode a specific piece of video content to efficiently achieve the highest quality video at a specific resolution and frame rate, the delivery of a large number of streams of video content to a large variety of playback devices can be simplified by specifying a limited number of maximum bitrates at which video can be encoded irrespective of the optimal target maximum bitrate for a specific frame rate and resolution combination. The ability of a specific type of playback device to playback video encoded at a specific maximum bitrate is typically confirmed via testing. Therefore, the smaller the number of maximum bitrate levels supported by a streaming system, the simpler the process of testing each playback device to confirm its ability to playback video encoded at supported target maximum bitrates. Accordingly, streaming systems can utilize a set of maximum bitrate levels to simply the process of certifying playback devices for use within the streaming system. When video is encoded for distribution via the streaming system at a number of different resolutions and frame rates, the maximum bitrate levels appropriate to each of the specific resolution and frame combinations can be selected and used as the target maximum bitrates when encoding the streams of video data.


In several embodiments, the process of selecting a set of maximum bitrate levels to use when encoding video for distribution via a streaming system involves determining the most popular aspect ratios and frame rates for video content and then determining all of the streaming resolutions and frame rates at which the video content will be encoded. When the most likely resolution and frame rate combinations are identified, the optimal target maximum bitrates for each resolution and frame rate combination can be determined using an appropriate bitrate formula or testing. Bitrate formulas that can be utilized to determine a optimal target maximum bitrate at which to encode video at a specified resolution and frame rate are discussed in U.S. patent application Ser. No. 13/432,521 entitled “Systems and Methods for Encoding Alternative Streams of Video for Playback on Playback Devices having Predetermined Display Aspect Ratios and Network Connection Maximum Data Rates”, to Soroushian et al., filed Mar. 28, 2012 (the disclosure of which is incorporated by reference herein in its entirety). The optimal target maximum bitrates can then be grouped into levels and a maximum bitrate determined for each level.


In several embodiments, the resolution and frame rate combinations can be grouped into levels based upon their corresponding optimal target maximum bitrates so that all optimal target maximum bitrates within a group are within a predetermined percentage of the highest optimal target maximum bitrate within the group. In many embodiments, the resolution and frame rate combinations can be grouped into levels based upon their corresponding optimal target maximum bitrates so that each optimal target maximum bitrate within the group is within a predetermined percentage of the next highest optimal target maximum bitrate within the group. In other embodiments, any of a variety of grouping criteria can be utilized in accordance with embodiments of the invention including criteria that group resolution and frame rate combinations into a predetermined number of groups based upon their optimal target maximum bitrates.


The maximum bitrate that is assigned to the resolution and frame rate combinations at a level can be determined in any number of different ways including (but not limited to) the average bitrate of the optimal target maximum bitrates included in the group, the minimum bitrate of the optimal target maximum bitrates included in the level, and/or a typical network connection data rate that is close to one or more of the target maximum bitrates in the level. The maximum bitrate determined for each level can then be used to encode content at the resolution and frame rate combinations within the level. In several embodiments, the process of determining the maximum bitrate levels is performed in a first process and the maximum bit rate levels and the resolution and frame rate combinations that fall within each level can be provided to a source encoding system for use in the encoding of video content.


In many embodiments, the streaming system is an adaptive bitrate streaming system. Adaptive bitrate streaming systems can stream alternative streams of video data encoded at maximum bitrates. In order to provide the highest quality video experience independent of the network data rate, the adaptive bitrate streaming systems switch between the available streams of video data throughout the delivery of the video data according to a variety of factors, including, but not limited to, the available network data rate and video decoder performance. Systems and methods for switching between video streams during playback are disclosed in U.S. patent application Ser. No. 13/221,682 entitled “Systems and Methods for Adaptive Bitrate Streaming of Media Stored in Matroska Container Files Using Hypertext Transfer Protocol” to Braness et al., filed Aug. 30, 2011, the disclosure of which is incorporated by reference herein in its entirety. In adaptive bitrate streaming systems, a number of alternative streams are likely to be encoded having the same aspect ratio, but different resolutions. Systems and methods for selecting the resolutions at which to encode alternative streams of video for use in adaptive bitrate streaming systems are described in U.S. patent application Ser. No. 13/430,032 entitled “Selection of Resolutions for Seamless Resolution Switching of Multimedia Content” to Soroushian et al., filed Mar. 26, 2012 (the disclosure of which is incorporated by reference herein in its entirety). Although much of the discussion that follows references adaptive bitrate streaming systems, systems and methods in accordance with embodiments of the invention can be utilized in streaming systems that are non-adaptive. Systems and methods for streaming video at a plurality of resolution and frame rates using a smaller set of maximum bit rate levels in accordance with embodiments of the invention are discussed further below.


System Overview


A streaming system in accordance with an embodiment of the invention is illustrated in FIG. 1. The streaming system 100 includes a source encoder 106 configured to encode source video as a number of alternative video streams. Alternative streams are streams that encode the same media content in different ways. In many instances, alternative streams encode media content (such as but not limited to video) at different resolution and sample aspect ratio combinations and different maximum bitrates. In a number of embodiments, alternative video streams form sets of alternative video streams encoded with the same aspect ratio corresponding to the display aspect ratio of a set of playback devices. In many embodiments, the source encoder possesses a lookup table that indexes resolution and frame rate combinations to a predetermined set of maximum bitrate levels. The source encoder uses the lookup table to determine the target maximum bitrate at which to encode video at a specific resolution and frame rate combination.


In many embodiments, the streaming system is an adaptive bitrate streaming system and the source encoder encodes each alternative stream into a separate container file and generates a top level index file describing each of the streams contained within the container files. The top level index file and the container files are uploaded to an HTTP server 104. In other embodiments, the container files are uploaded to an HTTP server 104 and the top level index file is dynamically generated in response to a request for a specific piece of content by a playback device. In the illustrated embodiment, the source encoder is a server. In other embodiments, the source encoder can be any processing device including a processor and sufficient resources to perform the transcoding of source media (including but not limited to video, audio, and/or subtitles).


In the illustrated embodiment, playback devices include personal computers 110, CE players 108, and mobile phones 112. In other embodiments, playback devices can include consumer electronics devices such as DVD players, Blu-ray players, televisions, set top boxes, video game consoles, tablets, and other devices that are capable of connecting to a server via HTTP and playing back encoded media. In the illustrated embodiment, a variety of playback devices use HTTP or another appropriate stateless protocol to request portions of a top level index file and the container files via a network 102 such as the Internet. Prior to a playback device performing adaptive bitrate streaming using portions of media from alternative streams contained within the container files, a bandwidth probe can be performed by the playback device to determine available bandwidth. Once the bandwidth probe has been completed, the playback device can utilize data within the top level index including (but not limited to) the maximum bitrate of each of the available streams to determine the initial streams from which to commence requesting portions of encoded media as part of an adaptive streaming process.


Once playback of content from the initial set of streams commences, the playback device utilizes the top level index to perform adaptive bitrate streaming of the content in response to changes in streaming conditions. In many adaptive bitrate streaming systems, the playback device can progress through a series of operational phases in which the playback device responds differently in each phase to changes in the streaming conditions. In a number of embodiments, stability in streaming conditions or improving streaming conditions can result in a transition to a phase in which the playback device assumes stable operating conditions, buffers more content, and is less responsive to fluctuations in streaming conditions. In many embodiments, a deterioration in streaming conditions results in a stream switch to a set of streams at a lower resolution utilizing less bandwidth and resulting in the playback device transitioning to a phase in which the playback device assumes unstable operating conditions, buffers less content, and responds rapidly to variations in streaming conditions.


Source Encoders


Source encoders in accordance with embodiments of the invention are utilized to encode source content at any of a number of resolutions and frame rates at target maximum bitrates determined using a set of predetermined maximum bitrate levels. The basic architecture of a source encoder in accordance with an embodiment of the invention is illustrated in FIG. 2. The source encoder 150 includes a processor 152 in communication with memory 154. In the illustrated embodiment, the memory 154 includes an encoding application 156, video data 158, which can include (but is not limited to) source video data and encoded alternative streams of video data, and data describing the target maximum bitrates at which to encode a plurality of resolution and frame rate combinations 160. In many embodiments, the target maximum bitrates are selected from a set of predetermined maximum bitrate levels that includes a number of levels that is smaller than the number of resolution and frame rate combinations. In certain embodiments, a plurality of resolution and frame rate combinations is associated with each of a plurality of maximum bitrate levels. In several embodiments, the data concerning target maximum bitrate levels is a lookup table that is indexed by resolution and frame rate combinations and associates specific maximum bitrate levels with specific resolution and frame rate combinations. In other embodiments, any of a variety of data structures can be utilized to identify a target maximum bitrate from a predetermined set of target maximum bitrates to utilize in the encoding of a specific resolution and frame rate combination.


Although a specific architecture is illustrated in FIG. 2, any of a variety of architectures including architectures where the application and/or set of predetermined maximum bitrate levels are located on disk or some other form of storage and is loaded into memory at runtime can be utilized to implement a source encoder in accordance with an embodiment of the invention. Furthermore, any of a variety of system architectures including (but not limited) to the system architecture illustrated in FIG. 1 can be utilized to perform video delivery in accordance with embodiments of the invention. Systems and methods for determining a predetermined set of maximum bitrate levels at which to encode video at a plurality of resolution and frame combinations in accordance with embodiments of the invention are discussed further below.


Determining Target Maximum Bitrates


The initial step in determining a set of predetermined bitrates at which to encode video is determining the characteristics of the video that is likely to be streamed by a streaming system. Once the resolution and frame rate combinations of the video that is likely to be streamed are identified, the optimal target maximum bitrate of each resolution and frame rate combination can be calculated and the results used to determine a set of maximum bitrate levels at which video can be encoded for different resolution and frame rate combinations. The term optimal target maximum bitrate can be used to describe the maximum bitrate beyond which video quality at a specific resolution and frame rate does not appreciably increase. Stated another way, the optimal target maximum bitrate is the lowest bitrate at which the highest quality video can be achieved at a given resolution and frame rate. In using a term such as optimal target maximum bitrate, there is typically an acknowledgement that video quality is subjective. Therefore, there is no concept of a “true” optimal target maximum bitrate. The optimal target maximum bitrate is simply a value that can be determined through subjective experimentation. In many instances, observations concerning target maximum bitrates have resulted in the definition of functions that can be utilized to calculate an optimal target maximum bitrate based upon the resolution and frame rate. As is discussed further below, the technique for determining an optimal target maximum bitrate is not as important as the manner in which that maximum bitrates are utilized to select maximum bitrate levels.


A process for determining optimal target maximum bitrates for video streamed within an adaptive bitrate streaming system in accordance with embodiments of the invention is illustrated in FIG. 3. The process 200 commences by selecting 210 display aspect ratios and frame rates supported by the streaming system. The display aspect ratios and frame rates are typically determined based upon popular display aspect ratios and frame rates supported by playback devices that are likely to be used to stream video within the streaming system. Resolutions can be determined 212 based upon the selected display aspect ratios and, in many instances, based upon anticipated maximum data rates supported within the streaming system. Processes for determining resolutions at which to encode alternative video streams based upon the display aspect ratio of a playback device are described in U.S. patent application Ser. No. 13/430,032 entitled “Selection of Resolutions for Seamless Resolution Switching of Multimedia Content” to Soroushian et al., filed Mar. 26, 2012 (incorporated by reference above).


An optimal target maximum bitrate is determined (214) for each selected frame rate and resolution combination. In several embodiments, maximum bitrate targets are determined 214 utilizing a bitrate formula where the bitrate formula may utilize various aspects of the video data, including frame rate, resolution, and other pertinent information as input. Examples of appropriate bitrate formulas are described in U.S. patent application No. “Systems and Methods for Encoding Alternative Streams of Video for Playback on Playback Devices having Predetermined Display Aspect Ratios and Network Connection Maximum Data Rates”, to Soroushian et al., filed Mar. 28, 2012 (incorporated by reference above). In a number of embodiments, the determination (214) of the optimal target maximum bitrate for a specific resolution and frame rate combination may involve subjective or objective quality evaluation methods of the video data encoded at the target maximum bitrate. Once the optimal target maximum bitrates for each of the resolution and frame rate combinations is determined, a process can then be performed to identify a set of maximum bitrate can be selected based upon the optimal target maximum bitrates. Processes for determining a set of maximum bitrate levels based upon a set of optimal target maximum bitrates associated with specific resolution and frame rate combinations in accordance with embodiments of the invention are discussed below.


Generating Sets of Maximum Bitrate Levels


A process for determining a set of maximum bitrate levels based upon a set of optimal target maximum bitrates associated with specific resolution and frame rate combinations in accordance with an embodiment of the invention is illustrated in FIG. 4. The process 300 involves setting (310) the current bitrate to the highest optimal target maximum bitrate from a set of optimal target maximum bitrates. The level maximum bitrate is updated (312) utilizing the current bitrate. In many embodiments, the level maximum bitrate may be set to the average, median, minimum, or maximum combination of the bitrates in the current bitrate level. In a number of embodiments, the level average bitrate is a linear or non-linear combination of the bitrates in the current bitrate level. In other embodiments, the level maximum bitrate can be determined after all of the levels are identified.


The current bitrate is compared (314) to the next lower optimal target maximum bitrate in the input set of optimal target maximum bitrates. A decision (316) is then made. Given a threshold value, if the difference between the current bitrate and the next lower optimal target maximum bitrate does not exceed the threshold value, the current bitrate is included in the optimal maximum bitrate level. In other embodiments, any of a variety of criteria can be utilized to determine whether to include a specific resolution and frame rate combination in a level based upon the optimal target maximum bitrate for the resolution and frame combination. Accordingly, the current bitrate is set (318) to the next lower optimal target maximum bitrate and the process loops back to updating (312) the level maximum bitrate. In several embodiments, the threshold value is a percentage difference between consecutive bitrate levels, such as 10%. In several embodiments, the threshold value is a fixed value or is related in a non-linear manner to the value of the current bitrate. If the threshold value is exceeded, the level maximum bitrate is recorded (320) in the set of maximum bitrate levels. In several embodiments, the level bitrate level is rounded to the closest whole number. Another decision (322) is made. If target maximum bitrates remain to be considered, a new level bitrate is started (324), the current bitrate is set (318) to the next highest optimal target maximum bitrate, and the process continues updating (312) the level maximum bitrate of the new level. The process 300 is complete when all bitrates have been considered.


In a number of embodiments, the maximum bitrate levels and the resolutions and frame rates assigned to specific groups can be modified in accordance with the requirements of a specific application. For example, the optimal maximum bitrate at each level can be rounded down (or up) to the closest whole-number multiple of 10, 100 or 1000. Although a specific process is illustrated in FIG. 4, any of a variety of processes can be utilized including a process that groups resolution and frame rate combinations into a predetermined number of levels based upon one or more criteria including (but not limited to) maximizing the similarity of the optimal target maximum bitrates of the resolution and frame combinations at each level.


An example of a grouping of a set of maximum bitrate levels defined based on the resolution, and frame rate of encoded video in accordance with an embodiment of the invention is illustrated in FIG. 5.


For example, in many embodiments of the invention 1440×816 is a sub-resolution for video data having a primary resolution of 1920×816 at 24 frames per second with a sample aspect ratio of 4:3. Likewise, the resolution 1440×800 is a sub-resolution for video data having a primary resolution of 1920×800 at 24 frames per second with a sample aspect ratio of 4:3. The encoded maximum bitrate of the 1440×816 video is 3,557 Kbps and the encoded maximum bitrate of the 1440×800 video is 3,459 Kbps. In several embodiments, 1440×816 and 1440×800 are within a threshold value of each other and no other resolutions are within the threshold value. The average bitrate for these resolutions is 3,508 Kbps, rounded to 3,500 Kbps. In accordance with an embodiment of the invention, 3,500 Kbps will be one maximum bitrate in the set of maximum profile bitrates.


In order to stream video content at each maximum bitrate level, a variety of resolutions may be utilized depending on the sample aspect ratio and frame rate of the source content. An example profile of recommended resolutions based on the frame rate and primary aspect ratio of the video content for various maximum bitrates is illustrated in FIG. 6. In many embodiments of the invention, the same resolution may be utilized for multiple frame rates and sample aspect ratios in order to maximize the subjective and/or objective quality of the streamed video data.


Although the present invention has been described in certain specific aspects, many additional modifications and variations would be apparent to those skilled in the art. It is therefore to be understood that the present invention may be practiced otherwise than specifically described, including playback devices where the set of streaming switching conditions utilized by the playback device are continuously changing, without departing from the scope and spirit of the present invention. Thus, embodiments of the present invention should be considered in all respects as illustrative and not restrictive. Accordingly, the scope of the invention should be determined not by the embodiments illustrated, but by the appended claims and their equivalents.

Claims
  • 1. A content distribution system comprising: a set of one or more encoding servers, wherein each server of the set of encoding servers comprises: a non-volatile storage containing an encoder application; andat least one processor;wherein the encoder applications cause the set of encoding servers to encode source content as a set of streams that are each stored in separate container files, each container files comprising a set of one or more alternative video streams, each having a frame rate and a bitrate, by causing the processor to perform the steps of: identifying a plurality of sections of the source content;identifying a plurality of resolution and frame rate combinations for encoding of video content;determining an optimal target maximum bitrate for each of the received plurality of resolution and frame rate combinations, wherein an optimal target maximum bitrate is the lowest bitrate at which a highest video quality criterion is satisfied for a specific resolution and frame rate combination;for each particular bitrate group of a plurality of bitrate groups: identifying, based on a relationship between the optimal target maximum bitrates and the particular bitrate group, a set of resolution and frame rate combinations from the plurality of resolution and frame rate combinations;for each particular section of the plurality of sections, encoding the particular section to produce a plurality of encodings of the particular section, wherein the plurality of encodings is encoded at one of the set of resolution and frame rate combinations and a bitrate associated with the particular bitrate group;assembling the encodings of the plurality of sections for a given video stream from the plurality of alternative video streams a container file for each of the plurality of alternative video streams by: assembling the encodings of the plurality of sections for a given video stream from the plurality of alternative video streams into a video container file; andgenerating entries in a container index within the video container file indicating sizes of portions of the given video stream within the video container file; anduploading the container files for each of the plurality of alternative video streams to a set of servers that form part of a content distribution system.
  • 2. The content distribution system of claim 1, wherein the optimal target maximum bitrates are determined using a formula.
  • 3. The content distribution system of claim 1, wherein the optimal target maximum bitrate of a resolution and frame rate combination is determined using experimentation.
  • 4. The content distribution system of claim 1, wherein identifying a set of resolution and frame rate combinations comprises identifying resolution and frame rate combinations with optimal target maximum bitrates within a predetermined percentage of the highest optimal target maximum bitrate of a resolution and frame rate combination within the particular bitrate group.
  • 5. The content distribution system of claim 1, wherein the resolution and frame rate combinations within a bitrate group have optimal target maximum bitrates that are within a predetermined percentage of the optimal target maximum bitrate of at least one other resolution and frame rate combination within the maximum bitrate level.
  • 6. The content distribution system of claim 1, wherein both a width and a height of each resolution of the plurality of resolution and frame rate combinations have an integer number of pixels.
  • 7. The content distribution system of claim 1, wherein each resolution of the plurality of resolution and frame rate combinations has a same display aspect ratio.
  • 8. The content distribution system of claim 7, wherein at least two resolutions of the plurality of resolution and frame rate combinations have different sample aspect ratios.
  • 9. A method for encoding source content as a set of streams that are each stored in separate container files, each container files comprising a set of one or more alternative video streams, each having a frame rate and a bitrate, the method comprising: identifying a plurality of sections of the source content;identifying a plurality of resolution and frame rate combinations for encoding of video content;determining an optimal target maximum bitrate for each of the received plurality of resolution and frame rate combinations, wherein an optimal target maximum bitrate is the lowest bitrate at which a highest video quality criterion is satisfied for a specific resolution and frame rate combination;for each particular bitrate group of a plurality of bitrate groups: identifying, based on a relationship between the optimal target maximum bitrates and the particular bitrate group, a set of resolution and frame rate combinations from the plurality of resolution and frame rate combinations;for each particular section of the plurality of sections, encoding the particular section to produce a plurality of encodings of the particular section, wherein the plurality of encodings is encoded at one of the set of resolution and frame rate combinations and a bitrate associated with the particular bitrate group;assembling the encodings of the plurality of sections for a given video stream from the plurality of alternative video streams a container file for each of the plurality of alternative video streams by: assembling the encodings of the plurality of sections for a given video stream from the plurality of alternative video streams into a video container file; andgenerating entries in a container index within the video container file indicating sizes of portions of the given video stream within the video container file; anduploading the container files for each of the plurality of alternative video streams to a set of servers that form part of a content distribution system.
  • 10. The method of claim 9, wherein the optimal target maximum bitrates are determined using a formula.
  • 11. The method of claim 9, wherein the optimal target maximum bitrate of a resolution and frame rate combination is determined using experimentation.
  • 12. The method of claim 9, wherein identifying a set of resolution and frame rate combinations comprises identifying resolution and frame rate combinations with optimal target maximum bitrates within a predetermined percentage of the highest optimal target maximum bitrate of a resolution and frame rate combination within the particular bitrate group.
  • 13. The method of claim 9, wherein the resolution and frame rate combinations within a bitrate group have optimal target maximum bitrates that are within a predetermined percentage of the optimal target maximum bitrate of at least one other resolution and frame rate combination within the maximum bitrate level.
  • 14. The method of claim 9, wherein both a width and a height of each resolution of the plurality of resolution and frame rate combinations have an integer number of pixels.
  • 15. The method of claim 9, wherein each resolution of the plurality of resolution and frame rate combinations has a same display aspect ratio.
  • 16. The method of claim 15, wherein at least two resolutions of the plurality of resolution and frame rate combinations have different sample aspect ratios.
CROSS-REFERENCE TO RELATED APPLICATIONS

The current application is a continuation of U.S. patent application Ser. No. 15/922,198, filed Mar. 15, 2018, which is a continuation of U.S. patent application Ser. No. 13/600,046, filed Aug. 30, 2012, which claims priority to U.S. Provisional Patent Application No. 61/529,201, filed Aug. 30, 2011, the disclosures of which are incorporated herein by reference.

US Referenced Citations (503)
Number Name Date Kind
3919474 Benson Nov 1975 A
4009331 Goldmark et al. Feb 1977 A
4694357 Rahman et al. Sep 1987 A
4802170 Trottier Jan 1989 A
4964069 Ely Oct 1990 A
4974260 Rudak Nov 1990 A
5119474 Beitel et al. Jun 1992 A
5274758 Beitel et al. Dec 1993 A
5361332 Yoshida et al. Nov 1994 A
5396497 Veltman Mar 1995 A
5400401 Wasilewski et al. Mar 1995 A
5404436 Hamilton Apr 1995 A
5420801 Dockter et al. May 1995 A
5420974 Morris et al. May 1995 A
5471576 Yee Nov 1995 A
5487167 Dinallo et al. Jan 1996 A
5533021 Branstad et al. Jul 1996 A
5537408 Branstad et al. Jul 1996 A
5539908 Chen et al. Jul 1996 A
5541662 Adams et al. Jul 1996 A
5574785 Ueno et al. Nov 1996 A
5583652 Ware Dec 1996 A
5600721 Kitazato Feb 1997 A
5621794 Matsuda et al. Apr 1997 A
5627936 Prasad May 1997 A
5633472 DeWitt et al. May 1997 A
5642171 Baumgartner et al. Jun 1997 A
5642338 Fukushima et al. Jun 1997 A
5655117 Goldberg et al. Aug 1997 A
5664044 Ware Sep 1997 A
5675382 Bauchspies Oct 1997 A
5675511 Prasad et al. Oct 1997 A
5684542 Tsukagoshi Nov 1997 A
5717394 Schwartz et al. Feb 1998 A
5719786 Nelson et al. Feb 1998 A
5745643 Mishina Apr 1998 A
5751280 Abbott May 1998 A
5763800 Rossum et al. Jun 1998 A
5765164 Prasad et al. Jun 1998 A
5794018 Vrvilo et al. Aug 1998 A
5805228 Proctor et al. Sep 1998 A
5805700 Nardone et al. Sep 1998 A
5813010 Kurano et al. Sep 1998 A
5822524 Chen et al. Oct 1998 A
5828370 Moeller et al. Oct 1998 A
5844575 Reid Dec 1998 A
5848217 Tsukagoshi et al. Dec 1998 A
5854873 Mori et al. Dec 1998 A
5903261 Walsh et al. May 1999 A
5907597 Mark May 1999 A
5907658 Murase et al. May 1999 A
5912710 Fujimoto Jun 1999 A
5923869 Kashiwagi et al. Jul 1999 A
5956729 Goetz et al. Sep 1999 A
5959690 Toebes, VIII et al. Sep 1999 A
5990955 Koz Nov 1999 A
6002834 Hirabayashi et al. Dec 1999 A
6005621 Linzer et al. Dec 1999 A
6009237 Hirabayashi et al. Dec 1999 A
6016381 Taira et al. Jan 2000 A
6031622 Ristow et al. Feb 2000 A
6046778 Nonomura et al. Apr 2000 A
6057832 Lev et al. May 2000 A
6065050 DeMoney May 2000 A
6079566 Eleftheriadis et al. Jun 2000 A
6157410 Izumi et al. Dec 2000 A
6169242 Fay et al. Jan 2001 B1
6195388 Choi et al. Feb 2001 B1
6204883 Tsukagoshi Mar 2001 B1
6246803 Gauch et al. Jun 2001 B1
6266483 Okada et al. Jul 2001 B1
6282320 Hasegawa et al. Aug 2001 B1
6308005 Ando et al. Oct 2001 B1
6320905 Konstantinides Nov 2001 B1
6330286 Lyons et al. Dec 2001 B1
6351538 Uz Feb 2002 B1
6373803 Ando et al. Apr 2002 B2
6374144 Viviani et al. Apr 2002 B1
6395969 Fuhrer May 2002 B1
6415031 Colligan et al. Jul 2002 B1
6430354 Watanabe Aug 2002 B1
6445877 Okada et al. Sep 2002 B1
6453115 Boyle Sep 2002 B1
6453116 Ando et al. Sep 2002 B1
6481012 Gordon et al. Nov 2002 B1
6504873 Vehvilaeinen Jan 2003 B1
6512883 Shim et al. Jan 2003 B2
6594699 Sahai et al. Jul 2003 B1
6614843 Gordon et al. Sep 2003 B1
6654933 Abbott et al. Nov 2003 B1
6658056 Duruöz et al. Dec 2003 B1
6665835 Gutfreund et al. Dec 2003 B1
6671408 Kaku Dec 2003 B1
6690838 Zhou Feb 2004 B2
6697568 Kaku Feb 2004 B1
6724944 Kalevo et al. Apr 2004 B1
6725281 Zintel et al. Apr 2004 B1
6751623 Basso et al. Jun 2004 B1
6807306 Girgensohn et al. Oct 2004 B1
6813437 Ando et al. Nov 2004 B2
6819394 Nomura et al. Nov 2004 B1
6856997 Lee et al. Feb 2005 B2
6859496 Boroczky et al. Feb 2005 B1
6871006 Oguz et al. Mar 2005 B1
6912513 Candelore Jun 2005 B1
6917652 Lyu Jul 2005 B2
6920179 Anand et al. Jul 2005 B1
6931531 Takahashi Aug 2005 B1
6944621 Collart Sep 2005 B1
6944629 Shioi et al. Sep 2005 B1
6956901 Boroczky et al. Oct 2005 B2
6957350 Demos Oct 2005 B1
6970564 Kubota et al. Nov 2005 B1
6983079 Kim Jan 2006 B2
6985588 Glick et al. Jan 2006 B1
6988144 Luken et al. Jan 2006 B1
7006757 Ando et al. Feb 2006 B2
7007170 Morten Feb 2006 B2
7020287 Unger Mar 2006 B2
7127155 Ando et al. Oct 2006 B2
7151832 Fetkovich et al. Dec 2006 B1
7188183 Paul et al. Mar 2007 B1
7209892 Galuten et al. Apr 2007 B1
7212726 Zetts May 2007 B2
7237061 Boic Jun 2007 B1
7242772 Tehranchi Jul 2007 B1
7274861 Yahata et al. Sep 2007 B2
7295673 Grab et al. Nov 2007 B2
7330875 Parasnis et al. Feb 2008 B1
7340528 Noblecourt et al. Mar 2008 B2
7349886 Morten et al. Mar 2008 B2
7352956 Winter et al. Apr 2008 B1
7356245 Belknap et al. Apr 2008 B2
7366788 Jones et al. Apr 2008 B2
7382879 Miller Jun 2008 B1
7397853 Kwon et al. Jul 2008 B2
7400679 Kwon et al. Jul 2008 B2
7418132 Hoshuyama Aug 2008 B2
7457359 Mabey et al. Nov 2008 B2
7457415 Reitmeier et al. Nov 2008 B2
7478325 Foehr Jan 2009 B2
7493018 Kim Feb 2009 B2
7499930 Naka et al. Mar 2009 B2
7499938 Collart Mar 2009 B2
7546641 Robert et al. Jun 2009 B2
7639921 Seo et al. Dec 2009 B2
7640435 Morten Dec 2009 B2
7711052 Hannuksela et al. May 2010 B2
7728878 Yea et al. Jun 2010 B2
7853980 Pedlow, Jr. et al. Dec 2010 B2
7864186 Robotham et al. Jan 2011 B2
7869691 Kelly et al. Jan 2011 B2
7945143 Yahata et al. May 2011 B2
8023562 Zheludkov et al. Sep 2011 B2
8046453 Olaiya Oct 2011 B2
8054880 Yu et al. Nov 2011 B2
8131875 Chen Mar 2012 B1
8169916 Pai et al. May 2012 B1
8225061 Greenebaum Jul 2012 B2
8233768 Soroushian et al. Jul 2012 B2
8243924 Chen et al. Aug 2012 B2
8249168 Graves Aug 2012 B2
8270473 Chen et al. Sep 2012 B2
8270819 Vannier Sep 2012 B2
8286213 Seo Oct 2012 B2
8289338 Priyadarshi et al. Oct 2012 B2
8311115 Gu et al. Nov 2012 B2
8312079 Newsome et al. Nov 2012 B2
8321556 Chatterjee et al. Nov 2012 B1
8369421 Kadono et al. Feb 2013 B2
8386621 Park Feb 2013 B2
8396114 Gu et al. Mar 2013 B2
8456380 Pagan Jun 2013 B2
8649669 Braness et al. Feb 2014 B2
8683066 Hurst et al. Mar 2014 B2
RE45052 Li Jul 2014 E
8767825 Wang et al. Jul 2014 B1
8768984 Priddle et al. Jul 2014 B2
8782268 Pyle et al. Jul 2014 B2
8818171 Soroushian et al. Aug 2014 B2
8819116 Tomay et al. Aug 2014 B1
8832297 Soroushian et al. Sep 2014 B2
8849950 Stockhammer et al. Sep 2014 B2
8914534 Braness et al. Dec 2014 B2
9021119 Van Der Schaar et al. Apr 2015 B2
9025659 Soroushian et al. May 2015 B2
9038116 Knox et al. May 2015 B1
9197944 Reisner Nov 2015 B2
9215466 Zhai et al. Dec 2015 B2
9344721 Dikvall May 2016 B2
9350990 Orton-Jay et al. May 2016 B2
9357210 Orton-Jay et al. May 2016 B2
9467708 Soroushian et al. Oct 2016 B2
9510031 Soroushian et al. Nov 2016 B2
9571827 Su et al. Feb 2017 B2
9661049 Gordon May 2017 B2
9712890 Shivadas et al. Jul 2017 B2
9955195 Soroushian Apr 2018 B2
10148989 Amidei et al. Dec 2018 B2
10645429 Soroushian May 2020 B2
10708587 Soroushian et al. Jul 2020 B2
10798143 Soroushian et al. Oct 2020 B2
20010021276 Zhou Sep 2001 A1
20010030710 Werner Oct 2001 A1
20010052077 Fung et al. Dec 2001 A1
20010052127 Seo et al. Dec 2001 A1
20020034252 Owen et al. Mar 2002 A1
20020048450 Zetts Apr 2002 A1
20020051494 Yamaguchi et al. May 2002 A1
20020062313 Lee et al. May 2002 A1
20020067432 Kondo et al. Jun 2002 A1
20020076112 Devara Jun 2002 A1
20020087569 Fischer et al. Jul 2002 A1
20020091665 Beek et al. Jul 2002 A1
20020093571 Hyodo Jul 2002 A1
20020094031 Ngai et al. Jul 2002 A1
20020110193 Yoo et al. Aug 2002 A1
20020118953 Kim Aug 2002 A1
20020120498 Gordon et al. Aug 2002 A1
20020135607 Kato et al. Sep 2002 A1
20020141503 Kobayashi et al. Oct 2002 A1
20020143413 Fay et al. Oct 2002 A1
20020143547 Fay et al. Oct 2002 A1
20020147980 Satoda Oct 2002 A1
20020151992 Hoffberg et al. Oct 2002 A1
20020154779 Asano et al. Oct 2002 A1
20020161462 Fay Oct 2002 A1
20020164024 Arakawa et al. Nov 2002 A1
20020169971 Asano et al. Nov 2002 A1
20020180929 Tseng et al. Dec 2002 A1
20020184159 Tadayon et al. Dec 2002 A1
20020191112 Akiyoshi et al. Dec 2002 A1
20020191960 Fujinami et al. Dec 2002 A1
20030001964 Masukura et al. Jan 2003 A1
20030002577 Pinder Jan 2003 A1
20030002578 Tsukagoshi et al. Jan 2003 A1
20030005442 Brodersen et al. Jan 2003 A1
20030035488 Barrau Feb 2003 A1
20030044080 Frishman et al. Mar 2003 A1
20030053541 Sun et al. Mar 2003 A1
20030063675 Kang et al. Apr 2003 A1
20030077071 Lin et al. Apr 2003 A1
20030078930 Surcouf et al. Apr 2003 A1
20030093799 Kauffman et al. May 2003 A1
20030123855 Okada et al. Jul 2003 A1
20030128296 Lee Jul 2003 A1
20030133506 Haneda Jul 2003 A1
20030135742 Evans Jul 2003 A1
20030142594 Tsumagari et al. Jul 2003 A1
20030142872 Koyanagi Jul 2003 A1
20030152370 Otomo et al. Aug 2003 A1
20030165328 Grecia Sep 2003 A1
20030185302 Abrams Oct 2003 A1
20030185542 McVeigh et al. Oct 2003 A1
20030206558 Parkkinen et al. Nov 2003 A1
20030206717 Yogeshwar et al. Nov 2003 A1
20030216922 Gonzales et al. Nov 2003 A1
20030231863 Eerenberg et al. Dec 2003 A1
20030231867 Gates et al. Dec 2003 A1
20030236836 Borthwick Dec 2003 A1
20040001594 Krishnaswamy et al. Jan 2004 A1
20040006701 Kresina Jan 2004 A1
20040021684 Millner Feb 2004 A1
20040022391 Obrien Feb 2004 A1
20040025180 Begeja et al. Feb 2004 A1
20040028227 Yu Feb 2004 A1
20040037421 Truman Feb 2004 A1
20040047592 Seo et al. Mar 2004 A1
20040047607 Seo et al. Mar 2004 A1
20040047614 Green Mar 2004 A1
20040052501 Tam Mar 2004 A1
20040071453 Valderas Apr 2004 A1
20040076237 Kadono et al. Apr 2004 A1
20040081333 Grab et al. Apr 2004 A1
20040081434 Jung et al. Apr 2004 A1
20040093494 Nishimoto et al. May 2004 A1
20040101059 Joch et al. May 2004 A1
20040107356 Shamoon et al. Jun 2004 A1
20040114687 Ferris et al. Jun 2004 A1
20040117347 Seo et al. Jun 2004 A1
20040136698 Mock Jul 2004 A1
20040143760 Alkove et al. Jul 2004 A1
20040146276 Ogawa Jul 2004 A1
20040150747 Sita Aug 2004 A1
20040208245 Macinnis et al. Oct 2004 A1
20040213547 Hayes Oct 2004 A1
20040217971 Kim Nov 2004 A1
20040255236 Collart Dec 2004 A1
20050013494 Srinivasan et al. Jan 2005 A1
20050015797 Noblecourt et al. Jan 2005 A1
20050038826 Bae et al. Feb 2005 A1
20050052294 Liang et al. Mar 2005 A1
20050055399 Savchuk Mar 2005 A1
20050063541 Candelore Mar 2005 A1
20050076232 Kawaguchi Apr 2005 A1
20050089091 Zhao et al. Apr 2005 A1
20050144468 Northcutt Jun 2005 A1
20050157948 Lee Jul 2005 A1
20050177741 Chen et al. Aug 2005 A1
20050180641 Clark Aug 2005 A1
20050193070 Brown et al. Sep 2005 A1
20050193322 Lamkin et al. Sep 2005 A1
20050196147 Seo et al. Sep 2005 A1
20050207442 Zoest et al. Sep 2005 A1
20050207578 Matsuyama et al. Sep 2005 A1
20050210145 Kim et al. Sep 2005 A1
20050243912 Kwon et al. Nov 2005 A1
20050265555 Pippuri Dec 2005 A1
20050273695 Schnurr Dec 2005 A1
20050275656 Corbin et al. Dec 2005 A1
20060013568 Rodriguez Jan 2006 A1
20060015813 Chung et al. Jan 2006 A1
20060039481 Shen Feb 2006 A1
20060072672 Holcomb et al. Apr 2006 A1
20060078301 Ikeda et al. Apr 2006 A1
20060093320 Hallberg et al. May 2006 A1
20060126717 Boyce et al. Jun 2006 A1
20060129909 Butt et al. Jun 2006 A1
20060165163 Burazerovic et al. Jul 2006 A1
20060168639 Gan et al. Jul 2006 A1
20060173887 Breitfeld et al. Aug 2006 A1
20060181965 Collart Aug 2006 A1
20060182139 Bugajski et al. Aug 2006 A1
20060235880 Qian Oct 2006 A1
20060245727 Nakano et al. Nov 2006 A1
20060259588 Lerman et al. Nov 2006 A1
20060263056 Lin et al. Nov 2006 A1
20060267986 Bae Nov 2006 A1
20060274835 Hamilton et al. Dec 2006 A1
20070005333 Setiohardjo et al. Jan 2007 A1
20070024706 Brannon et al. Feb 2007 A1
20070031110 Rijckaert Feb 2007 A1
20070047645 Takashima Mar 2007 A1
20070047901 Ando et al. Mar 2007 A1
20070053293 Mcdonald et al. Mar 2007 A1
20070067472 Maertens et al. Mar 2007 A1
20070083467 Lindahl et al. Apr 2007 A1
20070083617 Chakrabarti et al. Apr 2007 A1
20070086528 Mauchly et al. Apr 2007 A1
20070140647 Kusunoki et al. Jun 2007 A1
20070154165 Hemmeryckz-Deleersnijder et al. Jul 2007 A1
20070168541 Gupta et al. Jul 2007 A1
20070168542 Gupta et al. Jul 2007 A1
20070177812 Yang et al. Aug 2007 A1
20070180051 Kelly et al. Aug 2007 A1
20070180125 Knowles et al. Aug 2007 A1
20070239839 Buday et al. Oct 2007 A1
20070292107 Yahata et al. Dec 2007 A1
20080030614 Schwab Feb 2008 A1
20080052306 Wang et al. Feb 2008 A1
20080086570 Dey et al. Apr 2008 A1
20080101466 Swenson et al. May 2008 A1
20080101718 Yang et al. May 2008 A1
20080104633 Noblecourt et al. May 2008 A1
20080120330 Reed et al. May 2008 A1
20080120342 Reed et al. May 2008 A1
20080126248 Lee et al. May 2008 A1
20080137736 Richardson et al. Jun 2008 A1
20080137847 Candelore et al. Jun 2008 A1
20080137848 Kocher et al. Jun 2008 A1
20080192818 DiPietro et al. Aug 2008 A1
20080196076 Shatz et al. Aug 2008 A1
20080232456 Terashima et al. Sep 2008 A1
20080253454 Imamura et al. Oct 2008 A1
20080256105 Nogawa et al. Oct 2008 A1
20080263354 Beuque et al. Oct 2008 A1
20080266522 Weisgerber Oct 2008 A1
20080279535 Haque et al. Nov 2008 A1
20080310496 Fang Dec 2008 A1
20090010622 Yahata et al. Jan 2009 A1
20090013195 Ochi et al. Jan 2009 A1
20090031220 Tranchant et al. Jan 2009 A1
20090037959 Suh et al. Feb 2009 A1
20090060452 Chaudhri Mar 2009 A1
20090066839 Jung et al. Mar 2009 A1
20090077143 Macy, Jr. Mar 2009 A1
20090106082 Senti et al. Apr 2009 A1
20090116821 Shibamiya et al. May 2009 A1
20090132599 Soroushian et al. May 2009 A1
20090132721 Soroushian et al. May 2009 A1
20090150557 Wormley et al. Jun 2009 A1
20090169181 Priyadarshi et al. Jul 2009 A1
20090178090 Oztaskent Jul 2009 A1
20090201988 Gazier et al. Aug 2009 A1
20090226148 Nesvadba et al. Sep 2009 A1
20090249081 Zayas Oct 2009 A1
20090282162 Mehrotra et al. Nov 2009 A1
20090293116 DeMello Nov 2009 A1
20090300204 Zhang et al. Dec 2009 A1
20090303241 Priyadarshi et al. Dec 2009 A1
20090307258 Priyadarshi et al. Dec 2009 A1
20090307267 Chen et al. Dec 2009 A1
20090310819 Hatano Dec 2009 A1
20090313544 Wood et al. Dec 2009 A1
20090313564 Rottler et al. Dec 2009 A1
20090328124 Khouzam et al. Dec 2009 A1
20100002069 Eleftheriadis et al. Jan 2010 A1
20100040351 Toma et al. Feb 2010 A1
20100094969 Zuckerman et al. Apr 2010 A1
20100095121 Shetty et al. Apr 2010 A1
20100111192 Graves May 2010 A1
20100142915 Mcdermott et al. Jun 2010 A1
20100146055 Hannuksela et al. Jun 2010 A1
20100158109 Dahlby et al. Jun 2010 A1
20100189183 Gu et al. Jul 2010 A1
20100226582 Luo et al. Sep 2010 A1
20100228795 Hahn Sep 2010 A1
20100259690 Wang et al. Oct 2010 A1
20100262712 Kim et al. Oct 2010 A1
20100278271 MacInnis Nov 2010 A1
20100284473 Suh et al. Nov 2010 A1
20110010466 Fan et al. Jan 2011 A1
20110022432 Ishida et al. Jan 2011 A1
20110055585 Lee Mar 2011 A1
20110058675 Brueck et al. Mar 2011 A1
20110080940 Bocharov Apr 2011 A1
20110082924 Gopalakrishnan Apr 2011 A1
20110096828 Chen et al. Apr 2011 A1
20110099594 Chen et al. Apr 2011 A1
20110103374 Lajoie et al. May 2011 A1
20110126104 Woods et al. May 2011 A1
20110126191 Hughes et al. May 2011 A1
20110129011 Cilli et al. Jun 2011 A1
20110135090 Chan et al. Jun 2011 A1
20110142415 Rhyu Jun 2011 A1
20110145858 Philpott et al. Jun 2011 A1
20110150100 Abadir Jun 2011 A1
20110153785 Minborg et al. Jun 2011 A1
20110164679 Satou Jul 2011 A1
20110170408 Furbeck et al. Jul 2011 A1
20110173345 Knox et al. Jul 2011 A1
20110179185 Wang et al. Jul 2011 A1
20110197261 Dong et al. Aug 2011 A1
20110239078 Luby et al. Sep 2011 A1
20110246659 Bouazizi Oct 2011 A1
20110246661 Manzari et al. Oct 2011 A1
20110268178 Park et al. Nov 2011 A1
20110280307 MacInnis Nov 2011 A1
20110296048 Knox et al. Dec 2011 A1
20110302319 Ha et al. Dec 2011 A1
20110305273 He et al. Dec 2011 A1
20110310982 Yang et al. Dec 2011 A1
20110314130 Strasman Dec 2011 A1
20110314176 Frojdh et al. Dec 2011 A1
20110314500 Gordon Dec 2011 A1
20120005312 Mcgowan et al. Jan 2012 A1
20120023251 Pyle et al. Jan 2012 A1
20120042090 Chen et al. Feb 2012 A1
20120047542 Lewis et al. Feb 2012 A1
20120072493 Muriello et al. Mar 2012 A1
20120093214 Urbach Apr 2012 A1
20120105279 Brown et al. May 2012 A1
20120110120 Wllig et al. May 2012 A1
20120167132 Mathews et al. Jun 2012 A1
20120170642 Braness et al. Jul 2012 A1
20120170643 Soroushian et al. Jul 2012 A1
20120170906 Soroushian et al. Jul 2012 A1
20120170915 Braness et al. Jul 2012 A1
20120173751 Braness et al. Jul 2012 A1
20120177101 Van Der Schaar Jul 2012 A1
20120179834 van der Schaar et al. Jul 2012 A1
20120203766 Hörnkvist et al. Aug 2012 A1
20120269275 Hannuksela Oct 2012 A1
20120278496 Hsu Nov 2012 A1
20120281767 Duenas et al. Nov 2012 A1
20120307883 Graves Dec 2012 A1
20120311174 Bichot et al. Dec 2012 A1
20120331167 Hunt Dec 2012 A1
20130007200 van der Schaar et al. Jan 2013 A1
20130013803 Bichot et al. Jan 2013 A1
20130044821 Braness et al. Feb 2013 A1
20130046902 Villegas Nuñez et al. Feb 2013 A1
20130051767 Soroushian et al. Feb 2013 A1
20130051768 Soroushian et al. Feb 2013 A1
20130054958 Braness et al. Feb 2013 A1
20130055084 Soroushian et al. Feb 2013 A1
20130058393 Soroushian Mar 2013 A1
20130061045 Kiefer et al. Mar 2013 A1
20130080267 McGowan Mar 2013 A1
20130091249 McHugh et al. Apr 2013 A1
20130095855 Bort Apr 2013 A1
20130169863 Smith Jul 2013 A1
20130191754 Rose Jul 2013 A1
20130196292 Brennen et al. Aug 2013 A1
20140003501 Soroushian et al. Jan 2014 A1
20140003523 Soroushian et al. Jan 2014 A1
20140140253 Lohmar et al. May 2014 A1
20140149557 Lohmar et al. May 2014 A1
20140211840 Butt et al. Jul 2014 A1
20140241421 Orton-jay et al. Aug 2014 A1
20140250473 Braness et al. Sep 2014 A1
20140355958 Soroushian et al. Dec 2014 A1
20140359680 Shivadas et al. Dec 2014 A1
20150104153 Braness et al. Apr 2015 A1
20150229695 Kim et al. Aug 2015 A1
20150288530 Oyman Oct 2015 A1
20160127440 Gordon May 2016 A1
20160134881 Wang et al. May 2016 A1
20170026445 Soroushian et al. Jan 2017 A1
20170041604 Soroushian et al. Feb 2017 A1
20170366833 Amidei et al. Dec 2017 A1
20180278975 Soroushian Sep 2018 A1
20190182524 Amidei et al. Jun 2019 A1
Foreign Referenced Citations (87)
Number Date Country
2010202963 Feb 2012 AU
2237293 Jul 1997 CA
1221284 Jun 1999 CN
1662952 Aug 2005 CN
1723696 Jan 2006 CN
1756359 Apr 2006 CN
1787422 Jun 2006 CN
101461149 Jun 2009 CN
102138327 Jul 2011 CN
103858419 Jun 2014 CN
103875248 Jun 2014 CN
103875248 Sep 2018 CN
108989847 Dec 2018 CN
109314784 Feb 2019 CN
757484 Feb 1997 EP
813167 Dec 1997 EP
1335603 Aug 2003 EP
1420580 May 2004 EP
1453319 Sep 2004 EP
1283640 Oct 2006 EP
1718074 Nov 2006 EP
2180664 Apr 2010 EP
2360923 Aug 2011 EP
2661895 Nov 2013 EP
3473005 Apr 2019 EP
1195183 Feb 2018 HK
1260329 Dec 2019 HK
08163488 Jun 1996 JP
08287613 Nov 1996 JP
11328929 Nov 1999 JP
02001043668 Feb 2001 JP
2002170363 Jun 2002 JP
2002218384 Aug 2002 JP
2003250113 Sep 2003 JP
2005027153 Jan 2005 JP
2009508452 Feb 2009 JP
2019-526188 Sep 2019 JP
100221423 Sep 1999 KR
2002013664 Feb 2002 KR
1020020064888 Aug 2002 KR
20040039852 May 2004 KR
20060106250 Oct 2006 KR
20140056317 May 2014 KR
101928910 Dec 2018 KR
10-1936142 Jan 2019 KR
10-1981923 May 2019 KR
10-2020764 Sep 2019 KR
10-2074148 Jan 2020 KR
10-2086995 Mar 2020 KR
10-2140339 Jul 2020 KR
2328040 Jun 2008 RU
1995015660 Jun 1995 WO
2000049762 Aug 2000 WO
2000049763 Aug 2000 WO
2001031497 May 2001 WO
2001050732 Jul 2001 WO
2002001880 Jan 2002 WO
2003047262 Jun 2003 WO
2004012378 Feb 2004 WO
2004054247 Jun 2004 WO
2004097811 Nov 2004 WO
2004100158 Nov 2004 WO
2004102571 Nov 2004 WO
2005008385 Jan 2005 WO
2005015935 Feb 2005 WO
2009006302 Jan 2009 WO
2009065137 May 2009 WO
2009109976 Sep 2009 WO
2010060106 May 2010 WO
2010111261 Sep 2010 WO
2010122447 Oct 2010 WO
20100150470 Dec 2010 WO
2011053658 May 2011 WO
2011059291 May 2011 WO
2011087449 Jul 2011 WO
2011093835 Aug 2011 WO
2011101371 Aug 2011 WO
2011102791 Aug 2011 WO
2011103364 Aug 2011 WO
2012094171 Jul 2012 WO
20120094181 Jul 2012 WO
20120094189 Jul 2012 WO
2013033334 Mar 2013 WO
2013033335 Mar 2013 WO
2013033458 Mar 2013 WO
2013033458 May 2013 WO
2017218095 Dec 2017 WO
Non-Patent Literature Citations (211)
Entry
International Preliminary Report on Patentability for International Application No. PCT/US2012/053223, Report dated Mar. 4, 2014, Report mailed Mar. 13, 2014, 7 pgs.
International Search Report and Written Opinion for International Application No. PCT/US2012/053223, International Filing Date Aug. 30, 2012, Report Completed Dec. 7, 2012, dated Mar. 7, 2013, 10 pgs.
International Search Report for International Application No. PCT/SE2011/050166, Search completed Mar. 3, 2011, dated Mar. 3, 2011, 5 Pgs.
“Adaptive HTTP Streaming in PSS—Client Behaviour”, S4-AHI129, 3GPP TSG-SA4 Ad-Hoc Meeting, Dec. 14-16, 2009, Paris, France; section 12.6.1.
“Adaptive HTTP Streaming in PSS—Data Formats for HTTP-Streaming excluding MPD”, S4-AHI128, 3GPP TSGSA4 Ad-Hoc Meeting, Dec. 14-16, 2009, Paris, France, sections 12.2.1 and 12.2.4.2.1.
“Adaptive HTTP Streaming in PSS—Discussion on Options”, S4-AHI130, 3GPP TSG-SA4 Ad-Hoc Meeting, Dec. 14-16, 2009, Paris, France; sections 1, 2.7-2.8, and 2.16-2.19.
“Fragmented Time Indexing of Representations”, S4-AHI126, 3GPP TSG-SA4 Ad-Hoc Meeting, Dec. 14-16, 2009, Paris, France.
“Transparent end-to-end packet switched streaming service (PSS); 3GPP file format (3GP) (Release 9)”, 3GPP TS 26.244 V9.0.0 (Dec. 2009), sections 7.1-7.4.
International Search Report and Written Opinion for International Application No. PCT/US2012/053052, International Filing Date Aug. 30, 2012, Report Completed Oct. 25, 2012, dated Nov. 16, 2012, 9 pgs.
International Search Report and Written Opinion for International Application No. PCT/US2012/053053, International Filing Date Aug. 30, 2012, Completed Aug. 23, 2012, 11 pgs.
Extended European Search Report for European Application No. EP12828956.8, Report Completed Feb. 18, 2015, dated Mar. 2, 2015, 3 Pgs.
Lippens, Fecheyr A., “A Review of HTTP Live Streaming”, Internet Citation, Jan. 25, 2010, X P002638990, Retrieved from http://issuu.com/andruby/docs/http_live_streaming on May 24, 2011, 38 Pages.
Watson, Mark, “Input for DASH EE#1 (CMP): Pixel Aspect Ratio”, 94. MPEG Meeting, Oct. 11, 2010-Oct. 15, 2010, Guangzhou, (Motion Picture Expert Group OR ISO/IEC JTC1/SC29/WG11), No. M18498, Oct. 28, 2010, XP030047088, 4 Pages.
International Search Report and Written Opinion for International Application PCT/US2012/05223, completed Dec. 7, 2012, dated Mar. 7, 2013, 10 pgs.
Extended European Search Report for European Application EP12828956.8, Report Completed Feb. 18, 2015, dated Mar. 2, 2015, 13 pgs.
International Preliminary Report on Patentability for International Application No. PCT/US2012/053052, Completed Mar. 4, 2014, 8 pgs.
International Preliminary Report on Patentability for International Application No. PCT/US2012/053223, Report dated Mar. 4, 2014, 7 pgs.
International Search Report and Written Opinion for International Application PCT/US2012/053053, search completed Oct. 23, 2012, dated Nov. 13, 2012, 11 pgs.
International Search Report for International Application No. PCT/SE2011/050166, Search completed Mar. 30, 2011, dated Mar. 30, 2011, 5 pgs.
“Transparent end-to-end packet switched streaming service (PSS); 3GPP file format (3GP) (Release 9)”, 3GPP TS 26.244 V9.0.0 (Dec. 2009), sections 7.1-7.4, 52 pgs.
Akhshabi et al., “An Experimental Evaluation of Rate-Adapatation Algorithms in Adaptive Streaming over HTTP”, MMSys'11, Feb. 23-25, 2011, 12 pgs.
Fecheyr-Lippens, “A Review of HTTP Live Streaming”, Internet Citation, Jan. 25, 2010, 38 pgs.
Ozer, Jan “Adaptive Streaming in the Field”, Streaming Media, Dec. 2010-Jan. 2011, 9 pgs.
Watson, Mark “Input for DASH EE#1 (CMP): Pixel Aspect Ratio”, 94. MPEG Meeting, Nov. 10, 2010-Oct. 15, 2010; Guangzhou; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. M 18498, Oct. 28, 2010 (Oct. 28, 2010), XP030047088,, Oct. 2, 2010, 4 pgs.
Beker et al., “Cipher Systems, The Protection of Communications”, 1982, 40 pgs.
Bocharov et al, “Portable Encoding of Audio-Video Objects, The Protected Interoperable File Format (PIFF)”, Microsoft Corporation, First Edition Sep. 8, 2009, 30 pgs.
Bulterman et al., “Synchronized Multimedia Integration Language (SMIL 3.0)”, W3C Recommendation, Dec. 1, 2008, https://www.w3.org/TR/2008/REC-SMIL3-20081201/, 321 pgs. (presented in five parts).
Cahill et al., “Locally Adaptive Deblocking Filter for Low Bit Rate Video”, Proceedings 2000 International Conference on Image Processing, Sep. 10-13, 2000, Vancouver, BC, Canada, 4 pgs.
Candelore, File Wrapper, U.S. Appl. No. 60/372,901, filed Apr. 17, 2002, 5 pgs.
Chaddha et al., “A Frame-work for Live Multicast of Video Streams over the Internet”, Proceedings of 3rd IEEE International Conference on Image Processing, Sep. 19, 1996, Lausanne, Switzerland, 4 pgs.
Cheng, “Partial Encryption for Image and Video Communication”, Thesis, Fall 1998, 95 pgs.
Cheng et al., “Partial encryption of compressed images and videos”, IEEE Transactions on Signal Processing, vol. 48, No. 8, Aug. 2000, 33 pgs.
Cheung et al., “On the Use of Destination Set Grouping to Improve Fairness in Multicast Video Distribution”, Proceedings of IEEE INFOCOM'96, Conference on Computer Communications, vol. 2, IEEE, 1996, 23 pgs.
Collet, “Delivering Protected Content, An Approach for Next Generation Mobile Technologies”, Thesis, 2010, 84 pgs.
Diamantis et al., “Real Time Video Distribution using Publication through a Database”, Proceedings SIBGRAPI'98. International Symposium on Computer Graphics, Image Processing, and Vision (Cat. No. 98EX237), Oct. 1990, 8 pgs.
Dworkin, “Recommendation for Block Cipher Modes of Operation: Methods and Techniques”, NIST Special Publication 800-38A, 2001, 66 pgs.
Fang et al., “Real-time deblocking filter for MPEG-4 systems”, Asia-Pacific Conference on Circuits and Systems, Oct. 28-31, 2002, Bail, Indonesia, 4 pgs.
Fecheyr-Lippens, “A Review of HTTP Live Streaming”, Jan. 2010, 38 pgs.
Fukuda et al., “Reduction of Blocking Artifacts by Adaptive DCT Coefficient Estimation in Block-Based Video Coding”, Proceedings 2000 International Conference on Image Processing, Sep. 10-13, 2000, Vancouver, BC, Canada, 4 pgs.
Huang, U.S. Pat. No. 7,729,426, U.S. Appl. No. 11/230,794, filed Sep. 20, 2005, 143 pgs.
Huang et al., “Adaptive MLP post-processing for block-based coded images”, IEEE Proceedings—Vision, Image and Signal Processing, vol. 147, No. 5, Oct. 2000, pp. 463-473.
Huang et al., “Architecture Design for Deblocking Filter in H.264/JVT/AVC”, 2003 International Conference on Multimedia and Expo., Jul. 6-9, 2003, Baltimore, MD, 4 pgs.
Jain et al., U.S. Appl. No. 61/522,623, filed Aug. 11, 2011, 44 pgs.
Jung et al., “Design and Implementation of an Enhanced Personal Video Recorder for DTV”, IEEE Transactions on Consumer Electronics, vol. 47, No. 4, Nov. 2001, 6 pgs.
Kalva, Hari “Delivering MPEG-4 Based Audio-Visual Services”, 2001, 113 pgs.
Kang et al., “Access Emulation and Buffering Techniques for Steaming of Non-Stream Format Video Files”, IEEE Transactions on Consumer Electronics, vol. 43, No. 3, Aug. 2001, 7 pgs.
Kim et al, “A Deblocking Filter with Two Separate Modes in Block-based Video Coding”, IEEE transactions on circuits and systems for video technology, vol. 9, No. 1, 1999, pp. 156-160.
Kim et al., “Tree-Based Group Key Agreement”, Feb. 2004, 37 pgs.
Laukens, “Adaptive Streaming—A Brief Tutorial”, EBU Technical Review, 2011, 6 pgs.
Legault et al., “Professional Video Under 32-bit Windows Operating Systems”, SMPTE Journal, vol. 105, No. 12, Dec. 1996, 10 pgs.
Li et al., “Layered Video Multicast with Retransmission (LVMR): Evaluation of Hierarchical Rate Control”, Proceedings of IEEE INFOCOM'98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century, Cat. No. 98, vol. 3, 1998, 26 pgs.
List et al., “Adaptive deblocking filter”, IEEE transactions on circuits and systems for video technology, vol. 13, No. 7, Jul. 2003, pp. 614-619.
Massoudi et al., “Overview on Selective Encryption of Image and Video: Challenges and Perspectives”, EURASIP Journal on Information Security, Nov. 2008, 18 pgs.
McCanne et al., “Receiver-driven Layered Multicast”, Conference proceedings on Applications, technologies, architectures, and protocols for computer communications, Aug. 1996, 14 pgs.
Meier, “Reduction of Blocking Artifacts in Image and Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 3, Apr. 1999, pp. 490-500.
Newton et al., “Preserving Privacy by De-identifying Facial Images”, Carnegie Mellon University School of Computer Science, Technical Report, CMU-CS-03-119, Mar. 2003, 26 pgs.
O'Brien, U.S. Appl. No. 60/399,846, filed Jul. 30, 2002, 27 pgs.
O'Rourke, “Improved Image Decompression for Reduced Transform Coding Artifacts”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 5, No. 6, Dec. 1995, pp. 490-499.
Park et al., “A postprocessing method for reducing quantization effects in low bit-rate moving picture coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 1, Feb. 1999, pp. 161-171.
Richardson, “H.264 and MPEG-4 Video Compression”, Wiley, 2003, 306 pgs. (presented in 2 parts).
Sima et al., “An Efficient Architecture for Adaptive Deblocking Filter of H.264 AVC Video Coding”, IEEE Transactions on Consumer Electronics, vol. 50, No. 1, Feb. 2004, pp. 292-296.
Spanos et al., “Performance Study of a Selective Encryption Scheme for the Security of Networked, Real-Time Video”, Proceedings of the Fourth International Conference on Computer Communications and Networks, IC3N'95, Sep. 20-23, 1995, Las Vegas, NV, pp. 2-10.
Srinivasan et al., “Windows Media Video 9: overview and applications”, Signal Processing: Image Communication, 2004, 25 pgs.
Stockhammer, “Dynamic Adaptive Streaming over HTTP—Standards and Design Principles”, Proceedings of the second annual ACM conference on Multimedia, Feb. 2011, pp. 133-145.
Timmerer et al., “HTTP Streaming of MPEG Media”, Proceedings of Streaming Day, 2010, 4 pgs.
Tiphaigne et al., “A Video Package for Torch”, Jun. 2004, 46 pgs.
Trappe et al., “Key Management and Distribution for Secure Multimedia Multicast”, IEEE Transaction on Multimedia, vol. 5, No. 4, Dec. 2003, pp. 544-557.
Van Deursen et al., “On Media Delivery Protocols in the Web”, 2010 IEEE International Conference on Multimedia and Expo, Jul. 19-23, 2010, 6 pgs.
Ventura, Guillermo Albaida “Streaming of Multimedia Learning Objects”, AG Integrated Communication System, Mar. 2003, 101 pgs.
Waggoner, “Compression for Great Digital Video”, 2002, 184 pgs.
Watanabem et al., “MPEG-2 decoder enables DTV trick plays”, esearcher System LSI Development Lab, Fujitsu Laboratories Ltd., Kawasaki, Japan, Jun. 2001, 2 pgs.
Wiegand, “Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG”, Jan. 2002, 70 pgs.
Willig et al., U.S. Appl. No. 61/409,285, filed Nov. 2, 2010, 43 pgs.
Yang et al., “Projection-Based Spatially Adaptive Reconstruction of Block-Transform Compressed Images”, IEEE Transactions on Image Processing, vol. 4, No. 7, Jul. 1995, pp. 896-908.
Yang et al., “Regularized Reconstruction to Reduce Blocking Artifacts of Block Discrete Cosine Transform Compressed Images”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 3, No. 6, Dec. 1993, pp. 421-432.
Yu et al., “Video deblocking with fine-grained scalable complexity for embedded mobile computing”, Proceedings 7th International Conference on Signal Processing, Aug. 31-Sep. 4, 2004, pp. 1173-1178.
Zakhor, “Iterative Procedures for Reduction of Blocking Effects in Transform Image Coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 2, No. 1, Mar. 1992, pp. 91-95.
“Using HTTP Live Streaming”, iOS Developer Library, http://developer.apple.com/library/ios/#documentation/networkinginternet/conceptual/streamingmediaguide/UsingHTTPLiveStreaming/UsingHTTPLiveStreaming. html#//apple_ref/doc/uid/TP40008332-CH102-SW1, Feb. 11, 2014, 10 pgs.
“Video Manager and Video Title Set IFO file headers”, printed Aug. 22, 2009 from http://dvd.sourceforge.net/dvdinfo/ifo.htm, 6 pgs.
“What is a DVD?”, printed Aug. 22, 2009 from http://www.videohelp.com/dvd, 8 pgs.
“What is a VOB file”, http://www.mpucoder.com/DVD/vobov.html, printed on Jul. 2, 2009, 2 pgs.
“What's on a DVD?”, printed Aug. 22, 2009 from http://www.doom9.org/dvd-structure.htm, 5 pgs.
U.S. Appl. No. 13/224,298, “Final Office Action”, 26 pgs.
Akhshabi et al., “An Experimental Evaluation of Rate-Adaptation Algorithms in Adaptive Streaming over HTTP”, MMSys'11, Feb. 23-25, 2011, 12 pgs.
Anonymous, “Method for the encoding of a compressed video sequence derived from the same video sequence compressed at a different bit rate without loss of data”, ip.com, ip.com No. IPCOM000008165D, May 22, 2002, pp. 1-9.
Blasiak, “Video Transrating and Transcoding: Overview of Video Transrating and Transcoding Technologies”, Ingenient Technologies, TI Developer Conference, Aug. 6-8, 2002, 22 pgs.
Casares et al., “Simplifying Video Editing Using Metadata”, DIS2002, 2002, pp. 157-166.
Deutscher, “IIS Transform Manager Beta—Using the MP4 to Smooth Task”, Retrieved from: https://web.archive.org/web/20130328111303/http://blog.johndeutscher.com/category/smooth-streaming, Blog post of Apr. 29, 2011, 14 pgs.
Ding, Li-Fu et al., “Content-Aware Prediction Algorithm With Inter-View Mode Decision for Multiview Video Coding”, IEEE Transactions on Multimedia, vol. 10, No. 8, Dec. 2008., Dec. 8, 2008, 12 pgs.
Fielding et al., “Hypertext Transfer Protocol—HTTP1.1”, Network Working Group, RFC 2616, Jun. 1999, 114 pgs.
Gannes, “The Lowdown on Apple's HTTP Adaptive Bitrate Streaming”, GigaOM, Jun. 10, 2009, 12 pgs.
Ghosh, “Enhancing Silverlight Video Experiences with Contextual Data”, Retrieved from: http://msdn.microsoft.com/en-us/magazine/ee336025.aspx, 2010, 15 pgs.
Griffith, Eric “The Wireless Digital Picture Frame Arrives”, Wi-Fi Planet, printed May 4, 2007 from http://www.wi-fiplanet.com/news/article.php/3093141, Oct. 16, 2003, 3 pgs.
Inlet Technologies, “Adaptive Delivery to iDevices”, 2010, 2 pgs.
Inlet Technologies, “Adaptive delivery to iPhone 3.0”, 2009, 2 pgs.
Inlet Technologies, “HTTP versus RTMP”, 2009, 3 pgs.
Inlet Technologies, “The World's First Live Smooth Streaming Event: The French Open”, 2009, 2 pgs.
I-O Data, “Innovation of technology arrived”, Nov. 2004, Retrieved from http://www.iodata.com/catalogs/AVLP2DVDLA_Flyer200505.pdf, 2 pgs.
Jeannin, Sylvie et al., “Video Motion Representation for Improved Content Access”, IEEE Transactions on Consumer Electronics, vol. 46, No. 3., Aug. 2004, 11 pgs.
Karouia et al., “Video Similarity Measurement Based on Attributed Relational Graph Matching”, N.T. Nguyen, R. Katarzyniak (Eds.): New Challenges in Applied Intelligence Technologies, SCI 134, pp. 173-182, 2008., 2008, 10 pgs.
Kim, Seon H. et al., “Design and implementation of geo-tagged video search framework”, Journal of Visual Communication and Image Representation, 2010, vol. 21 (2010), pp. 773-786.
Kurzke et al., “Get Your Content Onto Google TV”, Google, Retrieved from: http://commondatastorage.googleapis.com/io2012/presentations/live%20to%20website/1300.pdf, 2012, 58 pgs.
Lang, “Expression Encoder, Best Practices for live smooth streaming broadcasting”, Microsoft Corporation, 2010, retrieved from http://www.streamingmedia.com/conferences/west2010/presentations/SMWest-12010-Expression-Encoder.pdf, 20 pgs.
Levkov, “Mobile Encoding Guidelines for Android Powered Devices”, Adobe Systems Inc., Addendum B, Dec. 22, 2010, 42 pgs.
Lewis, “H.264/MPEG-4 AVC CABAC overview”, Oct. 25, 2012, printed Jun. 24, 2013 from http://www.web.archive.org/web/20121025003926/www.theonlineoasis.co.uk/notes.html, 3 pgs.
Long et al., “Silver: Simplifying Video Editing with Metadata”, Demonstrations, CHI 2003: New Horizons, Apr. 5-10, 2003, pp. 628-629.
Morrison, “EA IFF 85 Standard for Interchange Format Files”, Jan. 14, 1985, printed from http://www.dcs.ed.ac.uk/home/mxr/gfx/2d/IFF.txt on Mar. 6, 2006, 24 pgs.
MSDN, “Adaptive streaming, Expression Studio 2.0”, Apr. 23, 2009, 2 pgs.
Nelson, “Smooth Streaming Deployment Guide”, Microsoft Expression Encoder, Aug. 2010, 66 pgs.
Noboru, “Play Fast and Fine Video on Web! codec”, Co. 9 No. 12, Dec. 1, 2003, pp. 178-179.
Noe, A. “Matroska File Format (under construction!)”, Retrieved from the Internet: URL:http://web.archive.orgweb/20070821155146/www.matroska.org/technical/specs/matroska.pdf [retrieved on Jan. 19, 2011], Jun. 24, 2007, pp. 1-51.
Noe, Alexander “AVI File Format”, http://www.alexander-noe.com/video/documentation/avi.pdf, Dec. 14, 2006, pp. 1-26.
Noe, Alexander “Definitions”, Apr. 11, 2006, retrieved from http://www.alexander-noe.com/video/amg/definitions.html on Oct. 16, 2013, 2 pgs.
Ozer, “The 2012 Encoding and Transcoding Buyers' Guide”, Streamingmedia.com, Retrieved from: http://www.streamingmedia.com/Articles/Editorial/Featured-Articles/The-2012-Encoding-and-Transcoding-Buyers-Guide-84210.aspx, 2012, 8 pgs.
Pantos, “HTTP Live Streaming, draft-pantos-http-live-streaming-10”, IETF Tools, Oct. 15, 2012, Retrieved from: http://tools.ietf.org/html/draft-pantos-http-live-streaming-10, 37 pgs.
Phamdo, “Theory of Data Compression”, printed on Oct. 10, 2003, 12 pgs.
RGB Networks, “Comparing Adaptive HTTP Streaming Technologies”, Nov. 2011, Retrieved from: http://btreport.net/wp-content/uploads/2012/02/RGB-Adaptive-HTTP-Streaming-Comparison-1211-01.pdf, 20 pgs.
Schulzrinne et al., “Real Time Streaming Protocol (RTSP)”, Internet Engineering Task Force, RFC 2326, Apr. 1998, 80 pgs.
Siglin, “HTTP Streaming: What You Need to Know”, streamingmedia.com, 2010, 15 pgs.
Siglin, “Unifying Global Video Strategies, MP4 File Fragmentation for Broadcast, Mobile and Web Delivery”, Nov. 16, 2011, 16 pgs.
Taxan, “AVel LinkPlayer2 for Consumer”, I-O Data USA—Products—Home Entertainment, printed May 4, 2007 from http://www.iodata.com/usa/products/products.php?cat=HNP&sc=AVEL&pld=AVLP2/DVDLA&ts=2&tsc, 1 page.
Unknown, “AVI RIFF File Reference (Direct X 8.1 C++ Archive)”, printed from http://msdn.microsoft.com/archive/en-us/dx81_c/directx_cpp/htm/avirifffilereference.asp?fr . . . on Mar. 6, 2006, 7 pgs.
Unknown, “Entropy and Source Coding (Compression)”, TCOM 570, Sep. 1999, pp. 1-22.
Unknown, “MPEG-4 Video Encoder: Based on International Standard ISO/IEC 14496-2”, Patni Computer Systems, Ltd., publication date unknown, 15 pgs.
Zambelli, “IIS Smooth Streaming Technical Overview”, Microsoft Corporation, Mar. 2009.
Information Technology—MPEG Systems Technologies—Part 7: Common Encryption in ISO Base Media File Format Files (ISO/IEC 23001-7), Apr. 2015, 24 pgs.
ISO/IEC 14496-12 Information technology—Coding of audio-visual objects—Part 12: ISO base media file format, Feb. 2004 (“MPEG-4 Part 12 Standard”), 62 pgs.
ISO/IEC 14496-12:2008(E) Informational Technology—Coding of Audio-Visual Objects Part 12: ISO Base Media Filea Format, Oct. 2008, 120 pgs.
ISO/IEC FCD 23001-6 MPEG systems technologies Part 6: Dynamic adaptive streaming over HTTP (DASH), Jan. 28, 2011, 86 pgs.
Microsoft Corporation, Advanced Systems Format (ASF) Specification, Revision Jan. 20, 2003, Dec. 2004, 121 pgs.
MPEG-DASH presentation at Streaming Media West 2011, Nov. 2011, 14 pgs.
Pomelo, LLC Tech Memo, Analysis of Netflix's Security Framework for ‘Watch Instantly’ Service, Mar.-Apr. 2009, 18 pgs.
Server-Side Stream Repackaging (Streaming Video Technologies Panorama, Part 2), Jul. 2011, 15 pgs.
Text of ISO/IEC 23001-6: Dynamic adaptive streaming over HTTP (DASH), Oct. 2010, 71 pgs.
Universal Mobile Telecommunications System (UMTS), ETSI TS 126 233 V9.1.0 (Jun. 2011) 3GPP TS 26.233 version 9.1.0 Release 9, 18 pgs.
Universal Mobile Telecommunications Systems (UMTS); ETSI TS 126 244 V9.4.0 (May 2011) 3GPP TS 26.244 version 9.4.0 Release 9, 58 pgs.
“Apple HTTP Live Streaming specification”, Aug. 2017, 60 pgs.
“Data Encryption Decryption using AES Algorithm, Key and Salt with Java Cryptography Extension”, Available at https://www.digizol.com/2009/10/java-encrypt-decrypt-jce-salt.html, Oct. 200, 6 pgs.
“Delivering Live and On-Demand Smooth Streaming”, Microsoft Silverlight, 2009, 28 pgs.
“HTTP Based Adaptive Streaming over HSPA”, Apr. 2011, 73 pgs.
“HTTP Live Streaming”, Mar. 2011, 24 pgs.
“HTTP Live Streaming”, Sep. 2011, 33 pgs.
“Information Technology—Coding of Audio Visual Objects—Part 2: Visual”, International Standard, ISO/IEC 14496-2, Third Edition, Jun. 1, 2004, pp. 1-724. (presented in three parts).
“Java Cryptography Architecture API Specification & Reference”, Available at https://docs.oracle.com/javase/1.5.0/docs/guide/security/CryptoSpec.html, Jul. 25, 2004, 68 pgs.
“Java Cryptography Extension, javax.crypto.Cipher class”, Available at https://docs.oracle.com/javase/1.5.0/docs/api/javax/crypto/Cipher.html, 2004, 24 pgs.
“JCE Encryption—Data Encryption Standard (DES) Tutorial”, Available at https://mkyong.com/java/jce-encryption-data-encryption-standard-des-tutorial/, Feb. 25, 2009, 2 pgs.
“Live and On-Demand Video with Silverlight and IIS Smooth Streaming”, Microsoft Silverlight, Windows Server Internet Information Services 7.0, Feb. 2010, 15 pgs.
“Microsoft Smooth Streaming specification”, Jul. 22, 2013, 56 pgs.
“Single-Encode Streaming for Multiple Screen Delivery”, Telestream Wowza Media Systems, 2009, 6 pgs.
“The MPEG-DASH Standard for Multimedia Streaming Over the Internet”, IEEE MultiMedia, vol. 18, No. 4, 2011, 7 pgs.
“Windows Media Player 9”, Microsoft, Mar. 23, 2017, 3 pgs.
Abomhara et al., “Enhancing Selective Encryption for H.264/AVC Using Advanced Encryption Standard”, International Journal of computer Theory and Engineering, Apr. 2010, vol. 2, No. 2, pp. 223-229.
Alattar et al., A.M. “Improved selective encryption techniques for secure transmission of MPEG video bit-streams”, In Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348), vol. 4, IEEE, 1999, pp. 256-260.
Antoniou et al., “Adaptive Methods for the Transmission of Video Streams in Wireless Networks”, 2015, 50 pgs.
Apostolopoulos et al., “Secure Media Streaming and Secure Transcoding”, Multimedia Security Technologies for Digital Rights Management, 2006, 33 pgs.
Asai et al., “Essential Factors for Full-Interactive VOD Server: Video File System, Disk Scheduling, Network”, Proceedings of Globecom '95, Nov. 14-16, 1995, 6 pgs.
Broadq—The Ultimate Home Entertainment Software, printed May 11, 2009 from ittp://web.srchive.org/web/20030401122010/www.broadq.com/qcasttuner/, 1 pg.
European Extended Search Report for EP Application 17813738.6, Search completed Oct. 18, 2019, dated Oct. 24, 2019, 9 pages.
European Search Report for Application 11855103.5, search completed Jun. 26, 2014, 9 pgs.
European Search Report for Application 11855237.1, search completed Jun. 12, 2014, 9 pgs.
European Supplementary Search Report for Application EP09759600, completed Jan. 25, 2011, 11 pgs.
Federal Computer Week, “Tool Speeds Info to Vehicles”, Jul. 25, 1999, 5 pages.
HTTP Live Streaming Overview, Networking & Internet, Apple, Inc., Apr. 1, 2011, 38 pages.
IBM Corporation and Microsoft Corporation, “Multimedia Programming Interface and Data Specifications 1.0”, Aug. 1991, printed from http://www.kk.iij4u.or.jp/˜kondo/wave/mpidata.txt on Mar. 6, 2006, 100 pgs.
InformationWeek, “Internet on Wheels”, InformationWeek: Front End: Daily Dose, Jul. 20, 1999, Printed on Mar. 26, 2014, 3 pgs.
International Preliminary Report on Patentability for International Application No. PCT/US2008/083816, dated May 18, 2010, 6 pgs.
International Preliminary Report on Patentability for International Application PCT/US2011/067167, dated Feb. 25, 2014, 8 pgs.
International Preliminary Report on Patentability for International Application PCT/US2017/031114, Report dated Dec. 18, 2018, dated Dec. 27, 2018, 7 pgs.
International Search Report and Written Opinion for International Application No. PCT/US09/46588, completed Jul. 13, 2009, dated Jul. 23, 2009, 7 pgs.
International Search Report and Written Opinion for International Application No. PCT/US2004/041667, completed May 24, 2007, dated Jun. 20, 2007, 6 pgs.
International Search Report and Written Opinion for International Application No. PCT/US2008/083816, completed Jan. 10, 2009, dated Jan. 22, 2009, 7 pgs.
International Search Report and Written Opinion for International Application No. PCT/US2017/031114, Search completed Jun. 29, 2017, dated Jul. 19, 2017, 11 pgs.
International Search Report and Written Opinion for International Application No. PCT/US2011/066927, completed Apr. 3, 2012, dated Apr. 20, 2012, 14 pgs.
International Search Report and Written Opinion for International Application PCT/US2011/067167, completed Jun. 19, 2012, dated Jul. 2, 2012, 11 pgs.
ITS International, “Fleet System Opts for Mobile Server”, Aug. 26, 1999, Printed on Oct. 21, 2011 from http://www.itsinternational.com/News/article.cfm?recordID=547, 2 pgs.
Linksys Wireless-B Media Adapter Reviews, printed May 4, 2007 from http://reviews.cnet.com/Linksys_Wireless_B_Media_Adapter/4505-6739_7-30421900.html?tag=box, 5 pgs.
Linksys, KISS DP-500, printed May 4, 2007 from http://www.kiss-technology.com/?p=dp500, 2 pgs.
LINKSYS®:“Enjoy your digital music and pictures on your home entertainment center, without stringing wires!”, Model No. WMA 11B, printed May 9, 2007 from http://www.linksys.com/servlet/Satellite?c=L_Product_C2&childpagename=US/Layout&cid=1115416830950&p, 10 pgs.
Microsoft Corporation, “Chapter 8, Multimedia File Formats” 1991, Microsoft Windows Multimedia Programmer's Reference, 3 cover pgs., pp. 8-1 to 8-20.
Microsoft Media Platform: Player Framework, “Microsoft Media Platform: Player Framework v2.5 (formerly Silverlight Media Framework)”, May 3, 2011, 2 pgs.
Microsoft Media Platform: Player Framework, “Silverlight Media Framework v1.1”, Jan. 2010, 2 pgs.
Microsoft Windows® XP Media Center Edition 2005, Frequently asked Questions, 10 pgs, printed May 4, 2007 from http://www.microsoft.com/windowsxp/mediacenter/evaluation/faq.mspx.
Microsoft Windows® XP Media Center Edition 2005: Features, printed May 9, 2007, from http://www.microsoft.com/windowsxp/mediacenter/evaluation/features.mspx, 4 pgs.
Multiview Video Coding (MVC), ISO/IEC 14496-10, 2008 Amendment, 10 pgs.
Open DML AVI-M-JPEG File Format Subcommittee, “Open DML AVI File Format Extensions”, Version 1.02, Feb. 28, 1996, 29 pgs.
pc world.com, Future Gear: PC on the HiFi, and the TV, from http://www.pcworld.com/article/id,108818-page,1/article.html, printed May 4, 2007, from IDG Networks, 2 pgs.
Qtv—About BroadQ, printed May 11, 2009 from http://www.broadq.com/en/about.php, 1 page.
Supplementary European Search Report for Application No. EP 04813918, Search Completed Dec. 19, 2012, 3 pgs.
Windows Media Center Extender for Xbox, printed May 9, 2007 from http://www.xbox.com/en-US/support/systemuse/xbox/console/mediacenterextender.htm, 2 pgs.
Windows® XP Media Center Edition 2005, “Experience more entertainment”, retrieved from http://download.microsoft.com/download/c/9/a/c9a7000a-66b3-455b-860b-1c16f2eecfec/MCE.pdf on May 9, 2007, 2 pgs.
“Adaptive Streaming Comparison”, Jan. 28, 2010, 5 pgs.
“Best Practices for Multi-Device Transcoding”, Kaltura Open Source Video, Printed on Nov. 27, 2013 from knowledge.kaltura.com/best-practices-multi-device-transcoding, 13 pgs.
“Container format (digital)”, printed Aug. 22, 2009 from http://en.wikipedia.org/wiki/Container_format_(digital), 4 pgs.
“DVD-MPeg differences”, printed Jul. 2, 2009 from http://dvd.sourceforge.net/dvdinfo/dvdmpeg.html, 1 page.
“DVD subtitles”, sam.zoy.org/writings/dvd/subtitles, dated Jan. 9, 2001, printed Jul. 2, 2009, 4 pgs.
“Final Committee Draft of MPEG-4 streaming text format”, International Organisation for Standardisation, Feb. 2004, 22 pgs.
“Information Technology—Coding of audio-visual objects—Part 17: Streaming text”, International Organisation for Standardisation, Feb. 2004, 22 pgs.
“Information technology—Coding of audio-visual objects—Part 18: Font compression and streaming”, ISO/IEC 14496-18, First edition Jul. 1, 2004, 26 pgs.
KISS Players, “KISS-DP-500”, retrieved from http://www.kiss-technology.com/?p=dp500 on May 4, 2007, 1 page.
“MPEG ISO/IEC 13818-1”, Information Technology—Generic Coding of Moving Pictures and Associated Audio: Systems, Apr. 25, 1995, 151 pgs.
“MPEG-4, Part 14, ISO/IEC 14496-14”, Information technology—Coding of audiovisual objects, Nov. 15, 2003, 18 pgs.
“Netflix turns on subtitles for PC, Mac streaming”, Yahoo! News, Apr. 21, 2010, Printed on Mar. 26, 2014, 3 pgs.
“OpenDML AVI File Format Extensions”, OpenDML AVI M-JPEG File Format Subcommittee, retrieved from www.the-labs.com/Video/odmlff2-avidef.pdf, Sep. 1997, 42 pgs.
“OpenDML AVI File Format Extensions Version 1.02”, OpenDMLAVI MJPEG File Format Subcommittee. Last revision: Feb. 28, 1996. Reformatting: Sep. 1997, 10 pgs.
“QCast Tuner for PS2”, printed May 11, 2009 from http://web.archive.org/web/20030210120605/www.divx.com/software/detail.php?ie=39, 2 pgs.
“Smooth Streaming Client”, The Official Microsoft IIS Site, Sep. 24, 2010, 4 pgs.
“Supported Media Formats”, Supported Media Formats, Android Developers, Printed on Nov. 27, 2013 from developer.android.com/guide/appendix/media-formats.html, 3 pgs.
“Text of ISO/IEC 14496-18/COR1, Font compression and streaming”, ITU Study Group 16—Video Coding Experts Group—ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 06), No. N8664, Oct. 27, 2006, 8 pgs.
“Text of ISO/IEC 14496-18/FDIS, Coding of Moving Pictures and Audio”, ITU Study Group 16—Videocoding Experts Group—ISO/IEC MPEG & ITU-T VCEG(ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 06), No. N6215, Dec. 2003, 26 pgs.
“Thread: SSME (Smooth Streaming Medial Element) config.xml review (Smooth Streaming Client configuration file)”, Printed on Mar. 26, 2014, 3 pgs.
“Transcoding Best Practices”, From movideo, Printed on Nov. 27, 2013 from code.movideo.com/Transcoding_Best_Practices, 5 pgs.
Related Publications (1)
Number Date Country
20200186854 A1 Jun 2020 US
Provisional Applications (1)
Number Date Country
61529201 Aug 2011 US
Continuations (2)
Number Date Country
Parent 15922198 Mar 2018 US
Child 16789303 US
Parent 13600046 Aug 2012 US
Child 15922198 US