This invention generally relates to start-up of playback of an encoded media in an adaptive streaming system. More particularly, this invention relates to systems and methods that can reduce the amount of encoded media buffered by a playback device prior to starting playback of the media.
The term streaming media describes the playback of media on a playback device, where the media is stored on a server and continuously sent to the playback device over a network during playback. For purposes of this discussion, media and/or encoded media is defined as data of a work that includes video, audio, pictures, or another type of presentation that may be displayed, played or in some other way presented by a playback device. Typically, the playback device stores a sufficient quantity of media in a buffer at any given time during playback to prevent disruption of playback due to the playback device completing playback of all the buffered media prior to receipt of the next portion of media. Adaptive bit rate streaming or adaptive streaming involves detecting the present streaming conditions (e.g. the user's network bandwidth and CPU capacity) in real time and adjusting the quality of the streamed media accordingly. Typically, the source media is encoded at multiple bit rates and the playback device or client switches between streaming the different encodings depending on available resources.
Adaptive streaming solutions typically utilize either Hypertext Transfer Protocol (HTTP), published by the Internet Engineering Task Force and the World Wide Web Consortium as RFC 2616, or Real Time Streaming Protocol (RTSP), published by the Internet Engineering Task Force as RFC 2326, to stream media between a server and a playback device. HTTP is a stateless protocol that enables a playback device to request a byte range within a file. HTTP is described as stateless, because the server is not required to record information concerning the state of the playback device requesting information or the byte ranges requested by the playback device in order to respond to requests received from the playback device. RTSP is a network control protocol used to control streaming media servers. Playback devices issue control commands, such as “play” and “pause”, to the server streaming the media to control the playback of media files. When RTSP is utilized, the media server records the state of each client device and determines the media to stream based upon the instructions received from the client devices and the client's state.
In adaptive streaming systems, the source media is typically stored on a media server as a top level index file pointing to a number of alternate streams that contain the actual video and audio data. Each stream is typically stored in one or more container files. Different adaptive streaming solutions typically utilize different index and media containers. The Synchronized Multimedia Integration Language (SMIL) developed by the World Wide Web Consortium is utilized to create indexes in several adaptive streaming solutions including IIS Smooth Streaming developed by Microsoft Corporation of Redmond, Washington, and Flash Dynamic Streaming developed by Adobe Systems Incorporated of San Jose, Calif. HTTP Adaptive Bitrate Streaming developed by Apple Computer Incorporated of Cupertino, Calif. implements index files using an extended M3U playlist file (.M3U8), which is a text file containing a list of URIs that typically identify a media container file. The most commonly used media container formats are the MP4 container format specified in MPEG-4 Part 14 (i.e. ISO/IEC 14496-14) and the MPEG transport stream (TS) container specified in MPEG-2 Part 1 (i.e. ISO/IEC Standard 13818-1). The MP4 container format is utilized in IIS Smooth Streaming and Flash Dynamic Streaming. The TS container is used in HTTP Adaptive Bitrate Streaming.
When a playback device commences adaptive bitrate streaming, the playback device typically starts by requesting portions of media from the lowest bitrate streams (where alternative streams are available). As the playback device downloads the requested media, the playback device can measure the available bandwidth. In the event that there is additional bandwidth available, the playback device can switch to higher bitrate streams.
To start playback of the encoded media, the playback device often attempts to buffer an adequate amount of the requested encoded media be received and stored to provide a minimum amount of playback time prior to commencing the playback. Buffering encoded media can assure that there are no underflow conditions during playback. An underflow condition is when the playback device does not have the next portion of encoded media needed to continue the playback. However, the acquisition of an adequate amount of encoded media usually causes a delay in the start of playback of the encoded media by the device. This is typically not a problem when the playback is only periodically started and/or re-started.
However, recently devices such as tablets and other mobile playback devices have made it easier for users to search the encoded media and re-start the playback at various points in the playback. As such, the conventional start-up requiring an adequate amount of encoded media may cause unsatisfactory pauses or delays in presentation of the playback. As such, those skilled in the art are constantly striving to provide a playback start-up that requires less of the encoded media prior to commencement of the playback to minimize the time needed for a start and/or re-start of the playback.
Systems and methods for decreasing an initial buffering period in an adaptive bitrate system in accordance with embodiments of this invention are disclosed. In accordance with some embodiments, a playback device selects one of set of alternative streams for start-up of playback of encoded media from a playback position within the encoded media in the following manner. The playback device begins by determining an estimated stability period for a current bandwidth of a communicative connection between the playback device and a remote system providing the alternative streams in response to a playback request. The playback device then selects one of the alternative streams from which each of the portions of the encoded media starting from the playback position can be provided prior to a playback time for the portion of encoded media during the estimated stability period such that an underflow condition does not occur during playback of the encoded media. The playback device then commences streaming of the encoded media by requesting the portions of encoded media be transmitted using the selected one of the alternative stream from the remote server. In accordance with some of these embodiments, the selected alternative stream also can provide a sufficient number of the portions of the encoded media starting from the playback position prior to an end of the estimated stability period to provide a sufficient buffer during playback after the estimated stability period has ended.
The selection of the alternative stream to use is performed in the following manner in accordance with some embodiments of this invention. The selection process begins by selecting of the alternative streams of encoded media to test. An index of portions of the encoded media for the selected stream is read to determine the size of each of the portions of encoded media starting from the playback position in the selected stream. A download time for each of the portions in the selected stream starting from the playback position is then determined based on the size of each of portions. The download time of each of the portions starting from the playback position is then compared to the playback time of the data in each of the portions and to determine whether an underflow condition occurs during the estimated stability period. If no under flow condition will occur, the download time of each of the portions is compared to an end time of the estimated stability period to determine whether a predetermined number of the portions of the selected stream is received prior to the end of the estimated stability period to provide a sufficient buffer for playback after the estimated stability period has ended. The stream is then selected if the process determines no underflow conditions will occur during the estimated stability period and if a sufficient buffer for playback is provided after the estimated stability period ends. In accordance with some of these embodiments, the selection of the streams and comparisons are repeated until a stream is selected.
In accordance with some embodiments of this invention, an alternative selection process is performed in response to a determination that none of the streams can provide the portions without an underflow condition and/or without a sufficient buffer at the end of the estimated stability period. In accordance with some embodiment of this invention the alternative selection process is performed by discarding a first portion from each of portions from each stream starting from the playback position from consideration and then repeating the selecting of one of the alternative streams, comparing of the download time of each of the portions to the playback time of each of the portions, and comparing of the download time of each of the of portions for each off the streams with the end time of the estimated stability period for the alternative streams with the first portion of each of the first portions discarded. In accordance with other embodiments, the alternative selection process is performed by selecting one of the alternative streams from which to obtain the portions of the encoded media and requiring a predetermined number of the portions starting from the playback position be received prior to commencing playback of the encoded media.
In accordance with some embodiments of this invention, the selection of one the alternative streams to test is based on a maximum bitrate of each of the plurality of alternative streams. In accordance with some embodiments of this invention the selection process further includes determining whether the index of portions for the selected alternative stream is stored by the playback device. If the index is not stored by the playback device, the index of portions for the selected alternative stream is requested from the remote system. The index of portions of the selected alternative stream is then received by the playback device in response to the request.
In accordance with some embodiments of this invention, the estimated stability period is determined by receiving the estimated stability period from the remote system. In accordance with other embodiment of this invention, the estimated stability period is determined by reading a predefined value for the estimated stability period from a memory of the playback device. In accordance with still other embodiments, the estimated stability period is calculated by the playback device from information about the communicative connection stored in memory.
Turning now to the drawings, systems and methods for decreasing an initial buffering period in an adaptive bitrate system in accordance with embodiments of the invention are illustrated. Adaptive streaming systems generally require an initial buffering period in order to obtain enough data of the encoded media to avoid underflow conditions in the latter parts of the multimedia presentation. For purposes of this discussion, an underflow condition is when a playback device does not have enough data of the encoded media in a buffer to continue playback of the encoded media. Typically, this buffering period may apply to the initial start of the system, as well as after each trick-play or seek operation. In current playback devices, many stream switching algorithms enforce a rule involving buffering a predetermined duration of video. In many instances, adaptive bitrate streaming systems download portions of video that include closed groups of pictures and can perform stream switches between closed groups of pictures. Examples of rules involving buffering a predetermined duration of video include (but are not limited to) an 8 second rule used in an adaptive bitrate streaming system that downloads closed groups of pictures have 2 second durations. The 8 second rule involves the playback device receives enough data of the encoded media to provide 8 seconds of playback prior to commencing the playback of the encoded media. In accordance with embodiments of this invention, systems and methods are provided that allow only one portion of encoded media (i.e. one closed group of pictures), to be received prior to commencing the playback. This reduces the start-up time from the time needed to receive a specific number of portions of the media to the time needed to receive a single portion of the media to greatly enhance the user's enjoyment of the playback of the encoded media.
Streaming System Architecture
Turning now to the
In the illustrated embodiment, playback devices include personal computers 18, CE players, and mobile phones 20. In other embodiments, playback devices can include consumer electronics devices such as DVD players, Blu-ray players, televisions, set top boxes, video game consoles, tablets, and other devices that are capable of connecting to a server via HTTP and playing back encoded media. Although a specific architecture is shown in
Playback Device
The processes for providing methods and systems in accordance with this invention are executed by a playback device. The relevant components in a playback device that perform the processes in accordance with an embodiment of the invention are shown in
Playback Start-Up Process
In accordance with many embodiments of this invention, a process for providing start-up of a playback process with only a minimal amount of data of the encoded media is provided by the playback device. In adaptive streaming systems, such as the system described with reference to
An underflow condition is when the playback device does not have enough data of the encoded media stored in a buffer to continue playback.
A process performed by a playback device for selecting a stream of encoded media in an adaptive streaming system such that playback may begin after receiving one portion of the encoded data of the stream in accordance with embodiments of this invention is shown in
In 310, the playback device tests the streams of encoded media to determine whether an underflow condition will occur during playback in the estimated stability period if the stream is used. The streams are also tested to determine whether a predetermined number of portions of the encoded media will be received during the estimated stability period to provide a sufficient buffer during playback. The predetermined number is a number of portions that provide data for a specified number of playback time periods after the estimated stability period expires. For example, a system may require enough portions of data to provide for 4 time periods of playback after the end of the estimated stability period or 8 seconds of playback time in accordance with an embodiment of this invention. However, the precise amount of portions and the amount of playback time required needed may vary based upon the configuration of the system and/or playback device.
A stream is selected to use to receive the portions of the encoded media needed for playback at 315. The stream is selected because the test process determined that no underflow conditions will occur during the estimated stability period when portions of the encoded media are received using the stream. Furthermore, the stream may also satisfy a requirement that at least the predetermined number of portions of the encoded media will be received by the end of the estimated stability period to provide a sufficient buffer during playback after the estimated stability period in accordance with some embodiments of this invention. The buffer can allow the playback device to determine an adequate stream to use to receive portions of the encoded media based upon the bandwidth conditions after the estimated stability period to continue playback. After the stream is selected, the playback device transmits a request to the remote server to provide portions of the encoded media using the selected stream in 320. The playback device then begins playback of the encoded media after the first portion of the encoded media is received in 325 and process 300 ends.
A process performed by the playback device to test the streams of encoded media to select a stream that provides portions of the encoded media starting from the playback position that do not cause an underflow condition during playback in the estimated stability period and provides a predetermined number of portions prior to the end of the estimated stability period to provide a sufficient buffer during playback in accordance with an embodiment of this invention is shown in
In 415, the playback device performs a test process on the streams. An embodiment of the test process is described below with reference to
Alternatively, process 400 may discard the first portion of encoded data from each stream in 425 and repeat the test process from 415 using the stream with the discarded first portion. This allows the process to try to determine a stream that can be used to allow star-up of the playback of the encoded media after two portions of the encoded media are downloaded.
A process performed by playback device in 415 of process 400 to select a stream in accordance with embodiments of this invention is shown in
After the stream is selected, the portion index for the selected stream is read in 510. Process 400 then determines the portions of the stream starting from the playback position of the encoded media and the size of each portion that may be downloaded during the estimated stability period in 515. The information about the size of the portions is then used to determine the download time of each portion of the selected stream in 520. In 525, the download time of each of the portions starting from the playback position is compared to a playback time for the information to determine whether an underflow condition may occur. If process 500 determines that an underflow condition may occur for the selected stream, a new stream is selected, if available, in 540 and process 500 is repeated from 510 for the subsequent stream. If there are no more streams available, process 500 may return an indication that test process 500 was unsuccessful in selecting a stream.
If process 500 determines that no underflow condition may occur, process 500 determines whether a predetermined number of portions of the stream starting from the playback position of the encoded media may be downloaded prior to the end of the estimated stability period. If it is determined that at least the predetermined number of portions will be downloaded, the stream will provide a sufficient buffer for playback at the end of the estimated stability period and process 500 selects the stream for use in 535. Otherwise, a new stream is selected, if available, in 540 is repeated from 510 for the subsequent stream. If there are no more streams available, process 500 may return an indication that test process 500 was unsuccessful in selecting a stream.
Example of Test Process
An illustration of the selection of a stream for use in receiving portions of the encoded media in accordance with an embodiment is provided with respect to
The test process reads the portion index for stream 702 and determines the playback times for the portions of encoded media starting from the playback position as shown in line 702. The playback times of the portions of stream 702 are compared to the playback times. As can be seen in
Improved Playback Start Up Time
The above is description of embodiments of systems and methods in accordance with the present invention. It is foreseen that other skilled in the art will design alternative systems that infringe on this invention as set forth in the following claims either literally or through the Doctrine of Equivalents.
The current application is a continuation of U.S. patent application Ser. No. 13/631,017, filed Sep. 28, 2012, entitled “System and Method for Decreasing an Initial Buffering Period of an Adaptive Streaming System” to Shivadas et al., which claims priority to U.S. Provisional Patent Application No. 61/696,095, filed Aug. 31, 2012, titled “System and Method for Decreasing an Initial Buffering Period of an Adaptive Streaming System”, the disclosure of which is incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
5400401 | Wasilewski et al. | Mar 1995 | A |
5574785 | Ueno et al. | Nov 1996 | A |
5600721 | Kitazato | Feb 1997 | A |
5621794 | Matsuda et al. | Apr 1997 | A |
5642338 | Fukushima et al. | Jun 1997 | A |
5805700 | Nardone et al. | Sep 1998 | A |
5813010 | Kurano et al. | Sep 1998 | A |
5854873 | Mori et al. | Dec 1998 | A |
5907658 | Murase et al. | May 1999 | A |
5923869 | Kashiwagi et al. | Jul 1999 | A |
6002834 | Hirabayashi et al. | Dec 1999 | A |
6009237 | Hirabayashi et al. | Dec 1999 | A |
6016381 | Taira et al. | Jan 2000 | A |
6057832 | Lev et al. | May 2000 | A |
6065050 | DeMoney | May 2000 | A |
6266483 | Okada et al. | Jul 2001 | B1 |
6282320 | Hasegawa et al. | Aug 2001 | B1 |
6320905 | Konstantinides | Nov 2001 | B1 |
6351538 | Uz | Feb 2002 | B1 |
6373803 | Ando et al. | Apr 2002 | B2 |
6385673 | Demoney | May 2002 | B1 |
6415031 | Colligan et al. | Jul 2002 | B1 |
6445877 | Okada et al. | Sep 2002 | B1 |
6453115 | Boyle | Sep 2002 | B1 |
6453116 | Ando et al. | Sep 2002 | B1 |
6504873 | Vehvilaeinen | Jan 2003 | B1 |
6512883 | Shim et al. | Jan 2003 | B2 |
6594699 | Sahai et al. | Jul 2003 | B1 |
6654933 | Abbott et al. | Nov 2003 | B1 |
6671408 | Kaku | Dec 2003 | B1 |
6690838 | Zhou | Feb 2004 | B2 |
6724944 | Kalevo et al. | Apr 2004 | B1 |
6751623 | Basso et al. | Jun 2004 | B1 |
6813437 | Ando et al. | Nov 2004 | B2 |
6871006 | Oguz et al. | Mar 2005 | B1 |
6912513 | Candelore | Jun 2005 | B1 |
6931531 | Takahashi | Aug 2005 | B1 |
6957350 | Demos | Oct 2005 | B1 |
6970564 | Kubota et al. | Nov 2005 | B1 |
6983079 | Kim | Jan 2006 | B2 |
7006757 | Ando et al. | Feb 2006 | B2 |
7007170 | Morten | Feb 2006 | B2 |
7020287 | Unger | Mar 2006 | B2 |
7047309 | Baumann et al. | May 2006 | B2 |
7151832 | Fetkovich et al. | Dec 2006 | B1 |
7188183 | Paul et al. | Mar 2007 | B1 |
7212726 | Zetts | May 2007 | B2 |
7242772 | Tehranchi | Jul 2007 | B1 |
7274861 | Yahata et al. | Sep 2007 | B2 |
7295673 | Grab et al. | Nov 2007 | B2 |
7349886 | Morten et al. | Mar 2008 | B2 |
7352956 | Winter et al. | Apr 2008 | B1 |
7382879 | Miller | Jun 2008 | B1 |
7397853 | Kwon et al. | Jul 2008 | B2 |
7400679 | Kwon et al. | Jul 2008 | B2 |
7418132 | Hoshuyama | Aug 2008 | B2 |
7457415 | Reitmeier et al. | Nov 2008 | B2 |
7499930 | Naka et al. | Mar 2009 | B2 |
7546641 | Robert et al. | Jun 2009 | B2 |
7639921 | Seo et al. | Dec 2009 | B2 |
7640435 | Morten | Dec 2009 | B2 |
7711052 | Hannuksela et al. | May 2010 | B2 |
7770200 | Brooks et al. | Aug 2010 | B2 |
7853980 | Pedlow, Jr. et al. | Dec 2010 | B2 |
7864186 | Robotham et al. | Jan 2011 | B2 |
7908393 | Marr et al. | Mar 2011 | B2 |
7945143 | Yahata et al. | May 2011 | B2 |
7949775 | Virdi et al. | May 2011 | B2 |
8009575 | Spain et al. | Aug 2011 | B1 |
8099757 | Riedl et al. | Jan 2012 | B2 |
8131875 | Chen | Mar 2012 | B1 |
8169916 | Pai et al. | May 2012 | B1 |
8243924 | Chen et al. | Aug 2012 | B2 |
8286213 | Seo | Oct 2012 | B2 |
8312079 | Newsome et al. | Nov 2012 | B2 |
8369421 | Kadono et al. | Feb 2013 | B2 |
8516144 | Hsu et al. | Aug 2013 | B2 |
8649669 | Braness et al. | Feb 2014 | B2 |
8683066 | Hurst et al. | Mar 2014 | B2 |
8782268 | Pyle et al. | Jul 2014 | B2 |
8812662 | Soroushian et al. | Aug 2014 | B2 |
8819116 | Tomay et al. | Aug 2014 | B1 |
8832297 | Soroushian | Sep 2014 | B2 |
8849950 | Stockhammer et al. | Sep 2014 | B2 |
8918533 | Chen et al. | Dec 2014 | B2 |
8997160 | Hunt et al. | Mar 2015 | B2 |
9038116 | Knox et al. | May 2015 | B1 |
9088527 | Manor et al. | Jul 2015 | B2 |
9124642 | Choudhury et al. | Sep 2015 | B2 |
9313249 | Soroushian et al. | Apr 2016 | B2 |
9420024 | Pearson et al. | Aug 2016 | B2 |
9491498 | Brooks et al. | Nov 2016 | B2 |
9521178 | Freeman, II et al. | Dec 2016 | B1 |
9936267 | Shivadas et al. | Apr 2018 | B2 |
20010021276 | Zhou | Sep 2001 | A1 |
20010052077 | Fung et al. | Dec 2001 | A1 |
20010052127 | Seo et al. | Dec 2001 | A1 |
20020048450 | Zetts | Apr 2002 | A1 |
20020067432 | Kondo et al. | Jun 2002 | A1 |
20020135607 | Kato et al. | Sep 2002 | A1 |
20020141503 | Kobayashi et al. | Oct 2002 | A1 |
20020154779 | Asano et al. | Oct 2002 | A1 |
20020164024 | Arakawa et al. | Nov 2002 | A1 |
20020169971 | Asano et al. | Nov 2002 | A1 |
20030002577 | Pinder | Jan 2003 | A1 |
20030044080 | Frishman et al. | Mar 2003 | A1 |
20030053541 | Sun et al. | Mar 2003 | A1 |
20030063675 | Kang et al. | Apr 2003 | A1 |
20030077071 | Lin et al. | Apr 2003 | A1 |
20030135742 | Evans | Jul 2003 | A1 |
20030142594 | Tsumagari et al. | Jul 2003 | A1 |
20030206717 | Yogeshwar et al. | Nov 2003 | A1 |
20040001594 | Krishnaswamy et al. | Jan 2004 | A1 |
20040022391 | Obrien | Feb 2004 | A1 |
20040028227 | Yu | Feb 2004 | A1 |
20040037421 | Truman | Feb 2004 | A1 |
20040047592 | Seo et al. | Mar 2004 | A1 |
20040047607 | Seo et al. | Mar 2004 | A1 |
20040076237 | Kadono et al. | Apr 2004 | A1 |
20040081333 | Grab et al. | Apr 2004 | A1 |
20040093494 | Nishimoto et al. | May 2004 | A1 |
20040101059 | Joch et al. | May 2004 | A1 |
20040107356 | Shamoon et al. | Jun 2004 | A1 |
20050013494 | Srinivasan et al. | Jan 2005 | A1 |
20050063541 | Candelore | Mar 2005 | A1 |
20050076232 | Kawaguchi | Apr 2005 | A1 |
20050144468 | Northcutt | Jun 2005 | A1 |
20050177741 | Chen et al. | Aug 2005 | A1 |
20050243912 | Kwon et al. | Nov 2005 | A1 |
20050265555 | Pippuri | Dec 2005 | A1 |
20060002425 | Mane et al. | Jan 2006 | A1 |
20060013568 | Rodriguez | Jan 2006 | A1 |
20060031564 | Brassil et al. | Feb 2006 | A1 |
20060165163 | Burazerovic et al. | Jul 2006 | A1 |
20070047645 | Takashima | Mar 2007 | A1 |
20070067472 | Maertens et al. | Mar 2007 | A1 |
20070083467 | Lindahl et al. | Apr 2007 | A1 |
20070086485 | Vega-Garcia et al. | Apr 2007 | A1 |
20070180051 | Kelly et al. | Aug 2007 | A1 |
20080086570 | Dey et al. | Apr 2008 | A1 |
20080101718 | Yang et al. | May 2008 | A1 |
20080137847 | Candelore et al. | Jun 2008 | A1 |
20090010622 | Yahata et al. | Jan 2009 | A1 |
20090013195 | Ochi et al. | Jan 2009 | A1 |
20090077143 | Macy, Jr. | Mar 2009 | A1 |
20090106082 | Senti et al. | Apr 2009 | A1 |
20090132599 | Soroushian et al. | May 2009 | A1 |
20090144425 | Marr et al. | Jun 2009 | A1 |
20090178090 | Oztaskent | Jul 2009 | A1 |
20090249081 | Zayas | Oct 2009 | A1 |
20090282162 | Mehrotra et al. | Nov 2009 | A1 |
20090300203 | Virdi et al. | Dec 2009 | A1 |
20090310819 | Hatano | Dec 2009 | A1 |
20100142915 | Mcdermott et al. | Jun 2010 | A1 |
20100235542 | Visharam et al. | Sep 2010 | A1 |
20100306373 | Wormley | Dec 2010 | A1 |
20100306810 | Brooks et al. | Dec 2010 | A1 |
20110010466 | Fan et al. | Jan 2011 | A1 |
20110058675 | Brueck et al. | Mar 2011 | A1 |
20110066673 | Outlaw | Mar 2011 | A1 |
20110096828 | Chen et al. | Apr 2011 | A1 |
20110103374 | Lajoie et al. | May 2011 | A1 |
20110135090 | Chan et al. | Jun 2011 | A1 |
20110145858 | Philpott et al. | Jun 2011 | A1 |
20110173345 | Knox et al. | Jul 2011 | A1 |
20110179185 | Wang et al. | Jul 2011 | A1 |
20110197261 | Dong et al. | Aug 2011 | A1 |
20110246661 | Manzari et al. | Oct 2011 | A1 |
20110296048 | Knox et al. | Dec 2011 | A1 |
20110314130 | Strasman | Dec 2011 | A1 |
20120005312 | Mcgowan et al. | Jan 2012 | A1 |
20120042090 | Chen et al. | Feb 2012 | A1 |
20120047542 | Lewis et al. | Feb 2012 | A1 |
20120110120 | Willig et al. | May 2012 | A1 |
20120141089 | Hunt | Jun 2012 | A1 |
20120167132 | Mathews et al. | Jun 2012 | A1 |
20120173751 | Braness et al. | Jul 2012 | A1 |
20120177101 | van der Schaar | Jul 2012 | A1 |
20120179834 | van der Schaar | Jul 2012 | A1 |
20120311174 | Bichot et al. | Dec 2012 | A1 |
20120324519 | Laughlin | Dec 2012 | A1 |
20120331167 | Hunt | Dec 2012 | A1 |
20130007200 | van der Schaar et al. | Jan 2013 | A1 |
20130007263 | Soroushian et al. | Jan 2013 | A1 |
20130007297 | Soroushian et al. | Jan 2013 | A1 |
20130013803 | Bichot et al. | Jan 2013 | A1 |
20130080267 | McGowan | Mar 2013 | A1 |
20140068096 | Shivadas et al. | Mar 2014 | A1 |
20140140253 | Lohmar et al. | May 2014 | A1 |
20140149557 | Lohmar et al. | May 2014 | A1 |
20140365651 | Soroushian et al. | Dec 2014 | A1 |
20150288530 | Oyman | Oct 2015 | A1 |
Number | Date | Country |
---|---|---|
2237293 | Jul 1997 | CA |
1453319 | Sep 2004 | EP |
1283640 | Oct 2006 | EP |
2180664 | Apr 2010 | EP |
2360923 | Aug 2011 | EP |
20040039852 | May 2004 | KR |
20060106250 | Oct 2006 | KR |
2328040 | Jun 2008 | RU |
2000049762 | Aug 2000 | WO |
2000049763 | Aug 2000 | WO |
2003047262 | Jun 2003 | WO |
2004012378 | Feb 2004 | WO |
2004100158 | Nov 2004 | WO |
2005008385 | Jan 2005 | WO |
2005015935 | Feb 2005 | WO |
2009006302 | Jan 2009 | WO |
2009109976 | Sep 2009 | WO |
2011087449 | Jul 2011 | WO |
2011101371 | Aug 2011 | WO |
2011103364 | Aug 2011 | WO |
2013002828 | Jan 2013 | WO |
2013002834 | Jan 2013 | WO |
2013002835 | Jan 2013 | WO |
Entry |
---|
International Preliminary Report on Patentability for International Application No. PCT/US2011/064684, dated Mar. 4, 2014, 5 pgs. |
International Preliminary Report on Patentability for International Application No. PCT/US2011/068156, Report dated Jan. 7, 2014, 9 Pgs. |
International Preliminary Report on Patentability for International Application No. PCT/US2011/068264, Search Completed Jan. 7, 2014, dated Jan. 16, 2014, 5 pgs. |
International Search Report and Written Opinion for Application PCT/US2011/068264, Search Completed Mar. 30, 2012, dated May 1, 2012, 6 pgs. |
International Search Report and Written Opinion for International Application No. PCT/US2011/068156, Search completed Apr. 7, 2012, dated May 1, 2012, 11 Pgs. |
International Search Report and Written Opinion for International Application PCT/US2011/064684, Search Completed Mar. 26, 2012, dated Apr. 10, 2012, 7 pgs. |
“MPEG-2, Part 1, ISO/IEC 13818-1”, Information technology—Generic Coding of Moving Pictures and Associated Audio: Systems, 161 pgs., Nov. 13, 1994. |
“MPEG-4, Part 14, ISO/IEC 14496-14”, Information technology—Coding of audiovisual objects, 18 pgs., Nov. 15, 2003. |
“Video Publishers Turning to HD Online Video to Boost Competitive Edge and Increase Revenues”, Business Wire, Inc., Apr. 22, 2009, 2 pages, retrieved from https://global.factiva.com/ga/default.aspx. |
Begen et al., “Watching Video over the Web Part 1: Streaming Protocols”, IEEE Internet Computing, Mar. 1, 2011, vol. 15, Issue 2, pp. 54-63. |
Fielding et al., “Hypertext Transfer Protocol—HTTP1.1”, Network Working Group, RFC 2616, Jun. 1999, 114 pgs. |
Gannes, “The Lowdown on Apple's HTTP Adaptive Bitrate Streaming”, GigaOM, Jun. 10, 2009, 12 pgs. |
Liu et al., “Rate adaptation for adaptive HTTP streaming”, MMSys '11 Proceedings of the second annual ACM conference on Multimedia systems, Feb. 23-25, 2011, San Jose, CA, USA, pp. 169-174. |
Riiser et al., “Video Streaming Using a Location-based Bandwidth-Lookup Service for Bitrate Planning”, ACM Transactions on Multimedia Computing, Communications, and Applications, vol. 8, Issue 3, Article No. 24, Jul. 2012, 24 pages. |
Schulzrinne, H, “Real Time Streaming Protocol 2.0 (RTSP): draft-ietfmmusic-rfc2326bis-27”, MMUSIC Working Group of the Internet Engineering Task Force (IETF), 296 pgs., Mar. 9, 2011. |
Zambelli, “IIS Smooth Streaming Technical Overview”, Microsoft Corporation, Mar. 2009, 17 pages. |
Srinivasan et al., “Windows Media Video 9: overview and applications”, Signal Processing: Image Communication, vol. 19, No. 9, Oct. 2004, 25 pgs. |
Stockhammer, “Dynamic Adaptive Streaming over HTTP—Standards and Design Principles”, Proceedings of the second annual ACM conference on Multimedia, Feb. 2011, pp. 133-143. |
Timmerer et al., “HTTP Streaming of MPEG Media”, Proceedings of Streaming Day, 2010, 4 pgs. |
Tiphaigne et al., “A Video Package for Torch”, IDIAP Communication, IDIAP-COM 04-02, Jun. 2004, 46 pgs. |
Trappe et al., “Key Management and Distribution for Secure Multimedia Multicast”, IEEE Transaction on Multimedia, vol. 5, No. 4, Dec. 2003, pp. 544-557. |
Van Deursen et al., “On Media Delivery Protocols in the Web”, 2010 IEEE International Conference on Multimedia and Expo, Jul. 19-23, 2010, pp. 1028-1033. |
Ventura, “Streaming of Multimedia Learning Objects”, AG Integrated Communication System, Thesis, Mar. 2003, 101 pgs. |
Waggoner, “Compression for Great Digital Video: Power Tips, Techniques, & Common Sense”, CMP Books, 2002, 184 pgs. |
Watanabem et al., “MPEG-2 decoder enables DTV trick plays”, esearcher System LSI Development Lab, Fujitsu Laboratories Ltd., Kawasaki, Japan, Jun. 2001, 2 pgs. |
Wiegand, “Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG”, Jan. 18, 2002, 70 pgs. |
Willig et al., U.S. Appl. No. 61/409,285, filed Nov. 2, 2010. |
Yang et al., “Projection-Based Spatially Adaptive Reconstruction of Block—Transform Compressed Images”, IEEE Transactions on Image Processing, vol. 4, No. 7, Jul. 1995, pp. 896-908. |
Yang et al., “Regularized Reconstruction to Reduce Blocking Artifacts of Block Discrete Cosine Transform Compressed Images”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 3, No. 6, Dec. 1993, pp. 421-432. |
Yu et al., “Video Deblocking with Fine-Grained Scalable Complexity for Embedded Mobile Computing”, Proceedings 7th International Conference on Signal Processing, Aug. 31-Sep. 4, 2004, pp. 1173-1178. |
Zakhor, “Iterative Procedures for Reduction of Blocking Effects in Transform Image Coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 2, No. 1, Mar. 1992, pp. 91-95. |
Alattar et al., “Improved Selective Encryption Techniques for Secure Transmission of MPEG Video Bit-Streams”, In Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348), vol. 4, IEEE, 1999, pp. 256-260. |
Abomhara et al., “Enhancing Selective Encryption for H.264/AVC Using Advanced Encryption Standard”, International Journal of Computer Theory and Engineering, Apr. 2010, vol. 2, No. 2, pp. 223-229. |
Antoniou et al., “Adaptive Methods for the Transmission of Video Streams in Wireless Networks”, Deliverable 2.2, Feedback Algorithms for the Increase of the Objective Quality, 2015, 50 pgs. |
Apostolopoulos et al., “Secure Media Streaming and Secure Transcoding”, Multimedia Security Technologies for Digital Rights Management, 2006, pp. 241-273. |
Asai et al., “Essential Factors for Full-Interactive VOD Server: Video File System, Disk Scheduling, Network”, Proceedings of Globecom '95, Nov. 14-16, 1995, 6 pgs. |
Beker et al., “Cipher Systems: The Protection of Communications”, Chapter 8: Applying Cipher Systems, 1982, 40 pgs. |
Bocharov et al., “Portable Encoding of Audio-Video Objects, The Protected Interoperable File Format (PIFF)”, Microsoft Corporation, First Edition Sep. 8, 2009, 30 pgs. |
Bulterman et al., “Synchronized Multimedia Integration Language (SMIL 3.0)”, W3C Recommendation, Dec. 1, 2008, https://www.w3.org./TR/2008/REC-SMIL3-20081201/, 321 pgs. (Presented in five parts). |
Cahill et al., “Locally Adaptive Deblocking Filter for Low Bit Rate Video”, Proceedings 2000 International Conference on Image Processing, Sep. 10-13, 2000, Vancouver, BC, Canada, pp. 664-667. |
Candelore et al., U.S. Appl. No. 60/372,901, filed Apr. 16, 2002. |
Chaddha et al., “A Frame-work for Live Multicast of Video Streams over the Internet”, Proceedings of 3rd IEEE International Conference on Image Processing, Sep. 19, 1996, Lausanne, Switzerland, 4 pgs. |
Cheng, “Partial Encryption for Image and Video Communication”, University of Alberta, Department of Computing Science, Thesis, Fall 1998, 95 pgs. |
Cheng et al., “Partial Encryption of Compressed Images and Videos”, IEEE Transactions on Signal Processing, vol. 48, No. 8, Aug. 2000, 13 pgs. |
Cheung et al., “On the Use of Destination Set Grouping to Improve Fairness in Multicast Video Distribution”, Proceedings of IEEE INFOCOM'96, Conference on Computer Communications, vol. 2, IEEE, Jul. 18, 1995, 23 pgs. |
Collet, “Delivering Protected Content: An Approach for Next Generation Mobile Technologies”, University of Namur, Thesis, 2010, 84 pgs. |
Diamantis et al., “Real Time Video Distribution using Publication through a Database”, Proceedings SIBGRAPI'98. International Symposium on Computer Graphics, Image Processing, and Vision (Cat. No. 98EX237), Oct. 1990, 8 pgs. |
Dworkin, “Recommendation for Block Cipher Modes of Operation: Methods and Techniques”, NIST Special Publication 800-38A, Computer Security, Dec. 2001, 66 pgs. |
Fang et al., “Real-Time Deblocking Filter for MPEG-4 Systems”, Asia-Pacific Conference on Circuits and Systems, Oct. 28-31, 2002, Bali, Indonesia, pp. 541-544. |
Fecheyr-Lippens, “A Review of HTTP Live Streaming”, Jan. 2010, 38 pgs. |
Fukuda et al., “Reduction of Blocking Artifacts by Adaptive DCT Coefficient Estimation in Block-Based Video Coding”, Proceedings 2000 International Conference on Image Processing, Sep. 10-13, 2000, Vancouver, BC, Canada, pp. 969-972. |
Huang, U.S. Pat. No. 7,729,426, U.S. Appl. No. 11/230,794, filed Sep. 20, 2005. |
Huang et al., “Adaptive MLP post-processing for block-based coded images”, IEEE Proceedings—Vision, Image and Signal Processing, vol. 147, No. 5, Oct. 2000, pp. 463-473. |
Huang et al., “Architecture Design for Deblocking Filter in H.264/JVT/AVC”, 2003 International Conference on Multimedia and Expo, Jul. 6-9, 2003, Baltimore, MD, 4 pgs. |
Jain et al., U.S. Appl. No. 61/522,623, filed Aug. 11, 2011. |
Jung et al., “Design and Implementation of an Enhanced Personal Video Recorder for DTV”, IEEE Transactions on Consumer Electronics, vol. 47, No. 4, Nov. 2001, pp. 915-920. |
Kalva, Hari, “Delivering MPEG-4 Based Audio-Visual Services”, Kluwer Academic Publishers, 2001, 113 pgs. |
Kang et al., “Access Emulation and Buffering Techniques for Steaming of Non-Stream Format Video Files”, IEEE Transactions on Consumer Electronics, vol. 43, No. 3, Aug. 2001, 7 pgs. |
Kim et al., “A Deblocking Filter with Two Separate Modes in Block-based Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 1, Feb. 1999, pp. 156-160. |
Kim et al., “Tree-Based Group Key Agreement”, ACM Transactions on Information and System Security, vol. 7, No. 1, Feb. 2004, pp. 60-96. |
Laukens, “Adaptive Streaming—A Brief Tutorial”, EBU Technical Review, 2011, 6 pgs. |
Legault et al., “Professional Video Under 32-bit Windows Operating Systems”, SMPTE Journal, vol. 105, No. 12, Dec. 1996, 8 pgs. |
Li et al., “Layered Video Multicast with Retransmission (LVMR): Evaluation of Hierarchical Rate Control”, Proceedings of IEEE INFOCOM'98, the Conference on Computer Communications, Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies, Gateway to the 21st Century, Cat. No. 98, vol. 3, 1998, 26 pgs. |
List et al., “Adaptive Deblocking Filter”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, No. 7, Jul. 2003, pp. 614-619. |
Massoudi et al., “Overview on Selective Encryption of Image and Video: Challenges and Perspectives”, EURASIP Journal on Information Security, Nov. 2008, 18 pgs. |
McCanne et al., “Receiver-driven Layered Multicast”, Conference proceedings on Applications, Technologies, Architectures, and Protocols for Computer Communications, Aug. 1996, 14 pgs. |
Meier, “Reduction of Blocking Artifacts in Image and Video Coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 3, Apr. 1999, pp. 490-500. |
Nelson, “Smooth Streaming Deployment Guide”, Microsoft Expression Encoder, Aug. 2010, 66 pgs. |
Newton et al., “Preserving Privacy by De-identifying Facial Images”, Carnegie Mellon University School of Computer Science, Technical Report, CMU-CS-03-119, Mar. 2003, 26 pgs. |
O'Brien, U.S. Appl. No. 60/399,846, filed Jul. 30, 2002. |
O'Rourke, “Improved Image Decompression for Reduced Transform Coding Artifacts”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 5, No. 6, Dec. 1995, pp. 490-499. |
Park et al., “A Postprocessing Method for Reducing Quantization Effects in Low Bit-Rate Moving Picture Coding”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 9, No. 1, Feb. 1999, pp. 161-171. |
Richardson, “H.264 and MPEG-4 Video Compression”, Wiley, 2003, 306 pgs. (Presented in two parts). |
Sima et al., “An Efficient Architecture for Adaptive Deblocking Filter of H.264 AVC Video Coding”, IEEE Transactions on Consumer Electronics, vol. 50, No. 1, Feb. 2004, pp. 292-296. |
Spanos et al., “Performance Study of a Selective Encryption Scheme for the Security of Networked, Real-Time Video”, Proceedings of the Fourth International Conference on Computer Communications and Networks, IC3N'95, Sep. 20-23, 1995, Las Vegas, NV, pp. 2-10. |
Apple HTTP Live Streaming specification, Aug. 2017, 60 pgs. |
Microsoft Smooth Streaming specification, Jul. 22, 2013, 56 pgs. |
ISO/IEC 14496-12:2008(E) Informational Technology—Coding of Audio-Visual Objects Part 12: ISO Base Media File Format, Oct. 2008, 120 pgs. |
Server-Side Stream Repackaging (Streaming Video Technologies Panorama, Part 2), Jul. 2011, 15 pgs. |
Universal Mobile Telecommunications System (UMTS), ETSI TS 126 233 V9.1.0 (Jun. 2011) 3GPP TS 26.233, Version 9.1.0, Release 9, 18 pgs. |
Universal Mobile Telecommunications Systems (UMTS); ETSI TS 126 244 V9.4.0 (May 2011) 3GPP TS 26.244, Version 9.4.0, Release 9, 58 pgs. |
HTTP Live Streaming, Mar. 31, 2011, 24 pgs. |
HTTP Live Streaming, Sep. 30, 2011, 33 pgs. |
Information Technology—MPEG Systems Technologies—Part 7: Common Encryption in ISO Base Media File Format Files (ISO/IEC 23001-7), Apr. 1, 2015, 24 pgs. |
ISO/IEC 14496-12 Information technology—Coding of audio-visual objects—Part 12: ISO base media file format, Feb. 1, 2004 (“MPEG-4 Part 12 Standard”), 62 pgs. |
ISO/IEC FCD 23001-6 MPEG systems technologies Part 6: Dynamic adaptive streaming over HTTP (DASH), Jan. 28, 2011, 86 pgs. |
Microsoft Corporation, Advanced Systems Format (ASF) Specification, Revision 01.20.03, Dec. 2004, 121 pgs. |
MPEG-DASH presentation at Streaming Media West 2011, Nov. 2011, 14 pgs. |
Pomelo, LLC Tech Memo, “Analysis of Netflix's Security Framework for ‘Watch Instantly’ Service”, Mar.-Apr. 2009, 18 pgs. |
Text of ISO/IEC 23001-6: Dynamic adaptive streaming over HTTP (DASH), Oct. 2010, 71 pgs. |
“Data Encryption Decryption using AES Algorithm, Key and Salt with Java Cryptography Extension”, Available at https://www.digizol.com/2009/10/java-encrypt-decrypt-jce-salt.html, Oct. 2009, 6 pgs. |
“Delivering Live and On-Demand Smooth Streaming”, Microsoft Silverlight, 2009, 28 pgs. |
“HTTP Based Adaptive Streaming over HSPA”, Apr. 2011, 73 pgs. |
“Information Technology—Coding of Audio Visual Objects—Part 2: Visual”, International Standard, ISO/IEC 14496-2, Third Edition, Jun. 1, 2004, pp. 1-724. (presented in three parts). |
“Java Cryptography Architecture API Specification & Reference”, Available at https://docs.oracle.com/javase/1.5.0/docs/guide/security/CryptoSpec.html, Jul. 25, 2004, 68 pgs. |
“Java Cryptography Extension, javax.crypto.Cipher class”, Available at https://docs.oracle.com/javase/1.5.0/docs/api/javax/crypto/Cipher.html, 2004, 24 pgs. |
“JCE Encryption—Data Encryption Standard (DES) Tutorial”, Available at https://mkyong.com/java/jce-encryption-data-encryption-standard-des-tutorial/, Feb. 25, 2009, 2 pgs. |
“Live and On-Demand Video with Silverlight and IIS Smooth Streaming”, Microsoft Silverlight, Windows Server Internet Information Services 7.0, Feb. 2010, 15 pgs. |
“OpenDML AVI File Format Extensions Version 1.02”, OpenDMLAVI MJPEG File Format Subcommittee. Last revision: Feb. 28, 1996. Reformatting: Sep. 1997, 42 pgs. |
“Single-Encode Streaming for Multiple Screen Delivery”, Telestream Wowza Media Systems, 2009, 6 pgs. |
“The MPEG-DASH Standard for Multimedia Streaming Over the Internet”, IEEE MultiMedia, vol. 18, No. 4, 2011, 7 pgs. |
“Windows Media Player 9”, Microsoft, Mar. 23, 2017, 3 pgs. |
Number | Date | Country | |
---|---|---|---|
20180288498 A1 | Oct 2018 | US |
Number | Date | Country | |
---|---|---|---|
61696095 | Aug 2012 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13631017 | Sep 2012 | US |
Child | 15937715 | US |