Adaptive video streaming is a method by which a receiving device or system selects a bitstream from among a set of bitstreams, each representing the same video interval, where the selected bitstream represents the highest quality level that can be sustained by the communications infrastructure and display. Each bitstream in the set of bitstreams may represent a different level, where a higher level corresponds to a higher bitrate and resolution. As a result, the bitstream at a higher level requires more processing time than the bitstream at a next lower level.
Not all platforms will have sufficient processing power to decode, with sufficient speed, the level that can be sustained by the network and display, however. Most notably, low powered personal computers (PCs) (such as laptops and older desktop PCs) may struggle with processing bitstreams at such a level. Furthermore, some computers, especially laptops, use dynamic frequency scaling. This allows the frequency of the central processing unit (CPU) to adapt, depending on the heat and power properties. This will affect the available processing power as well, possibly making it difficult for a computer to handle a bitstream level that is chosen on the basis of network and display capabilities. In addition, the CPUs may be shared with other running processes (programs), which reduces the available processing capacity for video processing. Therefore, the selection of a particular bitstream in an adaptive streaming system needs to consider the available processing power.
In the drawings, the leftmost digit(s) of a reference number identifies the drawing in which the reference number first appears.
An embodiment is now described with reference to the figures, where like reference numbers indicate identical or functionally similar elements. While specific configurations and arrangements are discussed, it should be understood that this is done for illustrative purposes only. A person skilled in the relevant art will recognize that other configurations and arrangements can be used without departing from the spirit and scope of the description. It will be apparent to a person skilled in the relevant art that this can also be employed in a variety of other systems and applications other than what is described herein.
Disclosed herein are methods, systems, and computer program products that allow for the load adaptive downloading, processing, and rendering of video by a video processing client, where the downloading is adaptive to the processing load of a computing system on which a video processing client operates.
Generally, the processing power required to decode and render video streams increases monotonically with bitrate and resolution of the streams. The load adaptive functionality described herein may provide a smooth playback at a specific level, thus avoiding excessive stutter on the client. The load adaptive process chooses an appropriate decode level (i.e., an appropriate bitstream from the set of bitstreams) that is sustainable (i.e. a bitstream that can be decoded in real-time given the current system processing capabilities), and with the best visual quality. An embodiment of the process, which includes a predictive feedback based process, will initially start with no prior knowledge of the video system, and will acquire knowledge by analyzing performance data received from the video system. A decision for the maximum sustainable decode level may be made prior to download of a video segment, and will be based on the recent performance history of the video system. Occasionally, selection of a decode level may, under specific conditions, be followed by flushing some of the already-downloaded video data in an embodiment.
In an embodiment, the load adaptive streaming process selects an initial playback bitrate from previously stored client configuration information. The client stores the maximum load adaptive decode level previously used during playback. For example, on Windows™, the client can store the maximum load adaptive level in the registry, in an embodiment. In the absence of a previous stored configuration, the load adaptive functionality can start from the lowest level.
From this initial state, a new decode level may be chosen, based on processing conditions, i.e., on the load being placed on the host computing system. There are many indications that could be used to determine whether the system can handle the load. Examples include CPU usage (as measured by the ratio of the amount of time in which the CPU is active to the time spent idle, for example) or the rate or extent of dropping of video frames. CPU usage may be used, but in an embodiment this is not considered as a measure as there is no strong correlation between the dead-line driven nature of the video system (i.e., the requirement for a certain number of frames per unit time) and the average load of a CPU. The rate of dropping frames is a useful measure, although it is reactive. A useful measure would indicate when the load is approaching the limit of a system. A video system must render a frame every frame period. From this follows that, on average, it must produce a frame every frame period, such that the second frame queue is never depleted.
The load-adaptive streaming process as described herein may use, as inputs, one or more of a variety of performance measures relating to the operations and delays of a system such as system 100. The following performance measurements may be used for load adaptive streaming functionality, according to an embodiment. In order to minimize communication overhead between the client video system and the load adaptive streaming process, the measurements may be assembled in the client's video system in a sample collection buffer and relayed to the load adaptive streaming process periodically.
A. Time to deliver a frame: The time to deliver a frame is a measurement of the total system time spent for decoding and video processing operations.
In an embodiment, the excess time to deliver a frame with respect to the frame period (referred to herein as excess frame time) may be used as a comparable measure. If the frame period is 40 ms and the time to deliver a frame is 50 ms then the excess frame time is 10 ms. The excess frame time is −10 ms when the time to deliver a frame is 30 ms. As a video system typically employs a frame queue, the delivery time is averaged over the frames in the queue. As can be concluded from empirical measurements, the time to deliver a frame varies considerably; however as all frames need to be delivered in time, the processing described here needs to consider only the outliers, i.e., the frames that take the longest time to process. In such an embodiment, a sorted list of the largest (or maximum) excess delivery times is maintained; the average of a subset of these maximum values is then calculated. In an embodiment, this subset represents a selected range of these maximum values. This average is used for comparison to a decision threshold. This average may be viewed as an average of a range of maximum excess delivery times. Note that the “excess delivery times” are determined as a function (e.g., the mean) of the delivery times of frames in the second queue in an embodiment.
In an embodiment, the difference between the two thresholds is larger than the expected performance increase. The lower threshold may be derived dynamically from the difference in resolution. In addition, in an embodiment, the thresholds may be derived dynamically in the client video system during operation. Alternatively, the thresholds may be configured statically by a remote server. The thresholds may also be stored locally at the client video system, and may be read at startup.
B. Total number of frames in the frame queue: Note that this value is dynamic
C. Dropped frame count over a predetermined period.
D. Current decode level.
E. The amount of video data in download buffers
F. The video resolution for each streaming level.
The choice of a lower decoding level is illustrated in
The choice of a higher decode level is illustrated in
In an embodiment, a minimum observation period may be implemented, such that a lower decode level is chosen only if the average time to deliver exceeds the threshold for this minimum observation period. In an embodiment, this time period may be zero seconds, but in other embodiments, this minimum observation period may be non-zero. Analogously, another minimum observation period may be implemented, such that a higher decode level is chosen only if the average time to deliver is below the defined threshold for this minimum observation period.
The flushing of the CPB (325 above) is performed when the proper condition(s) are met, and only performed to a certain extent, according to an embodiment. This is illustrated in
The extent of the flushing may vary according to system conditions. Generally, not every frame will be removed. A flush may be performed when the current level results in dropped frames. In an embodiment, the percentage of dropped frames will determine the aggressiveness of the flush. In such an embodiment, if the percentage of dropped frames is less than 2%, no flush is needed. If the percentage of dropped frames is between 2% and 15%, the CPB is flushed to the extent that 11 seconds of video are kept in the CPB. If the percentage of dropped frames exceeds 15%, the CPB is flushed to the extent that 6 seconds of video are retained in the CPB. In alternative embodiments, the dropped frame threshold percentages may vary and the extent of flushing may vary.
Note that in some video systems, a rate adaptive streaming process may also be in place. In such a context, there may be a relationship between the rate adaptive and load adaptive algorithms. The rate adaptive algorithm may rely on buffering several seconds of video data to avoid re-buffering, whereas the load adaptive algorithm avoids excessive stutter by choosing an appropriate decode level and by sometimes purging downloaded data from the CPB of the client. In an embodiment, the client chooses the lower of the two levels recommended by the rate adaptive process and the load adaptive process.
One or more features disclosed herein may be implemented in hardware, software, firmware, and combinations thereof, including discrete and integrated circuit logic, application specific integrated circuit (ASIC) logic, and microcontrollers, and may be implemented as part of a domain-specific integrated circuit package, or a combination of integrated circuit packages. The term software, as used herein, refers to a computer program product including at least one computer readable medium having computer program logic stored therein to cause a computer system to perform one or more features and/or combinations of features disclosed herein. The computer readable medium may be transitory or non-transitory. An example of a transitory computer readable medium may be a digital signal transmitted over a radio frequency or over an electrical conductor, through a local or wide area network, or through a network such as the Internet. An example of a non-transitory computer readable medium may be a compact disk, a flash memory, RAM, ROM, or other data storage device.
In an embodiment, some or all of the processing described herein may be implemented as software or firmware. Such a software or firmware embodiment is illustrated in the context of a computing system 500 in
In the embodiment of
In an embodiment, constants and definitions in the processing described herein may also be programmable, along with a set of default parameters. These may include the following configuration parameters:
Methods and systems are disclosed herein with the aid of functional building blocks illustrating the functions, features, and relationships thereof. At least some of the boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries may be defined so long as the specified functions and relationships thereof are appropriately performed.
While various embodiments are disclosed herein, it should be understood that they have been presented by way of example only, and not limitation. It will be apparent to persons skilled in the relevant art that various changes in form and detail may be made therein without departing from the spirit and scope of the methods and systems disclosed herein. Thus, the breadth and scope of the claims should not be limited by any of the exemplary embodiments disclosed herein.
Number | Name | Date | Kind |
---|---|---|---|
5361332 | Yoshida et al. | Nov 1994 | A |
5404436 | Hamilton | Apr 1995 | A |
5479303 | Suzuki et al. | Dec 1995 | A |
5717816 | Boyce et al. | Feb 1998 | A |
5867625 | Mclaren | Feb 1999 | A |
5887110 | Sakamoto et al. | Mar 1999 | A |
5946446 | Yanagihara | Aug 1999 | A |
6018611 | Nogami et al. | Jan 2000 | A |
6031622 | Ristow et al. | Feb 2000 | A |
6047100 | McLaren | Apr 2000 | A |
6058240 | McLaren | May 2000 | A |
6097877 | Katayama et al. | Aug 2000 | A |
6155840 | Sallette | Dec 2000 | A |
6195388 | Choi et al. | Feb 2001 | B1 |
6222981 | Rijckaert | Apr 2001 | B1 |
6292621 | Tanaka et al. | Sep 2001 | B1 |
6389218 | Gordon et al. | May 2002 | B2 |
6418270 | Steenhof et al. | Jul 2002 | B1 |
6466733 | Kim | Oct 2002 | B1 |
6510554 | Gordon et al. | Jan 2003 | B1 |
6621979 | Eerenberg et al. | Sep 2003 | B1 |
6658056 | Duruöz et al. | Dec 2003 | B1 |
6807306 | Girgensohn et al. | Oct 2004 | B1 |
6859496 | Boroczky et al. | Feb 2005 | B1 |
6956901 | Boroczky et al. | Oct 2005 | B2 |
6965724 | Boccon-Gibod et al. | Nov 2005 | B1 |
7023924 | Keller et al. | Apr 2006 | B1 |
7231132 | Davenport | Jun 2007 | B1 |
7242772 | Tehranchi | Jul 2007 | B1 |
7478325 | Foehr | Jan 2009 | B2 |
7720352 | Belknap et al. | May 2010 | B2 |
7962942 | Craner | Jun 2011 | B1 |
7991156 | Miller | Aug 2011 | B1 |
8023562 | Zheludkov et al. | Sep 2011 | B2 |
8046453 | Olaiya | Oct 2011 | B2 |
8054880 | Yu et al. | Nov 2011 | B2 |
8065708 | Smyth et al. | Nov 2011 | B1 |
8225061 | Greenebaum | Jul 2012 | B2 |
8233768 | Soroushian et al. | Jul 2012 | B2 |
8249168 | Graves | Aug 2012 | B2 |
8265168 | Masterson et al. | Sep 2012 | B1 |
8270473 | Chen et al. | Sep 2012 | B2 |
8270819 | Vannier | Sep 2012 | B2 |
8289338 | Priyadarshi et al. | Oct 2012 | B2 |
8291460 | Peacock | Oct 2012 | B1 |
8311115 | Gu et al. | Nov 2012 | B2 |
8321556 | Chatterjee et al. | Nov 2012 | B1 |
8386621 | Park | Feb 2013 | B2 |
8412841 | Swaminathan et al. | Apr 2013 | B1 |
8456380 | Pagan | Jun 2013 | B2 |
8472792 | Butt | Jun 2013 | B2 |
8510303 | Soroushian et al. | Aug 2013 | B2 |
8515265 | Kwon et al. | Aug 2013 | B2 |
20020136298 | Anantharamu et al. | Sep 2002 | A1 |
20030002578 | Tsukagoshi et al. | Jan 2003 | A1 |
20030152370 | Otomo et al. | Aug 2003 | A1 |
20030163824 | Gordon et al. | Aug 2003 | A1 |
20030231863 | Eerenberg et al. | Dec 2003 | A1 |
20030231867 | Gates et al. | Dec 2003 | A1 |
20030233464 | Walpole et al. | Dec 2003 | A1 |
20030236836 | Borthwick | Dec 2003 | A1 |
20030236907 | Stewart et al. | Dec 2003 | A1 |
20040093618 | Baldwin et al. | May 2004 | A1 |
20040136698 | Mock | Jul 2004 | A1 |
20040158878 | Ratnakar et al. | Aug 2004 | A1 |
20040184534 | Wang | Sep 2004 | A1 |
20050038826 | Bae et al. | Feb 2005 | A1 |
20050108320 | Lord | May 2005 | A1 |
20050114896 | Hug | May 2005 | A1 |
20050193070 | Brown et al. | Sep 2005 | A1 |
20050193322 | Lamkin et al. | Sep 2005 | A1 |
20050204289 | Mohammed et al. | Sep 2005 | A1 |
20050207442 | Zoest et al. | Sep 2005 | A1 |
20050207578 | Matsuyama et al. | Sep 2005 | A1 |
20050273695 | Schnurr | Dec 2005 | A1 |
20050275656 | Corbin et al. | Dec 2005 | A1 |
20060037057 | Xu | Feb 2006 | A1 |
20060078301 | Ikeda et al. | Apr 2006 | A1 |
20060129909 | Butt et al. | Jun 2006 | A1 |
20060173887 | Breitfeld et al. | Aug 2006 | A1 |
20060245727 | Nakano et al. | Nov 2006 | A1 |
20060259588 | Lerman et al. | Nov 2006 | A1 |
20060263056 | Lin et al. | Nov 2006 | A1 |
20070031110 | Rijckaert | Feb 2007 | A1 |
20070044010 | Sull et al. | Feb 2007 | A1 |
20070047901 | Ando et al. | Mar 2007 | A1 |
20070083617 | Chakrabarti et al. | Apr 2007 | A1 |
20070086528 | Mauchly et al. | Apr 2007 | A1 |
20070136817 | Nguyen | Jun 2007 | A1 |
20070140647 | Kusunoki et al. | Jun 2007 | A1 |
20070154165 | Hemmeryckx-Deleersnijder et al. | Jul 2007 | A1 |
20070168541 | Gupta et al. | Jul 2007 | A1 |
20070168542 | Gupta et al. | Jul 2007 | A1 |
20070180125 | Knowles et al. | Aug 2007 | A1 |
20070217759 | Dodd | Sep 2007 | A1 |
20070234391 | Hunter et al. | Oct 2007 | A1 |
20070239839 | Buday et al. | Oct 2007 | A1 |
20070292107 | Yahata et al. | Dec 2007 | A1 |
20080005175 | Bourke et al. | Jan 2008 | A1 |
20080066099 | Brodersen et al. | Mar 2008 | A1 |
20080086456 | Rasanen et al. | Apr 2008 | A1 |
20080086747 | Rasanen et al. | Apr 2008 | A1 |
20080120389 | Bassali et al. | May 2008 | A1 |
20080126248 | Lee et al. | May 2008 | A1 |
20080137736 | Richardson et al. | Jun 2008 | A1 |
20080187283 | Takahashi | Aug 2008 | A1 |
20080192818 | DiPietro et al. | Aug 2008 | A1 |
20080195664 | Maharajh | Aug 2008 | A1 |
20080195744 | Bowra et al. | Aug 2008 | A1 |
20080256105 | Nogawa et al. | Oct 2008 | A1 |
20080263354 | Beuque | Oct 2008 | A1 |
20080279535 | Haque et al. | Nov 2008 | A1 |
20080310454 | Bellwood et al. | Dec 2008 | A1 |
20080310496 | Fang | Dec 2008 | A1 |
20090031220 | Tranchant et al. | Jan 2009 | A1 |
20090048852 | Burns et al. | Feb 2009 | A1 |
20090055546 | Jung et al. | Feb 2009 | A1 |
20090060452 | Chaudhri | Mar 2009 | A1 |
20090066839 | Jung et al. | Mar 2009 | A1 |
20090132599 | Soroushian et al. | May 2009 | A1 |
20090132721 | Soroushian et al. | May 2009 | A1 |
20090132824 | Terada et al. | May 2009 | A1 |
20090150557 | Wormley et al. | Jun 2009 | A1 |
20090169181 | Priyadarshi et al. | Jul 2009 | A1 |
20090178090 | Oztaskent | Jul 2009 | A1 |
20090196139 | Bates et al. | Aug 2009 | A1 |
20090201988 | Gazier et al. | Aug 2009 | A1 |
20090226148 | Nesvadba et al. | Sep 2009 | A1 |
20090293116 | DeMello et al. | Nov 2009 | A1 |
20090303241 | Priyadarshi et al. | Dec 2009 | A1 |
20090307258 | Priyadarshi et al. | Dec 2009 | A1 |
20090307267 | Chen et al. | Dec 2009 | A1 |
20090310933 | Lee | Dec 2009 | A1 |
20090313544 | Wood et al. | Dec 2009 | A1 |
20090313564 | Rottler et al. | Dec 2009 | A1 |
20090328124 | Khouzam et al. | Dec 2009 | A1 |
20100040351 | Toma et al. | Feb 2010 | A1 |
20100074324 | Qian et al. | Mar 2010 | A1 |
20100083322 | Rouse | Apr 2010 | A1 |
20100095121 | Shetty et al. | Apr 2010 | A1 |
20100111192 | Graves | May 2010 | A1 |
20100142917 | Isaji | Jun 2010 | A1 |
20100158109 | Dahlby et al. | Jun 2010 | A1 |
20100186092 | Takechi et al. | Jul 2010 | A1 |
20100189183 | Gu et al. | Jul 2010 | A1 |
20100228795 | Hahn | Sep 2010 | A1 |
20100235472 | Sood et al. | Sep 2010 | A1 |
20100250532 | Soroushian et al. | Sep 2010 | A1 |
20110047209 | Lindholm et al. | Feb 2011 | A1 |
20110066673 | Outlaw | Mar 2011 | A1 |
20110080940 | Bocharov | Apr 2011 | A1 |
20110082924 | Gopalakrishnan | Apr 2011 | A1 |
20110126191 | Hughes et al. | May 2011 | A1 |
20110142415 | Rhyu | Jun 2011 | A1 |
20110145726 | Wei et al. | Jun 2011 | A1 |
20110149753 | Bapst et al. | Jun 2011 | A1 |
20110150100 | Abadir | Jun 2011 | A1 |
20110153785 | Minborg et al. | Jun 2011 | A1 |
20110197237 | Turner | Aug 2011 | A1 |
20110225315 | Wexler et al. | Sep 2011 | A1 |
20110225417 | Maharajh et al. | Sep 2011 | A1 |
20110239078 | Luby et al. | Sep 2011 | A1 |
20110246657 | Glow | Oct 2011 | A1 |
20110246659 | Bouazizi | Oct 2011 | A1 |
20110268178 | Park et al. | Nov 2011 | A1 |
20110302319 | Ha et al. | Dec 2011 | A1 |
20110305273 | He et al. | Dec 2011 | A1 |
20110314176 | Frojdh et al. | Dec 2011 | A1 |
20120023251 | Pyle et al. | Jan 2012 | A1 |
20120093214 | Urbach | Apr 2012 | A1 |
20120170642 | Braness et al. | Jul 2012 | A1 |
20120170643 | Soroushian et al. | Jul 2012 | A1 |
20120170906 | Soroushian et al. | Jul 2012 | A1 |
20120170915 | Braness et al. | Jul 2012 | A1 |
20120173751 | Braness et al. | Jul 2012 | A1 |
20120179834 | van der Schaar et al. | Jul 2012 | A1 |
20120254455 | Adimatyam et al. | Oct 2012 | A1 |
20120278496 | Hsu | Nov 2012 | A1 |
20120307883 | Graves | Dec 2012 | A1 |
20120311094 | Biderman et al. | Dec 2012 | A1 |
20130044821 | Braness et al. | Feb 2013 | A1 |
20130046902 | Villegas Nuñez et al. | Feb 2013 | A1 |
20130061045 | Kiefer et al. | Mar 2013 | A1 |
20130114944 | Soroushian | May 2013 | A1 |
20130166765 | Kaufman | Jun 2013 | A1 |
20130166906 | Swaminathan et al. | Jun 2013 | A1 |
20140101722 | Moore | Apr 2014 | A1 |
20140189065 | van der Schaar et al. | Jul 2014 | A1 |
Number | Date | Country |
---|---|---|
813167 | Dec 1997 | EP |
1553779 | Jul 2005 | EP |
8111842 | Apr 1996 | JP |
09-037225 | Feb 1997 | JP |
9613121 | May 1996 | WO |
9965239 | Dec 1999 | WO |
0208948 | Jan 2002 | WO |
0235832 | May 2002 | WO |
2004102571 | Nov 2004 | WO |
2007044590 | Apr 2007 | WO |
2008042242 | Apr 2008 | WO |
2009065137 | May 2009 | WO |
2010060106 | May 2010 | WO |
2010080911 | Jul 2010 | WO |
2010122447 | Oct 2010 | WO |
2012094171 | Jul 2012 | WO |
2012094181 | Jul 2012 | WO |
2012094189 | Jul 2012 | WO |
Entry |
---|
Akhshabi et al., “An Experimental Evaluation of Rate-Adaptation Algorithms in Adaptive Streaming over HTTP”, MMSys'11, Feb. 24-25, 2011, 12 pgs. |
Anonymous, “Method for the encoding of a compressed video sequence derived from the same video sequence compressed at a different bit rate without loss of data”, ip.com, ip.com No. IPCOM000008165D, May 22, 2012, pp. 1-9. |
Author Unknown, “Blu-ray Disc—Wikipedia, the free encyclopedia”, printed Oct. 30, 2008 from http://en.wikipedia.org/wiki/Blu-ray—Disc, 11 pgs. |
Author Unknown, “Blu-ray Movie Bitrates Here—Blu-ray Forum”, printed Oct. 30, 2008 from http://forum.blu-ray.com/showthread.php?t=3338, 6 pgs. |
Author Unknown, “O'Reilly—802.11 Wireless Networks: The Definitive Guide, Second Edition”, printed Oct. 30, 2008 from http://oreilly.com/catalog/9780596100520, 2 pgs. |
Author Unknown, “Tunneling QuickTime RTSP and RTP over HTTP”, Published by Apple Computer, Inc.: 1999 (month unknown), 6 pages. |
Author Unknown, “Turbo-Charge Your Internet and PC Performance”, printed Oct. 30, 2008 from Speedtest.net—The Global Broadband Speed Test, 1 pg. |
Author Unknown, “When is 54 Not Equal to 54? A Look at 802.11a, b and g Throughput”, printed Oct. 30, 2008 from http://www.oreillynet.com/pub/a/wireless/2003/08/08/wireless?throughput.htm., 4 pgs. |
Author Unknown, “White paper, The New Mainstream Wirless LAN Standard”, Broadcom Corporation, Jul. 2003, 12 pgs. |
Deutscher, “IIS Transform Manager Beta—Using the MP4 to Smooth Task”, Retrieved from: https://web.archive.org/web/20130328111303/http://blog.johndeutscher.com/category/smooth-streaming, Blog post of Apr. 17, 2010, 14 pgs. |
Gannes, “The Lowdown on Apple's HTTP Adaptive Bitrate Streaming”, GigaOM, Jun. 10, 2009, 12 pgs. |
Garg et al., “An Experimental Study of Throughput for UDP and VoIP Traffic in IEEE 802.11b Networks”, Wireless Communications and Networkings, Mar. 2003, pp. 1748-1753. |
Ghosh, “Enhancing Silverlight Video Experiences with Contextual Data”, Retrieved from: http://msdn.microsoft.com/en-us/magazine/ee336025.aspx, 15 pgs. |
Inlet Technologies, “Adaptive Delivery to iDevices”, 2 pages. |
Inlet Technologies, “Adaptive delivery to iPhone 3.0”, 2 pages. |
Inlet Technologies, “HTTP versus RTMP”, 3 pages. |
Inlet Technologies, “The World's First Live Smooth Streaming Event: The French Open”, 2 pages. |
Kim, Kyuheon, “MPEG-2 ES/PES/TS/PSI”, Kyung-Hee University, Oct. 4, 2010, 66 pages. |
Kozintsev et al., “Improving last-hop multicast streaming video over 802.11”, Workshop on Broadband Wireless Multimedia, Oct. 2004, pp. 1-10. |
Kurzke et al., “Get Your Content Onto Google TV”, Google, Retrieved from: http://commondatastorage.googleapis.com/io2012/presentations/live%20to%20website/1300.pdf, 58 pgs. |
Lang, “Expression Encoder, Best Practices for live smooth streaming broadcasting”, Microsoft Corporation, 20 pgs. |
Levkov, “Mobile Encoding Guidelines for Android Powered Devices”, Adobe Systems Inc., Addendum B, source and date unknown, 42 pgs. |
MSDN, “Adaptive streaming, Expression Studio 2.0”, 2 pgs. |
Nelson, “Smooth Streaming Deployment Guide”, Microsoft Expression Encoder, Aug. 2010, 66 pgs. |
Noé, Alexander, “Matroska File Format (under construction !)”, Jun. 24, 2007, XP002617671, Retrieved from: http://web.archive.org/web/20070821155146/www.matroska.org/technical/specs/matroska.pdf, Retrieved on Jan. 19, 2011, pp. 1-51. |
Ozer, “The 2012 Encoding and Transcoding Buyers' Guide”, Streamingmedia.com, Retrieved from: http://www.streamingmedia.com/Articles/Editorial/Featured-Articles/The-2012-Encoding-and-Transcoding-Buyers-Guide-84210.aspx, 2012, 8 pgs. |
Pantos, “HTTP Live Streaming, draft-pantos-http-live-streaming-10”, IETF Tools, Oct. 15, 2012, Retrieved from: http://tools.ietf.org/html/draft-pantos-http-live-streaming-10, 37 pgs. |
Pantos, R., “HTTP Live Streaming: draft-pantos-http-live-streaming-06”, Published by the Internet Engineering Task Force (IETF), Mar. 31, 2011, 24 pages. |
Papagiannaki et al., “Experimental Characterization of Home Wireless Networks and Design Implications”, INFOCOM 2006, 25th IEEE International Conference of Computer Communications, Proceedings, Apr. 2006, 13 pgs. |
RGB Networks, “Comparing Adaptive HTTP Streaming Technologies”, Nov. 2011, Retrieved from: http://btreport.net/wp-content/uploads/2012/02/RGB-Adaptive-HTTP-Streaming-Comparison-1211-01.pdf, 20 pgs. |
Schulzrinne, H. et al., “Real Time Streaming Protocol 2.0 (RTSP): draft-ietfmmusic-rfc2326bis-27”, MMUSIC Working Group of the Internet Engineering Task Force (IETF), Mar. 9, 2011, 296 pages. |
Siglin, “HTTP Streaming: What You Need to Know”, streamingmedia.com, 2010, 16 pages. |
Siglin, “Unifying Global Video Strategies, MP4 File Fragmentation for Broadcast, Mobile and Web Delivery”, Nov. 16, 2011, 16 pgs. |
Tan, Yap-Peng et al., “Video transcoding for fast forward/reverse video playback”, IEEE ICIP, 2002, I-713 to I-716. |
Wang et al., “Image Quality Assessment: From Error Visibility to Structural Similarity”, IEEE Transactions on Image Processing, Apr. 2004, vol. 13, No. 4, pp. 600-612. |
Wu, Feng et al., “Next Generation Mobile Multimedia Communications: Media Codec and Media Transport Perspectives”, In China Communications, Oct. 2006, pp. 30-44. |
Zambelli, Alex, “IIS Smooth Streaming Technical Overview”, Microsoft Corporation, Mar. 2009. |
European Search Report Application No. EP 08870152, Search Completed May 19, 2011, Mailed May 26, 2011, 9 pgs. |
European Search Report for Application 11855103.5, search completed Jun. 26, 2014, 9 pgs. |
European Search Report for Application 11855237.1, search completed Jun. 25, 2014, 9 pgs. |
Federal Computer Week, “Tool Speeds Info to Vehicles”, Jul. 25, 1999, 5 pages. |
HTTP Live Streaming Overview, Networking & Internet, Apple, Inc., Apr. 1, 2011, 38 pages. |
International Search Report and Written Opinion for International Application PCT/US2011/066927, International Filing Date Dec. 22, 2011, Report Completed Apr. 3, 2012, Mailed Apr. 20, 2012, 14 pgs. |
International Search Report and Written Opinion for International Application PCT/US2011/067167, International Filing Date Dec. 23, 2011, Report Completed Jun. 19, 2012, Mailed Jul. 2, 2012, 11 pgs. |
International Search Report for International Application No. PCT/US08/87999, date completed Feb. 7, 2009, date mailed Mar. 19, 2009, 2 pgs. |
ITS International, “Fleet System Opts for Mobile Server”, Aug. 26, 1999, 1 page. |
Lifehacker—Boxqueue Bookmarklet Saves Videos for Later Boxee Watching, printed Jun. 16, 2009 from http://feeds.gawker.com/˜r/lifehacker/full/˜3/OHvDmrIgZZc/boxqueue-bookmarklet-saves-videos-for-late-boxee-watching, 2 pgs. |
Microsoft, Microsoft Media Platform: Player Framework, “Silverlight Media Framework v1.1”, 2 pages. |
Microsoft, Microsoft Media Platform:Player Framework, “Microsoft Media Platform: Player Framework v2.5 (formerly Silverlight Media Framework)”, 2 pages. |
Supplementary European Search Report for Application No. EP 10729513, International Filing Date Jan. 7, 2010, Search Completed Dec. 9, 2013, 4 pgs. |
The Official Microsoft IIS Site, Smooth Streaming Client, 4 pages. |
Written Opinion of the International Searching Authority for International Application No. PCT/US08/87999, date completed Feb. 7, 2009, date mailed Mar. 19, 2009, 4 pgs. |
“Adaptive Streaming Comparison”, Jan. 28, 2010, 5 pgs. |
“Best Practices for Multi-Device Transcoding”, Kaltura Open Source Video, 13 pgs. |
“Informationweek: Front End: Daily Dose, Internet on Wheels”, Jul. 20. 1999, 3 pgs. |
“International Search Report and Written Opinion for International Application PCT/US2010/020372”, Search Report mailed Mar. 1, 2010, 7 pgs. |
“Netflix turns on subtitles for PC, Mac streaming”, 3 pgs. |
“Supported Media Formats”, Supported Media Formats, Android Developers, Nov. 27, 2013, 3 pgs. |
“Thread: SSME (Smooth Streaming Medial Element) config.xml review (Smooth Streaming Client configuration file)”, 3 pgs. |
“Transcoding Best Practices”, From movideo, Nov. 27, 2013, 5 pgs. |
“Using HTTP Live Streaming”, iOS Developer Library, Retrieved from: http://developer.apple.com/library/ios/#documentation/networkinginternet/conceptual/streamingmediaguide/UsingHTTPLiveStreaming/UsingHTTPLiveStreaming.html#//apple—ref/doc/uid/TP40008332-CH102-SW1, 10 pgs. |
Number | Date | Country | |
---|---|---|---|
20140096171 A1 | Apr 2014 | US |