The present invention relates to video distribution generally and, more particularly, to a method and/or architecture for a web based network operations center.
Content cached in a content delivery network or content distribution network (CDN) is generated by content producers. The content producers generate a fixed number of versions (or streams) of the content based on expected demand. Conventional content delivery solutions use an encoding device to produce several streams with a variety of predetermined encoding parameters simultaneously. The CDN delivers the content to an audience using the plurality of streams having the variety of encoding parameters. However, because the number of streams and variety of encoding parameters is fixed and the experience of consumers is not communicated to content producers, the conventional solutions can fail to provide the audience with an optimal experience.
Encoder settings are complicated. It can be difficult to know whether the encoding parameters are properly set, especially with adaptive bitrate streams across a variety of devices. An event creator may not have video expertise. The CDN may not be delivering good quality of service (QoS) to the end user. The conventional system does not have feedback on how many streams are enough. Thus, a conventional system can waste bandwidth across a network that could have been used to provide more bits for higher value content.
It would be desirable to implement a method and/or architecture for a web based network operations center.
The present invention concerns a system comprising a broadcast facility, one or more players, and an analytic service center. The broadcast facility may be configured to provide a plurality of streams. The one or more players may be configured to receive at least one of the plurality of streams and provide feedback on a user experience. The analytic service center may be configured to receive the feedback from the one or more players.
The objects, features and advantages of the present invention include providing a method and/or architecture for a web based network operations center that may (i) provide media analytics for protocols including Pantos HTTP live streaming (HLS) from Apple, Inc., Smooth Streaming from Microsoft Corp., Adobe Zeri/Flash, etc., (ii) provide feedback optimization, (iii) provide media analytics on playback experience, (iv) provide media analytics on who is watching what, and/or (v) directly feed back insights to encoding device(s) for real-time optimization of content and distribution methods.
These and other objects, features and advantages of the present invention will be apparent from the following detailed description and the appended claims and drawings in which:
An embodiment of the present invention may provide a system that brings the experience of the consumer of video content on any device to the producer of the content. The information provided by the consumer to the producer may provide the producer with insight into how to improve the experience of the consumer. The system may provide an automated quality control service to alert the producer of consumer problems as early as possible. The system may also help pinpoint where in a long chain of content processing any problems may be occurring. The system may also help the producer optimize the cost of delivery to the consumer by creating analytics on who is watching, in what regions, on what devices, using what content delivery mechanism (e.g., cable company, content delivery network (CDN) such as Akamai, mobile carrier (MC) such as Verizon, etc). A system in accordance with an embodiment of the present invention may put the end consumer in the loop with the initial content producer, especially with web based video formats (e.g., from Apple, Inc., Microsoft Corporation, Adobe, Google, etc.).
Referring to
In one example, an operator 102 may create an event through a broadcast facility 104. The broadcast facility 104 may generated a plurality of adaptive streams that may communicate event content via a number of content delivery networks (CDNs) 106a-106n and/or mobile carriers (MCs) 108 to a number of end users. The end users may use a number of actual player devices 110a-110n to connect to the streams available from the CDNs 106a-106n and MCs 108 and receive the event content. The actual player devices 110a-110n may be configured to provide feedback to a web-based network operations center (WEBNOC) 112.
The WEBNOC 112 may be configured to use the feedback from the player devices 110a-110n to adjust operation of the broadcast facility 104 and inform the operator 102 about the end user experience with respect to the event. The WEBNOC 112 may be configured to (i) receive event information from the broadcast facility 104, send insights (e.g. optimal settings, optimal streams, optimal CDN/MC choice, event reconfiguration, etc.) to the broadcast facility 104, and (iii) make information (e.g., account interface details, outages, alerts, analytics, global stream utilization, ad information, regional performance information, device demographics, etc.) available to the operator 102 via, for example, a web portal 114. The WEBNOC 112 may also be configured to facilitate concealment of errors in HTTP adaptive video sets using the techniques described in U.S. application Ser. No. 13/412,954, which is hereby incorporated by reference in its entirety.
In one example, the broadcast facility 104 may comprise a video encoding and packaging management system 120 and a live event encoder and packager 122. The video encoding and packaging management system 120 may be implemented, in one example, using an Elemental Conductor system (available from Elemental Technologies, Portland, Oreg.). The live event encoder and packager 122 may be implemented using, for example, one or more Elemental Live units (also available from Elemental Technologies, Portland, Oreg.).
In one example, the WEBNOC 112 may comprise a player cloud 130 and a central application (or service) 140. The live encoder and packager 122 generally communicates information with the service 140 including, but not limited to, settings, publishing points, digital rights management (DRM), player addresses, etc. When an event is started, the operator 102 may select whether or not to use dynamic quality analysis. When the event starts, a message is periodically sent to players as well as any server that is monitoring the streams. Feedback is sent back to the central service 140. The central service 140 associates the feedback with the event (e.g., using a unique event identifier). The feedback may be accessed later through the video encoding and packaging management system 120 and the live event encoder and packager 122. Analytics (e.g., media, etc.) for prior events and quality may also be viewed (e.g., through the video encoding and packaging management system 120, the live event encoder and packager 122 or a standard web browser). The end user of a device or player (e.g., iOS, android, silverlight, flash, etc.) may also click a “feedback up or down” button and/or select from various instantaneous feedback (e.g., “blocky”, “stuttering”, “video stopped”, “audio stopped”, etc).
A database of settings versus content versus quality may be built. The database may be used later so that the operator 102 may have a one button “optimize” capability that would use a piece of content and have the server offer optimal settings. The system 100 may facilitate holding CDNs and Mobile Carriers more accountable based upon historical data. The operator 102 may use the database to analyze advertisement value and standardize on user experience metrics. Consumers may chose (or search) content based on a user experience metric. The database may also receive and store feedback generated by a system such as the one described in U.S. application Ser. No. 13/412,954, which is incorporated herein by reference.
In one example, the WEBNOC 112 may be implemented as a web service based application that receives event details from the producer and receives real-time feedback on performance (e.g., playback performance and quality) from the consumers. The feedback to the service comes directly from the devices consuming the content, such as tablets, phones, computers, set top boxes (STBs), etc. The feedback generation capability is generally built into the players and player devices. For example, the players and player devices may be configured to know how to report back to the central service 140.
An automated player component may be implemented in the player cloud 130. The automated player component generally allows the content producers to automatically test their content playback without the attachment of actual users. For example, automated player instances may be created, for example, in a cloud compute service such as Amazon Elastic Compute Cloud (Amazon EC2), Rackspace, or any of various private cloud infrastructures that are spread around the world. In one example, automated player instances may be created in different (e.g., geographically) regions. In another example, the automated player instances may be configured to support the decryption of digital rights management (DRM) information as a way of testing the proper operation of a DRM service. The decryption of digital rights management (DRM) information may also provide another test as to the quality of the streams and whether the streams are properly formatted.
In one example, instantiation of automated player instances in multiple regions may allow broadcasters to test whether geo-blocking algorithms are working correctly. In another example, content providers may test system load handling by starting a number of automated player instances. The automated player instances would allow content providers to monitor content delivery network performance and health over multiple regions. The automated player instances may also be configured to automatically adjust network performance to simulate mobile device bandwidth fluctuations.
In one example, the automated player instances may be generated via an automatic player management system. The automatic player management system may be configured to manage the starting and stopping of automated player instances, for example, in the computing resources cloud(s). The automatic player management system may be configured to start and stop player instances in multiple or targeted regions using combinations of technologies and player frameworks. The various player instances may include, but are not limited to, technologies based, for example, on Microsoft Silver Light players, Adobe Flash players, HTML5 players, iOS emulators, and Android emulators. The player frameworks may be based, for example, on OSMF (open source media framework), SMF, or any other player framework. Operating systems (OSs) may include, but are not limited to, OSs from Microsoft and Linux. The hardware generally comprises a range of hardware capabilities, including, but not limited to combinations of differing central processing unit (CPU) performance and graphics processing units (GPUs). Additionally, a custom analyzer system may be implemented that monitors stream quality independent from these other technologies. In one example, the players may be web based (e.g., running in a browser). In another example, the players may be independent of a browser. When feedback from actual users is also available, the feedback data may be of higher quality.
In conventional system content playback is tested by manually test the streams by the producers, which is very tedious and error prone. Other detail that may be provided by the encoding units 122 may include, but is not limited to, some unique event identifier (e.g., name, UUID, etc.). The unique event identifier would then be used later to match the feedback with the event and allow the content owners to determine how well the event worked. A system in accordance with an embodiment of the present invention may have features that may include:
As would be apparent to those skilled in the relevant art(s), the signals illustrated in
Referring to
In the step 204, the process 200 may wait for the event to start. When the event has started, the process 200 may move to the step 206. In the step 206, the process 200 may check to determine whether a dynamic quality analysis has been selected by the user or content owner. When dynamic quality analysis has not been selected, the process 200 may remain idle. When dynamic quality analysis has been selected, the process 200 may move to the step 210. In the step 210, the process 200 may periodically send messages to players and servers requesting feedback information. When the request for feedback information has been sent, the process 200 may move to the step 212. In the step 212, the process 200 may receive feedback from actual end users and/or automated player instances created to simulate end users. The process 200 associates the feedback received with the respective event.
In one example, the feedback information (e.g., from embedded and automated player instances) may include, but is not limited to receiving bandwidth, CPU/dedicated decoding hardware utilization by decoder, frame decoding time/rate of video frames that are not displayed (e.g., dropped frames), native resolution of display device, whether player is in full screen mode or not, window size of player (e.g., when not in full screen mode), Profile/Level capability of decoder device, captioning, AV sync time stamps, whether an advertisement is being played, etc. When the requested feedback has been received, the process 200 moves to the step 214. In the step 214, the process 200 may generate one or more an analysis reports regarding the event. In one example, the analysis reports may include, but are not limited to outages, alerts, analytics, global stream utilization, advertisement information, regional performance information, device demographics information. When the analysis reports are generated, the process 200 may move to the step 216 and/or to the step 218. In the step 216, the process 200 may store the reports in a database for later use by the user or content owner. In the step 218, the process 200 may adjust settings of a broadcast facility (e.g., to optimize performance of the system). The steps 210-218 may be repeated periodically until the event ends.
Referring to
In the step 306, the process 300 creates an event entry in the database using the unique event identifier from the request. The process 300 then moves to the step 308. In the step 308, the process 300 instantiates an automated player instance in the player cloud (e.g., by sending a message to an automated player management system). When the automated player instance has been created, the process 300 moves to the step 310. In the step 310, the process 300 creates an interface for the automated player instance to post feedback data for the particular event (e.g., using hypertext transport protocol (HTTP)). When the interface has been created, the process 300 may move to the step 312. In the step 312, the process 300 waits for a signal from the broadcast facility indicating that the stream associated with the particular event is active. Upon receiving the signal from the broadcast facility, the process 300 moves to the step 314.
In the step 314, the process 300 listens for and logs data received from the automated player instance and actual player instances. In the step 316, the process 300 checks to make sure that feedback is being received. If no feedback is received, the process 300 may move to the step 318 and send an alert to a user account informing the user that no data is being received from the players. When feedback is received, the process 300 moves to the step 320 and begins monitoring the feedback for issues (e.g., quality, etc.). If there are issues (e.g., problems, etc.) with the playback quality, the process 300 may move to the step 324 to alert the user account that players are having trouble. In one example, the alert may include information specifying region, type, stream, particular issue, etc. When no issues with the playback quality are detected, the process 300 may move to the step 326 to determine whether the stream is finished. If the stream is not finished, the process 300 returns to the step 320 and continues monitoring the feedback. When the stream is finished, the process 300 may move to the step 328. In the step 328, the process 300 closes the feedback interface and performs a final (e.g., summary, etc.) analysis. The process 300 may also make sure the automated player instances that are no longer needed are closed.
Referring to
When connection to the stream is confirmed, the process 400 may move to the step 408. In the step 408, the player logs and sends back details about the stream (e.g., QoS, etc.) to the central application using the unique event identifier to associate the feedback with the appropriate stream. The process 400 may then move to the step 410 to check whether the stream is over. If the stream is not over, the process 400 returns to the step 408 and continues logging and sending feedback. As long as the player is connected to the stream (e.g., step 404) and the stream is not over (e.g., step 410), the process 400 continues to log and send back details about the stream (e.g., QoS, etc.) to the central application. When the stream is over, the process 400 may move to the step 412. In the step 412, the player sends a final report to the central application and the player instance is closed.
Referring to
In the step 506, the process 500 instantiates an automated player instances on server instances in multiple geographical regions. The process 500 then moves to the step 508. In the step 508, the player instance connects with the appropriate stream communicated by the central application. In one example, authorization keys may be required from the central application. In the step 510, the process 500 checks whether the player instance has connected to the stream. If the player instance has not connected to the stream, the process 500 may move to the step 512. In the step 512, the process 500 may make a report may to the central application regarding the error and close the automated player instance.
When connection to the stream is confirmed, the process 500 may move to the step 514. In the step 514, the automated player instance logs and sends back details about the stream (e.g., QoS, etc.) to the central application using the unique event identifier to associate the feedback with the appropriate stream. The process 500 may then move to the step 516 to check whether the stream is over. If the stream is not over, the process 500 returns to the step 514 and continues logging and sending feedback. As long as the automated player instance is connected to the stream (e.g., step 510) and the stream is not over (e.g., step 516), the process 500 continues to log and send back details about the stream (e.g., QoS, etc.) to the central application (e.g., step 514). When the stream is over, the process 500 may move to the step 518. In the step 518, the automated player instance sends a final report to the central application and the automated player instance is closed.
The functions performed by the diagrams of
The present invention may also be implemented by the preparation of ASICs (application specific integrated circuits), Platform ASICs, FPGAs (field programmable gate arrays), PLDs (programmable logic devices), CPLDs (complex programmable logic device), sea-of-gates, RFICs (radio frequency integrated circuits), ASSPs (application specific standard products), one or more monolithic integrated circuits, one or more chips or die arranged as flip-chip modules and/or multi-chip modules or by interconnecting an appropriate network of conventional component circuits, as is described herein, modifications of which will be readily apparent to those skilled in the art(s).
The present invention thus may also include a computer product which may be a storage medium or media and/or a transmission medium or media including instructions which may be used to program a machine to perform one or more processes or methods in accordance with the present invention. Execution of instructions contained in the computer product by the machine, along with operations of surrounding circuitry, may transform input data into one or more files on the storage medium and/or one or more output signals representative of a physical object or substance, such as an audio and/or visual depiction. The storage medium may include, but is not limited to, any type of disk including floppy disk, hard drive, magnetic disk, optical disk, CD-ROM, DVD and magneto-optical disks and circuits such as ROMs (read-only memories), RAMS (random access memories), EPROMs (erasable programmable ROMs), EEPROMs (electrically erasable programmable ROMs), UVPROM (ultra-violet erasable programmable ROMs), Flash memory, magnetic cards, optical cards, and/or any type of media suitable for storing electronic instructions.
The elements of the invention may form part or all of one or more devices, units, components, systems, machines and/or apparatuses. The devices may include, but are not limited to, servers, workstations, storage array controllers, storage systems, personal computers, laptop computers, notebook computers, palm computers, personal digital assistants, portable electronic devices, battery powered devices, set-top boxes, encoders, decoders, transcoders, compressors, decompressors, pre-processors, post-processors, transmitters, receivers, transceivers, cipher circuits, cellular telephones, digital cameras, positioning and/or navigation systems, medical equipment, heads-up displays, wireless devices, audio recording, audio storage and/or audio playback devices, video recording, video storage and/or video playback devices, game platforms, peripherals and/or multi-chip modules. Those skilled in the relevant art(s) would understand that the elements of the invention may be implemented in other types of devices to meet the criteria of a particular application.
While the invention has been particularly shown and described with reference to the preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made without departing from the scope of the invention.
This application is a continuation-in-part of U.S. application Ser. No. 13/436,856, filed Mar. 31, 2012, which claims the benefit of U.S. Provisional Application No. 61/469,979, filed Mar. 31, 2011. All of the above-referenced applications are hereby incorporated by reference in their entirety. This application is related to U.S. application Ser. No. 13/230,028, filed Sep. 12, 2011, U.S. application Ser. No. 13/323,007, filed Dec. 12, 2011, and U.S. application Ser. No. 13/412,954, filed Mar. 6, 2012. The above-referenced applications are hereby incorporated by reference in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
7197557 | Asar | Mar 2007 | B1 |
7373415 | DeShan et al. | May 2008 | B1 |
8457311 | Schultz et al. | Jun 2013 | B1 |
20040098748 | Bo et al. | May 2004 | A1 |
20040153561 | Dalal et al. | Aug 2004 | A1 |
20090013356 | Doerr | Jan 2009 | A1 |
20090254657 | Melnyk et al. | Oct 2009 | A1 |
20100235503 | Sitaraman et al. | Sep 2010 | A1 |
20120151080 | Brueck | Jun 2012 | A1 |
20130163953 | Peacock | Jun 2013 | A1 |
Entry |
---|
Rackspace Document, Apr. 2009. |
Number | Date | Country | |
---|---|---|---|
61469979 | Mar 2011 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13436856 | Mar 2012 | US |
Child | 13467397 | US |