The subject disclosure relates to measuring and reporting the quality of media services delivered to clients, and more particularly to a system for processing diagnostic reports of errors or failures in delivery of those services.
Diagnostics for networks delivering media content to client devices, such as networks with servers communicatively coupled to client devices which may include set top boxes (STBs), tablets, personal computers (PCs), mobile devices, smart TV, etc., typically involve periodic polling of the client devices. The client devices generally include rolling counters for logging diagnostic information. Events such as reboots and channel changes can alter or reset those counters. Network outages cause increases in diagnostic polling of the client devices. Outage events can alter usage patterns for various components of the video distribution network, servers, and client devices.
Reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and wherein:
The subject disclosure describes, among other things, illustrative embodiments of a method and system for automated publication of diagnostic reports on a network (for example, from client devices on a video network). Other embodiments are included in the subject disclosure.
One embodiment of the subject disclosure includes a method comprising receiving, by a collector device comprising a processor, diagnostic information from a plurality of client devices delivering media content, wherein the diagnostic information relates to a media delivery service quality; performing, by the collector device, a data compression procedure for the diagnostic information; transmitting, by the collector device, compressed data comprising the diagnostic information to an aggregator device; and sending, by the collector device, to the client devices a message to delay or prevent transmission of additional diagnostic information in accordance with an instruction received from the aggregator device, wherein the diagnostic information is sent automatically by each client device to the collector device periodically at a variable interval or in accordance with a change of state of the client device, and wherein the diagnostic information comprises a report of a degradation of the service quality or a fault relating to the service quality.
One embodiment of the subject disclosure includes a server comprising a memory to store instructions and a processor coupled to the memory. The processor, responsive to executing the instructions, performs operations. The operations comprise receiving client reports published by client devices on a network for delivering media content to the client devices, wherein the client reports comprise diagnostic information relating to a media delivery service quality; receiving additional reports from network components communicatively coupled to the server relating to the service quality; correlating the client reports and the additional reports to generate correlated diagnostic data; identifying a degradation of the service quality or a fault relating to the service quality based on the correlated diagnostic data; and determining that publication of subsequent client reports regarding the degradation of the service quality or the fault is to be delayed or suppressed.
One embodiment of the subject disclosure includes a tangible computer-readable storage device comprising executable instructions. The instructions, when executed by a processor, cause the processor to perform operations. The operations comprise receiving diagnostic information from a plurality of client devices delivering media content, wherein the diagnostic information relates to a media delivery service quality and wherein the diagnostic information is sent automatically by the client devices; performing a data compression procedure for the diagnostic information; transmitting compressed data comprising the diagnostic information to an aggregator device; and sending to the client devices a message to delay or prevent transmission of additional diagnostic information in accordance with an instruction received from the aggregator device.
The types of events tracked by the counter, and the context in which those events are detected, is referred to herein as the scope 106 of the counter. For example, if the client device is a set top box (STB) receiving video data from the network, the scope of the counter for this device will include gaps or distortions in the video stream for a particular channel. When the scope changes on account of a reboot, a channel change, or some other event, the counter resets and any new errors will be associated with the new scope.
Event data logged by the counter 104 in accordance with the scope 106 can be stored in a storage device 105. (In the schematic illustration of
Reports of trouble (e.g., disruption of a video stream on a channel) are published by the client device without prompting from the collector (that is, reports are pushed as events occur, as opposed to pulled when needed by the collector). Accordingly, errors are logged and reported along with information regarding the scope in real time or near-real time, permitting detailed analysis by diagnostic devices on the network (including tracking historical data trends). A report can indicate a degradation in service quality or a fault relating to service quality (e.g. a soft fault such as a network timing protocol (NTP) timing error or a digital rights management (DRM) error).
In this embodiment, the collectors 210 have two broadly defined tasks: (1) Data collection: The collectors in a given region of the network receive and process diagnostic publications from all clients in that region. The data is compressed and made ready for aggregation. (2) Storm protection: Outages and impairments of service, and even scheduled maintenance, can cause significant spikes in the number of diagnostic publications (a “storm” of trouble reports). The collectors 210 are enabled to respond to clients with a “back off” message to delay or suppress transmission of further diagnostic publications (discussed in more detail below).
Aggregators 220 are at the next tier of the architecture 200. At this level, data is evaluated and combined to identify patterns indicative of an impairment or outage in network service. The aggregators further process the raw data to prepare it for use in overall diagnostic analysis of the platform and video experience. Data is also made available for correlation with other diagnostic information captured from server-side components. Data determined to be insufficient for further action may still be considered valuable. All data will be made available for Big Data storage and analytics, which can include performance analysis and long term trending of minor data reporting events.
Diagnostic server 230 is at the top tier of architecture 200. In this embodiment, diagnostic server 230 has several functions, comprising: (1) An application program interface (API) layer is made available for real-time diagnostic requests. APIs will be available for third-party applications to request real-time diagnostics for a particular device, client, or account. (2) The diagnostic server correlates data received from the aggregators. Data from distribution servers and clients is combined to provide a holistic view of the video experience. (3) Diagnostic server 230 provides procedures for offloading data to Big Data repositories for further analysis. (4) Diagnostic server 230 controls policies regarding when the data collected is considered sufficient to declare an outage or impairment of service (thereby triggering, for example, alarms to operators to create tickets and thereby drive resolution of the outage or impairment). This declaration can also trigger a response to the collectors to begin the “back off” procedure for diagnostic publications related to a particular scope.
The reports from the client devices are published to collectors 310. Data from the reports is compressed and transmitted to aggregator 320. In this embodiment, data processed by the aggregator is transmitted to a characterization and analysis tool 360, a network broad band analysis tool 370, and to a system 350 including a diagnostic server 351 (Diagnostic Operational Support System or Diag OSS). Diagnostic server 351 is communicatively coupled to distribution server (Dist Server) 352 and content delivery network (CDN) 352. The data from the aggregator received by system 350 comprises client-side error reports. System 350 also includes server side systems for tracking and logging errors and producing server-side error reports. Diagnostic server 351 correlates the client-side error reports with the server-side error reports to detect a service outage or service impairment.
A procedure 600 for logging, publishing and processing error reports in a media distribution network, according to an embodiment of the disclosure, is shown in
The aggregator executes a pattern matching function (step 610) to search for commonalities in the incoming reports. In particular, the aggregator correlates reported events in the ATP logs to determine whether ATP logs from a plurality of different client devices relate to the same asset. The aggregator pushes the correlated results to the diagnostic server (step 612). The diagnostic server detects a service outage or service impairment using information from the ATP logs and server-side error logs (step 614). The diagnostic server determines whether a problem exists and decides at what level (measured by the number of reports received) the problem is actionable. When the problem is determined to be actionable, the diagnostic server causes an alarm and/or a maintenance ticket to be created (step 616).
Once a problem has been sufficiently reported and identified, it may not be necessary to process additional reports relating to that problem. The diagnostic server determines (step 618) whether a back off procedure should be invoked—that is, not receive or process further reports relating to the problem. This determination can be made according to a predefined rule (for example, back off when a threshold number of reports are received). Alternatively, the decision to back off can be made by network operators. In another embodiment, the decision can be to continue receiving client reports, but to suppress further notifications to the Ops/Ticketing function. In another embodiment, a determination to instruct client devices to delay or suppress reports may come from outside the system. For example, network fault surveillance systems and/or network ticketing layers that have further correlated the video diagnostic data with other network data can advise that no further diagnostic data is needed.
Steps in a back off procedure 700 are shown in
The IPTV media system can include a super head-end office (SHO) 810 with at least one super headend office server (SHS) 811 which receives media content from satellite and/or terrestrial communication systems. In the present context, media content can represent, for example, audio content, moving image content such as 2D or 3D videos, video games, virtual reality content, still image content, and combinations thereof. The SHS server 811 can forward packets associated with the media content to one or more video head-end servers (VHS) 814 via a network of video head-end offices (VHO) 812 according to a multicast communication protocol.
The VHS 814 can distribute multimedia broadcast content via an access network 818 to commercial and/or residential buildings 802 housing a gateway 804 (such as a residential or commercial gateway). The access network 818 can represent a group of digital subscriber line access multiplexers (DSLAMs) located in a central office or a service area interface that provide broadband services over fiber optical links or copper twisted pairs 819 to buildings 802. The gateway 804 can use communication technology to distribute broadcast signals to media processors 806 such as Set-Top Boxes (STBs) which in turn present broadcast channels to media devices 808 such as computers or television sets managed in some instances by a media controller 807 (such as an infrared or RF remote controller).
The gateway 804, the media processors 806, and media devices 808 can utilize tethered communication technologies (such as coaxial, powerline or phone line wiring) or can operate over a wireless access protocol such as Wireless Fidelity (WiFi), Bluetooth, Zigbee, or other present or next generation local or personal area wireless network technologies. By way of these interfaces, unicast communications can also be invoked between the media processors 806 and subsystems of the IPTV media system for services such as video-on-demand (VoD), browsing an electronic programming guide (EPG), or other infrastructure services.
A satellite broadcast television system 829 can be used in the media system of
In yet another embodiment, an analog or digital cable broadcast distribution system such as cable TV system 833 can be overlaid, operably coupled with, or replace the IPTV system and/or the satellite TV system as another representative embodiment of communication system 800. In this embodiment, the cable TV system 833 can also provide Internet, telephony, and interactive media services.
The subject disclosure can apply to other present or next generation over-the-air and/or landline media content services system.
Some of the network elements of the IPTV media system can be coupled to one or more computing devices 830, a portion of which can operate as a web server for providing web portal services over the ISP network 832 to wireline media devices 808 or wireless communication devices 816. In particular, communication system 800 can provide for all or a portion of the computing devices 830 to function as system 350 (see
Multiple forms of media services can be offered to media devices over landline technologies such as those described above. Additionally, media services can be offered to media devices by way of a wireless access base station 817 operating according to common wireless access protocols such as Global System for Mobile or GSM, Code Division Multiple Access or CDMA, Time Division Multiple Access or TDMA, Universal Mobile Telecommunications or UMTS, World interoperability for Microwave or WiMAX, Software Defined Radio or SDR, Long Term Evolution or LTE, and so on. Other present and next generation wide area wireless access network technologies can be used in one or more embodiments of the subject disclosure.
To enable these features, communication device 1000 can comprise a wireline and/or wireless transceiver 1002 (herein transceiver 1002), a user interface (UI) 1004, a power supply 1014, a location receiver 1016, a motion sensor 1018, an orientation sensor 1020, and a controller 1006 for managing operations thereof. The transceiver 1002 can support short-range or long-range wireless access technologies such as Bluetooth, ZigBee, WiFi, DECT, or cellular communication technologies, just to mention a few. Cellular technologies can include, for example, CDMA-1X, UMTS/HSDPA, GSM/GPRS, TDMA/EDGE, EV/DO, WiMAX, SDR, LTE, as well as other next generation wireless communication technologies as they arise. The transceiver 1002 can also be adapted to support circuit-switched wireline access technologies (such as PSTN), packet-switched wireline access technologies (such as TCP/IP, VoIP, etc.), and combinations thereof.
The UI 1004 can include a depressible or touch-sensitive keypad 1008 with a navigation mechanism such as a roller ball, a joystick, a mouse, or a navigation disk for manipulating operations of the communication device 1000. The keypad 1008 can be an integral part of a housing assembly of the communication device 1000 or an independent device operably coupled thereto by a tethered wireline interface (such as a USB cable) or a wireless interface supporting for example Bluetooth. The keypad 1008 can represent a numeric keypad commonly used by phones, and/or a QWERTY keypad with alphanumeric keys. The UI 1004 can further include a display 1010 such as monochrome or color LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diode) or other suitable display technology for conveying images to an end user of the communication device 1000. In an embodiment where the display 1010 is touch-sensitive, a portion or all of the keypad 1008 can be presented by way of the display 1010 with navigation features.
The display 1010 can use touch screen technology to also serve as a user interface for detecting user input. As a touch screen display, the communication device 1000 can be adapted to present a user interface with graphical user interface (GUI) elements that can be selected by a user with a touch of a finger. The touch screen display 1010 can be equipped with capacitive, resistive or other forms of sensing technology to detect how much surface area of a user's finger has been placed on a portion of the touch screen display. This sensing information can be used to control the manipulation of the GUI elements or other functions of the user interface. The display 1010 can be an integral part of the housing assembly of the communication device 1000 or an independent device communicatively coupled thereto by a tethered wireline interface (such as a cable) or a wireless interface.
The UI 1004 can also include an audio system 1012 that utilizes audio technology for conveying low volume audio (such as audio heard in proximity of a human ear) and high volume audio (such as speakerphone for hands free operation). The audio system 1012 can further include a microphone for receiving audible signals of an end user. The audio system 1012 can also be used for voice recognition applications. The UI 1004 can further include an image sensor 1013 such as a charged coupled device (CCD) camera for capturing still or moving images.
The power supply 1014 can utilize common power management technologies such as replaceable and rechargeable batteries, supply regulation technologies, and/or charging system technologies for supplying energy to the components of the communication device 1000 to facilitate long-range or short-range portable applications. Alternatively, or in combination, the charging system can utilize external power sources such as DC power supplied over a physical interface such as a USB port or other suitable tethering technologies.
The location receiver 1016 can utilize location technology such as a global positioning system (GPS) receiver capable of assisted GPS for identifying a location of the communication device 1000 based on signals generated by a constellation of GPS satellites, which can be used for facilitating location services such as navigation.
The motion sensor 1018 can utilize motion sensing technology such as an accelerometer, a gyroscope, or other suitable motion sensing technology to detect motion of the communication device 1000 in three-dimensional space. The orientation sensor 1020 can utilize orientation sensing technology such as a magnetometer to detect the orientation of the communication device 1000 (north, south, west, and east, as well as combined orientations in degrees, minutes, or other suitable orientation metrics).
The communication device 1000 can use the transceiver 1002 to also determine a proximity to a cellular, WiFi, Bluetooth, or other wireless access points by sensing techniques such as utilizing a received signal strength indicator (RSSI) and/or signal time of arrival (TOA) or time of flight (TOF) measurements. The controller 1006 can utilize computing technologies such as a microprocessor, a digital signal processor (DSP), programmable gate arrays, application specific integrated circuits, and/or a video processor with associated storage memory such as Flash, ROM, RAM, SRAM, DRAM or other storage technologies for executing computer instructions, controlling, and processing data supplied by the aforementioned components of the communication device 1000.
Other components not shown in
The communication device 1000 as described herein can operate with more or fewer of the circuit components shown in
The communication device 1000 can be adapted to perform the functions of the media processor 806, the media devices 808, or the portable communication devices 816 of
The communication device 1000 shown in
Upon reviewing the aforementioned embodiments, it would be evident to an artisan with ordinary skill in the art that said embodiments can be modified, reduced, or enhanced without departing from the scope of the claims described below. Other embodiments can be used in the subject disclosure.
It should be understood that devices described in the exemplary embodiments can be in communication with each other via various wireless and/or wired methodologies. The methodologies can be links that are described as coupled, connected and so forth, which can include unidirectional and/or bidirectional communication over wireless paths and/or wired paths that utilize one or more of various protocols or methodologies, where the coupling and/or connection can be direct (e.g., no intervening processing device) and/or indirect (e.g., an intermediary processing device such as a router).
The machine may comprise a server computer, a client user computer, a personal computer (PC), a tablet PC, a smart phone, a laptop computer, a desktop computer, a control system, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. It will be understood that a communication device of the subject disclosure includes broadly any electronic device that provides voice, video or data communication. Further, while a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methods discussed herein.
The computer system 1100 may include a processor (or controller) 1102 (e.g., a central processing unit (CPU), a graphics processing unit (GPU, or both), a main memory 1104 and a static memory 1106, which communicate with each other via a bus 1108. The computer system 1100 may further include a display unit 1110 (e.g., a liquid crystal display (LCD), a flat panel, or a solid state display. The computer system 1100 may include an input device 1112 (e.g., a keyboard), a cursor control device 1114 (e.g., a mouse), a disk drive unit 1116, a signal generation device 1118 (e.g., a speaker or remote control) and a network interface device 1120. In distributed environments, the embodiments described in the subject disclosure can be adapted to utilize multiple display units 1110 controlled by two or more computer systems 1100. In this configuration, presentations described by the subject disclosure may in part be shown in a first of the display units 1110, while the remaining portion is presented in a second of the display units 1110.
The disk drive unit 1116 may include a tangible computer-readable storage medium 1122 on which is stored one or more sets of instructions (e.g., software 1124) embodying any one or more of the methods or functions described herein, including those methods illustrated above. The instructions 1124 may also reside, completely or at least partially, within the main memory 1104, the static memory 1106, and/or within the processor 1102 during execution thereof by the computer system 1100. The main memory 1104 and the processor 1102 also may constitute tangible computer-readable storage media.
Dedicated hardware implementations including, but not limited to, application specific integrated circuits, programmable logic arrays and other hardware devices that can likewise be constructed to implement the methods described herein. Application specific integrated circuits and programmable logic array can use downloadable instructions for executing state machines and/or circuit configurations to implement embodiments of the subject disclosure. Applications that may include the apparatus and systems of various embodiments broadly include a variety of electronic and computer systems. Some embodiments implement functions in two or more specific interconnected hardware modules or devices with related control and data signals communicated between and through the modules, or as portions of an application-specific integrated circuit. Thus, the example system is applicable to software, firmware, and hardware implementations.
In accordance with various embodiments of the subject disclosure, the operations or methods described herein are intended for operation as software programs or instructions running on or executed by a computer processor or other computing device, and which may include other forms of instructions manifested as a state machine implemented with logic components in an application specific integrated circuit or field programmable array. Furthermore, software implementations (e.g., software programs, instructions, etc.) can include, but not limited to, distributed processing or component/object distributed processing, parallel processing, or virtual machine processing can also be constructed to implement the methods described herein. It is further noted that a computing device such as a processor, a controller, a state machine or other suitable device for executing instructions to perform operations or methods may perform such operations directly or indirectly by way of one or more intermediate devices directed by the computing device.
While the tangible computer-readable storage medium 622 is shown in an example embodiment to be a single medium, the term “tangible computer-readable storage medium” should be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “tangible computer-readable storage medium” shall also be taken to include any non-transitory medium that is capable of storing or encoding a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methods of the subject disclosure.
The term “tangible computer-readable storage medium” shall accordingly be taken to include, but not be limited to: solid-state memories such as a memory card or other package that houses one or more read-only (non-volatile) memories, random access memories, or other re-writable (volatile) memories, a magneto-optical or optical medium such as a disk or tape, or other tangible media which can be used to store information. Accordingly, the disclosure is considered to include any one or more of a tangible computer-readable storage medium, as listed herein and including art-recognized equivalents and successor media, in which the software implementations herein are stored.
Although the present specification describes components and functions implemented in the embodiments with reference to particular standards and protocols, the disclosure is not limited to such standards and protocols. Each of the standards for Internet and other packet switched network transmission (e.g., TCP/IP, UDP/IP, HTML, HTTP) represent examples of the state of the art. Such standards are from time-to-time superseded by faster or more efficient equivalents having essentially the same functions. Wireless standards for device detection (e.g., RFID), short-range communications (e.g., Bluetooth, WiFi, Zigbee), and long-range communications (e.g., WiMAX, GSM, CDMA, LTE) can be used by computer system 1100.
The illustrations of embodiments described herein are intended to provide a general understanding of the structure of various embodiments, and they are not intended to serve as a complete description of all the elements and features of apparatus and systems that might make use of the structures described herein. Many other embodiments will be apparent to those of skill in the art upon reviewing the above description. Other embodiments may be utilized and derived therefrom, such that structural and logical substitutions and changes may be made without departing from the scope of this disclosure. Figures are also merely representational and may not be drawn to scale. Certain proportions thereof may be exaggerated, while others may be minimized Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
Although specific embodiments have been illustrated and described herein, it should be appreciated that any arrangement calculated to achieve the same purpose may be substituted for the specific embodiments shown. This disclosure is intended to cover any and all adaptations or variations of various embodiments. Combinations of the above embodiments, and other embodiments not specifically described herein, can be used in the subject disclosure.
The Abstract of the Disclosure is provided with the understanding that it will not be used to interpret or limit the scope or meaning of the claims. In addition, in the foregoing Detailed Description, it can be seen that various features are grouped together in a single embodiment for the purpose of streamlining the disclosure. This method of disclosure is not to be interpreted as reflecting an intention that the claimed embodiments require more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive subject matter lies in less than all features of a single disclosed embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter.