The field of the present invention is session-based multimedia services, and more particularly, controlling the quality of experience (QoE) for session-based multimedia services over an Internet-Protocol (IP) based network including the Internet.
Emerging highly-demanding applications and services need proactive quality of experience (QoE) management to reduce customer churn and improve experiences. The traditional reactive quality of service (QoS)-based schemes for improving user experience may not be acceptable due to slow response time and requirements to allocate excessive overhead.
Currently used QoE management techniques used on Internet Engineering Task Force (IETF) protocols and mechanisms that utilize QoS management of transport layer (of ISO's seven-layer OSI model) parameters like latency/delay, jitter/delay-variation, and packet loss.
The mechanisms used to monitor packet delay, jitter, and loss commonly require additional overhead on the transport layer because of the incorporation of monitoring channels and/or messages that may need to be exchanged between the client and server, or among communicating peers.
In addition, bandwidth pre-allocation and over-provisioning may be used for QoE maintenance. This pre-allocation and over-provisioning of resources often leads to under-utilization of resources which may not acceptable in today's goal of cost-effective network operations.
Therefore, it would be advantageous for such an environment to deploy proactive end-point based mechanisms that utilize the dynamic characteristics of network transport. Consequently, the session may achieve a QoE that exceeds the expected regime without utilizing excess transport resources. These mechanisms utilize transport dynamics as inputs and adjust the endpoint presentations to effectively improve the expected QoE.
Aspects of the present invention overcome multiple drawbacks as discussed above (a) without incurring any overhead in the transport network, (b) utilizing virtualization at the endpoint, and (c) using a balanced combination of look-ahead/-back and error correction/concealment.
In one aspect, a method adjusts virtualized resources for delivery of a real-time multi-media session to a user terminal. Based on resource parameters, setting resource requirements, the user terminal sets resource requirements for delivery of the real-time multi-media session. The user terminal allocates the resources in accordance with the set resource requirements. The user terminal then continually determines if the distributed resources are sufficient for a desired quality of experience. If the distributed resources are not sufficient, at the user terminal adjusts the allocation of resources by procuring resources from a management of resources (MRD)/resources pre-positioning policy (RPP) database, to maintain the desired quality of experience. The resource parameters may include historic trends of resource allocation of delivery of audio, video, and/or text-messaging, current resource allocation trends, optimization criteria, traffic signature generation, and the like.
a shows a schematic for dynamically adjusting virtualized resources among sub-sessions (audio, video, text/messaging, etc.).
b presents a flowchart for dynamically adjusting virtualized resources among sub-sessions (audio, video, text/messaging, etc.).
Aspects of the present invention overcome drawbacks concerning the execution of real-time delivery of multi-media sessions (a) without incurring overhead in the transport network, (b) utilizing virtualization at the endpoint, and (c) using a balanced combination of look-ahead/-back and error correction/concealment.
Once a session starts with a specific transport bandwidth, one of the endpoint's objective is to maintain a consistent quality of experience even when the session bandwidth fluctuates. The intelligence resides at the endpoint, or user terminal, and the use of virtualization makes the implementation a technically feasible one.
One of the mechanisms utilized in aspects of the present invention is based on the commonly used high-performance and self-adapting high-end video encoders and decoders in networked (distributed) environment. For example, one of the mechanisms is based on the principle of multi-layer coding and automatic correction of errors including error concealment. Another mechanism is the adaptation of the rate at which information/packet is fed to the buffer of the rendering device. This is based on the video trick mode similar to the value-added features/functions of VCR or video cassette recorder which allows for slow or fast movement (forward and reverse) of session information based on the receipt of information/packet from the storage, but in this case the transport network.
Another feature is pre-positioning, including dynamic adjustment of resources among the entities, of the elements of multimedia session with an objective to maintain or exceed the desired target quality of experience (QoE) parameters. For example, resources used for maintaining video frame rate and pixel resolution of a session may be traded with those used for audio and messaging parts of the same session.
Another feature is the capability to emulate the perceptual parameters utilizing resources (real or virtualized) on an on-demand basis at the endpoint. This may include proactive correction related to bandwidth and quality of transport degradation, e.g., concealment of perceived impairments that are caused by the instantaneous reduction of bandwidth and the erroneous/fragmented transmission of information. For example, (a) adjustment of audio type (mono, stereo, surround, etc.) and volume may be tolerated more than freezing or fragmentation of a picture frame, (b) a little more delay in delivering the text/message in the ‘Instant Message’ window may be more tolerated more than absolute silence in the audio, and so on.
Features/functions which are components of a toolkit for open-loop QoE management, according to aspects of the present invention, are shown in
A schematic for dynamically adjusting virtualized resources among sub-sessions (audio, video, text/messaging, etc.) is shown in
Utilization of the dynamically recognized traffic signatures and other criteria for optimizing resources are used for assigning media streams to flow for delivering the acceptable quality of experience, which is illustrated in
It should be understood that the methods and systems of the present invention are executed employing machines and apparatus including simple and complex computers. Moreover, the architecture and methods described above can be stored, in part or in full, on forms of machine-readable media. For example, the operations of the present invention could be stored on machine-readable media, such as magnetic disks or optical disks, which are accessible via a disk drive (or computer-readable medium drive). Alternatively, the logic to perform the operations as discussed above, could be implemented in additional computer and/or machine readable media, such as discrete hardware components as large-scale integrated circuits (LSI's), application-specific integrated circuits (ASIC's), firmware such as electrically erasable programmable read-only only memory (EEPROM's); and the like. Implementations of certain embodiments may further take the form of machine-implemented, including web-implemented, computer software.
While aspects of this invention have been shown and described, it will be apparent to those skilled in the art that many more modifications are possible without departing from the inventive concepts that are described herein. The invention, therefore, is not to be restricted except in the spirit of the following claims.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2013/023364 | 1/28/2013 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61592726 | Jan 2012 | US |