Streaming over Hypertext Transfer Protocol (HTTP) has become a popular approach for delivering multimedia content (e.g., audio, video, etc.) over the Internet, for example, to set top boxes, Internet ready televisions, computers, wireless devices, and the like. Multimedia content may be made available at a variety of different bit rates, resolutions, minimum and/or maximum bandwidths, and may be available from multiple sources.
HTTP streaming clients, such as Wireless Transmit/Receive Units (WTRUs), may employ streaming rate adaptation. Such streaming rate adaptation approaches may apply single step or step-wise scale-up/scale down techniques, for example, to maximize a bandwidth utilization ratio. However, such rate adaptation techniques may result in sudden and/or noticeable changes in playback quality that may be objectionable to end users, for instance, end users concerned with one or more of the following: a constant perceived frame rate; minimal noticeable quality variations; consistent clarity of video and/or audio material throughout an entirety of a multimedia streaming session; the ability to access the streaming multimedia content from different devices with minimal interruptions; etc.
Additionally, some streaming rate adaptation approaches may fail to satisfactorily address networking resource sharing among multiple streaming clients and/or the splitting of bandwidth among various streaming media components such as video, audio, timed-text, and/or slides (e.g., presentation slides).
A multi-hypothesis rate adaptation technique may be performed for one or more wireless multimedia streaming (e.g., video streaming) scenarios.
A method of managing a multimedia streaming session may involve sending, by a client, a request for a first portion of content to a server. A response may be received from a proxy. The response may comprise the first portion of content and information associated with a second portion of content available via the proxy. A request may be sent to the proxy for the proxy to deliver the second portion of content to the client. A change in a characteristic associated with the multimedia streaming session may be determined based on data received from the proxy. It may be determined to change a rate adaptation.
A wireless transmit/receive unit (WTRU) may comprise a processor configured to cause the WTRU to send a request for a first portion of content to a server. On a condition that a response is received from a proxy comprising the first portion of content and information associated with a second portion of content available via the proxy, the processor may cause the WTRU to send a request to the proxy for the proxy to deliver the second portion of content to the WTRU. The processor may be configured to determine a change in a characteristic associated with the multimedia streaming session based on data received from the proxy and to determine to change a rate adaptation.
A detailed description of illustrative embodiments will now be described with reference to the various figures. Although this description provides a detailed example of possible implementations, it should be noted that the details are intended to be exemplary and in no way limit the scope of the application. In addition, the figures may illustrate one or more message charts, which are meant to be exemplary. Other embodiments may be used. The order of the messages may be varied where appropriate. Messages may be omitted if not needed, and, additional flows may be added.
Rate adaptation may be performed on streaming sessions (e.g., streaming of multimedia content) established over wired and/or wireless networks (e.g., 3G or 4G cellular, WiFi, Internet, etc.), for example, in response to variable bandwidth in an associated communications network. For example, in accordance with adaptive streaming, a rate at which media is streamed to one or more streaming clients may be adapted in accordance with varying network conditions or, for example, to maintain constant video quality. Adaptive streaming may enable one or more streaming clients to correlate respective rates at which streaming media is received by the one or more clients to respective bandwidths available or quality level criteria, to the one or more streaming clients.
In an adaptive streaming system, a content provider may offer streaming content 102 at different bit rates 104, 106, 108, for example, as illustrated in
Publishing of streaming content at multiple rates may increase production, quality assurance (QA), management, and/or storage costs associated with the streaming content, such that the number of available rates and/or resolutions of the streaming content made available may be limited.
A streaming client, such as a streaming media player, that supports bandwidth adaptation may learn about available bit rates from a media content description, for example. A streaming client may measure and/or estimate available bandwidth 202 and/or may control an associated streaming session, for example, by requesting segments at different bit rates 204, which may allow the streaming client to adapt to bandwidth fluctuations during playback of multimedia content, for example, as illustrated in
Stream switching behavior may be controlled by a server, for example, based on streaming client and/or network feedback. For example, such a model may be implemented with streaming technologies that are based on Real-time Transport Protocol (RTP) and/or Real Time Streaming Protocol (RTSP) protocols.
Access network bandwidth available for use by one or more streaming clients associated with the access network may vary, for example, due to one or more of an underlying communications technology used by the access network (e.g., as depicted in the table of
Streaming content may be rendered in varying resolutions, for example, in accordance with a device that renders the streaming content (e.g., smartphone, a tablet, a laptop, a High Definition television (HDTV), etc.). The table of
Content providers may use HTTP progressive downloading to distribute multimedia content, for example, wherein the content may be downloaded (e.g., partially or fully) before it may be played back. HTTP transport protocol may be likely to pass through (e.g., not be blocked by) a firewall, whereas transport protocols other than HTTP (e.g., RTP, RTSP, multicasting, and the like) may be likely to be blocked by a firewall and/or may be disabled by internet service provider (ISP). However, progressive downloading may not support bandwidth adaptation.
In adaptive streaming, for example over HTTP, content 602 (e.g., a media presentation) may be encoded at a number of bit rates 604, 606, 608. Each respective encoding may be partitioned into one or more segments of shorter duration, e.g., as illustrated in
An adaptive HTTP player may be modeled as a state machine 800, for example, having at least a Buffering state 802 and a Play state 804, as illustrated in
The Play state 804 may be further divided into an ON state 820 and an OFF state 822, as illustrated in
T=T1+T2 (1)
where T2 is a residual, such that T1<T2, e.g., T1<<T2.
If an available network bandwidth is larger than a maximum bitrate for one or more video segments presented in the MPD, an adaptive HTTP player may delay sending one or more subsequent HTTP GET requests, for example for a period of T2 seconds. One or more HTTP GET requests (e.g., N HTTP GET requests) may be sent in an interval of T seconds. The one or more HTTP GET requests may take effect for T1 seconds. When the adaptive HTTP player operates in the ON state 820, a bandwidth estimation may be calculated.
When the adaptive HTTP player operates in the OFF state 822, monitoring of a playback buffer may be applied, which may result in respective changes to one or more player parameters such as T1, T2, ρ, and/or μ.
An HTTP streaming video player may store one or more received segments (e.g., a full collection of received segments) locally (e.g., in a buffer associated with the HTTP streaming video player), so as to allow rewind operations, for example. The buffer may be implemented (e.g., logically) as an infinite buffer having sliding pointers ρ and μ.
An effective bandwidth may be estimated (e.g., calculated), for example, at an observation point (i) that may occur in accordance with an interval of T seconds (e.g., an observation point (i) that occurs once every T seconds). For example, an effective bandwidth estimation may be expressed as:
where Tb=the time of sending the HTTP GET request, Ta=the time of receiving the last byte of the HTTP GET request, seg_size=the multimedia segment size in bits, and N=the number of HTTP GET requests in this observation period.
An effective bandwidth estimation calculated with equation (2) may not be reliable. For example, in a scenario where the bandwidth estimation is performed using T intervals that correspond to small amounts of time, the bandwidth estimation may include one or more sudden upward and/or downward spikes in bandwidth that may cause the effective bandwidth estimation to be inaccurate. Such inaccuracy may be at least partially avoided by applying a weighting in accordance with one or more previous effective bandwidth estimates. This weighting may be expressed as, for example,
where parameter F may act as a stability factor and wj (j=0 . . . J) may be representative of weights assigned to one or more prior effective bandwidth estimates. For example, a value of F=0.95 may be selected. If J=1, values of w0=0.8 and w1=0.2 may be selected.
A downloading potential associated with bandwidth estimation may be expressed, for example, as a ratio of a segment duration (e.g., seg_duration) to a time it may take for the segment to be downloaded (e.g., from an associated network). For example, if one or more segments are downloaded from a cache (e.g., a nearby HTTP cache proxy), the ratio may be greater than 1. The ratio may be referred to as a download ratio, and may be expressed as, for example:
A median effective bandwidth may be determined. For example, in a scenario that involves streaming a large amount of content (e.g., a long movie), a minimum bandwidth (e.g., minBandwidth) and/or a maximum bandwidth (e.g., maxBandwidth) may be observed, for example, at a beginning of the movie, from which a median effective bandwidth may be derived.
A rate adaptation technique may apply one or more ratio measurements, for example, a ratio of a rate of proposed quality to a rate of observed quality (e.g., current quality), that may be expressed, for example, as:
where Q(i−1)=current quality and Q(i)=proposed quality (≤M).
A rate adaption algorithm may be classified, for example, as a single step technique or a step-wise scale-up/scale-down technique. In accordance with a single step technique, a maximum proposed quality may be selected, for example, using:
Q(i)=max{m+1, . . . M; where switchRatio(m)≤downloadRatio(i)}
Application of a single step technique to a HTTP player may result in one or more quality changes than may be objectionable, for example to a user of the HTTP player. A step-wise technique may limit quality level changes between adjacent segments, for example, to:
Q(i−1)−Δ≤Q(i)≤Q(i−1)+Δ
where Δ may be a maximum allowed step size (e.g., Δ=1, 2 or 3).
Rate adaptation may be designed to improve (e.g., maximize) a bandwidth utilization ratio, for example, and may be expressed as:
where I=a number of observation points (i) for a whole of a duration of the multimedia experience.
Optimization of the bandwidthUtilization for example, to a select class of multimedia content may not correlate to an improved multimedia experience from the perspective of an associated end user. Users of multimedia services may be concerned with a constant perceived frame rate, minimal noticeable quality variations, clarity of video and audio content throughout a multimedia session, the ability to access multimedia content from different devices with minimal interruptions, and/or other considerations. Other considerations may include, for example, fairness of networking resource sharing among clients, and sensibility of decisions about splitting of effective bandwidth among various media components, such as video, audio, timed text, and/or presentation slides.
Rate adaptation may include employing one or more parameters that are associated with a hypothesis. A rate adaptation technique that implements two or more such hypotheses, such as a plurality of hypotheses, may be referred to herein as a multi-hypothesis rate adaptation technique. A multi-hypothesis rate adaptation technique may be optimized for one or more wireless multimedia (e.g., video) streaming scenarios. For example, a multi-hypothesis rate adaptation technique may be optimized to account for variations of one or more channel conditions and/or access technology changes that may occur during an associated streaming session (e.g., in the case of streaming a long video).
A hypothesis may correspond to one or more parameters (e.g., measured, theoretical, etc.) of a streaming session (e.g., an HTTP streaming session) that may be encountered by a participant of a streaming session (e.g., a streaming client, a streaming server, etc.). Streaming session parameters may include, for example, a variation in an amount of effective bandwidth available to a streaming client over an interval of time (e.g., a fixed, gradual decrease or increase, a step change, sudden drop, etc.), usage of a proxy cache, and/or advertisement-sponsored video streaming.
For each hypothesis, one or more associated parameters may be specified e.g., Th, T1h, T2h, ρh, μh, Δh, etc.) that may be employed by a participant of a streaming session having one or more parameters that at least partially resemble those of the hypothesis. One or more of the specified parameters may be optimized in accordance with the parameters of the hypothesis, for instance, to improve (e.g., maximize) a quality of a user experience associated with a streaming session that at least partially resembles the hypothesis.
Each rate variability hypothesis may be uniquely represented, for example, to allow an HTTP streaming client (e.g., an HTTP player) to select one or more appropriate rate adaptation actions.
The content of a hypothesis may be modified. For example, a streaming client may modify a hypothesis in accordance with collected historical data, e.g., from one or more multimedia streaming sessions and/or with feedback (e.g., feedback collected from respective streaming clients associated with one or more end users). A modified hypothesis and/or an associated lookup table may be shared (e.g., communicated) among streaming clients.
One or more parameters for use by a streaming client may be pre-calculated, for example, based upon feedback data pertaining to one or more hypotheses having parameters that resemble those of an established streaming session. Feedback may be based, for example, on a mean value of feedback data received from streaming clients associated with one or more end users streaming the same content. The feedback may be volunteered, for example by one or more end users and/or may otherwise be submitted and/or collected for transmission to a streaming client. In order to create one or more hypotheses that may be associated with a streaming session, one or more tools (e.g., DummyNet) may be used to inject dummy bandwidth at a server and/or client side of the streaming session, for example to produce one or more hypotheses having parameters that may be similar to the example streaming sessions depicted in
A device participating in a streaming session (e.g., a streaming client) may detect an event (e.g., a change in effective bandwidth such as those as illustrated in
A streaming client may use previously calculated information for event detection (e.g., previously calculated effectiveBandwidth and/or downloadRatio values), for example, in an absence of sensor information. For example, a streaming client may detect an event using one or more of the following: a statistical mean and/or variance of effectiveBandwidth and/or downloadRatio values; a peak to mean ratio of effectiveBandwidth and/or downloadRatio values; an absolute difference between two adjacent effectiveBandwidth values; a minimum and maximum peak and/or duration associated with a drop in effectiveBandwidth; and the like.
Event parameters may be denoted as, for example, a1,h, a2,h, a3,h, and aK,h, where K may represent an overall number of parameters. Respective weighting factors may be associated with one or more parameters (e.g., for each parameter). The weighting factors may be used for calculating a respective confidence level for each hypothesis which may be donated as, for example, b1,h, b2,h, b3,h, and bK,h, which may be expressed as:
Σk=1Kbk,h=1 (7)
An average absolute difference E(h,i) for observation parameters ak(i) pertaining to a hypothesis h may be represented by the following:
where f(x,y) a function that may ensure that a maximum value for E(h,i) may be 1.
A confidence level for a hypothesis may be calculated using:
A streaming client (e.g., a HTTP player) may select a hypothesis h with a highest (e.g., maximum) confidence level Ch(i). A confidence level of a closest hypothesis may be considered in a hypothesis selection decision.
Rate adaptation may be implemented for a streaming session, for example, when one or more video segments referred to by HTTP GET requests of the streaming session are provided to a streaming client from a cache (e.g., a HTTP proxy cache), as may be illustrated by example 914 in
HTTP response from an HTTP proxy may include multi-portion data, such that a first portion of the HTTP response may include segment data that was requested by the HTTP GET request and a second portion of the HTTP response may include a summary of one or more other content segments that may be related to the HTTP GET request.
For example, a streaming client may send an HTTP GET request to retrieve a media segment (e.g., http://www.video.com/video1/seg2_quality1) that may pass through or be intercepted by an HTTP proxy. If the HTTP proxy has a cached copy of the requested segment and/or other segments, an HTTP response from the HTTP proxy may include one or more of the following; content corresponding to http://www.video.com/video1/seg2_quality1; one or more cache control parameters (e.g., cache validity timers); and/or a Media Presentation Description (MPD) corresponding to the cached http://www.video.com/video1 content. The MPD may describe respective content representations of segments of http://www.video.com/video1 that may be cached by the HTTP proxy.
Providing cache control parameters and/or a cache MPD to a streaming client in an HTTP response may help the streaming client to determine one or more representations (e.g., representations associated with http://www.video.com/video1) that may be desirable to retrieve, for example, if the streaming client wants to retrieve one or more additional segments of http://www.video.com/video1 from the HTTP proxy cache, so as to save bandwidth and/or reduce delay, for example.
At 1206, the streaming client 1204 may send an HTTP GET request (i) for a video content segment. The HTTP GET request may be intercepted by the HTTP proxy 1202. The HTTP GET request from the streaming client 1204 may include a header (e.g., a custom HTTP header) that may signal that the streaming client is interested in receiving video segments from, for example, a Dynamic Adaptive Streaming over HTTP (DASH)-aware proxy cache. An example custom HTTP header may be, for example:
If the streaming client 1204 is not interested in receiving a video segment (e.g., a valid video segment copy) from the DASH-aware proxy, it may send a HTTP GET request that may be, for example:
At 1208, the HTTP proxy 1202 may analyze the HTTP GET request (i), for example, to determine if there is a cached copy of the requested video segment and/or may determine the validity of such cached content. The HTTP GET request may be forwarded to a streaming server (e.g., an original video server, or original server 1210, associated with the requested video segment) if the requested video content segment is not in the HTTP proxy cache. The streaming client 1204 may request a fresh copy of the video segment from the original server 1210, for example, to accurately determine an effective bandwidth between the streaming client 1204 and the original server 1210. If the HTTP proxy cache is DASH-unaware, the HTTP proxy cache may disregard the custom header of the HTTP GET request and may operate in accordance with a normal cache proxy.
At 1212, the original server 1210 may respond to the HTTP proxy and may send the requested video segment to the HTTP proxy 1202.
At 1214, the HTTP proxy 1202 may forward the response to the streaming client 1204. The HTTP proxy 1202 may include one or more cache control parameters in the response. The HTTP proxy 1202 may include a custom HTTP header, for example, to signal to the streaming client 1204 an existence of a DASH-aware proxy that may have copies of one or more video segments from the original video server. An example custom HTTP header may be, for example:
At 1216, the HTTP proxy 1202 may prefetch content (e.g., perform one or more prefetching techniques), for example, to improve a cache hit ratio that may be associated with a large number of streaming clients. The HTTP proxy 1202 may proactively download an associated original MPD and/or one or more video segments from the original server 1210. A streaming client (e.g., a DASH streaming client) may send an HTTP GET request to query an MPD of the HTTP proxy. The MPD of the HTTP proxy may be a subset of the original MPD. For a streaming session involving a long video, for example, the streaming client 1204 may query the HTTP proxy 1202 several times, so as to get a latest MPD as one or more video segments are added and/or removed from the cache of the HTTP proxy 1202.
At 1218, the streaming client 1204 may send an HTTP GET request (i+1) for a video segment to the HTTP proxy 1202.
At 1220, the HTTP proxy 1202 may respond to the streaming client 1204 and may send a cached copy of the requested video segment to the streaming client 1202.
At 1222, the streaming client 1204 may detect an event corresponding to a change in effective bandwidth associated with the streaming session, for example, as illustrated by example 914 of
At 1224, the streaming client 1204 may send an HTTP GET request (i+2) for the next video segment to the HTTP proxy 1202.
At 1226, the HTTP proxy 1202 may respond and may send a cached copy of the requested next video segment to the streaming client 1204.
At 1228, the streaming client 1204 may send an HTTP GET request (i+3) for a following video segment to the HTTP proxy 1202.
At 1230, the HTTP proxy 1202 may respond and may send a cached copy of the requested following video segment to the streaming client 1204.
At 1232, the HTTP proxy 1202 may perform a prefetching step, for example, to prepare for one or more future video segment requests.
The HTTP proxy 1202 may store (e.g., in a HTTP proxy cache) one or more video segments per representation, for example, for one or more video segments that may be requested frequently (e.g., most frequently) by respective DASH streaming clients that are served by the HTTP proxy 1202. Streaming clients that are interested in receiving subsequent video segments that may not be stored in a cache of the HTTP proxy may perform one or more HTTP GET requests to an associated original server, for example. The one or more HTTP GET requests may be performed in parallel, for example, to receiving one or more cached video segments from the HTTP proxy.
Multimedia scenes may include several components, such as video, audio, images, captioned text, slides, and/or the like. In accordance with a manifest file (e.g., an MPD), a segment may carry one or more of media components as disclosed herein. With reference to equation (2) disclosed herein, for example, an effective bandwidth may be calculated for an overall multimedia streaming session, for example, at each observation point (i).
To determine a proposed representation quality Q(i) to be retrieved for each media component, a streaming device (e.g., a streaming client) may have knowledge pertaining to an importance of each media component relevant to the streaming session. For example, from the perspective of an end user, audio components may be more important than video components, such that when the effective bandwidth is substantially low, one or more media components other than audio components may be dropped in order to maximize quality of the audio components. Another end user, e.g., in another streaming session of a different type, may prioritize video components over audio components, such that when the effective bandwidth is substantially low, a media component other than a video component may be dropped to maximize the quality of a video component.
As an effective bandwidth associated with a streaming session (e.g., effectiveBandwidth) increases, overall bandwidth may be partitioned intelligently. For example, for one or more observation points (i) (e.g., each observation point (i)), a proposed representation quality Q(i) for a media component may be adjusted, for example, in accordance with a priority metric. A priority metric may reflect a proposed quality of experience pertaining to an overall multimedia streaming session.
The rate adaptation techniques described herein (e.g., multi-hypothesis rate adaptation techniques) may be applied to suitable HTTP-based streaming systems, including one or more of the following: Dynamic Adaptive Streaming over HTTP (DASH) (e.g., MPEG DASH); Apple® HTTP Live Streaming (HLS); Microsoft® Smooth Streaming; Adobe® HTTP Dynamic Streaming; Open IPTV Forum HTTP Adaptive Streaming (HAS); 3GPP Adaptive HTTP Streaming (AHS); or the like.
The rate adaptation techniques (e.g., multi-hypothesis rate adaptation techniques) disclosed herein may be implemented in accordance with multimedia streaming sessions performed in a wireless communication system, such as the example wireless communication system 1400, and components thereof, illustrated in
As shown in
The communications systems 1400 may also include a base station 1414a and a base station 1414b. Each of the base stations 1414a, 1414b may be any type of device configured to wirelessly interface with at least one of the WTRUs 1402a, 1402b, 1402c, 1402d to facilitate access to one or more communication networks, such as the core network 1406, the Internet 1410, and/or the networks 1412. By way of example, the base stations 1414a, 1414b may be a base transceiver station (BTS), a Node-B, an eNode B, a Home Node B, a Home eNode B, a site controller, an access point (AP), a wireless router, and the like. While the base stations 1414a, 1414b are each depicted as a single element, it should be appreciated that the base stations 1414a, 1414b may include any number of interconnected base stations and/or network elements.
The base station 1414a may be part of the RAN 1404, which may also include other base stations and/or network elements (not shown), such as abase station controller (BSC), a radio network controller (RNC), relay nodes, etc. The base station 1414a and/or the base station 1414b may be configured to transmit and/or receive wireless signals within a particular geographic region, which may be referred to as a cell (not shown). The cell may further be divided into cell sectors. For example, the cell associated with the base station 1414a may be divided into three sectors. Thus, in one embodiment, the base station 1414a may include three transceivers, i.e., one for each sector of the cell. In another embodiment, the base station 1414a may employ multiple-input multiple output (MIMO) technology and, therefore, may utilize multiple transceivers for each sector of the cell.
The base stations 1414a, 1414b may communicate with one or more of the WTRUs 1402a, 1402b, 1402c, 1402d over an air interface 1416, which may be any suitable wireless communication link (e.g., radio frequency (RF), microwave, infrared (IR), ultraviolet (UV), visible light, etc.). The air interface 1416 may be established using any suitable radio access technology (RAT).
More specifically, as noted above, the communications system 1400 may be a multiple access system and may employ one or more channel access schemes, such as CDMA, TDMA, FDMA, OFDMA, SC-FDMA, and the like. For example, the base station 1414a in the RAN 1404 and the WTRUs 1402a, 1402b, 1402c may implement a radio technology such as Universal Mobile Telecommunications System (UMTS) Terrestrial Radio Access (UTRA), which may establish the air interface 1416 using wideband CDMA (WCDMA). WCDMA may include communication protocols such as High-Speed Packet Access (HSPA) and/or Evolved HSPA (HSPA+). HSPA may include High-Speed Downlink Packet Access (HSDPA) and/or High-Speed Uplink Packet Access (HSUPA).
In another embodiment, the base station 1414a and the WTRUs 1402a, 1402b, 1402c may implement a radio technology such as Evolved UMTS Terrestrial Radio Access (E-UTRA), which may establish the air interface 1416 using Long Term Evolution (LTE) and/or LTE-Advanced (LTE-A).
In other embodiments, the base station 1414a and the WTRUs 1402a, 1402b, 1402c may implement radio technologies such as IEEE 802.16 (e.g., Worldwide Interoperability for Microwave Access (WiMAX)), CDMA2000, CDMA2000 1×, CDMA2000 EV-DO, Interim Standard 2000 (IS-2000), Interim Standard 95 (IS-95), Interim Standard 856 (IS-856), Global System for Mobile communications (GSM), Enhanced Data rates for GSM Evolution (EDGE), GSM EDGE (GERAN), and the like.
The base station 1414b in
The RAN 1404 may be in communication with the core network 1406, which may be any type of network configured to provide voice, data, applications, and/or voice over internet protocol (VoIP) services to one or more of the WTRUs 1402a, 1402b, 1402c, 1402d. For example, the core network 1406 may provide call control, billing services, mobile location-based services, pre-paid calling, Internet connectivity, video distribution, etc., and/or perform high-level security functions, such as user authentication. Although not shown in
The core network 1406 may also serve as a gateway for the WTRUs 1402a, 1402b, 1402c, 1402d to access the PSTN 1408, the Internet 1410, and/or other networks 1412. The PSTN 1408 may include circuit-switched telephone networks that provide plain old telephone service (POTS). The Internet 1410 may include a global system of interconnected computer networks and devices that use common communication protocols, such as the transmission control protocol (TCP), user datagram protocol (UDP) and the Internet protocol (IP) in the TCP/IP internet protocol suite. The networks 1412 may include wired or wireless communications networks owned and/or operated by other service providers. For example, the networks 1412 may include another core network connected to one or more RANs, which may employ the same RAT as the RAN 1404 or a different RAT.
Some or all of the WTRUs 1402a, 1402b, 1402c, 1402d in the communications system 1400 may include multi-mode capabilities, e.g., the WTRUs 1402a, 1402b, 1402c, 1402d may include multiple transceivers for communicating with different wireless networks over different wireless links. For example, the WTRU 1402c shown in
The processor 1418 may be a general purpose processor, a special purpose processor, a conventional processor, a digital signal processor (DSP), a plurality of microprocessors, one or more microprocessors in association with a DSP core, a controller, a microcontroller, Application Specific Integrated Circuits (ASICs), Field Programmable Gate Array (FPGAs) circuits, any other type of integrated circuit (IC), a state machine, and the like. The processor 1418 may perform signal coding, data processing, power control, input/output processing, and/or any other functionality that enables the WTRU 1402 to operate in a wireless environment. The processor 1418 may be coupled to the transceiver 1420, which may be coupled to the transmit/receive element 1422. While
The transmit/receive element 1422 may be configured to transmit signals to, or receive signals from, abuse station (e.g., the base station 1414a) over the air interface 1416. For example, in one embodiment, the transmit/receive element 1422 may be an antenna configured to transmit and/or receive RF signals. In another embodiment, the transmit/receive element 1422 may be an emitter/detector configured to transmit and/or receive IR, UV, or visible light signals, for example. In yet another embodiment, the transmit/receive element 1422 may be configured to transmit and receive both RF and light signals. It should be appreciated that the transmit/receive element 1422 may be configured to transmit and/or receive any combination of wireless signals.
In addition, although the transmit/receive element 1422 is depicted in
The transceiver 1420 may be configured to modulate the signals that are to be transmitted by the transmit/receive element 1422 and to demodulate the signals that are received by the transmit/receive element 1422. As noted above, the WTRU 1402 may have multi-mode capabilities. Thus, the transceiver 1420 may include multiple transceivers for enabling the WTRU 1402 to communicate via multiple RATs, such as UTRA and IEEE 802.11, for example.
The processor 1418 of the WTRU 1402 may be coupled to, and may receive user input data from, the speaker/microphone 1424, the keypad 1426, and/or the display/touchpad 1428 (e.g., a liquid crystal display (LCD) display unit or organic light-emitting diode (OLED) display unit). The processor 1418 may also output user data to the speaker/microphone 1424, the keypad 1426, and/or the display/touchpad 1428. In addition, the processor 1418 may access information from, and store data in, any type of suitable memory, such as the non-removable memory 1430 and/or the removable memory 1432. The non-removable memory 1430 may include random-access memory (RAM), read-only memory (ROM), a hard disk, or any other type of memory storage device. The removable memory 1432 may include a subscriber identity module (SIM) card, a memory stick, a secure digital (SD) memory card, and the like. In other embodiments, the processor 1418 may access information from, and store data in, memory that is not physically located on the WTRU 1402, such as on a server or a home computer (not shown).
The processor 1418 may receive power from the power source 1434, and may be configured to distribute and/or control the power to the other components in the WTRU 1402. The power source 1434 may be any suitable device for powering the WTRU 1402. For example, the power source 1434 may include one or more dry cell batteries (e.g., nickel-cadmium (NiCd), nickel-zinc (NiZn), nickel metal hydride (NiMH), lithium-ion (Li-ion), etc.), solar cells, fuel cells, and the like.
The processor 1418 may also be coupled to the GPS chipset 1436, which may be configured to provide location information (e.g., longitude and latitude) regarding the current location of the WTRU 1402. In addition to, or in lieu of, the information from the GPS chipset 1436, the WTRU 1402 may receive location information over the air interface 1416 from a base station (e.g., base stations 1414a, 1414b) and/or determine its location based on the timing of the signals being received from two or more nearby base stations. It should be appreciated that the WIRU 1402 may acquire location information by way of any suitable location-determination method while remaining consistent with an embodiment.
The processor 1418 may further be coupled to other peripherals 1438, which may include one or more software and/or hardware modules that provide additional features, functionality and/or wired or wireless connectivity. For example, the peripherals 1438 may include an accelerometer, an e-compass, a satellite transceiver, a digital camera (for photographs or video), a universal serial bus (USB) port, a vibration device, a television transceiver, a hands free headset, a Bluetooth® module, a frequency modulated (FM) radio unit, a digital music player, a media player, a video game player module, an Internet browser, and the like.
As shown in
The core network 1406a shown in
The RNC 1442a in the RAN 1404a may be connected to the MSC 1446 in the core network 1406a via an IuCS interface. The MSC 1446 may be connected to the MGW 1444. The MSC 1446 and the MGW 1444 may provide the WTRUs 1402a, 1402b, 1402c with access to circuit-switched networks, such as the PSTN 1408, to facilitate communications between the WTRUs 1402a, 1402b, 1402c and traditional land-line communications devices.
The RNC 1442a in the RAN 1404a may also be connected to the SGSN 1448 in the core network 1406a via an IuPS interface. The SGSN 1448 may be connected to the GGSN 1450. The SGSN 1448 and the GGSN 1450 may provide the WTRUs 1402a, 1402b, 1402c with access to packet-switched networks, such as the Internet 1410, to facilitate communications between and the WTRUs 1402a, 1402b, 1402c and IP-enabled devices.
As noted above, the core network 1406a may also be connected to the networks 1412, which may include other wired or wireless networks that are owned and/or operated by other service providers.
The RAN 1404b may include eNode-Bs 1440d, 1440e, 1440f, though it should be appreciated that the RAN 1404b may include any number of eNode-Bs while remaining consistent with an embodiment. The eNode-Bs 1440d, 1440e, 1440f may each include one or more transceivers for communicating with the WTRUs 1402a, 1402b, 1402c over the air interface 1416. In one embodiment, the eNode-Bs 1440d, 1440e, 1440f may implement MIMO technology. Thus, the eNode-B 1440d, for example, may use multiple antennas to transmit wireless signals to, and receive wireless signals from, the WIRU 1402a.
Each of the eNode-Bs 1440d, 1440e, and 1440f may be associated with a particular cell (not shown) and may be configured to handle radio resource management decisions, handover decisions, scheduling of users in the uplink and/or downlink, and the like. As shown in
The core network 1406b shown in
The MME 1443 may be connected to each of the eNode-Bs 1440d, 1440e, and 1440f in the RAN 1404b via an S1 interface and may serve as a control node. For example, the MME 1443 may be responsible for authenticating users of the WTRUs 1402a, 1402b, 1402c, bearer activation/deactivation, selecting a particular serving gateway during an initial attach of the WTRUs 1402a, 1402b, 1402c, and the like. The MME 1443 may also provide a control plane function for switching between the RAN 1404b and other RANs (not shown) that employ other radio technologies, such as GSM or WCDMA.
The serving gateway 1445 may be connected to each of the eNode Bs 1440d, 1440c, 1440f in the RAN 1404b via the S1 interface. The serving gateway 1445 may generally route and forward user data packets to/from the WTRUs 1402a, 1402b, 1402c. The serving gateway 1445 may also perform other functions, such as anchoring user planes during inter-eNode B handovers, triggering paging when downlink data is available for the WTRUs 1402a, 1402b, 1402c, managing and storing contexts of the WTRUs 1402a, 1402b, 1402c, and the like.
The serving gateway 1445 may also be connected to the PDN gateway 1447, which may provide the WTRUs 1402a, 1402b, 1402c with access to packet-switched networks, such as the Internet 1410, to facilitate communications between the WTRUs 1402a, 1402b, 1402c and IP-enabled devices.
The core network 1406b may facilitate communications with other networks. For example, the core network 1406b may provide the WTRUs 1402a, 1402b, 1402c with access to circuit-switched networks, such as the PSTN 1408, to facilitate communications between the WTRUs 1402a, 1402b, 1402c and traditional land-line communications devices. For example, the core network 1406b may include, or may communicate with, an IP gateway (e.g., an IP multimedia subsystem (IMS) server) that serves as an interface between the core network 1406b and the PSTN 1408. In addition, the core network 1406b may provide the WTRUs 1402a, 1402b, 1402c with access to the networks 1412, which may include other wired or wireless networks that are owned and/or operated by other service providers.
As shown in
The air interface 1416 between the WTRUs 1402a, 1402b, 1402c and the RAN 1404c may be defined as an R1 reference point that implements the IEEE 802.16 specification. In addition, each of the WTRUs 1402a, 1402b, and 1402c may establish a logical interface (not shown) with the core network 1406c. The logical interface between the WTRUs 1402a, 1402b, 1402c and the core network 1406c may be defined as an R2 reference point, which may be used for authentication, authorization, IP host configuration management, and/or mobility management.
The communication link between each of the base stations 1440g, 1440h, 1440i may be defined as an R8 reference point that includes protocols for facilitating WTRU handovers and the transfer of data between base stations. The communication link between the base stations 1440g, 1440h, 1440i and the ASN gateway 1441 may be defined as an R6 reference point. The R6 reference point may include protocols for facilitating mobility management based on mobility events associated with each of the WTRUs 1402a, 1402b, 1402c.
As shown in
The MIP-HA may be responsible for IP address management, and may enable the WTRUs 1402a, 1402b, and 1402c to roam between different ASNs and/or different core networks. The MIP-HA 1454 may provide the WTRUs 1402a, 1402b, 1402c with access to packet-switched networks, such as the Internet 1410, to facilitate communications between the WTRUs 1402a, 1402b, 1402c and IP-enabled devices. The AAA server 1456 may be responsible for user authentication and for supporting user services. The gateway 1458 may facilitate interworking with other networks. For example, the gateway 1458 may provide the WTRUs 1402a, 1402b, 1402c with access to circuit-switched networks, such as the PSTN 1408, to facilitate communications between the WTRUs 1402a, 1402b, 1402c and traditional landline communications devices. In addition, the gateway 1458 may provide the WTRUs 1402a, 1402b, 1402c with access to the networks 1412, which may include other wired or wireless networks that are owned and/or operated by other service providers.
Although not shown in
The processes and instrumentalities described herein may apply in any combination, may apply to other wireless technology, and for other services.
A WTRU may refer to an identity of the physical device, or to the user's identity such as subscription related identities, e.g., MSISDN, SIP URI, etc. WTRU may refer to application-based identities, e.g., user names that may be used per application.
Although features and elements are described above in particular combinations, one of ordinary skill in the art will appreciate that each feature or element may be used alone or in any combination with the other features and elements. In addition, the methods described herein may be implemented in a computer program, software, or firmware incorporated in a computer-readable medium for execution by a computer or processor. Examples of computer-readable media include electronic signals (transmitted over wired or wireless connections) and computer-readable storage media. Examples of computer-readable storage media include, but are not limited to, a read only memory (ROM), a random access memory (RAM), a register, cache memory, semiconductor memory devices, magnetic media such as internal hard disks and removable disks, magneto-optical media, and optical media such as CD-ROM disks, and digital versatile disks (DVDs). A processor in association with software may be used to implement a radio frequency transceiver for use in a WTRU, terminal, base station, RNC, or any host computer.
This application is the National Stage Entry under 35 U.S.C. § 371 of Patent Cooperation Treaty Application No. PCT/US2013/065440, filed Oct. 19, 2012, which claims the benefit of priority to provisional application No. 61/716,369, filed Oct. 19, 2012.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2013/065440 | 10/17/2013 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2014/062921 | 4/24/2014 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
8938767 | Chen | Jan 2015 | B2 |
8977704 | Liu | Mar 2015 | B2 |
9131027 | Zhang | Sep 2015 | B2 |
9549000 | Panje | Jan 2017 | B2 |
20060168295 | Batterberry | Jul 2006 | A1 |
20090086627 | Ujjain | Apr 2009 | A1 |
20110225317 | Balachandran et al. | Sep 2011 | A1 |
20120042090 | Chen | Feb 2012 | A1 |
20120090036 | Kang | Apr 2012 | A1 |
20120117261 | Bouazizi | May 2012 | A1 |
20120185570 | Bouazizi | Jul 2012 | A1 |
20120259994 | Gillies et al. | Oct 2012 | A1 |
20130007814 | Cherian | Jan 2013 | A1 |
20130117413 | Kaneko et al. | Mar 2013 | A1 |
20130159546 | Thang et al. | Jun 2013 | A1 |
20130191511 | Liu | Jul 2013 | A1 |
20130227102 | Beck | Aug 2013 | A1 |
20140149557 | Lohmar | May 2014 | A1 |
20160255133 | Nagaraj | Sep 2016 | A1 |
20160323342 | Luby | Nov 2016 | A1 |
Number | Date | Country |
---|---|---|
10-2010-0057622 | May 2010 | KR |
WO 2011038021 | Mar 2011 | WO |
WO 2011038321 | Mar 2011 | WO |
WO 2012011450 | Jan 2012 | WO |
WO 2012019621 | Feb 2012 | WO |
WO 2012030178 | Mar 2012 | WO |
WO 2012138909 | Oct 2012 | WO |
Entry |
---|
Bouazizi et al., “3GPP Mobile Multimedia Services”, IEEE Signal Processing Magazine, Sep. 2010, pp. 126-130. |
Choi et al., “A Study on Service Migration in HTML5 based HTTP Streaming Environments”, Journal of Korea Multimedia Society, vol. 14, No. 7, Jul. 2011, 13 pages. |
Rejaie et al., “Multimedia Proxy Caching Mechanism for Quality Adaptive Streaming Applications in the Internet”, IEEE INFOCOM, 2000, pp. 980-989. |
3rd Generation Partnership Project(3GPP), TS 26.234 V9.6.0, “Technical Specification Group Services and System Aspects, Transparent End-to-End Packet-Switched Streaming Service (PSS), Protocols and Codecs (Release 9)”, Mar. 2011, 189 pages. |
3rd Generation Partnership Project(3GPP), TS 26.247 V10.0.0, “Technical Specification Group Services and System Aspects, Transparent End-to-End Packet-Switched Streaming Service (PSS), Progressive Download and Dynamic Adaptive Streaming over HTTP (3GP-DASH) (Release 10)”, Jun. 2011, 94 pages. |
Adobe, “HTTP Dynamic Streaming on the Adobe® Flash® Platform-Enabling High-Quality, Network-Efficient HTTP Streaming for Media Delivery”, Adobe Flash Platform Technical White Paper, 2010, pp. 1-18. |
Conklin et al., “Video Coding for Streaming Media Delivery on the Internet”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 11, No. 3, Mar. 2001, pp. 269-281. |
ISO/IEC, “Information Technology-Coding of Audio-Visual Objects—Part 12: ISO Base Media File Format, Amendment 3: DASH Support and RTP Reception Hint Track Processing”, ISO/IEC 14496-12:2008/FDAM 3:2011(E), STD Version 2.1c2, Aug. 17, 2011, 44 pages. |
ISO/IEC, “Information Technology-Dynamic Adaptive Streaming over HTTP (DASH)—Part 1: Media Presentation Description and Segment Formats”, ISO/IEC 23009-1:2012(E), STD Version 2.1c2, Jan. 5, 2012, 133 pages. |
Malvar, Henrique S.,“Signal Processing with Lapped Transforms”, Artech House, Jan. 1992, 5 pages. |
Open IPTV Forum, “Release 2 Specification-Volume 2a-HTTP Adaptive Streaming”, vol. 2.1, Jun. 21, 2011, pp. 1-25. |
Pantos et al., “HTTP Live Streaming”, draft-pantos-http-live-streaming-06, Apple Inc., Mar. 31, 2011, 25 pages. |
Sodagar et al., “Reinventing Multimedia Delivery with MPEG-DASH”, Proc. SPIE 8135, Applications of Digital Image Processing XXXIV, 81350R, Sep. 24, 2011, 8 pages. |
Stockhammer, Thomas, “Dynamic Adaptive Streaming over HTTP-Standards and Design Principles”, Proceedings of the Second Annual ACM Conference on Multimedia Systems New York, NY, USA: ACM Press, Feb. 23-25, 2011, 11 pages. |
Wolters et al., “A Closer Look into MPEG-4 High Efficiency AAC”, Audio Engineering Society, Convention Paper, Presented at the 115th Convention, Oct. 10-13, 2003, 16 pages. |
Zambelli, Alex,“IIS Smooth Streaming Technical Overview”, Microsoft Corporation, Mar. 2009, 17 pages. |
Number | Date | Country | |
---|---|---|---|
20160050241 A1 | Feb 2016 | US |
Number | Date | Country | |
---|---|---|---|
61716369 | Oct 2012 | US |