This application claims the benefit, under 35 U.S.C. § 365 of International Application PCT/CN2007/000120, filed Jan. 11, 2007which was published in accordance with PCT Article 21(2) on Jul. 17, 2008in English.
The present invention generally relates to network communications and, more particularly, to communication of content such as video information via a network.
Server bandwidth has been identified as a major bottleneck in large systems communicating content responsive to user demand, such as video on demand (VOD) systems. Dedicating a channel to each client quickly uses up server bandwidth and is non-scalable. To preserve server bandwidth, many users can share a channel using multicast.
There are two types of multicast: periodic broadcast and non-periodic multicast. In a periodic broadcast environment, the server does not wait for service requests. The server broadcasts content cyclically. In the case of video content, cyclical broadcast does not guarantee true VOD. Cyclical broadcasts do keep the worst service latency experienced by any client within a certain limit. In fact, the bandwidth requirement is independent of the number of subscribers to the system. However the benefit of periodic broadcast is limited to content that is frequently demanded such as popular videos.
For content that is not frequently demanded, such as videos which are not very popular, non-periodic multicast can be used. In a non-periodic multicast environment, users make content requests to a server; and the server serves them according to some scheduling policy. A technique referred to as patching allows a new incoming request to join an on-going multicast and therefore takes advantage of the same data stream. Non-periodic multicast approaches can provide true VOD service. However, such approaches, including those that adopt the patching technique, while providing a true VOD service may have a great data burst impact.
An aspect of the present invention involves recognition that existing content delivery systems may have problematic characteristics such as creating undesirable data burst impact. Another aspect of the present invention involves a method of communicating content that may comprise receiving a request for a content; generating a schedule for delivering the content; determining whether the schedule will satisfy a delay parameter of the request; and modifying the schedule to delay delivery of a portion of the content responsive to determining that the delay parameter is satisfied. Modifying the schedule may further comprise detecting a first time interval of the schedule for delivering the content during which bandwidth is available; and adjusting the schedule for delaying delivery of the portion of the content to occur during the time interval. A request may be received from a client device and the delay parameter may comprise a delay limit established by a user of the client device. The schedule may comprise a plurality of time intervals including a first time interval during which delivery of the portion of the content is scheduled for delivery, the content may comprise a plurality of blocks of information, the portion may comprise a first one of the plurality of blocks of information; and modifying the schedule may comprise determining that additional bandwidth is needed to deliver the portion of the content during the first interval; delaying transmission of the first block to occur during a second time interval during which additional bandwidth is available, the second time interval occurring subsequent to the first time interval; and determining whether a delay in transmission resulting from a delay from the first interval to the second interval exceeds a delay limit associated with the delay parameter.
Another aspect of the invention involves a method of delivering content that may comprise receiving a request for a content; and generating a schedule for delivering the content with a first delay for an initial portion of the content and with a second delay for a subsequent portion of the content, wherein generating the schedule comprises selecting the first delay to minimize the time from receiving the request to delivery of the initial portion of the content, and selecting the second delay to satisfy a delay parameter associated with the request and increase a delay of delivery of the subsequent portion.
Another aspect of the invention involves a method of receiving content that may comprising requesting a content from a content provider; providing a delivery delay limit to the content provider; receiving the content according to a schedule including a first time for starting delivery of an initial portion of the content and a second time for starting delivery of a subsequent portion of the content, wherein the first time minimizes a delay from receiving the request to starting delivery of the initial portion of the content, and the second time satisfies the delivery delay limit while also increasing a delay for starting delivery of the subsequent portion of the content.
Another aspect of the invention involves a system for delivering content that may comprise an interface for receiving a request from a requesting device for a content and receiving a delay parameter from the requesting device; and a scheduler coupled to the interface and responsive to the request for delivering the content to the requesting device according to a schedule, wherein the scheduler modifies the schedule responsive to a delay parameter of the requesting device for delaying delivery of a portion of the content and determines that the delay parameter is satisfied.
Another aspect of the invention involves a method of delivering content that may comprise the steps of receiving a request for a content; generating a schedule for delivering the content in responsive to the request; and transmitting a message indicating a delay time for transmitting the content. The method may further comprise a step of determining whether the schedule will satisfy a delay parameter of the request, wherein if the schedule will not satisfy the delay parameter, the message indicates that the request is denied.
The present invention may be readily understood by considering the following detailed description in conjunction with the accompanying drawings which include:
To facilitate understanding of the drawings and the associated description, identical reference numerals have been used in the various figures to identify identical or similar features. It should be understood that the drawings are for purposes of illustrating aspects of the invention and, in particular, for illustrating an exemplary embodiment of the invention. Other configurations and embodiments of systems incorporating principles of the invention are possible.
For the purpose of ease of explanation, the following will describe an exemplary embodiment of principles of the invention in a video on demand system, or VOD. However, the invention is broadly applicable to various systems for communicating content between content sources and users. Principles of the invention described herein are applicable to systems delivering and/or receiving all types of content including, but not limited to, video and/or audio. In addition, the content may be communicated via various types of communication networks incorporating various communication media and devices. For example, principles of the invention are applicable to wired and wireless communication networks (e.g., CATV, cell networks, satellite systems, etc.) for providing content to devices including telephones (e.g., wired phones or wireless phones such as cell phones), set top boxes, televisions, computers, etc. In addition, aspects of the invention relate to systems including content storage features and/or capability such as a personal video recorder (PVR). For example, availability of storage capability such as a PVR may enable a later arriving client as described below to join a multicast stream delivering the media data to some earlier clients by buffering the data it received until it is needed for playback.
An exemplary embodiment of a system incorporating principles of the invention as described herein involves a VOD service mode and a related method of scheduling a multicast transmission. The described VOD system can provide to users, customers or clients of the system a list identifying content, e.g., a video name list, and the respective earliest playback time. Providing information regarding time when playback is possible allows each entity requesting content, e.g., customer, client or user, to set a delay parameter or delay limit specifying the requester's preferred or acceptable or tolerable delay accordingly, e.g., by requesting one of the content items in the provided list or by providing information specifying tolerable delay to a server in a separate communication such as during a set-up mode of operation. By receiving the requests from the customers, the system determines whether to accept a request or not according to the available network bandwidth and the user tolerable delay.
For example,
The system shown in
In accordance with a further aspect of the invention, the scheduler may modify or adapt the schedule, e.g., by rearranging the schedule as explained below. For example, the schedule may be modified responsive to a delay parameter or delay limit such as a user-specified tolerable delay to delay delivery of a portion of the content. The delay may provide for delaying transmission of blocks in a stream as late as possible to increase the probability of transmitted blocks of content being utilized to serve multiple requests. That is, if a second request for a video is received subsequent to a first request for the same video, transmission of blocks responsive to the first request may also be used to serve the second and or other succeeding requests. Modification of the schedule by the scheduler to delay delivery as described occurs after determining that the delay satisfies the delay parameter. A further consideration is the need for playing content smoothly.
In more detail, the exemplary VOD system comprises two primary components: VOD server 110 and clients 130. VOD server 110 publishes the play list of the video which include video name and earliest access time. The earliest access time is updated dynamically. Whenever a client is interested in a video, it makes a request in which the information such as video name and user tolerable delay is included. After receiving the request, the VOD server determines whether this request is accepted or not according to the available bandwidth and the user tolerable delay. If the request is accepted, the playback delay may be included in the acknowledge information. If the request is refused, the minimum possible playback delay may be included in the acknowledge information, based on which the client can make another reasonable request if desired.
An exemplary embodiment of scheduling transmissions is illustrated in flow-chart format in
For the purpose of describing aspects of
In addition to the described terminology, the description herein will use the following symbols:
An example of the operation of the exemplary embodiment for providing scheduling in accordance with aspects of the invention is illustrated in
For the first request in a transmission period, the scheduler generates a reference stream, that is, to transmit all N blocks consecutively just like in a conventional VOD system, starting at T0, the arrival time of the first request R0. When the kth request arrives, the system schedules a stream for kth request, which is denoted by stream Sk. The schedule procedure in more detail is described below in regard to
After receiving a request, e.g., the kth request, as in step 210 of
Uk={uk1, uk2, . . . , uky},
where uki is the scheduled transmission time of the ith block in the kth stream. The ith block in the kth stream does not necessarily is the ith block of the requested video or content.
Following creation of the initiatory schedule, in step 230 of
From the time point ak, the set of the time slots whose bandwidth is below the bandwidth limit is denoted as L. L={l1, l2, . . . , lw}. Every li comprises two attributes, li={li1, li2}where li1 denotes the start time of the time slot and li2 denotes the difference between the occupied bandwidth and the bandwidth limit. li2 is referred to as depth degree. li(i=1, 2, . . . , w) is ordered with li1 increased.
In accordance with an aspect of the invention, at step 240 of
During step 250, the scheduled stream k will be transmitted at time Tk where Tk=ak which means the service delay of the kth request is zero. The transmission time of the blocks is Vk=Uk={uk1, uk2, . . . , uky}. For example, in
If the evaluation at step 240 of
An exemplary embodiment of schedule adjustment or rearrangement as in step 270 is described below and shown in more detail in
A first step in the schedule modification is a determination of a set G of the under load time slots. Assume G being generated from L, G={g1,g2, . . . , gn}, where
and w is the number of elements in L. G can be generated as follows:
g1=l11
gi(i=2, 3, . . . , n) shall be generated according to the following rule:
If li2=j, then gs=gs+1= . . . =gs+j−1=li1, where
Next, m elements of G are selected to for a set Q where Q={Q1, Q2, . . . , Qx}, x=cnm and m is the number of elements in H.
Each Qi={qi1, qi2, . . . , qim}, Qi⊂G qijεG i=1, 2, . . . , x j=1, 2, . . . , m
Next, Qi are selected from Q such that the following equation (1) holds:
Then hi2 is scheduled to transmit at qij.
Next, all the blocks scheduled for kth stream should be reordered in an increasing sequence. The transmission time of the blocks is represented as Vk={vk1, vk2, . . . , vky}. So the delay of the playback time is equal to:
If the delay needed is within the user's latency tolerance, i.e., the delay parameter or limit is satisfied, the system transmits video blocks as scheduled. If the delay needed is beyond the latency tolerance, i.e., the delay parameter or limit is not satisfied, the request is refused and an earliest possible start time is sent back to the requester.
For example, in
Another aspect of the invention involves selecting appropriate under load timeslots, i.e., determining appropriate time intervals during which bandwidth is available. An exemplary embodiment for choosing the proper under-load timeslots to modify or adjust the schedule providing rearrangement is described below in regard to
An exemplary embodiment for providing a system for satisfying both conditions provides for considering condition 1 first and then, after satisfying the first condition, considering the second condition. Satisfying the first condition of providing minimum initial delay will be referred to as a first-pass of schedule modification. During the first pass, two procedures occur: under-load time slot selection and block shifting.
In order to achieve the minimum initial delay, i.e., within the delay tolerance, as in step 560 of
The shift or delay occurs as follows. If an over-load block hi2 (at the timeslot hi1) needs to be moved to the under-load time slot lj1, then there are 2 cases to consider. In case 1, i.e., if lj1<hi1, the block at the time slot directly next to the lj1 will be moved to the lj1, and all the blocks between (lj1, hi1) should be moved to the time slot just directly prior to itself in turn, the block hi2 (at the timeslot hi1) will be moved to the time slot directly prior to the hi1. In case 2, i.e., if lj1>hi1, the block at the timeslot directly prior to the lj1 will be moved to the lj1, and all the blocks between (hi1, lj1) should be moved to the timeslot just directly next to itself in turn, the block hi2 (at the timeslot hi1) will be moved to the timeslot directly next to the hi1.
Next, the minimum initial delay d can be determined. Let the transmission time of the blocks after initiatory schedule be represented as U={u1, u2, . . . , uy} and let the transmission time of the blocks after the first pass reschedule be represented as V={v1, v2 . . . , vy} Then, the minimum delay d is determined as follows:
Next, at step 561, the minimum delay is checked to determine if the minimum delay is within the tolerance, i.e., whether the schedule will satisfy the delay parameter or limit. If not, the request is rejected at step 580. If the minimum delay is acceptable (i.e., within tolerance or satisfies the delay parameter or limit), a second pass of scheduling occurs for considering the second condition of maximum data sharing. That is, in response to determining that the delay parameter is satisfied, a second pass occurs to modify the schedule to delay delivery of at least a portion of the content. After the first pass, the minimum initial delay Dmin for the schedule is determined and the initiatory scheduled stream is delayed with Dmin at step 562. Then, bandwidth detection occurs at step 563 and all the over-load blocks and all the under-load timeslots are found. From the last over-load block to the first over-load block, shifting occurs at step 564 to move the over-load block to the under-load timeslot respectively which lies before its current position and has the minimum distance to its current position. This shifting or delaying or rearrangement is explained in detail below.
After delaying the initiatory schedule with Dmin, for each overload block, it is possible to always find at least one under-load timeslot, which lies before the overload timeslot, to “hold” the overload block. This proceeds as follows.
First, the stream is scheduled with the minimum initial delay by delaying the initiatory schedule with Dmin. That is, for the kth stream, all the blocks that have been transmitted in [ak−1, ak] are scheduled to transmit at their time offset from the first block plus Dmin. The transmission time of the blocks is presented as U={u1+Dmin, u2+Dmin, . . . , uy+Dmin}.
Next bandwidth detection occurs. After delaying the schedule, the bandwidth of the timeslots has been changed. Therefore, it is necessary to do bandwidth detection again in order to find all the overload blocks and all the under-load timeslots.
Next, the scheduled blocks are rearranged. Rearrangement is similar to that of the first pass schedule. It also includes two procedures: under-load timeslots selection and blocks shifting.
In order to determine which under-load timeslots will be chosen to contain the overload blocks, the selection occurs from “back” to “front”. That is, first it is determined which under-load time slot will contain the last (on the time axis) overload block, and then it is determined which under-load timeslot will contain the second last (on the time axis) overload block, and so on. For the overload block hi2 (at the timeslot hi1), the under-load timeslot lj1 which contains hi2, is determined as follows:
Liprior is the subset of all the under-load timeslots which lies before hi1 (less than hi1). That is, the under-load timeslot lj1 has the minimum distance to hi1 among all the under-load timeslots which lie before hi1.
Block shifting of the second pass schedule is identical to that of the first pass schedule. However, only case 1 exists because the selected under-load timeslot is before the overload timeslot, so the block shifting of the second pass has only case 1.
Another aspect of the invention involves combining content streams as in step 590 of
Streams are transmitted to clients according to the schedule in step 565. There are several ways in which the streams can be multicast to the clients. One possibility is a unique multicast stream for each user request of the content. Another possibility is a single multicast stream with all the user requests. The advantage of the first approach is that a user needs to only subscribe to the multicast streams of interest and the irrelevant streams will not reach the user. The latter approach needs to filter the redundancy data at the client.
The above described aspects of the invention may be better understood by considering the following explanation of the described exemplary embodiment in conjunction with
In the example of
When client device 0 requests for the video program (request R0 in
Since the server transmits one block per time slot in response to request 0, a bandwidth of two blocks in each time slot is available for other requests.
Client device 1 submits a request (R1 in
At time a2 or time slot 13, client device 2 submits a request (R2 in
At this point, the description has been in regard to the case described above in which the bandwidth in each time slot has not been exceeded, i.e., the time slots are under load time slots. In the following, the condition of insufficient bandwidth when a request is received is covered, i.e., the situation of overload time slots.
The schedule at this point is as follows:
Stream 0: U0=V0=(0, 1, 2 . . . 19) corresponding to blocks 0-19, respectively.
Stream 1: U1=V1=(8, 9 . . . , 15) corresponding to blocks 0-7, respectively
Stream 2: U2=V2=(13, 14, 15, 16, 17, 21, 22, 23, 24, 25) corresponds to blocks 0-4 and 8-12, respectively.
At a3 or time slot 15, receiver 3 submits a request (R3 in
Thus, w=9 and the number of elements in the G, n, is 1+2+2+2+1+2+2+2+2 or 16.
In computing G, we note that g1=17. Other elements of G are computed from the following equation described above:
Thus, g2=g3=18, g4=g5=19, g6=g7=20, g8=21, g9=g10=22, g11=g12=23, g13=g14=24, and g15=g16=25.
The m index in generating Q represents the number of items in the H list. In this example, it is 1. As such, the number of elements in Q, x, is 16, and Q includes 16 lists, Q1-Q16. Each list includes only one item and ti1=gi.
Then, equation (1) below is used to select a qi1 which is closest in time to the starting time slot of each element in the H list. That is:
In this example, qi1=17 is selected, which means block 0 will be transmitted at timeslot 17. After blocks reorder, V3=(16, 17, 20, 21, 28, 29), block 0 will be transmitted at timeslot 16 and block 1 will be transmitted at timeslot 17. Blocks 5, 6, 13, 14 keep their original schedule, i.e., they will be transmitted at timeslot 20, 21, 28, 29 respectively.
At this point, the server knows the delay time of one time slot. If the request requires a delay time of up to one time slot, the request is granted and the grant message includes the delay time. If the request requires a delay of less than one time slot, the request is denied and the message also includes the delay time, so that a user can submit another request with a longer waiting time.
Various modifications and/or extensions of principles described herein are contemplated. For example, for applications such as VOD the described system is flexible and scalable to support increased numbers of users. Schedule modification as described may be used to reduce or flatten the data burst impact of multiple requests and adding users by providing a reasonable latency service for some users where the definition of “reasonable” may be specified by the users. The invention is applicable to various systems including VOD systems with personal video recorder (PVR) enabled customers. For example, when a PVR is available, a later arriving client joins the multicast stream delivering the media data to some earlier clients, buffers the data it received until it is needed for playback. This can reduce the server bandwidth required. A system as described herein may provide useful information to customers such as the earliest access time of particular content. For example, the system may provide a list of video name and their respective earliest access time. The earliest access time helps users to make a rational request for content, which can avoid meaningless requests from users and increase system efficiency. The described system operates in accordance with a multicast transmission schedule arranged according to the arrival of the requests, current available bandwidth and the users' tolerable delay. This system can make a trade off between server bandwidth and service latency. It can combine streams dynamically to enable clients to optimally share data.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/CN2007/000120 | 1/11/2007 | WO | 00 | 6/25/2009 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2008/083523 | 7/17/2008 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5561456 | Yu | Oct 1996 | A |
5594491 | Hodge et al. | Jan 1997 | A |
5964829 | Ozden et al. | Oct 1999 | A |
6216006 | Scholefield et al. | Apr 2001 | B1 |
6219704 | Kim et al. | Apr 2001 | B1 |
7434242 | Goode | Oct 2008 | B1 |
20020006801 | Siren | Jan 2002 | A1 |
20020049804 | Rodriguez et al. | Apr 2002 | A1 |
20040098470 | Kurihara | May 2004 | A1 |
20040133907 | Rodriguez et al. | Jul 2004 | A1 |
Number | Date | Country |
---|---|---|
1487457 | Apr 2004 | CN |
1697511 | Nov 2005 | CN |
10-91466 | Apr 1998 | JP |
2002-112231 | Apr 2002 | JP |
2004-312746 | Nov 2004 | JP |
2006-108831 | Apr 2006 | JP |
WO2005098674 | Oct 2005 | WO |
WO 2005098674 | Oct 2005 | WO |
Entry |
---|
International Search Report, dated Oct. 25, 2007. |
Number | Date | Country | |
---|---|---|---|
20100058406 A1 | Mar 2010 | US |