Patent Application
20060168289
The present invention relates to multimedia streaming. In particular, the invention provides systems and methods for signaling clients of broadcast or multicast multimedia streaming services.
In a multimedia streaming system, a server computer transmits a stream of data to one or more client devices as a multicast or a broadcast. Each of the client devices may be provided with a different connection condition and different capability. These variations can lead to numerous issues related to the playback of the data at the client devices. For example, the client device may suffer through interruptions during the playback, requiring rebuffering of the data. Also, playbacks at various client devices may differ, causing playback to occur at different times at each device. Thus, for example, one client device may playback the final score of a sporting event before other client devices.
The present invention is directed to methods, devices, systems, program products, and computer-implemented methods adapted for multicasting or broadcasting of streamed data.
In one embodiment, a method of streaming multimedia includes streaming data from a streaming server to one or more receiving devices, the data including a series of packets to be decoded by the receiving devices; and providing each device with timing information, next-packet and last-sent packet information, the timing information being indicative of a desired playback schedule.
In another embodiment, a method for multimedia streaming includes receiving streamed data from a streaming server by a receiving device, the data including a series of packets to be decoded; and receiving timing information, next-packet and last-sent packet information from the streaming server, the timing information being indicative of a desired playback schedule.
In another embodiment, a client device adapted to receive streamed data includes a communication module adapted to receive streamed data from a streaming server, the data including a series of packets to be decoded. The communication module is further adapted to receive timing information, next-packet and last-sent packet information from then streaming server, the timing information being indicative of a desired playback schedule. The client device also includes a decoder adapted to determine a desired buffering based on the timing information and next-packet information.
In another embodiment, a system for multimedia streaming includes a server computer and one or more client devices. The server computer is adapted to transmit streamed data, the data including a series of packets to be decoded. The server computer is further adapted to transmit timing information, next-packet and last-sent packet information from the streaming server, the timing information being indicative of a desired playback schedule. Each client device is adapted to receive said streamed data, timing information and next-packet information.
Another embodiment of the invention includes a program product having machine readable program code for causing a machine to perform the following: streaming data from a streaming server to one or more receiving devices, the data including a series of packets to be decoded by the receiving devices; and providing each device with timing information and next-packet information, the timing information being indicative of a desired playback schedule.
In another embodiment, a computer-implemented method includes streaming data from a streaming server to one or more receiving devices, the data including a series of packets to be decoded by the receiving devices; and providing each device with timing information, next-packet and last-sent packet information, the timing information being indicative of a desired playback schedule.
In another embodiment, the invention includes a program product having machine readable program code for causing a machine to perform the following: receiving streamed data from a streaming server by a receiving device, the data including a series of packets to be decoded; and receiving timing information, next-packet and last-sent packet information from the streaming server, the timing information being indicative of a desired playback schedule.
In another embodiment, a computer-implemented method includes receiving streamed data from a streaming server by a receiving device, the data including a series of packets to be decoded; and receiving timing information, next-packet and last-sent packet information from the streaming server, the timing information being indicative of a desired playback schedule.
Other principle features and advantages of the invention will become apparent to those skilled in the art upon review of the following drawings, the detailed description, and the appended claims.
Exemplary embodiments will hereafter be described with reference to the accompanying drawings, in which:
Such streamed data is typically transmitted by the server computer as packets of data using the Realtime Transport Protocol (RTP) and Realtime Transport Control Protocol (RTCP) in accordance with the 3rd Generation Partnership Project (3GPP) Packet Switched Streaming Service (PSS) requirements.
The server 110 may be adapted to provide any type of streamed data, including audio, video or a combination thereof. The server 110 may be adapted to send RTP packets. In this regard, the server 110 may include one or more components (not shown) to encode data for streaming. In this regard, the server 110 is adapted to encode the data in interleaved or non-interleaved packets for streaming.
The packets of data are transmitted to the client devices 120a-d, where they are initially received by a communication module, such as communication module 122 of client device 120a, adapted to receive RTP packets. The communication module 122 may be adapted to store the data in a buffer memory 124. A decoder 126 can decode the data for playback to the user.
In addition to the information contained in the RTCP SR packet 200, in embodiments of the present invention, information relating to next packet to be decoded and the timing information, such as playout delay of the current packet, may be included. In one embodiment, as data packets are streamed to the client devices, such information may be transmitted in RTCP application specific (APP) packets, an example of which is illustrated in
The RTCP APP packet 300 illustrated in
The playout delay 310 is used to indicate when the streaming server assumes that each client device should start to decode the packet indicated by the NSN 320. The LSSN 330 allows each client to determine the designed buffer level of the streamed data.
The combination of the information in the RTCP SR packet 200 and the RTCP APP packet 300 allows each client device to determine when to start playback. Further, the information allows each client to calculate how to adaptively schedule the playback speed to accommodate for any channel variation. This provides an improved continuous playback.
Specifically, the information in the RTCP SR packets and the RTCP APP packets allows the client device to determine the designed buffer level at a certain time. An example of this is illustrated below with reference to
For RTP/RTCP streamed data, playback begins with the reception of an Intra, or IDR, packet, which contains information required for decoding of the stream. In the example illustrated in
During playback, the continuity of the playback may be maintained by using the playout delay 310 indicated in the RTCP APP packet (
Although the above exemplary embodiment illustrates the use of an RTCP APP packet to provide each client device with certain information, in other embodiments, the information may be provided through, for example, session description protocol (SDP) or real-time streaming protocol (RTSP) signaling.
Certain client devices may be equipped with a Global Positioning System (GPS) capability. Such a capability may provide the client device with an accurate clock. In such devices, the client device may utilize the NTP timestamp (
Thus, in addition to the streamed data, each client device is provided with timing information and the next packet identification to allow the client device to determine an appropriate buffering requirement and to schedule the decoding for an accurate and continuous playback.
In the foregoing description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It is evident, however, to one skilled in the art that the exemplary embodiments may be practiced without these specific details. In other instances, structures and devices are shown in block diagram form in order to facilitate description of the exemplary embodiments.
While the exemplary embodiments illustrated in the Figures and described above are presently preferred, it should be understood that these embodiments are offered by way of example only. Other embodiments may include, for example, different techniques for performing the same operations. The invention is not limited to a particular embodiment, but extends to various modifications, combinations, and permutations that nevertheless fall within the scope and spirit of the appended claims.
