The present invention relates, in general, to broadcasting Internet media, and, more specifically, to a system and method for providing a client controllable server-side playlist.
Streaming media is a technology that has steadily grown over the course of the Internet's popularity. A media stream is generally a cohesive segment of some media, such as video, audio, data, or the like. In a typical application a user may access a streaming media source to listen to music, view a movie or video feed, whether live or pre-recorded, all played from a remote server. The server generally sends the media segments across the Internet to the user, who generally must have a compatible media player to view the steaming media. Many different users may access the media stream, referred to as subscribing, to view or play the same content. Players such as the MICROSOFT WINDOWS MEDIA PLAYER™, REALNETWORK'S REALONE PLAYER™ and REALPLAYER™, QUICKTIME™ PLAYER, and the like, render the different media streams depending on their formats and display or play the media to the user.
Playlists are generally a list of media segments that are played in the playlist order. For example, radio stations typically plan the songs they will play throughout any given day by assembling a list of artists and songs for the disc jockeys to either play or monitor. In digital media, a sequence of media segments, for example, music, can be played one after the other either on a user's local machine, or played on the server side. Most media players, such as the MICROSOFT WINDOWS MEDIA PLAYER™, allow a user to assemble a list of digitally recorded songs or video clips on the user's computer to play in any sequence selected by the user.
Streaming media is generally played from the server side, allowing individual users to subscribe to the media streams. Server-side programmers and administrators may basically combine snippets from different media files and treat them as one media output or stream. A television broadcasts is a similar concept where the content and advertisements are interspersed with each other with the user watching them on a single channel. While the media is being switched from one to another, the user does not intervene in anyway and experiences only a “single” stream of the channel broadcast. One of the limitations with this server-side playlist scheme is that the user must usually not only know what it is that the user wants to view (i.e., the media format and access address), but the media must also typically have an explicit resource as well (e.g., channel 1, 6, and the like).
While playlists may provide the user with multimedia content that is very rich and very entertaining or informational, it is still a rather static experience among the growing number of dynamic and interactive applications appearing on the Internet. The user can subscribe or unsubscribe and, when subscribed, see or hear only the content playing on the server. While this may be acceptable in the case of a movie or song, if the streaming media is an instructional program, the user can only sit and experience the media. Users may overcome this limitation by developing their own playlists locally. However, those playlists cannot generally be shared with other users across a network without copying the entire playlist content to the other users.
The present invention is directed to a system and method for establishing an interactive multimedia application environment in which server-side streaming media may be controlled not only from the server-side developers, but also from users at the client-side. A programming model is provided at a communication server and an interactive multimedia runtime on a client. The application program interface (API) preferably provides methods for the user at a client to establish a stream of data from the client to the communication server in addition to allowing a stream from the communication server to the client. The API also preferably allows the user at a client to exert control over the broadcasting of the media streams. Streams may be built, edited, paused, stopped, augmented, and the like by a user operating a client. Each function that the client user may operate on the broadcast media stream is preferably viewed by all of the other subscribing clients.
The foregoing has outlined rather broadly the features and technical advantages of the present invention in order that the detailed description of the invention that follows may be better understood. Additional features and advantages of the invention will be described hereinafter which form the subject of the claims of the invention. It should be appreciated by those skilled in the art that the conception and specific embodiment disclosed may be readily utilized as a basis for modifying or designing other structures for carrying out the same purposes of the present invention. It should also be realized by those skilled in the art that such equivalent constructions do not depart from the spirit and scope of the invention as set forth in the appended claims. The novel features which are believed to be characteristic of the invention, both as to its organization and method of operation, together with further objects and advantages will be better understood from the following description when considered in connection with the accompanying figures. It is to be expressly understood, however, that each of the figures is provided for the purpose of illustration and description only and is not intended as a definition of the limits of the present invention.
For a more complete understanding of the present invention, reference is now made to the following descriptions taken in conjunction with the accompanying drawing, in which:
Existing multimedia application environments (MAE) do not provide true interactivity with streaming media applications. Once the server has begun to broadcast the media stream, each accessing client or user may typically only play the stream. Individually, each client may pause or cut access to the stream, but the paused client will continue from the real-time point of the media stream.
By selecting various functions provided on action panel 202, iMR 201 may preferably initiate a stream of data to iMCS 200. Therefore, unlike the process in
It should be noted that the iMAE that is established between iMCS 200 and iMR 201 is made possible by a programming model that exists within each one. The programming model on the server-side provides a method of specifying the resource and the duration of how long to play that resource and/or when to start within that media resource. Considering a media resource as merely a time-based resource (i.e., it starts at zero seconds and it has a specified duration), a developer may preferably provide to play a given media segment starting at 10 seconds and continuing for another 10 seconds. In this manner, using the server-side programming model, a developer may preferably issue multiple commands to create or edit a media stream (e.g., play media X for 10 seconds followed by media Y for one hour, and then switch to a live feed after playing media Y). Thus, a server-side interface is provided that makes the playlist editing and/or creation simple.
In addition to providing control and access to server-side developers, the client-side programming model provides methods to the client that are communicated to and executed by the server. Therefore, a user, through the client-side application program interface (API) may also preferably issue the scripts or commands that are executable by the server to play media X for 10 seconds followed by media Y for one hour, and then switch to a live feed after playing media Y in the same way as the server-side developer.
IMR 400 at client 103 may also instruct iMCS 401 to stop playing video from camera source 402 to play a multimedia datastream from electronic whiteboard 404. The instructor in the video may desire to write up certain formulae in real time for viewing by each subscribing client. Because the media stream at iMCS 401 now broadcasts the datastream from electronic whiteboard 404, each of clients 405-407 may preferably view the live writing in real-time. This operation illustrates the ability of iMR 400 and iMCS 401 to interleave live and recorded content and to do so “on-the-fly,” when the originating stream has already begun.
In additional embodiments, a user of any of clients 405-407 may wish to participate in the seminar by asking the lecturer a question. In such embodiments, microphone resource 403 may be made available to any or all of clients 405-407, or may be representative of a microphone peripheral attached to any one of more of clients 405-407. When a client, such as client 405, desires to ask a question, iMR 400 at client 103 may preferably instruct iMCS 401 to stop playing the media stream from camera resource 402 and play the audio stream captured from microphone resource 403. Because iMCS 401 is now streaming the live audio captured from the user of client 405, each of the subscribing clients may listen to the user's question. The lecturer may be set up to either hear the audio directly from microphone resource 403 or may have his or her own subscribed client (not shown) to hear the audio. Therefore, by utilizing the client side API of iMR 400 at client 103, a complete iMAE is established in which live media and pre-recorded media may preferably be assembled and broadcast in a single streaming media source.
Moreover, regardless of which format the media segments are stored or created in, each subscribing client only sees a common, single media stream playing on the iMR, such as MACROMEDIA'S FLASH™ PLAYER 6. Furthermore, the users at the subscribing clients preferably do not see or have to deal with changing the locations of the different media resources. The embodiments described herein preferably provide a single access point to the streaming media. Management of that media stream is preferably performed on the server-side, either by server-side developers or by client-side developers with, for example, ACTIONSCRIPT™ from MACROMEDIA'S FLASH MX™ development environment.
All media stream management is preferably directed by the programming model within an interactive multimedia development environment (iMDE). One example of a programming model capable of providing the features and elements of the embodiments described herein is MACROMEDIA'S ACTIONSCRIPT™ API. It should be noted that the features and elements described herein may also be programmed and controlled by other similar programming models and APIs. However, for purposes of this disclosure, ACTIONSCRIPT™ is used as an example in
In line 502, a communication stream is initiated between the publishing client and broadcasting iMCS 506. The first action performed in
In the ACTIONSCRIPT™ model shown in
Multiple streams may preferably be open over a single connection, but in the embodiment described herein using the example programming model of ACTIONSCRIPT™, each stream either publishes or plays. The publishing client represented in
Program segment 61 represents example code that may be used within the subscribing client. In lines 607 and 608, a connection is established between the subscribing client and broadcasting iMCS 605 at rtmp://myRTMPServer.myDomain.com/app. In line 609, a new stream is initiated on the connection. In line 610, the subscribing client plays video stream myWeddingVideo 606 being broadcast on broadcasting iMCS 605.
It should be noted that in different embodiments of the technology described herein, program code or script, such as that described in
Program segment 71 represents example code that may be used within the iMR. In lines 709 and 710, a new connection is established between the iMR and iMCS 714 at rtmp://myRTMPServer.myDomain.com/appMM. In line 711, a new stream is initiated over the connection. Line 712 adds a video object to the newly initiated stream. Finally, the client plays stream object 705 in line 713. Thus, the client subscribes to the stream being played at iMCS 714 comprising two recorded segments 706 and 707, and one live segment 708.
It is also possible to provide for clients to subscribe to streams published from an iMCS in which the stream may be live or recorded.
Program segment 81 represents example code that may be run from the iMR to subscribe to the published and recorded multi-source stream. Similar to the example from
When implemented in software, the elements of the present invention are essentially the code segments to perform the necessary tasks. The program or code segments can be stored in a computer readable medium or transmitted by a computer data signal embodied in a carrier wave, or a signal modulated by a carrier, over a transmission medium. The “computer readable medium” may include any medium that can store or transfer information. Examples of the computer readable medium include an electronic circuit, a semiconductor memory device, a ROM, a flash memory, an erasable ROM (EROM), a floppy diskette, a compact disk CD-ROM, an optical disk, a hard disk, a fiber optic medium, a radio frequency (RF) link, etc. The computer data signal may include any signal that can propagate over a transmission medium such as electronic network channels, optical fibers, air, electromagnetic, RF links, etc. The code segments may be downloaded via computer networks such as the Internet, Intranet, etc.
Bus 902 is also coupled to input/output (I/O) controller card 905, communications adapter card 911, user interface card 908, and display card 909. The I/O adapter card 905 connects to storage devices 906, such as one or more of a hard drive, a CD drive, a floppy disk drive, a tape drive, flash ROM, or the like to the computer system. Communications card 911 is adapted to couple the computer system 900 to a network 912, which may be one or more of a telephone network, a local (LAN) and/or a wide-area (WAN) network, an Ethernet network, and/or the Internet network implemented either using wireline and/or wireless transmission technology. User interface card 908 couples user input devices, such as keyboard 913, pointing device 907, or may also include input devices, such as touch-screens, telephone keypads, and the like, to the computer system 900. The display card 909 is driven by CPU 901 to control the display on display device 910, which may include devices, such as a computer monitor, a personal digital assistant (PDA) screen, a landline and/or wireless telephone, or the like.
Of course, it should be noted that in some embodiments, it may be beneficial to prevent everyone from being able to add media to the broadcasting streams. In these embodiments, access parameters may be established to grant rights for editing the streams.
Although the present invention and its advantages have been described in detail, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims. Moreover, the scope of the present application is not intended to be limited to the particular embodiments of the process, machine, manufacture, composition of matter, means, methods and steps described in the specification. As one of ordinary skill in the art will readily appreciate from the disclosure of the present invention, processes, machines, manufacture, compositions of matter, means, methods, or steps, presently existing or later to be developed that perform substantially the same function or achieve substantially the same result as the corresponding embodiments described herein may be utilized according to the present invention. Accordingly, the appended claims are intended to include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or steps.
This application is a continuation of and claims the benefit of the priority of U.S. patent application Ser. No. 10/353,811, filed Jan. 29, 2003, entitled “Client Controllable Server-Side Playlists”, and is hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
5751968 | Cohen et al. | May 1998 | A |
5805804 | Laursen et al. | Sep 1998 | A |
5841432 | Carmel et al. | Nov 1998 | A |
5892915 | Duso et al. | Apr 1999 | A |
5956719 | Kudo et al. | Sep 1999 | A |
6023271 | Quaeler-Bock et al. | Feb 2000 | A |
6044205 | Reed et al. | Mar 2000 | A |
6064379 | DeMoney | May 2000 | A |
6085252 | Zhu et al. | Jul 2000 | A |
6105072 | Fischer | Aug 2000 | A |
6112024 | Almond et al. | Aug 2000 | A |
6125369 | Wu et al. | Sep 2000 | A |
6148334 | Imai et al. | Nov 2000 | A |
6163796 | Yokomizo | Dec 2000 | A |
6216157 | Vishwanath et al. | Apr 2001 | B1 |
6330006 | Goodisman | Dec 2001 | B1 |
6397230 | Carmel et al. | May 2002 | B1 |
6453355 | Jones et al. | Sep 2002 | B1 |
6477580 | Bowman-Amuah | Nov 2002 | B1 |
6487564 | Asai et al. | Nov 2002 | B1 |
6549934 | Peterson et al. | Apr 2003 | B1 |
6631418 | Watkins | Oct 2003 | B1 |
6665865 | Ruf | Dec 2003 | B1 |
6744763 | Jones et al. | Jun 2004 | B1 |
6760378 | Conklin | Jul 2004 | B1 |
6763390 | Kovacevic et al. | Jul 2004 | B1 |
6801947 | Li | Oct 2004 | B1 |
6823394 | Waldvogel et al. | Nov 2004 | B2 |
6877010 | Smith-Semedo et al. | Apr 2005 | B2 |
6985932 | Glaser et al. | Jan 2006 | B1 |
6990497 | O'Rourke et al. | Jan 2006 | B2 |
6999424 | Kovacevic et al. | Feb 2006 | B1 |
7003570 | Messinger et al. | Feb 2006 | B2 |
7133922 | She et al. | Nov 2006 | B1 |
7149813 | Flanagin et al. | Dec 2006 | B2 |
7287256 | Lozben et al. | Oct 2007 | B1 |
7383289 | Kraft et al. | Jun 2008 | B2 |
20010004417 | Narutoshi et al. | Jun 2001 | A1 |
20010044851 | Rothman et al. | Nov 2001 | A1 |
20020055989 | Stringer-Calvert et al. | May 2002 | A1 |
20020065926 | Hackney et al. | May 2002 | A1 |
20020103815 | Duvillier et al. | Aug 2002 | A1 |
20020116716 | Sideman | Aug 2002 | A1 |
20020165907 | Dornquast et al. | Nov 2002 | A1 |
20030046431 | Belleguie | Mar 2003 | A1 |
20030061369 | Aksu et al. | Mar 2003 | A1 |
20030115268 | Esposito | Jun 2003 | A1 |
20030154239 | Davis et al. | Aug 2003 | A1 |
20030161324 | Clemens et al. | Aug 2003 | A1 |
20030187993 | Ribot | Oct 2003 | A1 |
20030221014 | Kosiba et al. | Nov 2003 | A1 |
20040032424 | Florschuetz | Feb 2004 | A1 |
20040098533 | Henshaw et al. | May 2004 | A1 |
20040215803 | Yamada et al. | Oct 2004 | A1 |
20050083401 | Mizutani et al. | Apr 2005 | A1 |
20060161516 | Clarke et al. | Jul 2006 | A1 |
20080320155 | Ganapathy et al. | Dec 2008 | A1 |
20090119594 | Hannuksela | May 2009 | A1 |
Number | Date | Country |
---|---|---|
2009003683 | Jan 2009 | WO |
Number | Date | Country | |
---|---|---|---|
Parent | 10353811 | Jan 2003 | US |
Child | 12580008 | US |