The invention relates to presenting content associated with broadcast program in a user terminal of a telecommunication system.
Media broadcasters, such as television and radio, have taken steps to provide audience with digital supplementary services, such a program information, news, weather information, competitions and other related content, in addition to a traditional media stream. These digital supplementary services are usually delivered over the Internet using audiences' personal computers or other devices capable of connecting to the Internet.
Radio and television stations often deliver content of the content providers through their service and collect revenues out of content sales. Already, broadcasters are offering ringing tones and logos on their web sites, which are delivered to a user from the content provider's system. The user is required to take up the task of navigating to the broadcaster web site to access the information on content available, and how to acquire or purchase it. The broadcasters have to promote the web address in the broadcast to attract users to visit the web site.
There are, however, problems related to acquiring, delivering and presenting broadcast related content by the listeners of the progam. Often, people do not have a PC with Internet access when they are receiving the broadcast. Additionally, navigating a way through a complicated Internet web structure to the correct service address is laborious and time consuming. Acquiring, for example, of a ringing tone requires the user to send a text message to a defined service number with a service code and content identification string. The service codes and identification strings are difficult to remember. The complexity in accessing the service results in a high barrier to connect a user to a service and low ratings of the service.
An object of the present invention to provide an improved method and related apparatus for presenting content associated with a broadcast program in the user terminal. The objects of the invention are achieved by a method and apparatus which are characterized by what is stated in the independent claims 1, 10, 19, and 27. The preferred embodiments of the invention are disclosed in the dependent claims.
The invention is based on the idea of arranging two reception modes, one for interactive user operations and one for the default operation executed according to a defined order timed according to the broadcast program. Furthermore, the transition from the mode for interactive user operations is disabled unless appropriately authorized.
An advantage of the invented solution is that the interactive operations are in control of the user and are thus not overridden by content timed or pushed to the user terminal for display.
In the following the invention will be described in greater detail by means of preferred embodiments with reference to the attached drawings, in which
The telecommunication system 110 provides the user terminal 150 with an access to external networks, hosts, or services offered by specific service providers. In the following, the invention will be described using the terms and elements of the combined structure of the GSM (Global System for Mobile Communications) and GPRS systems (General Packet Radio Service), and the telecommunication system is thus referred to as a radio system. The radio system 110 here refers generally to a telecommunications system that provides a wireless access to the system. Typically the access point of the wireless access can change when user terminals move within the service area of the system. A typical radio system is a Public Land Mobile Network (PLMN). The invention may, however, be applied in connection of any other mobile radio system that provides bidirectional data communication. Examples of such systems are PCS (Personal Communication System) and DCS 1800 (Digital Cellular System for 1800 MHz), TETRA (Terrestrial Trunked Radio), and third generation mobile systems, such as UMTS (Universal Mobile Communication System) and IMT-2000 (International Mobile Telecommunication System 2000). It should be noted that the invention can also be applied to fixed systems, for example to the PSTN (Public Switched Telephone Network), local area networks, and wide area networks, though the advantages of the invention are more imminent in mobile communication environment.
The content server 130 and the content creation tool 120 facilitate generation and/or delivery of information associated with the program service from the broadcast transmitting system 100 to the radio system 110 and vice versa. This information is provided to the user terminal 150 through the wireless access of the radio system 110, hereinafter referred as a parallel channel 160. This parallel channel 160 may be used to deliver information associated with the content of the program service of the broadcast transmitting system 100 for display in the user terminal 150 timed according to the broadcasted program.
A centre 200 represents a mobile services switching centre (MSC) and a serving GPRS support node (SGSN) that enable circuit-switched and packet switched signaling, respectively, in the radio system. The radio system may further comprise a gateway unit 202, which represents a gateway mobile service switching centre (GMSC) and a gateway GPRS support node (GGSN). The GMSC attends to the circuit-switched connections between the core network and external networks, such as a public land mobile network (PLMN) or a public switched telephone network (PSTN), and the GGSN attends to the packet-switched connections between the core network and external networks such as the Internet.
The centre 200 controls a radio access network (RAN) 204, which comprises at least one base station controller 206 that controls at least one base station 208. The base station controller 206 may also be called a radio network controller, and the base station may be called a node B. A user terminal 150 communicates with at least one base station 208 over a radio interface.
The radio system 110 is connected to a server 130 that in
The parallel channel is opened by creating a connection with the server 130. This is typically created from the user terminal. A packet switching method is suitable for data transmission where the data is transmitted in bursts. In such a case, it is not necessary to allocate a data link for the entire duration of transmission; only for the time it takes to transmit the packets. This reduces costs and saves capacity considerably. Thus, a packet data connection (GPRS) is shown in this embodiment, though basically a circuit switched connection is applicable as well.
Based on the received information from the broadcast transmitting system 100 the content creation tool 120 generates a first signal associated with information on the program service. The information can comprise, for example, an object identification relating to the media stream, data about the music played at the moment, a time table of the program, DJ's message to the listeners or the like.
The first signal enters a content server 130, which now serves as a gateway to the radio system 110. The content server 130 processes the first signal received from the broadcast system 100, and based on the received information on the program service generates a second signal that carries a content package comprising one or more content items for displaying on the terminal screen. The content server 130 feeds the second signal to the radio system 110, and the signal is transmitted to the user terminal 150.
It should be noted that the first signal from the content creation tool 120 to the user terminal 150 may alternatively be sent to user terminals utilizing the RDS (Radio Data System) provided that the user terminal has a receiver for the RDS signal. The RDS signaling can be utilized on the FM broadcast since the RDS information is encoded in the FM signal.
If the signal is sent to the user through the radio system, it should be noted, that the user does not mandatorily have to be able to receive or to be aware of the broadcast program; it is enough that the user can receive the content items through the parallel channel. Naturally in this case the user terminal 150 does not necessarily need to be equipped with a receiver of the broadcast system.
Primarily a content item is shown to the user according to a pre-defined order and timing, substantially synchronized to the program of the broadcast system it is associated with. For example, a content item showing the name and the artist of a song may be displayed in the user terminal at the moment the song starts playing in the broadcast. If more than one content items are associated with the program, their mutual structure and timing is generally defined as well. However, a user receiving the parallel channel or a RSD signal has furthermore an opportunity for interactive communication. In the embodied solution this opportunity is realized by providing the user with a on-screen button that is displayed in the user terminal 150. The on-screen button is incorporated in the displayed content item and corresponds to a content object identification so that pressing of the button initiates a request of uplink data transmission, and generates an uplink signal including a content object identification from the user terminal. The uplink signal is transmitted from the user terminal 150 through the radio system 110 to the content server 130 that forwards the request to a destination derived according to the content object identification.
For example, let us assume that the content item comprises an offer on a deliverable content object, which may be purchased over the air. The content object may comprise, for example, a text string, a picture, a video clip, an audio clip, a game, a logo, a screen saver, a ringing tone, or the like, a series of these or any combination thereof. The parameters required for delivering and purchasing are included in the object identification that has been received by the user terminal 110. If the user pushes the on-screen button in the screen, an uplink signal is generated, and forwarded to the object provider's delivery system, using the parameters comprised in the object identification. If the object provider is an operator, the object can locate in an object database 170, which may thus be a part of the radio system 110, as shown in
Broadcast Transmitting System
The broadcast transmitting system 100 of
A broadcast content delivery module 102 generates and transmits the media stream comprising the broadcast program to a broadcast receiver 412, such as FM radio receiver, TV set receiver, or the like. The receiver may also be comprised in the user terminal 150. The broadcast content delivery module 108 of a radio station typically comprises a sophisticated digital content management system to compile and run a broadcast program. Examples of such content management systems are RCS's Master Control and Jutel's RadioMan. A broadcast may include FM transmission, AM transmission or digital radio or television transmission, or the like.
The timing information module 104 generates timing information for synchronizing the contents in the broadcast channel and in the parallel channel. The timing information module 102 embodied here may provide, for example, information on the starting time and the ending time of a particular program, as well as information on timing of advertising breaks etc.
The dynamic content delivery module 106 may provide additional dynamic content information related to the broadcast program. Such dynamic content information may comprise, for example, results of events in the broadcast, such as the name of a winner in a quiz show, or the like. If such content information is generated during the program, for example, in live events, sports coverage or in broadcast radio, the content information is transferred to the content creation tool 120 by the dynamic content delivery module 106. In addition, the dynamic content delivery module 106 may receive interaction results from the content server 130 to be used as part of the broadcast, for example, to display the results of a vote on the TV as a video overlay.
The broadcast transmitting system 100 may also provide a user interface 106. The user interface 106 is used for outputting the received interaction results from the content server 130 to the broadcasting personnel.
Content Creation Tool
The content creation tool 120, which in this embodiment can also be called a visual radio tool, allows creating a visual, acoustic or tactile presentation and manage presentation of it in the user terminal timed according to the broadcast program. The content creation tool 120 forms the content items that are provided to the user terminal for outputting. In addition, the content creation tool allows managing interactive elements, such as delivering and purchasing objects, voting and quizzes. The content creation tool 120 may locate in the broadcaster's premises, for example in a radio or in a television station, and be integrated to the broadcast transmitting system 100 so as to form an integrated broadcast system. The content creation tool 120 may also be used to define a user navigation structure within the parallel channel. The user navigation structure refers to a sequential order of a group of content items associated with the same program, or of object identifications in the same content item.
The content creation tool 120 comprises a content structure tool 122, content packaging module 124, and a feedback module 126. The content structure tool 122 may receive information from the dynamic content delivery module 106, and from the timing information module 104 of the broadcast transmitting system 100. The content structure tool 122 attaches timing to content items so that a content item may be output in a user terminal 150 synchronized to the media stream of the broadcast program (for example, show the identification of this object on the screen of the user terminal at 14:43:02 after the beginning of the program). The content structure tool 122 provides the layouts for displaying the content items, thereby defining their appearance on the screen. Furthermore, the content structure tool 122 may define the delivery of content items to the user terminal in accordance with the broadcasting time line of the media stream.
The content packaging module 124 may receive information from the dynamic content delivery module 106, and from the timing information module 104 of the broadcast transmitting system 100. Based on the content structure definition by the content structure tool 122, it creates a content package for delivery to the user terminal 150, comprising content items carrying the individual content objects to be displayed, such as text strings, graphic file objects, animations, video clips, etc.
The feedback module 126 is arranged to the content creation tool 120 for processing the interaction signals from the users. User responses that are sent from the user terminal through the radio system to the server 130 are fed to the feedback module 126 in the content creation tool 120. Based on the responses, the feedback module 126 formats a presentation that may be fed to the broadcasting personnel through the dynamic content delivery tool 106 and user interface 108 of the broadcast transmitting system 100, or as a new dynamic content item to be included in the broadcast program.
Content Server
The content server 130 provides an access point and thus controls the content flow to and from the user terminal. It facilitates a timed delivery of content items and/or packages to the user terminal, as well as collecting and forwarding of interaction results from the radio system 110 to the broadcast system 100. The content server 130 may also control, and if necessary limit the number of users using the parallel channel at the same time.
The content server comprises a content delivery engine 132, an interaction engine 134, and a synchronization engine 136. The content delivery engine 132 receives a content package comprising one or more content items created by the content packager 124 of the content creation tool 120. The content package is fed from the content delivery engine 132 to the interaction engine 134, which sends a signal comprising said content package through the radio system 110 to the user terminal 150. Prior to sending the content package the content may be adjusted to the capabilities and the screen size of the receiving user terminal. This requires that the capability information of the user terminal has been signaled to the content server, for example, at connection setup.
It is possible that one content package is associated with one program and delivered to the user terminal before the program starts. This is appropriate when dealing with pre-planned and recorded shows and programs, where the content and content timeline are relatively accurately known in beforehand. The content associated with one program may alternatively be delivered in a package that contains both the user terminal software module in a suitable format, such as a Java MIDlet and the content package for a particular program. In this case, dynamic content may be delivered in addition to the preliminarily delivered content package to deal with variations in content during the broadcast. Alternatively, the package may correspond to a segment of the program. This approach is suitable for, for example, FM radio, where the play list is often more dynamically designed.
The synchronization engine 136 receives timing information from the timing information module 104 of the broadcast transmitting system 100, and utilizes that to manage the transmission of content packages to the user terminal. In addition, the synchronization engine 136 allows the user terminal 110 to synchronize their clocks to broadcast system time references by running a synchronization algorithm. These control events may be communicated through a synchronization engine 136 to an interaction engine 152 of the user terminal 150 and the synchronization engine 320 may thus adjust parallel channel timing accordingly.
The interaction engine 134 receives responses from the user terminal and forwards them to the content object provider according to the received object identification. In addition, the interaction engine 134 may collect the interaction responses from the user terminals and feed them to broadcast transmitting system 100 through the feedback module 126 of the content creation tool 120, dynamic content delivery module 106 and user interface 108 of the broadcast transmitting system 100. The interaction engine 134 may also create and store statistics of the number of the users as well as the activity to participate in interactions.
Mobile
The user terminal 150 includes a specific software module (400 to 410) for providing the parallel channel functionality. This module can be implemented using a native operating system such as, for example, Symbian, or using a programming environment, such as, for example, Java MIDP.
A content package from, for example, the server interaction engine 134 or as a broadcast is received to the user terminal 150 through the interaction engine 400. The received content package is stored in a local memory, a content storage 402. The content packages may be stored in a content storage 402 as a background process, so that content information is available for a content processor 404 and for a rendering engine 406 when needed. Default information can also be stored in content storage of the local memory 402 to be shown in case dynamic content for some reason is not available to the user terminal 150.
The rendering engine 406 provides visual, acoustic and/or tactual effects to be output according to the content item to the user.
The reception of the parallel channel can be initiated in several ways. The user may activate a functionality, which enables the user terminal to receive and display the content items coming from the broadcast system either through the radio system, or as an RDS broadcast. If the user terminal includes a broadcast receiver, instead of manual initiation, the user terminal may also be programmed to automatically initiate the reception of the content items over the parallel channel and display them on the terminal screen whenever the user selects a particular broadcast channel.
In initiating the reception of the parallel channel in the user terminal 150, the user terminal 150 transmits information about itself to the content server 130. The information may comprise data indicating the variant of the user terminal, which enables adjusting the content items to contain, for example, graphic objects optimized to the capabilities of the particular user terminal.
The timer controller module 408 may run a synchronization algorithm with the content server 130 to synchronize an internal clock of the user terminal to the internal clock of the server. A simple synchronization algorithm can be used, based on calculating round trip delays of requests sent to content server 130 by the user terminal 110, and on calculating the difference between the user terminal clock and the server clock. Once the user terminal 150 has performed synchronization and the starting time of a program is known, media stream timeline references may be translated to references in the internal clock of the user terminal 150.
The timer controller module 408 is thus aware of whether the program has already started and what is the current time line position. If the program is running, the timer controller 408 may thus automatically find a correct content item in the parallel channel to be displayed in the user interface 410.
Once the use of parallel channel is activated and the user terminal has received a content item to be shown at a particular time, the content processor 404 may start executing. The processor 404 reads the content structure definition in the content storage 402 to determine the current content item to be displayed and communicates the content item and a related layout to the rendering engine 406 for display in the user interface 410. Based on the content structure definition, the content processor 404 informs the timer controller module 408 to create timer events, for example displaying of a next content item according to content structure. In such a case the processor 404 reads the structure definition in the storage 402, determines the content item to be displayed, and a related layout, and sends them to a user interface 410 to be displayed. A combination of the content item and a layout is hereinafter called a slide.
When the displayed slide provides a possibility for the user to interact, for example, by means of selecting an on-screen button, entering text to a text entry slot, or a defined key combination, or the like, a signal having information on the action is communicated from the user interface 410 to the content processor 404. The content processor 404 analyses the action and based on the analysis triggers a related transaction. The signal of the user action is communicated from the content processor 404 to the interaction engine 400 of the user terminal, which transmits the signal through the radio system 110 to the database 170 and possibly also to the interaction engine 134 of the server 130. In case the interactive action is activated using an object identification, the user activity triggers communication from the user terminal 150 to the server 130 automatically and the user does not need to know a long list of service numbers, service codes or identification strings.
In practice there has appeared a problem with the parallel usage of alternative types of content. As the processor 404 reads the structure definition in the content structure memory 402, and sends the current content items and layouts to a user interface 410 to be displayed it follows an order pre-defined with the content creation tool. If the display, due to this, is suddenly changed, while the user is still in the middle of an interactive procedure, for example activating a purchase request, paying a purchase, or viewing some information, this creates irritation, and possible uncertainty of the payment operation. This has been considered to severely degrade the user experience of the proposed solution This is overcome in the embodied solution as shown in
The second mode primarily relates to a user interaction, more specifically the user terminal interacting with the content server 130 or servers accessible to it and thereby retrieving information or content objects from external service providers (browsing). Preferably this is realized with the help of a displayed content object identification, as disclosed earlier. However, it should be noted that one content package may comprise a structure that, in addition to the pre-defined, synchronized structure, provides alternative sequences of content items for the user to choose from. Accordingly, even though there is no interaction for data retrieval with the server, the terminal may, in such a case, operate in the second mode.
However, in case the user activates the on-screen button (step 510), the user terminal will change into the second mode (step 530). It may be possible that additional user action, for example in the form of confirming the transaction is necessary (step 535). If the confirmation is not received, the procedure will continue from step 555 by checking whether the transition back to the first mode is authorized by the user. If the confirmation is received, the specific module of in the user terminal 150 sends a transaction signal (step 540) to the database 170 of the object provider. In the database 170 of the object provider the user terminal is identified by the received transaction signal. The database sends in return to the request a signal with the ordered object using a suitable delivery channel of the radio system. When the user terminal 110 receives (step 545) the signal with the object it notifies the user. The object can be saved in the memory of the user terminal and shown to the user. While the transaction is ongoing the timer is not checked and even if the threshold T1 of the first slide would be exceeded, the interactive procedure will not be interrupted. After the transition is completed, the inactivity timer of the user is reset (step 550) and it is checked whether the transition back to the first mode is authorized by the user (step 555). If the authorization is explicitly received by a user action the procedure will immediately continue from step 570 by determining, according to the timing of the slides, which slide should be displayed, and then move to step 520 of retrieving the slide from the content storage for display. If the authorization is not received, it is checked (step 560) whether the inactivity timer t2 has exceeded a pre-defined threshold T2. If not, the procedure will continue from step 535 by waiting for new information from the user. If yes, the procedure will continue from step 570 by determining, according to the timing of the slides, which slide should be displayed, and then continue from step 520.
The procedure of
In
In the options presented in
The other possibility to continue from slide S41 is to answer to the question by activating the on-screen button of S41, which leads the procedure to slide S45. In
In the first embodiment the order defined by the media system was the pre-defined timing of the slides. In some systems the content may also be pushed spontaneously from the server to the terminal, which in conventional operation will override any other content viewing in the terminal. In the invented solution such overriding may happen only if the terminal is in the first mode, and therefore open for the new display order as pushed by the system. If the user terminal is in the second mode, the display status will not change unless appropriately authorized. The authorization may be given as described earlier, for example, by the user action, user inactivity, or an incoming signal.
In case of active push services, the user terminal may be arranged to give an indication of the new content to the user, for example in form of a signal tone, flashing of the keyboard, or sign may appear in a particular information section of the screen. In noticing this, the user may decide whether to interrupt the ongoing browsing activity to check for the new incoming information, or finalize the activity before entering the new display order provided by the content server.
In the first embodiment the first and of the second mode have been implemented by the user terminal. It is also possible that the operation modes are arranged into the content server 130. In such embodiment, the mode selection module 414 of the user terminal 150 is configured to generate and transmit a signal to the content server 130 whenever a mode transition occurs in the user terminal 150. In response to the received indication the content server 130 will either spontaneously resume pushing new content to the user terminal (second mode->first mode), or refrain from pushing new content to the user terminal (first mode->second mode).
The flow chart of
At presenting the content it is checked whether the terminal currently operates in the first mode or in the second mode (step 840). If the terminal operates in the first mode, it is checked (step 845) whether the timing indicates that a new presentation element is necessary (step 850) or not. A presentation element refers to a group of effects that at one time may be output from the terminal without causing disturbing interference. A presentation element typically corresponds to a content item, and in principle an implementation specific definition. Such a presentation element may comprise, for example, a slide of a display, comprising a content item and a template. Such a presentation element may also comprise a short clip of a song played with the loudspeaker of the terminal, or a combination of simultaneous rhythmic blinking of the keyboard light and vibration of the terminal. For a person skilled in the art there are various possibilities for defining presentation items, and any such variations fall in the scope of the present invention. In case it is considered that some functionality, for example incoming call, does not cause disturbing interference, it is not considered part of presentation element, and appears neutral to the operation modes described herein.
If a new presentation element is necessary, new content will be retrieved, basically from the content storage (back to step 830). If no, the presentation of the current slide will continue. If the terminal operates in the second mode, it is checked (step 855) whether the user has entered a user activity. If yes, content will be retrieved, basically from the content storage or through a session with an access point (back to step 830). If no, the presentation of the current slide will continue.
It will be obvious to a person skilled in the art that, as the technology advances, the inventive concept can be implemented in various ways. The invention and its embodiments are not limited to the examples described above but may vary within the scope of the claims.
Number | Date | Country | Kind |
---|---|---|---|
PCT/IB02/02537 | Jul 2002 | WO | international |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/FI03/00287 | 4/14/2003 | WO | 10/19/2004 |
Number | Date | Country | |
---|---|---|---|
Parent | 10126623 | Apr 2002 | US |
Child | 10511771 | Oct 2004 | US |
Parent | 10319475 | Dec 2002 | US |
Child | 10511771 | Oct 2004 | US |