Some embodiments pertain to mobile broadcasting and mobile broadcasting services. Some embodiments pertain to enhancing mobile broadcasting services with rich media content.
Mobile broadcasting and mobile broadcasting services allow a user to watch television on a mobile device and conventionally have been limited to basic audio and video broadcasting. These mobile conventional broadcasting services have had limited functionality and have not been able to provide either rich service interactivity or rich media content. In other words, current broadcast solutions do not offer an in-band service level and interactive content as they are primarily based on basic audio and video capabilities. Rich media technologies, on the other hand, offer much needed interactivity that can tremendously enhance the user's experience with accurate synchronization of multiple media types including graphics, audio, video, images and text. In addition, rich media technologies also offer a rich set of animation and interaction functionalities not available in mobile broadcasting services.
Thus, there are general needs for mobile broadcasting systems and methods for enhancing mobile broadcasting services with rich media.
The following description and the drawings sufficiently illustrate specific embodiments to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. Examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in, or substituted for those of other embodiments. Embodiments set forth in the claims encompass all available equivalents of those claims.
In accordance with some embodiments, broadcast server 102 is a rich media-based broadcast server that comprises application layer 108 configured to generate and/or provide service guide 106. Service guide 106 may include, among other things, an indication of the capabilities for mobile subscriber terminal 104 to access and render rich media content. Service guide 106 may also include an indication of how to preview an interactive service in a rich media format or to preview rich media content in a rich media format. In some embodiments, service guide 106 may include an element to provide an entry point to an interactive media document with rich media content embedded therein to provide a rich service level interaction. These embodiments are discussed in more detail below.
Mobile subscriber terminal 104 is configured to receive service guide 106 as well as broadcast channels from broadcast server 102. In accordance with some embodiments, mobile subscriber terminal 104 may include physical layer 119 to transmit and receive signals from transmission network 110, and application layer 118 configured to implement one or more applications running thereon. Application layer 118 may include, among other things, broadcast client 115 to store service guide 106 after delivery by broadcast server 102 for use in receiving and displaying content of the broadcast channels. In accordance with some embodiments, broadcast client 115 may also include rich media engine 117 configured to access service guide 106, and render and/or display rich media content received from broadcast server 102.
In accordance with embodiments, the indication of the capabilities provided in service guide 106 may indicate the capabilities for rich media engine 117 to render the rich media content. In some embodiments, broadcast server 102 may be configured to include, as part of service guide 106, a notification message to indicate updates to service guide 106. The notification message may include rich media as a media type. These embodiments are also discussed in more detail below.
In some embodiments, mobile subscriber terminal 104 may be configured to access and render rich media content in mobile broadcasting system 100, and physical layer 119 may receive radio-frequency (RF) signals from broadcast server 102 through transmission network 110. The RF signals may include service guide 106, among other things. In these embodiments, rich media engine 117 within application layer 118 may access and render rich media content indicated by service guide 106. Service guide 106 may include an indication of the capabilities for rich media engine 117 to access and render the rich media content. Service guide 106 may also include information for obtaining and previewing a service or content in a rich media format.
Mobile broadcasting system 100 may be a mobile broadcasting system that operates in accordance with one or more mobile broadcasting techniques and/or specifications, such as the Open Mobile Alliance (OMA) Mobile Broadcast Services (BCAST) specifications, the Digital Video Broadcasting (DVB) specification for terrestrial (DVB-T), satellite (DVB-S), hybrid-satellite (DVB-H) and satellite-handheld (DVB-SH) of the European Telecommunications Standards Institution (ETSI), and/or the MediaFlo specifications of the Telecommunications Industry Association (TIA), although the scope of the embodiments is not limited to any of these techniques and/or specifications.
In some embodiments, mobile broadcasting system 100 may be part of a WiMax or a 3rd Generation Partnership Project (3GPP)-LTE (4G) communication system configured to provide mobile broadcasting services in accordance with the IEEE 802.16(e) or the 3GPP-LTE communication standards. In these embodiments, transmission network 110 may use orthogonal frequency division multiple access (OFDMA) as an access technique and for broadcasting, although the scope of the embodiments is not limited in this respect.
Although mobile broadcasting system 100 is illustrated as having several separate functional elements, one or more of the functional elements may be combined and may be implemented by combinations of software-configured elements, such as processing elements including digital signal processors (DSPs), and/or other hardware elements. For example, some elements may comprise one or more microprocessors, DSPs, application specific integrated circuits (ASICs), radio-frequency integrated circuits (RFICs) and combinations of various hardware and logic for performing at least the functions described herein. In some embodiments, the functional elements of mobile broadcasting system 100 may refer to one or more processes operating on one or more processing elements. For example, application layer 108 and application layer 118 may include one or more processing elements configured with software to implement the functions described herein.
Service guide 106 enables service and content providers 112 to describe the services and content that are made available or offered for subscription or purchase by a user of mobile subscriber terminal 104. A service guide, as used herein, may be any type of program guide. These mobile broadcast services, including content, may be provided over a broadcast channel or an interaction channel. Service guide 106 may also describe how to access the services. From the user's perspective, service guide 106 serves as an entry point to discover currently available and/or scheduled services and content. Service guide 106 may also provide an entry point for interactive services. Service guide 106 also models services, schedules, content, related purchase and provisioning data, and access and interactivity data in terms of service guide fragments used for entry. These service guide fragments may be Extensible Markup Language (XML) fragments, although the scope of the embodiments is not limited in this respect.
In some embodiments, service guide fragments 200 may include access fragment 202, session description fragment 204, preview data fragment 206, service fragment 208, schedule fragment 210, content fragment 212 and interactivity data fragment 214. Service guide fragments 200 may also include various purchasing and provisioning related fragments that are not illustrated. The functional connections between the fragments are not illustrated. Although the example of service guide fragments 200 illustrated in
Service fragment 208 describes, at an aggregated level, the content items which comprise a broadcast service. The service may be delivered to a user using multiple means of access, such as through a broadcast channel and an interactive channel. As part of a service guide, service fragment 208 forms a central hub referenced by the other fragments including access fragment 202, schedule fragment 210, content fragment 212 and a purchase item fragments (not shown). Together with the associated fragments, mobile subscriber terminal 104 (
Schedule fragment 210 defines the timeframes in which associated content items are available for streaming, downloading and/or rendering. This fragment references service fragment 208. Schedule fragment 210 may also defines the valid distribution and/or presentation timeframe of those content items belonging to the service, or the valid distribution timeframe and the automatic activation time of interactivity media documents associated with the service.
Content fragment 212 provides a detailed description of a specific content item. Content fragment 212 may define the type, the description and the language of the content, among other things. Content fragment 212 may be referenced by schedule fragment 210 and may reference preview data fragment 206 or service fragment 208.
Access fragment 202 describes how the service may be accessed during the lifespan of the service. Access fragment 202 includes or references session description information and indicates the delivery method. One or more access fragment 202 may reference service fragment 208 offering alternative ways for accessing or interacting with the associated service. For mobile subscriber terminal 104 (
Session description fragment 204 provides the session information for access to a service or content item. Session description information may be provided using either syntax of a session description protocol (SDP) in text format, or through a 3GPP Multimedia Broadcast Multicast Service (MBMS) user service bundle description. Auxiliary description information may be provided in XML format and may include an associated delivery description.
Preview data fragment 206 includes information that is used by mobile subscriber terminal 104 (
Interactivity data fragment 214 may include information used by mobile subscriber terminal 104 (
In accordance with some embodiments, interactivity data fragment 214 may provide a point of entry to an interactivity media document. The contents of an interactivity media document may trigger mobile subscriber terminal 104 (
Example 1 illustrates the use of an initial scene in the media object set with the associated MIME type and location. The location of the initial scene may be the location of the file delivered via the File Delivery over Unidirectional Transport (FLUTE) protocol (i.e., with a reference to the location in the File Delivery Table (FDT) or an arbitrary URI). Example 2 illustrates how an interactivity document may be made up with an initial scene followed by a set of scene updates packaged in a scene command group, which may be defined by the OMA RME specification. Example 3 illustrates the inclusion of rich media content using a 3GPP file which includes the scene and scene updates, which may be referred to as Dynamic and Interactive Multimedia Scene (DIMS) units.
In some DVB embodiments, the service guide fragments may include an acquisition fragment. In these DVB embodiments, a rich media element may be included as part of a component characteristic of the acquisition fragment to indicate the capabilities for rich media engine 117 (
Terminal capability requirement element 310 includes video element 312, audio element 314 and download file element 316. Video element 312 may describe the video codec capability related requirements, audio element 314 may describe the audio codec capability, and download file element 316 may describe the capability for a terminal to download files. In accordance with some embodiments, terminal capability requirement element 310 may also include rich media element 318 to indicate the capabilities for a mobile subscriber terminal to access and render the rich media content. For example, the capabilities indicated by rich media element 318 may be the capabilities that rich media engine 117 (
In these embodiments, rich media element 318 may be a sub-element of terminal capability requirement element 310. In these embodiments, rich media element 318 may indicate a number of animations, a number of embedded media elements, and a number of document object model (DOM) nodes to render a rich media scene. In XML DOM, each node is an object. In some embodiments, rich media element 318 may also indicate whether scene orientation management, scene update commands, scripts, and compression/encoding are to be used by the rich media engine 117 to render the rich media scene.
In some embodiments, access fragment 300 may be associated with one of a plurality of broadcast channels, and rich media element 318 may indicate the capabilities for rich media engine 117 (
In some embodiments, rich media element 318 may include complexity element 320 to indicate the complexity associated with the rich media content. In these embodiments, complexity element 320 may include one or more of animations element 321, embedded media elements element 322, scene orientation element 323 and/or DOM nodes element 324. Animations element 321 may indicate a number of animations in the rich media content. Embedded media elements element 322 may indicate a number of embedded media elements (e.g., audio or video streams) in the rich media content. Scene orientation element 323 may indicate whether the rich media content uses scene orientation management. DOM nodes element 324 may indicate a number of document object model nodes to render the rich media content.
In some embodiments, complexity element 320 may also include one or more of scene update commands element 325, scripting element 326, and/or compression element 327. Scene update commands element 325 may indicate whether the rich media content includes scene update commands to modify the rich media content. Scripting element 326 may indicate whether the rich media content includes scripts that modify the rich media content. Compression element 327 may indicate whether the rich media content is delivered compressed or encoded, or whether the rich media content is delivered in an XML or an original raw format.
In some embodiments, rich media element 318 may be included in access fragment 202 when the complexity indicated by the MIME type parameters in the SDP differs from the actual complexity. In some embodiments, animations element 321 may include an attribute to indicate the maximum number of animations in the rich media content. Embedded media elements element 322 may include an embedded video attribute to indicate a number of concurrently running embedded video elements in the rich media content. Embedded media elements element 322 may also include an embedded audio attribute to indicate a number of concurrently running embedded audio elements in the rich media content. DOM nodes element 324 may include an attribute to indicate the maximum number of active DOM nodes in the rich media content. Compression element 327 may include an encoding attribute to indicate the particular scheme to encode or compress the rich media content.
Rich media content, as used herein, may include, in addition to an audio-video broadcasted stream, at least some of animations, embedded media elements, scene orientation modes, and DOM nodes. Rich media content may comprise a scene and a set of scene updates, including features that are applied to the scene. For example, rich media content, in addition to a scene, may include scene-update commands, scripting and compression.
In some embodiments, an XML language, such as the Scalable Vector Graphics (SVG) language, may be used for the base content format for delivering rich media content when mobile broadcast system 100 operates in accordance with either the 3GPP DIMS specification or the OMA RME specification. In these embodiments, either the 3GPP DIMS of the OMA RME format may be used. SVG may be used for representing two-dimensional vector graphics and provided for scalability, interactivity, animations, and the ability to embed media such as raster images, in audio and video content. SVG-based rich media content may also be delivered by inclusion in other content formats, such as Synchronized Multimedia Integration Language (SMIL) and Compound Document Formats (CDFs). In some embodiments, W3C SVG Tiny 1.2 may be used as the rich media format. Other examples of rich media formats may include MPEG LASeR, W3C SVG, Adobe Flashâ„¢ and Microsoft Silverlightâ„¢, although the scope of the embodiments is not limited to any particular type of rich media format or any encoding of rich-media format.
In some embodiments, rich media element 405 may include rich media URI element 412 referencing the rich media clip and MIME type element 414 indicating a MIME media type of the rich media clip. Rich media element 405 may also include alternative text element 416 indicating alternative text to be displayed either when the rich media clip is not available or cannot be played by mobile subscriber terminal 104 (
In some embodiments, when Asynchronous Layered Coding (ALC) is used for delivery of the rich media clip, rich media URI element 412 may correspond to a content-location attribute in a file element in access fragment 202. When FLUTE is used for delivery of the rich media clip, rich media URI element 412 may correspond to a content location attribute in an FDT of the FLUTE session. When HTTP is used for delivery of the rich media clip, rich media URI element 412 may correspond to a request URI to be used in a request line of the HTTP request. When a Real Time Streaming Protocol (RTSP) is used for negotiation of the rich media clip delivery, rich media URI element 412 may correspond to a request-URI to be used in a request line of the RTSP request.
In some embodiments, MIME type element 414 may include codec attribute 422 to indicate the codec parameters associated with the MIME media type. In some embodiments, alternative text element 416 may provide alternate text in multiple languages. The language may be expressed in a built-in XML attribute.
In some embodiments, rich media element 405 of preview data fragment 400 may include encoding attribute 411 to indicate how the rich media data is embedded when the rich media data is not embedded into a character data (CDATA) section. In some embodiments, the encoding attribute 411 may be set to a specific MIME content transfer encoding scheme, such as Base 64 encoding, although the scope of the embodiments is not limited in this respect.
In some embodiments, access reference element 408 may include a usage attribute indicating that preview data files referenced by rich media URI element 412 are to be accessed from a file distribution session. In these embodiments, scheduling of the file distribution session may be signaled by a session description embedded in or referenced by an access fragment associated with preview data fragment 400. In these embodiments, access reference element 408 may indicate an ID of the access fragment specifying delivery of associated preview data via a broadcast channel during a file distribution session or a stream distribution session, although the scope of the embodiments is not limited in this respect. When the preview data files are not associated with a rich media clip, the usage attribute may indicate the preview data files referenced by a Video URI, Audio URI or Picture URI to be accessed from the file distribution session.
In accordance with some embodiments, media information element 504 may include picture element 512, audio element 514, video element 516 and rich media element 518. Rich media element 518 may define how to obtain particular rich media content and a MIME type of the rich media content. In some embodiments, rich media element 518 includes a MIME type attribute to indicate the MIME type, a codec attribute to indicate codec parameters for the MIME type, and a rich media URI attribute to indicate a URI that references the associated rich media content.
In some embodiments, notification message 500 may be a BCAST notification message provided in accordance with the OMA BCAST specification, although the scope of the embodiments is not limited in this respect. In other embodiments, notification message 500 may be provided in accordance with one of the DVB specifications referenced above.
Some embodiments may be implemented in one or a combination of hardware, firmware and software. Embodiments may also be implemented as instructions stored on a computer-readable medium, which may be read and executed by at least one processor to perform the operations described herein. A computer-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer). For example, a computer-readable medium may include read-only memory (ROM), random-access memory (RAM), magnetic disk storage media, optical storage media, flash-memory devices, and others. For example, application layer 108 and application layer 118 may include one or more processing elements configured with software to implement the functions and generate the various fragments and messages described herein.
The Abstract is provided to comply with 37 C.F.R. Section 1.72(b) requiring an abstract that will allow the reader to ascertain the nature and gist of the technical disclosure. It is submitted with the understanding that it will not be used to limit or interpret the scope or meaning of the claims. The following claims are hereby incorporated into the detailed description, with each claim standing on its own as a separate embodiment.