Patent Grant
9560401
This Application is a Section 371 National Stage Application of International Application No. PCT/EP2008/050906, filed Jan. 25, 2008 and published as WO 2008/095800 on Aug. 14, 2008, not in English.
None.
None.
The field of the disclosure is that of creating and transmitting multimedia content on a radiocommunication terminal, e.g., of the wireless telephone, PDA (“Personal Digital Assistant”), laptop computer type, etc.
A multimedia content is understood to mean, in particular, a set consisting of at least one animated graphic scene, which is also called a multimedia scene, and a series of commands enabling this scene to be played from one state to another. A multimedia scene corresponds, in particular, to the arrangement of a set of graphic objects in time and space, with which the user of the radiocommunication terminal can interact. This arrangement is described using vocabulary dependent on the scene description format. The scene vocabulary can be used in textual descriptions or in binary descriptions. In an XML-format textual description, the vocabulary words are the names of the elements used in the description. In a binary description, the words are the binary objects, used in the description.
The disclosure finds applications in all fields requiring a representation of the signals in the form of a space-time arrangement of graphic objects with interactivity.
The disclosure applies in particular to already known graphic scene description formats such as MPEG-4/BIFS (“Binary Format Scene”), SVG (“Scalable Vector Graphics”), SMIL (“Synchronized Multimedia Integration Language”), XHTML (“Extensible HyperText Markup Language”), etc.
Several devices currently exist for converting a textual multimedia scene description into content viewable by a user, among which are included:
Among the above-mentioned techniques, the most widely used is of the Encoder type. It does nothing more than to translate a set of multimedia instructions expressed in one format F1 into another format F2, which format F2 being generally more compressed than the first format F1.
One disadvantage of this technique lies in the fact that it does not enable the author to translate a set of graphic scenes into an executable code which will generate content according to the execution context. Therefore, this technique is not suited to generating dynamic content.
The most advanced technique defines how a dynamic publishing engine device interprets a document and constructs content intended to be broadcasted directly, i.e., in the format used for the scene description portion of the initial document. In the following examples, such a format, for example, is an XML or HTML text format exempt of the scripts to be executed on the server.
For example, Server Pages technologies (e.g., Active Server Pages™ or XML Server Pages) supply a server script development environment for creating Web server applications, which are both dynamic and interactive. The author can associate XML or HTML pages and the script commands for creating interactive Web pages or powerful Web-based applications. The majority of active page technologies (ASP, PHP etc.) are based on an interpreted code, the execution of which requires many resources in order to provide the answer.
Java Server Pages (JSP) technologies are differentiated by the fact that they are compiled only in the case where the Java Server Pages script has been updated. These JSP technologies are faster running than completely interpreted technologies.
However, in every instance, the document is interpreted at the moment of the user request, which makes a priori validation of all of the content difficult.
In addition, these techniques do not enable a priori validation of a “dynamic service,” i.e., a set of dynamic content and navigation rules which connect said dynamic contents, and even less the operation of the content generating system as a whole.
Furthermore, interpreting at the moment of the user request makes any management of the media used in the service difficult or impossible, especially if the references to these media are created by script commands.
Finally, another disadvantage of JSP technologies is due to the fact that all of the vocabulary words of the description of the service must be words of the final language. It is not possible to make extensions, in the description of the service, which would not be compatible with the final language.
Application design methods also exist which are based solely on a programming language. It is actually possible to include a series of modules in a computer program the functions of which encompass:
These approaches enable any type of service to be created, including a very complex mixture of data presentation and computations, which may be required in a game-type application.
On the other hand, these approaches are extremely costly in terms of development time and are poorly suited to broadcasting over a broad range of different terminals, because each application must be tested on each type of terminal.
Finally, techniques based on compiler-type devices only enable a executable code to be generated, the computer languages used at the input often describe basic instructions interpreted and executed by the execution environment and not content-creating rules, and cannot therefore be used within the framework of creating dynamic content.
An aspect of the present disclosure relates to a method of transmitting at least one content representative of a service, from a server to a terminal.
According to an embodiment of the invention, such a method includes:
In this way, the method according to an embodiment of the invention makes it possible to transmit binary content representative of a service to a terminal, in response to a request by same, while having carried out a service preparation phase in advance.
This preparation phase first consists in creating the service in question, by means of a service creator, and in providing this service to the transmitting server.
This provisioning step consists in making a service available to the transmitting server which is either created “internally”, within the server itself, in a service design environment, or created in a design environment external to the server, such as a computer or server dedicated specifically to the creation of services.
In the first case, the provisioning step consists in transmitting a service within a single server, and, in the second case, this step consists in providing the server with a service which was created “externally” with regard to this server.
The created service is advantageously in the form of a textual description comprising a text portion and at least one program instruction.
Once the service has thus been created and made available to the server, it undergoes a translation step, within a so-called compilation environment. This translation step consists in converting the textual description of the service into a service program, comprising executable instructions.
This translation step likewise occurs in the transmitting server.
This phase of preparing the service, prior to transmission, enables a considerable time gain in processing the response to the request by the terminal, the service being already pre-processed and “ready” to be executed in the form of a service program.
In addition, the creation of this service program enables binary data to be generated dynamically, in the next execution step, without passing through a language such as XML, thereby making it possible to significantly economize on the memory required for transmitting content representative of a service.
The phase of transmitting the content representative of a service itself includes several steps, which are initiated on receipt of a request coming from the terminal receiving the content.
The first step first consists in executing the service program on the server, thereby delivering or generating content in the form of binary data.
This binary data thus generated is then transmitted to the terminal in response to the request by same.
Said step of executing said service program on said server preferably includes a sub-step of identifying an execution context associated with said terminal, providing at least one characteristic of said terminal, which is taken into account for generating said binary data transmitted to said terminal.
In this way, the transmitting server will take account of certain characteristics of the terminal, which are contained, for example, in the request issued by same, in order to create an execution environment for the service program, and to thereby adapt the execution to the terminal in question. This step of identifying an execution context thus makes it possible to optimize the service program execution step, while taking account of characteristics of the terminal.
The server will likewise take into consideration characteristics related to the service in order to create this execution context.
Said translation and execution steps advantageously implement a single programming interface, making use of scene vocabulary used in said textual description of said service.
Thus, the translation step will in particular determine whether the textual description of the service is consistent with a scene vocabulary. Thus, the terms belonging to this vocabulary will be used to translate the text into instructions, by means of a programming interface. For example, the translation step will use a dictionary comprising the terms of the scene vocabulary and the corresponding instructions.
In addition, the service program is also consistent with this scene vocabulary. Thus, the service program execution step will use this same programming interface, making use of the same scene vocabulary, in order to interpret and execute the instructions.
According to one particular aspect of the method according to an embodiment of the invention, said scene vocabulary includes elements referring to at least one type of media.
Thus, the scene vocabulary enables reference to be made to audio or video.
According to another aspect of the method according to an embodiment of the invention, at least one of said program instructions relates to at least one multimedia object.
For example, the program instructions can enable creation of a video object (e.g., a “clip”), or an audio object (e.g., a musical interlude or “jingle”).
According to another particular embodiment, at least one of said program instructions relates to at least one address pointing to at least one multimedia object or other content.
Thus, the program instructions make it possible to make use of multimedia (audio, video, . . . ) objects or content which are not directly described in the service, but which are accessible by means of addresses, e.g., a “URL”.
Said transmission step advantageously includes a step of multiplexing said binary data of said content, at the server output, with binary data generated independently of said content.
Thus, the method according to an embodiment of the invention enables the server to transmit, to the terminal, content representative of a service, into which other data has been integrated, e.g., audio or video data. This binary data is multiplexed with service data in order to form a “complete” content to be transmitted to the terminal.
According to yet another particular embodiment, said transmission and execution steps are carried out in parallel so that said binary data is transmitted to the terminal as it is being generated.
Thus, parallelization of these transmission and execution steps enables continuous-mode transmission, which is also called “streaming,” of the content representative of the service, as the binary data is being generated on the server. This makes it possible, in particular, to begin transmitting content to the terminal even if the entire service program has not yet been executed on the server.
Said preliminary preparation phase of said service advantageously includes a step of controlling said scene vocabulary, prior to said translation step, thereby verifying that said text portion corresponds to elements of said scene vocabulary.
In this way, this control step will make it possible to validate whether the service has been created while respecting the chosen scene vocabulary, and will enable facilitation of the translation of the textual description of the service, either by eliminating the elements of the description which are not consistent with the vocabulary, or by correcting same.
In addition, according to one particular embodiment, said preliminary preparation phase of said service includes a step of controlling said program instructions, thereby verifying whether said program instruction or instructions correspond(s) to computer program instructions which are directly convertible into binary code sequences capable of being executed by said server.
This control step makes it possible to verify whether the program instructions present in the description of the service are consistent with server-executable instructions. There again, this step makes the translation step easier.
Said preliminary preparation phase of said service advantageously includes a step of converting said text portion into program instructions using said same programming interface.
Thus, this conversion step uses the same programming interface as that used in the translation and execution steps.
Finally, according to yet another particular embodiment, said preliminary preparation phase of said service includes a consistency control step, which verifies whether said program instructions of said description are consistent with those resulting from said conversion step.
In this way, the method can verify whether the instructions do not make use of elements not present in the textual description, for example. In addition, this step can verify whether the conversion step has generated instructions consistent with the instructions present upon creation of the service.
An embodiment of the invention likewise relates to a device for transmitting at least one content representative of a service from a server to a terminal.
According to an embodiment of the invention, such a device includes:
In particular, such a device is capable of implementing the transmission method according to an embodiment of the invention, as described previously.
Such a device, for example, is a service server capable of transmitting content representative of a service to a terminal.
An embodiment of the invention further relates to a computer program product which can be downloaded from a communication network and/or recorded on a machine-readable medium and/or executed by a processor, characterized in that it includes program code instructions for implementing the transmission method as described previously.
Other characteristics and advantages will become more apparent upon reading the following description of one particular embodiment, given for non-limiting and illustrative purposes, and from the appended drawings, in which:
1. General Principle of an Embodiment of the Invention
The general principle of an embodiment of the invention consists in describing a method of converting a description of multimedia scenes into a system code, the execution of this system code then generating binary multimedia data in a content also referred to as a dynamic service.
The method according to an embodiment of the invention consists in providing an author with tools for generating an executable code which can be understood directly by a computer system on the basis of a scene description. The execution of this code will then produce a set of contents which will depend on the execution context of said code, i.e., of both the service and the client requesting to use this service. These contents are referred to as dynamic.
The various steps of the method according to one particular embodiment of the invention are introduced in relation to
The various steps can be grouped into 2 phases:
The first preparation phase 31 includes two steps, which enable a service program to be generated.
The first step 311 of providing a service consists in designing and creating a service, which is intended for use by a terminal having requested same. This step can be carried out internally within the transmitting server, or externally.
In both cases, a service, which is represented in the form of a textual description, comprising a text portion and at least one program instruction, is made available to the server for the second step 312 of translating this service into a service program.
This step consists in converting the textual description of the service into instructions executable by the server, in the form of a service program.
The second transmission phase 32 likewise includes two steps which, in response to a request by a terminal, make it possible to provide a binary content and to transmit it to the terminal.
The first step 321 of executing the service program consists in converting the service program into binary data while executing it. This binary data forms the content to be transmitted to the terminal in a second transmission step 322.
The step of designing a service, according to one particular embodiment of the invention, is presented hereinbelow in relation to
Generally speaking, an authoring tool called Studio 11 creates and/or acts on a textual description of a dynamic service 12. The description of said dynamic service 12 is then compiled by an Interpreter 13, which is based on a Dictionary 14 for matching up the elements stated in the description of dynamic services and the corresponding program instructions. The result of the compilation is a dynamic service 15 in executable code 16.
2. Designing a Dynamic Service
2.1 First Embodiment
The various steps of designing a dynamic service, according to a first embodiment of the invention, are introduced hereinbelow in relation to
Owing to the Studio tool 11, the author will make multimedia presentations within which the graphic objects have dynamic behaviors.
The author also expresses navigation rules enabling a user to navigate between the various presentations.
All of the dynamic contents and the navigation rules interconnecting them are hereinafter designated by the term dynamic service.
In the design step, the form of the description of the dynamic service 12 is a textual form, wherein program instructions are inserted into a declarative textual description using a LASeR-type vocabulary.
An Interpreter tool 13, which, in particular, is responsible for the binary generation of the textual description of the dynamic contents, is input with the graphic elements, graphic arrangements and navigation rules expressed by the author. This Interpreter 13 constructs a set of executable codes 16, which are also called binary data, on the basis of a Dictionary of instructions and rules 14, which is also called a vocabulary, which makes it possible to:
The set of executable codes is then inserted into the execution environment of the service Server 23.
2.2 Second Embodiment
In one particular mode of implementing an embodiment of the invention, the dynamic service textual description 12 is subjected to a text editing step by a service designer desiring to overcome the limitations associated with the authoring tool Studio 11.
2.3 Third Embodiment
In another mode of implementing an embodiment of the invention, the dynamic service textual description 12 consists of a LASeR ML (“LASeR Markup Language”) description, i.e., the statement of the content of an interactive multimedia scene in LASeR format, with LASeR scene elements and attributes and LASeR scene modification commands.
In this description, Java program instructions are inserted, as described below in one example:
These Java instructions can refer to:
In this description, “<%” and “%” define program instruction regions. The first region corresponds to package imports containing all required libraries, the second one creates an object enabling properties to be obtained, and the third one examines the background color.
In this description, an attribute is described in XML, and the value thereof is defined in program instructions (in Java here).
In particular, this enables the author to freely define the elements, attributes and contents in one or the other of the formalisms, or even to define them partially in one formalism and to complete them in another.
For example, the description extract below implements a reference to an element encompassing a program instruction:
3. Examples of Interpreter Tools According to Various Particular Embodiments of the Invention
In a first possible mode of implementing an embodiment of the invention, the Interpreter tool 13 consists of:
In one preferred mode of implementing an embodiment of the invention, the Interpreter tool 13 consists of:
The steps of transmitting a dynamic service designed as previously described, according to one embodiment of the invention, will now be introduced in relation to
The terminal 20 requests content from a service Server 23 following interaction with a user who generates a request 21.
The service Server 23 selects the execution environment 24 and executes the executable code 16, i.e., the various instructions contained in this code.
These various instructions make it possible, in particular, to take account of the following various parameters:
These various parameters can be taken into account in a variable order, based on the service, with, in particular, account being taken, on several occasions during the execution step, of a single parameter, based on the account taken of the previous parameters.
Therefore, the execution step follows a logic for binary generation of the scene description resulting from the account taken of the various logics above.
The server then sends content to the terminal 20, which describes the space-time arrangement of the graphic objects, which constitutes the response 22. All of these steps are then repeated as many times as necessary in order to respond to the successive requests by the user.
In one particular mode of implementing the service Server 23, a multiplexing phase follows the binary generation phase.
Over the course of the service lifetime, a set of binary scene description packets are generated, and a set of packets containing media frames, which are generally audio or video, are sent via a single communication channel.
This multiplexing phase contains a step for scheduling the sending of the packets which were entrusted to the multiplexer, and then a step for interleaving the various types of packets in a manner optimal to the user experience.
The method, according to at least one embodiment of the invention, enables an author to validate a dynamic service, i.e., a set of dynamic contents and navigation rules which connect said dynamic contents, prior to deploying this service. This is then referred to as “a priori validation”.
The method, according to at least one embodiment of the invention, likewise enables an author to ensure optimal operation of the executable code representing a dynamic service, by reducing the weight of the intermediate steps, and in particular by reducing the volume of the character strings to be processed in order to execute this service.
In addition, the method, according to at least one embodiment of the invention, makes it possible to obtain a gain in expressiveness in content creation, because the author of the service benefits from an integrated mechanism enabling same to simultaneously process the content presentation, the interpretation of the instructions executed within the execution environment and the generation of these contents in dynamic mode.
The method, according to at least one embodiment of the invention, enables a reduction in memory and the use of computing resources for the execution of a dynamic service by storing in memory and executing only the executable code generated. Contrary to conventional publishing engines, the interpreter of the documents in executable code is not required during execution.
According to at least one embodiment of the invention, the method advantageously enables the obtainment of a gain in the implementation of the publishing system: the use of a device which integrates a Compiler, an Encoder and a Publishing engine makes it possible to simplify the process of editing said content. This ensures that the author has an integrated environment, thereby enabling same to generate dynamic services in a single interface and to validate the complexity, consistency and operation of these services, without deployment on a publishing server platform.
According to at least one embodiment of the invention, the method likewise makes it possible to obtain compatibility with conventional execution environments, while being capable of generating an executable code which is compatible with any compatible execution environment (i.e., JAVA executable code on J2EE platform).
According to at least one embodiment of the invention, the method also makes it possible to add to the description extensions which are incompatible with the final language. These extensions are intended for optimizing the service or one of the phases of the service, and are deleted by the binary generation phase. This significant flexibility makes it possible to simply express information for the author which is useful in optimizing execution of the code generated during execution of the service: e.g., server cache instructions, factorization of a subset of scenes included in several other scenes.
According to at least one embodiment of the invention, the method makes it possible to implement fine-tuning of the media referenced by the service, owing to the systematic interpretation of all portions of the service, including the references to said media.
In addition, according to at least one embodiment of the invention, the method enables the number of detectable design errors to be increased during the design phase and therefore enables improved a priori validation of the services: during the phase of converting the textual description of the dynamic service into executable code, the two portions of the textual description, namely the scene description and the program instructions, are translated and merged into a single description, which enables static and global analysis of the links between said two portions, while, for the existing techniques, the only means of verifying these links is to execute a large number of content requests in the working environment.
Finally, the techniques used in the method according to at least one embodiment of the invention enable development costs to be reduced by not requiring any advanced programming skill to design the services. In addition, a generic renderer can be tested on each type of terminal irrespective of the number of services that will be used by this generic renderer.
Although the present disclosure has been described with reference to one or more examples, workers skilled in the art will recognize that changes may be made in form and detail without departing from the scope of the disclosure and/or the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 07 00765 | Feb 2007 | FR | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP2008/050906 | 1/25/2008 | WO | 00 | 10/8/2009 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2008/095800 | 8/14/2008 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 6044397 | Eleftheriadis | Mar 2000 | A |
| 6456857 | Bos | Sep 2002 | B1 |
| 7099687 | Makela | Aug 2006 | B1 |
| 7216288 | Westerink et al. | May 2007 | B2 |
| 7221801 | Jang et al. | May 2007 | B2 |
| 7251277 | Luken | Jul 2007 | B2 |
| 7877460 | Brouwer et al. | Jan 2011 | B1 |
| 20020095433 | Inohara et al. | Jul 2002 | A1 |
| 20030018783 | Bos | Jan 2003 | A1 |
| 20040054653 | Dufourd et al. | Mar 2004 | A1 |
| 20040109502 | Luken | Jun 2004 | A1 |
| 20040123238 | Hefetz et al. | Jun 2004 | A1 |
| 20050149558 | Zhuk | Jul 2005 | A1 |
| 20050234844 | Ivanov | Oct 2005 | A1 |
| 20060041674 | Reme | Feb 2006 | A1 |
| 20060179079 | Kolehmainen | Aug 2006 | A1 |
| 20070294674 | Marilly | Dec 2007 | A1 |
| 20080052396 | Tell | Feb 2008 | A1 |
| 20090055473 | Synnergren | Feb 2009 | A1 |
| 20090167769 | Gouesbet et al. | Jul 2009 | A1 |
| 20090305743 | Gouesbet et al. | Dec 2009 | A1 |
| 20100030852 | Kerebel et al. | Feb 2010 | A1 |
| Entry |
|---|
| International Search Report from International Application No. PCT/EP2008/050906 dated Apr. 17, 2008. |
| K. Kim, I. Lee and M. Ki, “Interactive Contents Authoring System based on XMT and BIFS,” Multimedia 2002, Dec. 1-6, 2002, pp. 275-278. |
| C. Liu, “Data Flow Analysis and Testing of JSP-Based Web Applications,” Information and Software Technology, 2006, pp. 1137-1147. |
| Chinese Office Action from Application No. 200880003829.X dated May 6, 2011 (English Translation only). |
| Chinese Office Action from Application No. 200880003829.X dated Sep. 28, 2010. |
| International Search Report for corresponding International Application No. PCT/EP2008/050906, filed Jan. 25, 2008. |
| Preliminary Report on Patentability and Written Opinion of the International Searching Authority for corresponding International Application No. PCT/EP2008/050906, filed Jan. 25, 2008. |
| Office Action from Chinese Patent Application No. 200880003820.X, dated Feb. 13, 2012, 7 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20100030852 A1 | Feb 2010 | US |
