Patent Grant
7248830
1) Field of the Invention
The present invention relates to a method of and an apparatus for generation/presentation of program-related contents that generate program-related contents to be distributed to a portable terminal from a program video and program-related information that is relevant to this program video along the progress of a program, under a mobile environment of receiving a text, a still picture, and a motion picture by utilizing a portable terminal such as a portable telephone and a PDA. More specifically, this invention relates to a method of and an apparatus for generation/presentation of program-related contents that generate and present program-related contents, by efficiently presenting a large quantity of information during a short period of time with a simple operation, even when a portable terminal having a small display area and with low manipulability is used.
2) Description of the Related Art
In recent years, there has been a rapid progress in the distribution of portable terminals including portable telephones. According to a next-generation portable terminal (IMT 2000) that is currently being operated on a trial basis, this portable terminal can receive motion pictures as well as texts and still pictures by using a network band of a maximum 384 Kbps. It has been considered it possible to install a high-level function of voice reading onto this portable terminal.
As a system using such portable terminals, there has been a service of generating and transmitting program-related contents such as a quick report on a baseball or soccer game. Following the occurrence of an event such as a scoring, or an inning end, a service provider prepares a character string like “The bottom of the first inning, Giant 3-1 Hiroshima, Giant came from behind with Y. Takahashi's timely hit”, and transmits this mail to user's portable terminals. Based on this service, a user who cannot watch television during moving can know the progress of the program. At present, a character string is a main form of information transmitted by this service. It is expected that, in the near future, more sophisticated form of information will be transmitted such as motion pictures, data of an existing database, and a page of a relevant Web site.
For example, a baseball program is considered to have various kinds of program-related information such as occurrence events of a hit, an HR (homerun), scores, SBO (a strike, a ball, an out), a safe base status, a player's profile, cumulative number of turns at bat, a digest scene, a page of a relevant Web site, etc. These pieces of information are related to each other, and it is possible to express a structure of this relationship as shown in
Presentation of the above information to portable terminals has following problems. That is,
As a measure to solve the above problems (1) and (2), a passive viewing of programmed program-related information (a generation of program-related contents) is considered. For example, when a user views the scenes as shown in
As a measure to solve the above problems (3) and (4), it is necessary to provide a function that can prepare contents effectively and efficiently to enable each user to sequentially view desired scenes of information in a desired order within a short period of time such as one minute or three minutes. It is said that, in general, not more than three minutes is suitable for a user to watch data on the portable terminal. This is because as the form of information becomes more sophisticated, more personalized information becomes necessary. Particularly, there is an extremely large difference in the preference of a sport program between users. Therefore, each user wants information different from what the other users want.
For example, assume that the player Takahashi of Giant hit HR in a game between Giant and Hiroshima. For the users who like Takahashi, information relating to Takahashi is important, and they want to have information relating to Takahashi such as “cumulative number of turns at bat”, “record in this season”, “relevant Web information”, etc.
On the other hand, for Hiroshima fan users, the information on Takahashi is not necessarily important. Therefore, for these users, more information about “pitch status” of Hiroshima pitchers, “digest” up to the current time, and the team's “relevant Web information” are effective, instead of the information on Takahashi. In order to present these pieces of information as a short-time program (program-related contents) of one minute to three minutes on the portable terminals, it is necessary to automatically extract information that is important for each user, and efficiently and sequentially present the information in the order each user wants. In other words, in order to program program-related information and generate program-related contents for the portable terminals, it is necessary to provide a function that reflects individual users' preferences, and automatically generates a short-time program containing various contents.
There are relevant conventional techniques as follows.
In “Kondo”, Kondo and others considered that a passive viewing type presentation system is more suitable than an active type presentation on a portable terminal that has a small display area and has a small opportunity of interaction. Therefore, they proposed a WebCarrousel system that presents a search result on the Web in the Carrousel system as a programmed component. This system is effective for a user to passively views a large quantity of information obtained based on a searching of the Web, on the portable terminal. However, this system does not reflect users' preferences in presenting the information, and does not take into account a programming according to a link circulation when there is a strong relationship between the information like the program-related contents.
In “Sumiya”, Sumiya and others proposed a method of presenting information in a stream, by detecting a master page common to each page from a result of searching the Web, and providing a series of flow to the searched result. This system places importance on the determination of a presentation order based on a relationship that common master pages are the same. However, this system does not take into account a determination of a presentation order and a scenario generation that reflect users' preferences.
In “Uma”, Uma and others proposed a system of presenting information by calculating a degree of freshness of Web information and a scoop level, and filtering the information based on these values. However, this system does not take users' preferences into account either.
On the other hand, the applicants of the present invention have so far proposed systems that present high-level and structured program-related contents. These systems place an emphasis on how to restructure and present program-related contents according to users' preferences and characteristics of information.
For example, the applicants of the present invention have so far proposed a “personalized digest preparation system” according to individual users' preferences by utilizing metadata of television programs like baseball and soccer, in “Hashi 00”, “Hashi 01”, and “Hashimoto 00”. This system extracts scenes having an organized meaning from basic and objective program metadata, calculates levels of importance of occurred events by reflecting users' preference information, and prepares a digest by selecting scenes in the order of high importance levels.
In “Shiro” and “Hashimoto 01”, the applicants of the present invention have proposed a “program generation system using digest scenes” that automatically generates a program for each user, from digest scenes generated by the above personalized digest preparation system. This system has devised a program definition language called ppml (Personalized Program Markup Language). Based on this, the system describes components of virtual characters and program metaphors to generate a program, and stores the components into a database as an operation template. The system automatically generates a program by selecting an operation template that is optimum for each digest scene. A program that is finally output is also described in the ppml. This system can control different elements of videos and character strings, and realize a flexible generation of a program.
In “Shirota”, the applicants of the present invention considered that, in order to put a data broadcasting service into practical use in a digital broadcasting, it is necessary to automatically generate data that is relevant to a program. Therefore, the applicants proposed “A Program-Related Contents Preparation System for Data Broadcasting” that dynamically generates program-related contents from program metadata.
However, according to the above conventional techniques, it has not been possible to provide a system that satisfies all the above requirements (1) to (4) that become the problems when the portable terminal receives program-related contents.
In other words, according to the above conventional techniques, in a method of and an apparatus for generation/presentation of program-related contents that generates program-related contents to be distributed to a portable terminal from a program video and program-related information that is relevant to this program video along the progress of a program, under a mobile environment of receiving a text, a still picture, and a motion picture by utilizing a portable terminal such as a portable telephone and a PDA, there has not been provided a method or an apparatus that enables users to passively view information personalized for each user without a complex interaction in a limited display area of each portable terminal and that enables each user to view desired information in a desired order.
It is an object of the present invention to provide a method of and an apparatus for generation/presentation of program-related contents that enable users to passively view information personalized for each user without a complex interaction in a limited display area of each portable terminal and that enable each user to view desired information in a desired order.
According to the present invention, a program video and program-related information are input, and program-related contents are generated based on a tree structure defined in advance. Based on a preset viewing data quantity as a viewing request from each user who has a portable terminal, leaf nodes in the tree structure of the program-related contents are selected as presentation candidates for each user. A presentation route that follows the leaf nodes of the presentation candidates starting from the root of the tree structure is generated as a presentation scenario for each user. The generated presentation scenario is transmitted to the portable terminal of the corresponding user.
These and other objects, features and advantages of the present invention are specifically set forth in or will become apparent from the following detailed descriptions of the invention when read in conjunction with the accompanying drawings.
Embodiment(s) of a program-related contents distribution system to which the method of and the apparatus for generation/presentation of program-related contents of the present invention are applied will be explained in detail below with reference to the attached drawings. The explanation will be made in the following order. That is,
The method of and the apparatus for generation/presentation of program-related contents of the present invention utilize the techniques of the personalized digest preparation system, the program generation system using digest scenes, and the program-related contents preparation system for data broadcasting that have been already proposed by the applicants of the present invention (that is, the techniques disclosed in the literatures of “Hashi 00”, “Hashi 01”, “Shiro”, “Shirota”, “Hashimoto 00”, and “Hashimoto 01” that have been explained in the description of the related art). However, based on only these techniques, it is not possible to automatically generate personalized contents for users to passively view program-related contents that change following the progress of a program on users' portable terminals.
Therefore, the present invention proposes a system that automatically generates a “scenario” showing what program-related information is to be presented in what order based on users' preference information and viewing status, and characteristics of information presented, and presents programmed program-related information (generates program-related contents) based on this scenario.
In general, a user interface structure is expressed in a tree structure, and the progress is expressed based on a change of the status on the nodes of the tree structure. In the present invention the program-related contents generation/presentation apparatus first defines a tree structure of program-related contents, and determines presentation attributes of subordinate nodes of each sub-tree. When a specific event occurs on the program, program-related contents are generated, and a presentation yardstick that reflects users' preference information is calculated for leaves of the tree structure. Then, a status change route for presentation to each user is determined according to the calculated presentation yardstick and the presentation attributes of the relevant information. This status change route is called a “presentation scenario”. Then, presentation scenarios are distributed to corresponding portable terminals. At each portable terminal, based on the presentation according to the presentation scenario, a user can passively view personalized information prepared for each user, on a limited display area of the portable terminal without a complex interaction. The user can view desired information in a desired order.
Number is not particularly limited for each of the broadcasting station 100, the program-related contents generation/presentation apparatus 200, and the portable terminals 300. For the portable terminal 300, it is possible to use an apparatus that has a video transmitting and receiving function, and a display function, like a portable telephone, a notebook type computer, and a PDA (portable information terminal). It is also possible to use an apparatus that is a combination of an STB (set top box) that has been distributed recently and a display device.
The program-related contents generation/presentation apparatus 200 shows an example of when this apparatus receives program videos and program metadata from the broadcasting station 100. The operation that this apparatus directly inputs program videos and program metadata of a past broadcasting from a medium is basically the same as the above, and this operation is also included within the scope of the present invention.
The outline of a program-related contents transmission service by the program-related contents generation/presentation apparatus 200 according to the present embodiment will be explained below. This service is one that enables a user to view desired information in a desired order according to the progress of a program (that is, a real-time program-related contents transmission service). This service has the following characteristics.
First, the system instantly transmits program-related contents when an important event has occurred in the program.
Second, a user of the service (the same as the user of the portable terminal 300) can assign a timing of receiving program-related contents, and a data quantity of the receiving program-related contents.
Third, the program-related contents reflect users' preferences, and kinds of information, a quantity of information, and an order of the program-related contents presented are different for each user.
Fourth, a user can passively view program-related contents as a program.
In order for a user to start viewing program-related contents, the user first transmits a “viewing request” from the portable terminal 300 to the program-related contents generation/presentation apparatus (distribution server) 200. When an important event has occurred in the program, a program within the program-related contents generation/presentation apparatus 200 decides whether program-related contents should be transmitted to individual users or not.
When the program has decided that program-related contents should be transmitted to individual users, the program instantly reflects a user's preference, prepares personalized program-related contents, and transmits the program-related contents to the user's terminal by mail via the i-mode or the IMT 2000 network. Based on this service, the user can view desired program-related contents, and can know the progress of the program substantially in real time.
Screen images when a user views the generated program-related contents on the portable terminal 300 will be explained with reference to
First, “contents explanation” of the two-run home run of Yoshi Takahashi player is shown. Next, “scores”, “today's turns at bat”, “a word before the game”, “record in this season”, and “digest” of Yoshi Takahashi are shown. When a program is to be generated for Hiroshima fans, presentation of information should be focused on Hiroshima. For example, the Yoshi Takahashi's homerun scene is shown first, and “today's pitching” of Hiroshima's Kuroda pitcher, and “digest” of Hiroshima first scoring scene will be shown. In the present embodiment, a motion picture is presented for five seconds to ten seconds depending on the importance level, and a text is presented for three seconds to ten seconds depending on the quantity of information. According to the program-related contents transmission service of the present embodiment, these scenes are automatically developed on the portable terminal 300.
In
The program-related contents generation/presentation method of the present embodiment consists of the following seven processing steps from (1) to (7).
(1) Program-related contents structure definition processing
(2) Program-related contents transmission decision processing
(3) Program-related contents generation processing
(4) Presentation yardstick calculation processing by reflecting user's preference
(5) Presentation candidate selection processing
(6) Element tree presentation yardstick setting processing
(7) Presentation scenario generation processing
At the (1) program-related contents structure definition processing step, a tree structure of program-related contents is defined first.
In general, it is possible to express a tree structure as a composite of one-layer sub-trees, as shown in
An attribute (presentation attribute) that shows an order of presenting subordinate nodes is set to this element tree as follows.
Presentation attribute, in_order_of (<attribute name>|presentation yardstick)
{ascendant|descendant}
The above in_order_of (<attribute name>) shows that subordinate nodes are presented in the ascending order (or the descending order, in the ascending order when this indication is omitted) of values of the assigned attributes. In an example shown in
In an example shown in
As another example of a presentation yardstick, there are a number of accesses made to a Web page.
The (2) program-related contents transmission decision processing step will be explained. According to the progress of a program, a program video and metadata are transmitted from the broadcasting station 100. At the program-related contents transmission decision processing step, when an event has occurred in the program, it is decided whether program-related contents should be transmitted to individual users or not.
Assume that a user has assigned in advance a timing of receiving program-related contents as the following viewing request.
When an event has occurred in the program, at the program-related contents transmission decision processing step, it is decided whether program-related contents should be transmitted or not based on the viewing request and the information of the occurrence event. For example, when “Receive information each time when a score has been added” has been stored as the viewing request, it is decided that the program-related contents should be transmitted when the contents of the occurrence event is “addition of score”. When “Receive information each time when an event important has occurred (important event, Takahashi's turns at bat)” has been stored as the viewing request, it is decided that the program-related contents should be transmitted when the contents of the occurrence event is “turn at bat, Takahashi”.
Depending on information, some information should be transmitted to certain users, but this information should not be transmitted to other users. In the present embodiment, viewing request has been stored for each user in advance. Therefore, it is possible to decide for each user whether program-related contents should be transmitted or not. When there is at least one person to whom the information should be transmitted, the process proceeds to the next (3) program-related contents generation processing step.
The (3) program-related contents generation processing step will be explained. First, as a conventional technique, there has been already known a system for automatically preparing event drive type program-related information that utilizes program metadata (“Shirota”, An Event Drive type Data Broadcasting Program-Related Information Preparation System). The “event” refers to event information of an event that occurred in the program.
In the (3) program-related contents generation processing of the present embodiment, program-related contents are generated based on the occurrence event by using the technique known in “Shirota”. Program-related contents are generated based on the tree structure of the contents. For example, in the tree structure shown in
These data are updated each time when an event occurs, and the latest information is always held in the program-related contents database. On the other hand, digest scenes and relevant Web pages are data that are generated according to the progress of a game and are accumulated in the program-related contents database. Users want to view always the latest information regarding the occurrence events, and the information accumulated according to the progress of a game from its start regarding the digest and the relevant Web.
At the (4) presentation yardstick calculation processing step, individual users' presentation yardsticks are calculated for the program-related contents that have been prepared in the (3) program-related contents generation processing. A presentation yardstick is calculated based on the following characteristics that are added to each leaf node of the tree structure of the program-related contents.
F, Freshness. This is a characteristic that represents freshness of information. When the information becomes old, the value of this information becomes lower. The freshness is a yardstick for filtering the information of time-series data that has been proposed by Uma and others in the literature of “Uma”. When an average time distance between certain information A and a set of similar information ω is larger, the freshness of the information A is considered larger, and the freshness of the information A based on the time distance between the information A and the set of similar information ω is defined as follows.
where t (A) represents an updating time of the information A, m represents a number of articles of ω, and bi represents each similar information of ω.
S, Significance. This is a characteristic that represents significance of information. The significance is a value obtained according to a status parameter calculation technique that reflects users' preferences in generating a digest that has been proposed in the literature of “Hashi 01”.
U, Unexpectedness. This is a characteristic of which value increases when the information of a leaf node has had unexpected contents. A weight Wi is set to each characteristic. Based on these characteristics and weights, a presentation parameter (presentation_param) of each leaf node of the program-related contents is calculated as a weighted average of the characteristics.
where nid represents an ID of a leaf, and Wi (nid) represents a function that reflects the weight of a characteristic shown by the index i in this leaf node. Parami (nid) represents a value in the leaf node of the characteristic shown by the index i. This value becomes 0 when an assigned characteristic has not been added. As users' preference information is reflected in the significance S, this presentation parameter also reflects the users' preference as a result.
Leaf nodes are sorted based on the calculated values of presentation parameters. The orders of the sorted result become the “presentation yardsticks” of these leaf nodes.
At the (5) presentation candidate selection processing step, a candidate of information to be presented is selected according to individual users' requests. A user makes the following requests regarding the quantity of information that the user receives at the portable terminal 300.
When the user has assigned “Want to view during a period of one minute”, leaf nodes that can present information during a period of one minute are selected as presentation candidates according to the presentation yardsticks of the leaf nodes at the presentation candidate selection processing step.
At the (6) element tree presentation yardstick setting processing, a presentation yardstick of a master node of an element tree to which leaf nodes of the presentation candidates belong is obtained. The presentation yardstick of a master node becomes a maximum value among presentation yardsticks of subordinate nodes that belong to this element tree. A presentation yardstick of this master node is obtained in a similar manner, and presentation yardsticks are set, up to the subordinate nodes one layer below the route. In
At the (7) presentation scenario generation processing step, a presentation scenario is generated based on presentation yardsticks obtained so far.
A determination processing of a presentation scenario is started from the route node “quick report on the game”. The presentation attribute of the root node is in_order_of (presentation yardstick). This indicates that the nodes that are one layer below the root node are traced in the order of the presentation yardsticks. The presentation yardsticks of the nodes are 1* (“occurrence event”) and 7* (“digest”). Therefore, the tree of the “occurrence event” is traced first.
The presentation attribute of the “occurrence event” is in_order_of (nid). Therefore, the nodes of the presentation candidates (presentation yardsticks 1, 6, 2**) are traced in the order of nid, as the “contents explanation”, the “scores”, and the “butter information”. The presentation attribute of the “today's turns at bat” (the presentation yardstick 2*) below the “butter information” (the presentation yardstick 2**) is in_order_of (timecode). Therefore, the nodes of the presentation candidates are presented in the order of the timecode. This processing is carried out recursively until when all leaves that have been selected as presentation candidates are traced. Then, a presentation scenario is generated. Based on this processing, a presentation scenario for presenting the program shown in
A presentation scenario generated for each user by this presentation scenario generation processing is transmitted to a portable terminal of the corresponding user as an html file, of which detailed explanation will be omitted. This transmission processing uses a function (mail transmission) as a distribution server of the program-related contents generation/presentation apparatus 200.
The program-related contents generation/presentation apparatus 200 operates as a distribution server of program-related contents on the Windows 2000 machine (pentium III 600 MHz), for example.
The digest generation program utilizes a digest generation PDMS system of a known technique that has been proposed in “Hashi 01”. Assume that a metadata file of a baseball program is prepared in advance, and this metadata file has been accumulated in the database together with a program video. The digest generation program calculates the significance of the occurrence event itself and the significance of the digest scene.
The metadata analysis program reads metadata in real time from the file according to a timecode, and issues information of the occurrence event to the digest generation program and the relevant Web search program.
The relevant Web search program searches for articles of the past two years of the ZZ Newspaper Publishing Company, for example, and calculates unexpectedness of each page. Specifically, this program categorizes pages of the searched result according to similarity, and increases the levels of unexpectedness of the pages that are included in the category other than professional baseball.
The program-related contents generation program is a program that executes the presentation scenario generation processing of the program-related contents in the present embodiment (the processing of the steps (1) to (7) in FIG. 5). In other words, the program-related contents generation program generates program-related contents, calculates freshness, and generates presentation scenarios for individual users, based on the significance of digest scenes generated by the digest generation program and each event, the Web pages searched for by the relevant Web search program, and the calculated unexpectedness.
In the program-related contents generation/presentation apparatus 200, a presentation scenario is realized as an html page attached with only one link button. A mail attached with URL of this presentation scenario is transmitted to users. The users click this URL, and start viewing the program-related contents. The users depress a link button within each page to change statuses according to the presentation scenario.
As explained above, according to the present embodiment, a program video and program-related information are input, and program-related contents are generated based on a tree structure. Based on a viewing data quantity that has been set in advance as a viewing request from each user who has a portable terminal, leaf nodes in the tree structure of the program-related contents are selected as presentation candidates for each user. A presentation route that follows the leaf nodes of the presentation candidates starting from the root of the tree structure is generated as a presentation scenario for each user. The generated presentation scenario is transmitted to the portable terminal of the corresponding user. Therefore, users can passively view the information that has been personalized for each corresponding user in the limited display area of the portable terminal, without a complex interaction. Each user can view the information in a desired order of viewing the information.
As explained above, according to a program-related contents generation/presentation method of the present invention, a program video and program-related information are input, and program-related contents are generated based on a tree structure defined in advance. Based on a viewing data quantity that has been set in advance as a viewing request from each user who has a portable terminal, leaf nodes in a tree structure of the program-related contents are selected as presentation candidates for each user. A presentation route that follows the leaf nodes of the presentation candidates starting from the root of the tree structure is generated as a presentation scenario for each user. The generated presentation scenario is transmitted to the portable terminal of the corresponding user. Therefore, there is an effect that users can passively view the information that has been personalized for each corresponding user in the limited display area of the portable terminal, without a complex interaction. Each user can view the information in a desired order of viewing the information.
According to a method of and an apparatus for generation/presentation of program-related contents of the present invention, optional attributes are set as presentation attributes to sub-trees of a defined tree structure, and an ascending order or a descending order is set to the attributes, thereby to define how to trace subordinates nodes of the tree structure of program-related contents. A receiving timing of each user and an event that occurred in a program video are compared with each other, thereby to decide for each user whether the program-related contents should be generated and transmitted or not. When there exists a user to whom it has been decided that the program-related contents should be transmitted, the program video and program-related information are input, and the program-related contents are generated based on the defined tree structure. Presentation parameters are calculated for various information of leaf nodes in the tree structure of the generated program-related contents, by using significance that reflects users' preferences set in advance and freshness that shows levels of freshness of the information, and the leaf nodes are sorted based on the calculated values of the presentation parameters to obtain presentation yardsticks. Leaf nodes in the tree structure of the program-related contents are selected as presentation candidates for each user in the calculated order of the presentation yardsticks based on the viewing data quantity that has been set as a viewing request. A presentation yardstick of a master node of the selected presentation candidates is set to a maximum value among the presentation yardsticks of the subordinate nodes. A presentation route that follows the leaf nodes of the presentation candidates starting from the root of the tree structure based on how to trace the subordinates nodes is generated as a presentation scenario for each user. The generated presentation scenario is transmitted to the portable terminal of the corresponding user. Therefore, there is an effect that users can passively view the information that has been personalized for each corresponding user in the limited display area of the portable terminal, without a complex interaction. Each user can view the information in a desired order of viewing the information.
Although the invention has been described with respect to a specific embodiment for a complete and clear disclosure, the appended claims are not to be thus limited but are to be construed as embodying all modifications and alternative constructions that may occur to one skilled in the art which fairly fall within the basic teaching herein set forth.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2001-216039 | Jul 2001 | JP | national |
This application is a continuation of U.S. patent application Ser. No. 10/194,220, filed Jul. 15, 2002 now U.S. Pat. No. 6,954,611, and in turn claims priority to Japan Patent 2001-216039, filed Jul. 16, 2001, the entire contents of each of which are hereby incorporated herein by reference.
| Number | Name | Date | Kind |
|---|---|---|---|
| 20020178447 | Plotnick et al. | Nov 2002 | A1 |
| 20030120555 | Kitagawa | Jun 2003 | A1 |
| 20030121040 | Ferman et al. | Jun 2003 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20050272411 A1 | Dec 2005 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10194220 | Jul 2002 | US |
| Child | 11184794 | US |
