Patent Application
20090172512
1. Field of the Invention
The present invention relates to a technology for changing a screen display layout according to a viewer's taste, attributes, specification, and so on in a screen generating apparatus which can simultaneously display various pieces of information, such as information about a digital data transmission service and information about an IP broadcast service, together with an on-screen video (or image).
2. Description of Related Art
Information services which provide many persons with the same information, such as digital data transmission services and IP (Internet Protocol) broadcast services, can provide related information in the form of, for example, alphabetic information or image information, advertisement, and so on in synchronization with a video. For example, a terrestrial digital media broadcasting service provides, in synchronization with a video, contents-of-broadcast related information described in BML (Broadcast Markup Language), general information including news, a weather forecast, or the like, information about the provider of the video, advertisement, or the like. When a viewer views and listens to such information, he or she operates a broadcast receive terminal using a remote control or the like so as to make it display an information screen. An information service using communications provides, via the Internet, information including news, a weather forecast, a stock price, or the results of a search for restaurants, which is described in HTML (HyperText Markup Language). Conventionally, for an information service, such as a broadcast, which provides many persons with the same information, there is provided only one pattern of screen layout of information which is to be displayed on a broadcast receive terminal in synchronization with a video, and the pattern is fixed. Therefore, it is impossible to change the screen layout according to the viewer's attributes or utilizing environments. Because information to be displayed is determined according to the screen layout, the fact that the screen layout cannot be changed results in that the type of the information to be displayed cannot be changed.
To solve this problem, for example, patent reference 1 proposes a screen generating apparatus for changing the screen layout of information which is provided in synchronization with a video which is played back by a broadcast receive terminal. The screen generating apparatus selects a screen layout according to a viewer's sex, taste information, and so on from a number of patters of screen layouts which are provided by an information provider. Therefore, the conventional screen generating apparatus can display an information screen with a screen layout suitable for the viewer's attributes.
[Patent reference 1] JP, 2007-13819, A
Because the conventional screen generating apparatus is constructed as mentioned above, the screen generating apparatus cannot select any screen layout except one of screen layouts provided by the information provider, and therefore the viewer cannot but select both a desired screen layout and information to be displayed in the selected screen layout collectively. A problem is therefore that the viewer cannot change the screen layout and the information to be displayed in the screen layout freely.
The present invention is made in order to solve the above-mentioned problem, and it is therefore an object of the present invention to provide a screen generating apparatus which can switch to a screen display visible to a viewer by allowing the viewer to freely make a setting of arrangement of pieces of video information and applications which display the pieces of video information, respectively.
In accordance with the present invention, there is provided a screen generating apparatus including: a receiving unit for receiving a content having an identification number; an application executing unit for executing an application which generates an application image; a screen layout forming unit for, for the identification number, generating screen layout information which associates the application image generated by the application with a preset screen area; an application drawing unit for drawing the application image generated by the application in the screen area associated with the application image on a basis of the screen layout information generated by the screen layout forming unit; and a video output unit for displaying the application image drawn by the application drawing unit on a screen while superimposing the application image on a video included in the content.
As previously mentioned, because the screen generating apparatus in accordance with the present invention includes: the receiving unit for receiving a content having an identification number; the application executing unit for executing an application which generates an application image; the screen layout forming unit for, for the identification number, generating screen layout information which associates the application image generated by the application with a preset screen area; the application drawing unit for drawing the application image generated by the application in the screen area associated with the application image on a basis of the screen layout information generated by the screen layout forming unit; and the video output unit for displaying the application image drawn by the application drawing unit on a screen while superimposing the application image on a video included in the content, the screen generating apparatus enables the viewer to freely perform a setting of arrangement of one or more applications each of which displays video information and can switch to a screen display visible to the viewer.
Further objects and advantages of the present invention will be apparent from the following description of the preferred embodiments of the invention as illustrated in the accompanying drawings.
The broadcast service distributing apparatus 10 shown in
A screen layout forming unit 204 generates a screen layout used for setting up the position of display and arrangement of one or more applications each of which draws video information on the screen, and so on by using the video information metadata and the arrangement template. A screen layout storage unit 207 stores the generated screen layout therein. An application executing unit 201 executes an application by using both the screen layout recorded into the screen layout storage unit 207 and the application data about the application which are recorded into the application data storage unit 202. By executing a specific application, the application executing unit generates a specific video and a specific audio. A GUI (Graphical User Interface, an application drawing unit) 203 carries out a drawing process of drawing an application or the like which is to be displayed on the screen, an audio output process, and a process of inputting an operational instruction which is provided by a viewer using an input device not shown, such as a remote control.
The video output unit 212 mixes one or more applications (i.e., one or more application images) drawn by the GUI 203 and the decoded video data outputted from the video decoder 210 into an image, and displays this image on the screen. The audio output unit 213 mixes the audio data (i.e., application sounds) about the one or more applications which are generated by the application executing unit 201 and the decoded audio data outputted from the audio decoder 211 into a sound, and outputs this sound from a speaker not shown.
In this arrangement template 42, an application area ID “001” which determines the application area 22, a display area “900×100” which shows the size of the area in which the application is displayed, a display position “(900, 50)” which shows the coordinates of the display area on the screen 21, and so on are described. Similarly, an application area ID which determines the application area 23, a display area, a display position, and so on are described in the arrangement template. In this example, a genre: “character string” which restricts the genre of an application which can be displayed in the application area 23 is added to the description of the arrangement template 42 which determines the application area 23.
These applications 24 and 25 shown in
The broadcast service distributing apparatus 10 multiplexes pieces of information, such as the current time and a news flash, which are displayed in the applications, like the clock application and the news application, to the video information, and distributes them. As an alternative, the broadcast receive terminal can acquire those pieces of information from the broadcast service distributing apparatus 10 via HTTP communications using the network interface 205, or the like, or the pieces of information can be enclosed with the application data 43.
Thus, because the video information metadata and the arrangement template are associated with each other by way of the video content ID, the application areas are automatically determined by the video content ID. The user can select and set up freely the type of the application which is to be displayed in each of the application areas. This type of the application which is to be displayed in each of the application areas can be a type of application which is associated with the video distributed from the broadcast service distributing apparatus 10 and which displays the description of program information, or a type of application which displays a description which is not associated with the video, like the current time.
Hereafter, the operation of the screen generating apparatus 200 will be explained.
Next, the video decoder 210 and the audio decoder 211 decode the video data and the audio data, respectively, and the decoded video data and the decoded audio data which are decoded by the video decoder and the audio decoder are outputted to the video output unit 212 and the audio output unit 213, respectively (step ST106 and ST107). The above-mentioned processes of steps ST101 to ST207 are carried out repeatedly while the video, the audio, and the video information are received.
When a viewer performs an operation of pressing down an application start button of an input device, such as a remote control, or the like to input a request to start an application to the GUI 203 during a time period during which the above-mentioned processes are performed (step ST108), the GUI 203 makes a request of the application executing unit 201 to start a process of starting the application (step ST109). The application executing unit 201 then performs a process of starting the application which the application executing unit has been requested to start by the GUI 203 (step ST110), and makes a request of the screen layout forming unit 204 to form a screen layout (step ST111). In response to this request, the screen layout forming unit 204 acquires the video information metadata currently being received from the broadcast service distributing apparatus 10, which are stored in the video information metadata recording unit 206 (step ST112).
In step ST113, the screen layout forming unit 204 determines whether the screen layout 44 (shown in
Next, in order to make the viewer select the type of one or more applications which are to be arranged respectively in one or more application areas described in the arrangement template, the screen layout forming unit 204, in steps ST118 and ST119, makes a request of the GUI 203 to draw an application selection screen via the application executing unit 201. In response to this request, the GUI 203 displays the application selection screen on the screen (step ST120).
An example of the application selection screen displayed on the screen is shown in
The GUI 203 accepts a request to select the application from the input device (step ST121), so that the application to be placed in the application area 22 is determined. When there is two or more application areas, the broadcast receive terminal has only to repeatedly perform the steps ST118 to ST121 only the number of application areas in such a way as to, for example, determine an application to be placed in the application area 23 after determining an application to be placed in the application 22.
The GUI 203 notifies the application data corresponding to the application selected for each application area to the screen layout forming unit 204 via the application executing unit 201 (steps ST122 and ST123). The screen layout forming unit 204 which has received this notification generates a screen layout which is a combination of the arrangement template associated with the video information currently being received and the application data about the one or more applications to be respectively placed in the one or more application areas which are defined by the arrangement template (step ST124). This screen layout is associated with the video information metadata and is stored in the screen layout storage unit 207.
If it is determined, as a result of the determination in step ST113, that there exists a screen layout in which the same video content ID as the video content ID “001” described in the video information metadata is described, the screen layout forming unit 204 outputs the screen layout acquired from the screen layout storage unit 207 to the application executing unit 201, whereas, if there exists no existing screen layout in which the same video content ID as the video content ID 00111 described in the video information metadata is described, the screen layout forming unit 204 outputs the new screen layout generated in steps ST124 to ST116 to the application executing unit 201 (step ST125). In a case in which there exists an existing screen layout in which the same video content ID as the video content ID “001” described in the video information metadata is described, the broadcast receive terminal has only to inquire of the viewer whether to use the existing screen layout, and advance to the same process to generate a new screen layout when the viewer does not use the existing screen layout, as in the above-mentioned case in which there exists no screen layout in which the same video content ID as the video content ID “001” described in the video information metadata is described.
The application executing unit 201 makes a request of the GUI 203 to perform a process of drawing the one or more applications on the basis of the screen layout (step ST126). The application executing unit 201 generates audio data for the one or more applications on the basis of the application data about the one or more applications, and outputs the audio data to the GUI 203. The GUI 203 then makes a request of the video output unit 212 and the audio output unit 213 to output the video data and the audio data about the one or more applications which are specified by the screen layout, respectively (steps ST127 and ST128). The video output unit 212 mixes the decoded video data outputted in step ST106 with the video data outputted in step ST116 in response to the received output request, and outputs them (step ST129). The audio output unit 213 mixes the decoded audio data outputted in step ST107 with the audio data outputted in step ST117 in response to the received output request, and outputs them (step ST130).
The screen layout in which the plurality of applications are associated with the single type of video information metadata can be thus generated, and, as shown in
Furthermore, by allowing the viewer to make a setting of arrangement of one or more applications using an arrangement template, the broadcast receive terminal can restrict the number of items which the viewer has to operate in order to make a setting of arrangement of one or more applications and can therefore decrease the number of times that the viewer performs an operation for the setting. In addition, the broadcast provider can provide the arrangement template so as to prevent the one or more applications from being arranged in one or more non-intended locations, respectively, on the video displayed on the screen.
As mentioned above, the screen generating apparatus in accordance with embodiment 1 is provided with the tuner 208 for receiving a video, an audio, and video information which are identified by a video content ID, the application executing unit 201 for executing an application, the screen layout forming unit 204 for generating a screen layout for associating an application, which is determined by, for example, a user, with each application area described by an arrangement template for each video content ID, the GUI 203 for drawing an image generated by the application in each application area on the basis of the screen layout generated by the screen layout forming unit 204, the video output unit 212 for superimposing the image generated by each application, which is drawn by the GUI 203, on the decoded video data, and for displaying them on the screen 21, and the audio output unit 213 for mixing an audio generated by each application and the decoded audio data, and for outputting them. Therefore, the screen generating apparatus can switch to a screen display visible to the viewer by allowing the viewer to freely make a setting of arrangement of one or more applications each of which displays video information.
In this Embodiment 1, the application data are beforehand stored in the application data storage unit 202, as previously mentioned. As an alternative, the broadcast provider can provide the application data which are suited to the video. In this case, the screen generating apparatus 200 acquires the application data via either the network interface 205 or the tuner 208, and stores the application data in the application data storage unit 202. In this structure, the screen generating apparatus can display an application which is suited to an image of a specific scene on the screen, and therefore can provide program related information, a commercial, or the like for the viewer.
In addition, the screen generating apparatus in according to this Embodiment 1 is constructed in such a way as to arrange one or more applications on the screen by using a screen layout in which the same video content ID as the video content ID “001” described by the video information metadata is described. As an alternative, by associating specific information included in the video information metadata, e.g., a genre, a channel, or the like with each possible screen layout in advance, when receiving a video to which video information metadata specified by the viewer, such as a genre or a channel, belongs, the screen generating apparatus can arrange one or more applications on the screen by using a screen layout associated with the specified genre, channel, or the like. More specifically, by describing an ID of a genre, a channel, or the like in each possible screen layout in advance, when the screen layout forming unit 204 searches for a screen layout in step ST113 shown in
In Embodiment 2, an image layout sharing system which has a screen layout sharing server in order to share a screen layout generated by the screen generating apparatus 200 which a broadcast receive terminal 20 in accordance with Embodiment 1 has among a plurality of broadcast receive terminals will be explained.
Hereafter, the operation of the screen layout sharing system will be explained. First, a case in which the screen generating apparatus 200 uploads a screen layout generated thereby to the screen layout sharing server 50 will be explained. In a case in which a screen layout is newly generated (step ST124 shown in
Next, a case in which the screen generating apparatus 200 downloads a screen layout from the screen layout sharing server 50 will be explained. When the screen layout forming unit 204 searches through the screen layout storage unit 207 for a screen layout (step ST113 shown in
The web server 53 outputs the received video content ID to the screen layout management unit 51. The screen layout management unit 51 makes a search so as to determine whether the screen layout corresponding to this video content ID exists in the screen layout storage unit 52. When determining, as a result of the search, that the screen layout exists in the screen layout storage unit 52, the screen layout management unit 51 transmits this screen layout to the screen generating apparatus 200 via the web server 53. In contrast, when determining, as a result of the search, that the screen layout does not exist in the screen layout storage unit 52, the screen layout management unit 51 transmits a message to notify the fact to the screen generating apparatus 200 via the web server 53.
The screen generating apparatus 200 can be constructed in such a way as to download a screen layout at a timing except when the screen layout forming unit 204 searches through the screen layout storage unit 207 for the screen layout (step ST113 shown in
As mentioned above, because the image layout sharing system according to this Embodiment 2 is constructed in such a way that the screen layout sharing server 50 is connected with a plurality of screen generating apparatuses 200, the plurality of screen generating apparatus 200 can share screen layouts. Furthermore, in a case in which a viewer uses a plurality of screen generating apparatuses 200, because the image layout sharing system can cause a specific screen generating apparatus 200 to upload a screen layout generated thereby to the screen layout sharing server 50 and then allow any other screen generating apparatus 200 to download the screen layout from the screen layout sharing server 50, the image layout sharing system can avoid the necessity for all the screen generating apparatuses 200 to carry out generation and settings of a screen layout. In addition, because a plurality of screen generating apparatuses 200 share a screen layout which a viewer has generated and set up, each of the plurality of screen generating apparatuses does not need to carry out generation and settings of a screen layout individually and can make an arrangement of one or more applications on the screen automatically.
When, in step ST128 shown in
For example, the audio control unit 214 extracts information about the video, such as a video content ID and a genre (“genre: music”, “genre: movie”, or the like), which is included in the video information metadata. The application executing unit 201 uses, as a key, an application ID which is described in the screen layout 44 as shown in
The video control unit 214 stores the priority of each genre therein in advance in such a way that the priority of “genre: photo” is 3, the priority of “genre: music” is 5, and the priority of “genre: movie” is 10. In this case, the audio control unit is constructed in such a way as to, at the time of mixing, make each audio have a higher volume level with increase in the numeric value of its priority. The audio control unit 214 then compares the genre described in the video information metadata with the genre described in the screen layout, and, when, for example, the genre of the video is “genre: movie” and the genre of the application is “genre: music”, performs a mixing operation of increasing the volume level of the decoded audio which accompanies the video and decreasing the volume level of the audio of the application or muffling this audio according to their priorities.
As the rule governing the mixing, another rule can be used instead of the above-mentioned presetting of priorities. For example, priorities can be generated dynamically according to a history of the viewer's setting operations, or the like, or priorities can be preset by describing an item of “volume” in the application data about the application.
The audio data about the application and the decoded audio data which are mixed by the audio control unit 214 are then outputted to the audio output unit 213a.
As mentioned above, the screen generating apparatus according to this Embodiment 3 is constructed in such a way as to assign priorities to the audio data about an application and the decoded audio data, respectively, and include the audio control unit 214 for mixing the decoded audio data and the audio data about the application while adjusting the sound volume of the decoded audio data and the sound volume of the audio data about the application according to their priorities.
Therefore, the screen generating apparatus can avoid the necessity for the viewer to adjust the audio of the video and the audio of the application and can perform the sound field setting automatically.
The screen generating apparatus 200 in accordance with above-mentioned Embodiment 1 is constructed in such a way as to download an arrangement template from the arrangement template providing server 30, and arrange one or more applications according to the arrangement template. In contrast, a screen generating apparatus 200 in accordance with the present Embodiment 4 is constructed in such a way as to arrange one or more applications without using any arrangement template by using an image analyzing unit 215.
Hereafter, an operation of generating an arrangement template of the image analyzing unit 215 will be explained.
b) shows areas in which the telops in the video which the image analyzing unit 215 has detected from the video on the screen 21 shown in
The screen generating apparatus 200a equipped with the image analyzing unit 215 shown in
As mentioned above, because the screen generating apparatus according to this Embodiment 4 is constructed in such a way as to have the image analyzing unit 215 for analyzing the decoded video data so as to determine an area in which the decoded video data do not vary with time, and for defining this area as an application area, the screen generating apparatus does not need to acquire any arrangement template from the arrangement template providing server 30 by using the network interface 205. Furthermore, the necessity for a broadcast provider or the like to make available any arrangement template beforehand can be eliminated.
When a viewer operates the screen generating apparatus to insert an optical disc into the optical disc drive 216 mounted to the screen generating apparatus 200c, this optical disc drive 216 plays back the optical disc. The disc information analyzing unit 217 then acquires a disc ID for specifying the optical disc from the optical disc drive 216, and outputs the disc ID to the screen layout forming unit 204.
The screen generating apparatus 200c shown in
The video data of the optical disc are outputted from the optical disc drive 216 to the video decoder 210a, and are decoded by the video decoder. The decoded video data are then outputted to the video output unit 212a. The decoded video data are superimposed on the video data about the application outputted from the GUI 203 by the video output unit 212a. Similarly, the audio data of the optical disc are outputted from the optical disc drive 216 to the audio decoder 211a, and are decoded. The decoded audio data are then outputted to the audio output unit 213b. The decoded audio data are mixed with the audio data about the application outputted from the GUI 203 by the audio output unit 213b.
In this case, as the application, there can be, for example, an application which displays information associated with a movie when playing back a DVD (Digital Versatile Disk) in which the movie content is recorded, or an application which acquires caption data for a movie for which display of subtitles in a desired language cannot be selected by using the network interface 205 and which displays the caption data. The manufacturer of the optical disc has only to generate such the application data and the arrangement template and distribute them from the arrangement template providing server 30.
As mentioned above, because the screen generating apparatus according to this Embodiment 5 is constructed in such a way as to include the optical disc drive 216 for playing back an optical disc in which a video, an audio, and a disc ID are stored, and the information analyzing unit 217 for acquiring the disc ID from the optical disc, the screen generating apparatus can arrange an application automatically at the same time when it plays back the optical disc. The manufacturer of the optical disc generates and distributes application data about the application and an arrangement template for arrangement of the application. Therefore, related information or the like can be additionally displayed on the video of the optical disc.
In the above-mentioned explanation, the cases in which above-mentioned Embodiments 2 to 5 are applied to the structure shown in above-mentioned Embodiment 1, respectively are shown. The present invention is not limited to these cases, and either the structures shown in above-mentioned Embodiments 2 to 4 or the structures shown in above-mentioned Embodiments 2, 3 and 5 can be combined properly.
Many widely different embodiments of the present invention may be constructed without departing from the spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific embodiments described in the specification, except as defined in the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2007-335891 | Dec 2007 | JP | national |
