Patent Application
20090012939
The present application claims priority from Japanese application JP2007-171376 filed on Jun. 29, 2007, the content of which is hereby incorporated by reference into this application.
1. Field of the Invention
The present invention relates to a search of information and/or a presentation of search results. More particularly it relates to a method of searching information via the Internet, an information display apparatus for displaying searched information, and a program for executing information search and display. More specifically it relates to a technology suitably applied to an apparatus, such as a television set, that displays content, such as broadcasting programs.
2. Description of the Related Art
As for the field of the invention described above, JP-A-2005-115790 “Information Search Method, Information Display Apparatus and Program”, for instance, has a task of “being able to easily search various pieces of information from wide ranges of areas without requiring special, complex operations”. To achieve this objective, JP-A-2005-115790 “performs a series of operations that involves, for example, displaying first content such as received broadcast programs, extracting and displaying keywords associated with the displayed first content, searching second content of a predetermined form, such as a web page on the Internet based on the displayed keyword, and displaying the second content obtained”. Furthermore, as the keywords a plurality of pieces of information associated with the program are displayed for a user to choose.”
JP-A-2005-115790, however, has a drawback that even when there are very many keywords associated with first content, there is no alternative but to display a list of keywords at one time for the user to choose in making a search for second content. The user may therefore be under stress by being forced to select one keyword from the list of a huge number of keywords. The above patent document also fails to give enough consideration to narrowing a range of keywords for user selection.
Under these circumstances, therefore, the present application provides an information presentation method and a program for extracting keywords synchronized with a “scene” and “corner” of a television program as the first content that changes in units of seconds and/or searching and displaying content of a predetermined form, such as web pages based on the extracted keywords.
For example, an information presentation apparatus may comprise an AV content output unit to output AV content (e.g., TV programs and movies) and a web page output unit that outputs, along with the AV content from the AV content output unit, a web page corresponding to a keyword associated with a scene in the content being output from the AV content output unit, rather than requiring the user to take trouble to select a keyword, and which, when the scene in the content changes, automatically updates the web page to one that corresponds to the changed scene.
The present invention can therefore provide a TV viewing environment that allows even a user not used to complicated operations of an AV equipment to view associated web pages while watching TV programs.
These and other features, objects and advantages of the present invention will become more apparent from the following description when taken in conjunction with the accompanying drawings wherein:
A preferred embodiment of the present invention will be described. It is noted however that the invention is not in any way limited to this embodiment.
This embodiment relates to an information search method for searching information via the Internet, an information display apparatus for displaying searched information and a program for executing information search and display, and more specifically to a technology suitably applied to such apparatus as audiovisual (AV) equipment (television receivers, recorders and set top boxes), that output AV content such as broadcast programs and movies.
A central processing unit (CPU) 12001 that controls an operation of the apparatus is connected with a ROM 12002 and a RAM 12003 via an internal bus line. The apparatus also has a network interface 12004 to connect with external networks. The CPU 12001 functions as a control unit that executes an information search operation described later, and the connected memories 12002, 12003 also function as a storage unit for a keyword list described later. Further a program to execute the information search operation is stored in the ROM 12002 or RAM 12003. Based on the program, the CPU 12001 executes the information search operation. The storage unit such as RAM 12003 may use hard disks in addition to a semiconductor memory, and also a removable device such as memory card. When a large capacity storage unit (recording unit) is used, the apparatus in the case of a television receiver for example may have a recording function of accumulating broadcast programs.
Possible devices for the network interface 12004 include, for example, analog modem for analog telephone circuit, modem for ISDN circuit, router or modem for ADSL (Asymmetric Digital Subscriber Line), adapter for LAN (Local Area Network), adapter for wireless telephone and adapter for wire communication such as Bluetooth (trademark). Through this interface 12004 the apparatus can connect to the Internet.
Further, the apparatus includes a graphic controller 12009 that performs a display control on various pieces of information and moving images. The graphic controller 12009 is connected with a VRAM 12010 that holds video data. Video generated by the graphic controller 12009 is displayed on a display unit 12008. As the display unit 12008 a liquid crystal display panel may be used. The display unit 12008 may also display videos (images) produced by video signals received by a tuner not shown or video signals supplied from outside (e.g., video signals played back by a video player). Video from these video signals and video from a web page on the Internet described later can be displayed simultaneously on a single screen by the control of the graphic controller 12009. It is also possible to display character-based information, such as keywords described later, superimposed on the video image.
The apparatus also includes an operation unit 12006 with various operation keys and operation buttons, and a user interface controller 12005 to accept operations performed by the operation unit 12006. The operation data accepted by the user interface controller 12005 is sent to the CPU 12001. Infrared signals received by a light receiving unit 12007 is checked by the user interface controller 12005, allowing for a remote control from a remote control device.
In
Referring to
Although a web page is shown as an example information source from which to obtain AV content-related information, with a TV program used as an example of AV content, it should be noted that the information source may be otherwise. For example, it may be a built-in electronic encyclopedia. The AV content may be DVD-recorded movies and movies distributed via Internet. The information source from which to extract AV content-related information may be information incorporated in the apparatus.
Each of interface elements in the interface screen 8001 of
A TV program display screen 8002 includes a TV picture display area 8003 and a TV display operation area 8004 having a TV picture display temporary halt button, a stop button, a backward button, a forward button and a TV content scroll bar. Those functions the TVs conventionally have, including TV channel selection buttons and a sound volume adjust button, may be mounted on a remote controller as in the conventional TVs or added to the TV display operation area 8004. The TV display operation area 8004 may also be provided with a function that moves a predetermined length of time backwards and displays the video forwardly from there, such as a button that moves back by 10 minutes.
Web page display screens 8005, 8009 have web page display areas 8006, 8010, horizontal scroll bars 8007, 8011 and vertical scroll bars 8008, 8012, respectively. The web page display screen 8005 displays a web page that has been searched using a keyword extracted from videos, subtitles, telops, data broadcast and text broadcast. The web page display screen 8009 displays an electronic table of programs and a list of recorded programs.
Backward button, forward button, update button and home button that standard browsers have to control a web page are arranged in a web page control button group 8013.
A web page address input area 8014 and a search execute button 8015 have the same functions as those of the standard browsers.
A keyword display area 8016 displays three keywords, extracted in synchronism with the elapse of time of a TV program, in reverse chronological order. The number of keywords displayed in the keyword display area 8016 may be set such that the user will not feel a stress as he or she browses them.
A broadcast time display area 8017 shows an elapse of time of the program being broadcast in the form of # hours # minutes # seconds with the broadcast start time of the TV program set at 0 hour 0 minute 0 second.
The TV program display screen 9002 has a TV picture display area 9003, a TV display operation area 9004 with a TV picture display temporary halt button, a stop button, a backward button, a forward button and a TV content scroll bar. As in the explanation of
The information presentation apparatus has a keyword list generation unit 1001, a keyword management unit 1002, a web page retrieval unit 1003 and an information display unit 1004. In the following description, a keyword is also referred to as KW.
A KW extraction unit 5001 extracts keywords (KW's in a program or KW's in AV content) from videos, subtitles, telops, data broadcast and text broadcast, all making up the TV program.
An in-web page KW collection unit 5002 checks in advance (before playback or reception of AV content) web pages registered with a web page preferential order list 3003 held in a web page selection unit 3002 and gathers keywords found in the web pages (keywords in web pages and keywords in web content).
An in-web page KW classification unit 5003 checks a genre-based dictionaries not shown, determines genres represented by keywords in the web pages gathered by the in-web page KW collection unit 5002 and genres represented by web pages that contain the in-web page keywords and classifies the in-web page keywords into news, sports, music, shopping, finance and others.
The in-web page KW collection unit 5002 and the in-web page KW classification unit 5003 allow an irrelevant KW discarding unit 2007 described later to eliminate irrelevant keywords, preventing the user from having to look at unnecessary keywords and web pages searched based on the keywords. Of the two units, only the in-web page KW collection unit 5002 may be used. Or none of them may be used. “KW candidate list” represents a list of keywords in a web page, which is output by the in-web page KW collection unit 5002.
The KW management unit 1002 has a KW list 2001 in which a plurality of pairs of KW and its occurrence time can be registered, a KW selection unit 2002 and a KW comparison unit 2006 that compares a registered time, paired with the extracted keyword, with a broadcast time of a TV program and, if they match, issues a notification that they have matched.
The KW selection unit 2002 is comprised of a KW retrieval unit 2003 that retrieves keywords registered with the KW list 2001 in chronological order, a same KW discarding unit 2004 that compares a newly retrieved keyword with an immediately preceding keyword and, if they are found to be the same keywords, discards the newly retrieved keyword, and a continually recurring KW discarding unit 2005 that compares an occurrence time of a newly retrieved keyword with that of an immediately preceding keyword and, if they are found to fall within a predetermined time interval, discards the newly retrieved keyword.
The KW list 2001 comprises a KW list and a second KW list. The first KW list is a list of keywords that the in-AV content KW extraction unit 5001 making up the KW list generation unit 1001 has successively extracted in synchronism with an AV content playback time. The second KW list is a list of keywords extracted by the in-web page KW collection unit 5002 that are each attached with an associated genre by the in-web page KW classification unit 5003.
The KW retrieval unit 2003 retrieves keywords registered with the KW list 2001 in chronological order. Then the same KW discarding unit 2004 and the continually recurring KW discarding unit 2005, whose operation will be explained later, perform keyword discarding sessions to select effective keywords.
The same KW discarding unit 2004, when the same keywords are retrieved successively in time frame, discards the second and subsequent keywords. The same KW discarding unit 2004 thus can avoid a situation where a search of the same web page is repeated with the same keyword.
When a time interval between the occurrence time of a newly retrieved keyword and that of an immediately preceding keyword is short, the continually recurring KW discarding unit 2005 discards the newly retrieved keyword. The continually recurring KW discarding unit 2005 thus prevents a search of the next web page from being initiated before the user can take a good look at the retrieved web page.
The irrelevant KW discarding unit 2007 checks a newly retrieved keyword against the second KW list including in-web page keywords and, when the keyword is found to match no in-web page keywords, discards the newly retrieved keyword. If a genre of the newly retrieved keyword fails to match any of those of the in-web page keywords, the irrelevant KW discarding unit 2007 also rejects the newly retrieved keyword. Thus, if a keyword or its genre does not match any of the already searched in-web page keywords or their genres, the keyword is rejected lowering a probability of web content irrelevant to the TV program being searched and displayed. It is also possible not to consider genre but to only consider a keyword.
The KW comparison unit 2006 in step 11001 compares a registered time paired with the retrieved keyword with a broadcast time of a TV program to find a matching time. In step 11002, the KW comparison unit 2006 stores the present time and the keyword. When the KW retrieval unit 2003 picks up a next new keyword and its occurrence time, the present time of the keyword stored as described above is used as the occurrence time of the immediately preceding keyword for comparison, to be performed by the continually recurring KW discarding unit 2005, with the occurrence time of the new keyword.
The web page retrieval unit 1003 has a web page search unit 3001 that searches the Internet based on the keyword selected by the KW selection unit 2002; and a web page selection unit 3002 that determines which of a plurality of web pages searched by the web page search unit shall be displayed according to the web page preferential order list 3003.
The web page search unit 3001 enters the keyword chosen by the KW selection unit 2002 into a predetermined search site to execute a search. The web page search unit 3001 also matches the time of a web page detection to the search result (web page found by the search) in order to synchronize the KW comparison unit 2006 with the time of detection.
The web page selection unit 3002 selects, according to the web page preferential order list 3003 of
The following process reverse to what has been explained may be adopted. That is, the process involves holding a preferential order of search sites in the web page preferential order list 3003, selecting a search site of first priority order by the web page selection unit 3002, executing the search by the web page search unit 3001, and, if the search result is zero web pages, selecting a search site of second priority order by the web page selection unit 3002. In this way, the search sites may be selected in the preferential order and the web pages thus found retrieved.
The information display unit 1004 comprises a TV program display unit 4001 that displays videos, subtitles, telops, data broadcast and text broadcast, all making up TV programs; a KW list display unit 4002 that displays en masse a predetermined number of keywords picked up by the KW selection unit 2002 in an inverted chronological order; a broadcast time display unit 4003 that displays an elapse of time of the program being broadcast in the form of # hours # minutes # seconds with the broadcast start time of the TV program set at 0 hour 0 minute 0 second; a web page selective display unit 4004 that selectively displays a particular part of content, as by displaying only a text body excluding advertisements and decorative display portions; and a screen structure changing unit 4005 that changes a display area for the TV program display unit 4001 and a display area for the web page selective display unit 4004 either at a predetermined timing or by user operations.
The TV program display unit 4001 displays videos, subtitles, telops, data broadcast and text broadcast, all making up TV programs, in the TV picture display area 8003 of
The KW list display unit 4002 displays en masse a predetermined number of keywords picked up by the KW selection unit 2002 in the keyword display area 8016 in reverse chronological order. From what is shown in the keyword display area 8016 it is possible to determine from which keyword the content of a predetermined form currently being displayed, such as web page, has been searched.
The broadcast time display unit 4003 displays in the broadcast time display area 8017 an elapsed time of the TV program being broadcast in the form of # hours # minutes # seconds with the broadcast start time of the TV program set at 0 hour 0 minute 0 second. From this information the relation between the broadcast time and the keyword can be known, so it is possible to specify a desired part of content, such as a web page, that is being displayed in synchronism with the TV program, by simply giving a time instruction, such as “go back to 10 minutes before”.
The web page selective display unit 4004, according to the display format of the predetermined form of content, such as a web page, that has been searched based on the keyword, selectively displays a particular part of the content in the web page display area 8006, as by displaying only a text body excluding advertisements and decorative display portions. This allows an important part of the web page to be selectively displayed even in an narrow display area.
The screen structure changing unit 4005 changes a display area of the TV program display screen 8002 and a display area of the web page display screen 8005 displayed by the web page selective display unit 4004 either at a predetermined timing or by user operations. When, for example, a new keyword search is executed and a web page is updated, the interface screen 8001 of the apparatus presented to the user is structured as shown in
In the above embodiment, the user of the apparatus is able to simply watch a TV screen without becoming much conscious of how to select a keyword associated with the TV program from a list or how to enter a keyword from a keyboard, and still able to search and display a predetermined form of content, such as a web page, based on the keyword in synchronism with a scene included in the TV program. As described above, since the user does not have to change the conventional TV viewing style, a TV viewing environment can be realized in which the user, if not accustomed to a complicated operation of AV equipment, can browse associated web pages while watching a TV program.
While we have shown and described several embodiments in accordance with our invention, it should be understood that disclosed embodiments are susceptible of changes and modifications without departing from the scope of the invention. Therefore, we do not intend to be bound by the details shown and described herein but intend to cover all such changes and modifications that fall within the ambit of the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2007-171376 | Jun 2007 | JP | national |
