This application relates to a method and system to search viewable content in the context of television entertainment.
The approaches described in this section could be pursued, but are not necessarily approaches that have been previously conceived or pursued. Therefore, unless otherwise indicated herein, the approaches described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.
In the field of television entertainment, there is a new generation of viewers that has a high expectation of the level of entertainment to be enjoyed from television programming. These viewers may expect more choice, more flexibility, as well as the ability to interact and participate more with the viewable content.
On the other hand, the sheer volume of content that is available for viewing is exploding dramatically. Just the number of television channels that are now available is almost unmanageable. The amount of content that is available via free video or video on demand service is also increasing. It is now possible to view content over a wider span of time by employing time shifting technologies, such as Personal Video Recording (PVR) (sometimes referred to as DVR or Digital Video Recording). This explosion of content may be described as a paradox of choice, where the excess of choices causes a viewer's inability to choose.
Embodiments are illustrated by way of example and not limitation in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
A method and system to search viewable content available for viewing (e.g., satellite content, cable content, mobile telephony content, IPTV content, and the like) and to manage a viewer's choice is described. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of an embodiment of the present invention. It will be evident, however, to one skilled in the art that the present invention may be practiced without these specific details. It is to be noted that the delivery mechanism for the content for viewing may be via a satellite, cable, terrestrial broadcast, Internet, local storage, a local network, mobile telephony, or any other content distribution network. Accordingly, the viewing device need not be a television set but may be any display unit of any device (including portable devices). It will be noted that any references to television content will be understood to include any content available for viewing on an entertainment display device, such as a television screen. Such content may include television programming, as well as locally stored content, such as stored video files or digital images, as well as content accessible via the Internet. It will be noted that the term viewer may be understood broadly as any viewer of the system to navigate television content.
In one example embodiment, a viewer is permitted to enter or select a search term or an indication of a desired content item, e.g., via the directional keys on a remote control device used to navigate television programs. An example system to search viewable content uses a search term or a keyword designated by the viewer (e.g., via text entry, chosen from a list or keywords, etc.) to locate and select content that has been identified as potentially desired by the viewer, based on the submitted search term. For example, the system may search for a desirable content item by detecting the search term in the title of a particular content item. In some embodiments, the system may be configured to investigate metadata associated with a content item with respect to the search term and determine whether the content item should be presented to the viewer based on the results of the investigation.
The search results may be provided to the viewer in a variety of formats. For example, one or more content items that were determined to be most relevant with respect to the search term provided by the viewer, may be presented to the viewer in a manner that allows the displaying of a still picture or streaming video. In some embodiments, the search results may be presented in the form of a list of items, from which the viewer may make a selection. The search results may also be provided by grouping a plurality of links to resulting content items into several categories, based on different interpretations of a more precise meaning of the search term.
As described in more detail below, a search term may be determined from a search request that was submitted to the system by a viewer utilizing a text entry mode. A request may also be submitted by selecting a keyword extracted from metadata associated with a content item or selected from a list of keywords provided to the viewer as part of a particular navigation mode. For example, a list of keywords may be provided with a so-called media card associated with a particular content item. A media card, in one example embodiment, may provide additional information regarding the content item, including a list of keywords, stored as metadata associated with the content item. In some embodiments, a search term may be derived from a selection made by a viewer from a so-called margin menu.
A margin menu, in one example embodiment, is a menu that can be displayed in the margins of a viewing area (e.g., in the margins, or along the edges of video content, or at the periphery of a TV screen or any other viewing device). A system to search viewable content, in some example embodiments, may be implemented as part of a system to navigate viewable content that may include functionality beyond search capabilities. An example system to navigate viewable content in the context of television entertainment may be described with reference to
The presentation module 206 may be configured to present viewers with search options, search results, as well as with various navigation options. For example, the presentation module 206 may cooperate with a margin menu module 218 to present different margin menus in response to viewer's requests associated with directional keys on a remote control device. The margin menu module 218, in one example embodiment, may include a plurality of modules, each of which being associated with its respective margin menu. Example margin menus are described further below. The presentation module 206 may also be configured to present to a viewer a media card associated with a particular content item, utilizing a media card module 220.
As mentioned above, the content available for viewing on an entertainment display device may include television programming, locally stored content, video on demand, as well as content accessible via a local network or the Internet. The system 200, in one example embodiment, includes a broadcast interface module 222 to access television programming, a library interface module 224 to access locally stored content, a video on demand module 226 to access video on demand, an Internet interface module 228 to access local network and Internet content, and an anticipation engine 212 to drive recommendations suggested to a viewer. Example recommendations mode is described further below. It will be noted that some or all of the modules of the system 200 may be considered to be a system to search viewable content. Example operations performed by the system 200 may be described with reference to
As shown in
The concept of margin menus in general may be utilized advantageously with the system 200 to navigate viewable content to assist viewers to navigate to relevant and interesting content. In one example embodiment, an interface for navigating viewable content may include a feature that permits a viewer to continue viewing the current content while, at the same time, previewing different content (e.g., the content selected via a margin menu choice). It will be noted, however, that in some embodiments there may not be a margin per se. In such situation, the main content may be resized in order to create space for the margin menu. An example margin menu may be displayed such that it does not obscure the content that a viewer is currently watching, while permitting a viewer to start navigating towards different viewable content. A separate margin menu may be associated with each directional key on a viewer's remote control device. The margin menu may extend around the entire periphery of the viewing area or only a portion thereof. In one example embodiment, the directional keys that are provided with a remote control device may be utilized to navigate margin menus, with or without employing a specialized control key to permit content navigation and selection.
In one example embodiment, a margin menu associated with a particular directional key may be displayed in such a way that it reinforces a viewer's key-menu association. For example, a margin menu associated with an “Up” directional key may be displayed near the top edge of the viewing area, a “Down” directional key may be displayed near the bottom edge of the viewing area, a “Left” directional key may be displayed near the left edge of the viewing area, and a “Right” directional key may be displayed near the right edge of the viewing area. It will be noted, that a variety of remote control devices may be utilized with the system to navigate viewable content, including, e.g., controllers designed for games, that may have more than four directional keys. Using points of a compass, such controllers may have directional keys labels as “N,” “NE,” “E,” “SE,” “S,” “SW,” “W,” and “NW,” and these directional keys may also be used by the system to permit viewers to navigate through viewable content.
In order to exit from viewing a margin menu, a viewer may press the directional key opposite from the key that engaged the margin menu. For example, a viewer may bring up a left margin menu by pressing the left directional key and then exit from viewing the left margin menu by pressing the right directional key. According to one example embodiment, a viewer may also exit by pressing some other key as well, such as “Back”, “Exit,” or any other key. It will be appreciated that the specific interface used to navigate a margin menu may vary from one viewing device to another. For example, when viewing content on a computer system, directional keys of a keyboard may be used. When viewing content on a mobile device, numerical keys may be used, and so on.
Returning to
If it is determined, at operation 316, that a particular search result was selected by the viewer, the content item associated with the selected search result is displayed at operation 318. As mentioned above, an example system to search viewable content may be configured to permit a viewer to enter a search term or a keyword utilizing various features or navigation modes that may be provided with the system 200 to navigate viewable content. Example operations that may be performed while processing a search request may be discussed with reference to
As shown in
In another embodiment, instead of presenting the wheels of letters to a viewer, each of the four directional keys may be associated with a plurality of letters, so that the viewer may be able to select letters by pressing the directional keys. For example the “Up” key may be associated with the letters A, B, C, D, E and F. This technique may be termed “T4,” as text may be entered via the four directional keys provided on a remote control device. Because, in this embodiment, there is no one-to-one association between letters and the directional keys, the text entry module 208 of
Returning to
In one example embodiment, the example system to search viewable content may be configured to present a navigation grid associated with some or all of the margin menu to provide a more advanced discovery mode. A respective a navigation grid for a margin menu may be requested by pressing the direction button a second time when the margin menu is shown. For example, a recommendation margin menu may be associated with a recommendation grid, which is described further below. A “Recommend” action on a media card, for example, may be configured to permit a viewer to drive a recommendations grid based on the piece of content associated with the media card. An example media card is illustrated in
As shown in
As mentioned above, the system 200 may be configured to receive requests initiated by activating directional keys provided on a television remote control device. The requests may activate functionality to provide shortcuts to a variety of content navigation functions (e.g., to automatically engage a particular way of navigating), and thus may be referred to as “surfcuts,” as navigating through content is sometimes referred to as “surfing”. A content navigation function (or a content navigation mode that may comprise a variety of navigation functions) may be associated with a particular margin menu. The search margin menu is an example margin menu.
Returning to
In one example embodiment, in response to a search request, a viewer is presented, at operation 418, with one or more terms reflecting more precise meanings of the search term determined from the search request, as a way to permit the viewer to filter or refine the search results. A process to determine a more precise meaning of the search term may be referred to as disambiguation. If it is determined, at operation 420, that the viewer selected the presented term that reflects a more precise meaning of the search term, the selected term is used to generate refined search results at operation 422. At operation 424, the refined search results are presented to the viewer. If it is determined, at operation 426, that the viewer selected a particular item from the search results, e.g., by navigating to the particular item and activating the “Select” button on the remote control device, the content item associated with the selection is displayed at operation 428.
An example presentation interface that utilizes a disambiguation technique is illustrated in
Another example mechanism to refine or filter the search results is to present the viewer with an option to select a particular keyword, tag, category, or a type of content. An example presentation interface providing a viewer with a selection of a keyword, a tag, a category, or a type of content is illustrated in
One example interface is single screen faceted browsing, where a list of filter terms is presented in multiple lists in the same interface as the search result list. One list of terms may be content categories and another list of terms may be content specific keywords/tags. In one example embodiment, moving between the terms and selecting terms from the lists allows the search results to be filtered/pivoted. The viewer may navigate between the search results list and search term lists using the “Left” and “Right” directional keys and navigate up and down the lists using the “Up” and “Down” directional keys. The search results list may contain images, text, or video to identify the associated content in the search result set.
One example of a search results list is a “lightbox” model, where a search result is just the title of a content item except for the search item that has focus, which would be expanded in size to contain a thumbnail video or a still image. In one example embodiment, the pool of content utilized to generate a list of search results includes broadcast content, on-demand content, recorded content, Internet content, content stored on a local network, as well as any other type of content that may be viewable on a television set, or any other display device.
In one example embodiment, a viewer may access content items associated with previously generated search results by activating a search margin menu. In one example embodiment, the search margin menu that may be presented near the right margin of the viewer's screen, displays content items associated with previous search results. The search margin menu may be activated by the “Right” directional key on a remote control device. An example search margin menu is illustrated in
In one example embodiment, the system to navigate viewable content may be configured to provide other margin menus in addition to the search margin menu. Other margin menus may include a library margin menu, a broadcast margin menu, sceneographic margin menu, and a recommendation margin menu. As mentioned above, the system may be configured to present a navigation grid associated with some or all of the margin menu to provide a more advanced discovery mode that may be requested by pressing the direction button a second time when the margin menu is shown.
The library margin menu, in one example embodiment, permits a viewer to access content, both for locally sourced content (e.g., PVR), and remotely sourced content (e.g., video on demand, content from a local network, content via Internet-based distribution, etc.). The library margin menu, in one example embodiment, may be activated by the “Left” directional key on a remote control device and may be displayed near the left margin of the viewer's screen. Each item in the library margin menu may have associated “Preview” and “Select” (or “OK”) options. The “Preview” option may permit a viewer to visually access the content that is different from the currently viewed content, while continuing to display the currently viewed content. Once the library margin menu has been engaged, a viewer may use directional keys on a remote control device to move between different content items (e.g., by pressing the “Up” and “Down” directional keys). The “Select” key, activated on a remote control device, in one example embodiment, causes the currently viewed content to be replaced by the new content. The library margin menu, in one example embodiment may be associated with a library grid. An example library grid includes a display area divided into a plurality of sections, where each section (e.g., each column) includes library content items associated with different categories. In some embodiments a viewer may be invited to use default categories (e.g., “Movies,” “TV Programs,” “Sports,” “Photos,” etc.) or create custom categories. In one example embodiment, the content items that may be accessed utilizing the library menu and the library grid are the content items that have been designated by a viewer as being of interest to the viewer (e.g., recorded, bookmarked, etc.)
Another example of a margin menu is a broadcast margin menu. The broadcast margin menu, in one example embodiment, may be activated by the “Down” directional key on a remote control device and may be displayed at the bottom of the viewer's screen. The broadcast margin menu may permit a viewer to see what TV programs are available on other channels.
In one example embodiment, a viewer may be permitted to select and view a program from the broadcast margin menu, or, alternatively, the viewer may be permitted to access a so-called broadcast grid associated with the broadcast margin menu. In one example embodiment, the broadcast grid is an additional linear TV grid, which may include some features of a conventional TV grid. In one example embodiment, the TV grid may be displayed such that the channels run across the top of the viewer's screen, while the time runs down the side of the viewer's screen. It will however be appreciated that the grid could be provided on any display device. The broadcast grid may be accessed by the viewer by pressing the same button that was used to access the broadcast margin menu while the broadcast margin menu is visible.
Within the broadcast grid, a viewer may be permitted to not only navigate by content, but also by the channel names or brands. So as with any other content item, a viewer may bring up a media card to view information associated with a particular channel, to search based on that channel, to make recommendations based on the channel brand, or to save content associated with the channel.
In one example embodiment, each content item associated with a particular channel in the broadcast margin menu (or in a broadcast grid) may be displayed utilizing a still image or streaming video. When the channels in the broadcast margin menu or in a broadcast grid are represented as streaming videos, a viewer may be permitted to actually sample the channels' content directly through these individual screens. In one example embodiment of the broadcast grid, the text associated with different TV programs may be presented as having different color, brightness, or different font size, or any combination of the above, to indicate a recommendation generated by the anticipation engine 230 of the system 200 illustrated in
In one example embodiment, the “Up” directional key on a remote control device may be utilized to engage a recommendations margin menu. The recommendations margin menu may be associated with an engine that may be configured to intelligently anticipate a viewer's choice of particular content. Thus, such an engine may be termed an anticipation engine. The recommendations generated by an example anticipation engine may be based, for example, on the specific content that the viewer is currently watching, a profile of the viewer, environmental context, general popularity, or any combination of the preceding factors. A margin menu with several recommended content items may appear near the top margin of the viewer's screen in response to the control key. The viewer may then select any of the recommended content items, either for preview or for committed viewing. Alternatively, the viewer may choose to solicit further recommendations by engaging a so-called full committed interface (or entering a committed recommendations mode). While in the example committed recommendations mode, a viewer may request recommendations from the anticipation engine based not on the originally viewed content but rather based on the selected recommended content item. In response, the anticipation engine may provide further recommendations to be displayed by the navigation interface.
It will be noted, that the recommendations mode that permits viewers to view recommendations and solicit more targeted recommendations may be accessed from any other margin menu, navigation grid, media card, or any other component of the viewer interface. In one example embodiment, a viewer may be presented simultaneously with recommendations based on the originally viewed content and with recommendations based on the selected recommended content item, as well as on the profile of the viewer. The content item that is selected to be the basis for a group of recommended content items may be called a source item. For example, while the system is operating in the committed recommendations mode, a source item (e.g., a source video) may be displayed along with two recommended content items displayed either side of it. A viewer may be permitted to navigate with the “Left” and “Right” directional keys to either of those content items. If a viewer navigates to a recommended content item and selects it, the item may be then brought into focus and displayed in the center of the viewer's screen, as the new source content item, surrounded by two other recommendations. A viewer may navigate with the “Up” directional keys to retain the current source content and replace the two recommended content items with two new recommendations based on the same source item. A viewer may navigate with the “Down” directional keys to return to a previous source item. The recommendations may be displayed as still images, while the source item may be displayed as a streaming video. Data about the recommendations and the source item may be displayed with images, video, or text, for example, title. For a recommendation item, this data may also include the tag/keyword common to the recommendation item and source item that had the most influence on the recommendation being made.
To illustrate an example use case of the recommendations mode, as a viewer follows the direction of a recommendation, the new recommendation in the same direction may have the same link, creating an association between the direction and the tag/keyword while the same direction is followed. In one example embodiment, the recommended content items may be selected from a variety of sources, such as broadcast television, video-on-demand, the content on the viewer's PVR, the content available over the Internet, content available from a local network(s), as well as from any interactive, dynamic or Internet Protocol (IP) based content.
The anticipation engine, in one example embodiment, may utilize a variety of criteria in order to generate recommendations for a particular viewer. An example criteria may include the viewer's consumption statistics or viewing behavior, e.g., what a viewer has actually watched in the past. Another criterion that may be used by the anticipation engine is a viewer's environment, e.g., the current time of day, the viewer's geographic location, or the type of the viewer's display device (e.g., a TV set which may be a standard definition TV set or a high definition TV set). Furthermore, the anticipation engine may utilize data that may be indicative of the viewer's mood. For example, information pertaining to how hard the viewer is pressing the remote control buttons and how long the viewer has lingered on each content item may provide an indication of the viewer's mood. Thus, the anticipation engine may be configured to utilize a viewer's environment and mood indicators, in addition to utilizing the viewer's consumption patterns, in order to generate recommendations. It will be noted that, in one example embodiment, the anticipation engine may utilize a variety of recommendation techniques. For example, the content presented to a viewer as related to the source content item may be shared from a social network, and use collaborative filtering.
In one example embodiment, a viewer may be presented with reasoning behind recommendation, e.g., the name of the actor, a category, a particular key word, etc. The recommendations may be based, for example, on one or more characteristics of the source content item, on the viewer's personal profile, or on a combination of both.
As shown in
The suggested content items are displayed at operation 1108. The method 1100 proceeds further to permit a viewer to explore further recommendation, unless it is determined, at operation 1110, that the viewer requested to exit the recommendation mode, in which case the system 200 processes the exit request, at operation 1112. In one example embodiment, if it is determined, at operation 1114, that the viewer selected a suggested content item, the method proceeds to operation 1104 to display the selected content item as a new source item and continue with determining further suggested content.
In some embodiments, the anticipation engine 230 may be configured to generate a set of recommendations first, and then, for each recommendation, compare keywords from a recommended content item metadata with keywords from the source content item metadata to determine a keyword that reflects such commonality between these to content items that the keyword may be considered the strongest link between the recommended content item and the source content item. This determined keyword may be used by the anticipation engine 230 to drive further recommendations in response to further navigation requests from the viewer.
It will be noted that, although the embodiments have been described by way of example with reference to digital video, it will be appreciated to a person of skill in the art that the techniques described herein may be utilized to navigate and to manage the choice of any digital data.
In alternative embodiments, the machine operates as a standalone device or may be connected (e.g., networked) to other machines. In a networked deployment, the machine may operate in the capacity of a server or a client machine in server-client network environment, or as a peer machine in a peer-to-peer (or distributed) network environment. The machine may be a personal computer (PC), a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a cellular telephone, a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while only a single machine is illustrated, the term “machine” shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
The example computer system 1200 includes a processor 1202 (e.g., a central processing unit (CPU), a graphics processing unit (GPU) or both), a main memory 1204 and a static memory 1206, which communicate with each other via a bus 1208. The computer system 1200 may further include a video display unit 1210 (e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)). The computer system 1200 also includes an alphanumeric input device 1212 (e.g., a real or virtual keyboard), a viewer interface (UT) navigation device 1214 (e.g., a remote control or a mouse), a disk drive unit 1216, a signal generation device 1218 (e.g., a speaker) and a network interface device 1220.
The disk drive unit 1216 includes a machine-readable medium 1222 on which is stored one or more sets of instructions and data structures (e.g., software 1224) embodying or utilized by any one or more of the methodologies or functions described herein. The software 1224 may also reside, completely or at least partially, within the main memory 1204 and/or within the processor 1202 during execution thereof by the computer system 1200, the main memory 1204 and the processor 1202 also constituting machine-readable media.
The software 1224 may further be transmitted or received over a network 1226 via the network interface device 1220 utilizing any one of a number of well-known transfer protocols (e.g., HTTP).
While the machine-readable medium 1222 is shown in an example embodiment to be a single medium, the term “machine-readable medium” may be taken to include a single medium or multiple media (e.g., a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. The term “machine-readable medium” shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions for execution by the machine and that cause the machine to perform any one or more of the methodologies of the present invention, or that is capable of storing, encoding or carrying data structures utilized by or associated with such a set of instructions. The term “machine-readable medium” shall accordingly be taken to include, but not be limited to, solid-state memories, optical and magnetic media, and carrier wave signals.
The embodiments described herein may be implemented in an operating environment comprising software installed on a computer, in hardware, or in a combination of software and hardware.
Although embodiments have been described with reference to specific example embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
This application claims the priority benefit of U.S. Provisional Application Ser. No. 60/842,735 filed on Sep. 7, 2006 and entitled “METHOD AND SYSTEM TO NAVIGATE MULTIMEDIA CONTENT” and of U.S. Patent Application Ser. No. 60/911,009 filed on Apr. 10, 2007 and entitled “METHOD AND SYSTEM TO SEARCH MULTIMEDIA CONTENT IN THE CONTEXT OF TELEVISION ENTERTAINMENT”, both of which are incorporated by reference in their entirety. This application is also related to co-pending and commonly assigned PCT Application entitled “METHOD AND SYSTEM TO NAVIGATE VIEWABLE CONTENT” filed on even date herewith and incorporated by reference in its entirety.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/US07/19527 | 9/7/2007 | WO | 00 | 10/15/2010 |
Number | Date | Country | |
---|---|---|---|
60842735 | Sep 2006 | US | |
60911009 | Apr 2007 | US |