Patent Grant
8621514
Media devices, such as a set top box, a television, a computer system, a game system, or the like, are configured to present program content to a user. To assist the user in selecting program content, an electronic program guide (EPG) may be presented to the user on a display. The EPG is a type of user interface that presents a menu, or a series of menus, that use a combination of text and symbols to indicate program content viewing choices that may be selected by the user. Some EPGs include a thumbnail image pertaining to the indicated program content to further assist the user in understanding the subject matter of the indicated program content. The thumbnail image may be a single frame or other still image that may be selected from and/or that may be related to the indicated program content.
However, the thumbnail image in combination with the text and the symbols may not adequately describe the nature of the indicated program content on the presented EPG. Even if a sufficient textual description is provided in the presented EPG, it may take some amount of time for the user to read and interpret the EPG information. Accordingly, there is a need in the arts to more efficiently present information in an EPG that may be more quickly understood by the user.
Systems and methods of generating a video thumbnail electronic program guide (EPG) that include at least one video thumbnail are disclosed. An exemplary embodiment receives a media content stream at a media device; picks a plurality of still image video frames from the received media content stream, wherein each still image video frame has information that is sufficient to construct the still image video frame; generate a plurality of still image video frame thumbnails, wherein each of the still image video frame thumbnails correspond to one of the still image video frames; generate a video thumbnail from the plurality of still image video frame thumbnails; and incorporate the video thumbnail with at least one program descriptor and a channel identifier associated with the media content stream into the video thumbnail EPG.
Preferred and alternative embodiments are described in detail below with reference to the following drawings:
Embodiments of the video thumbnail EPG system 100 process a plurality of received media content streams 110 to generate a plurality of relatively small sized video clips that are combined with, or are otherwise added to, the EPG information that describes available program content. Accordingly, the exemplary video thumbnail EPG system 100 comprises a listing of channel identifiers 112 that identify the programming available on selected ones of the received media content streams 110, a program descriptor 114 providing textual information describing the program content on corresponding listed channels, and a video thumbnail 116 that presents a relatively small sized video clip of selected video content corresponding to one of the received media content streams 110.
In an exemplary embodiment, a series of consecutive still image video frames are selected from one of the received media content streams 110. Each selected still image video frame is compressed into a still image video frame thumbnail. In an exemplary embodiment, the generated still image video frame thumbnails are saved for later presentation. When the video thumbnail EPG 104 is presented, the series of still image video frame thumbnails are retrieved and a video thumbnail 116 is constructed therefrom by serially presenting the retrieved still image video frame thumbnails.
A selected still image video frame is characterized as having a complete set of video information that is sufficient to construct a still image video frame thumbnail. For example, the received media content streams 110 may be communicated to the media device 102 using one of the motion picture experts group (MPEG) standards. The MPEG intra-coded frames (I-frames) are “still image” frames that have a complete set of video information. Other MPEG frames have less video information, and may be reconstructed by the media device 102 based upon a related I-frame.
As a currently processed MPEG media content stream 110 provides an I-frame in the stream of video frames, that I-frame may be picked from the received media content stream 110. The picked I-frame is compressed into a still image video frame thumbnail, and is stored. In an exemplary embodiment, as a next one of the I-frames arrives at the media device 102, that I-frame is picked from the received media content stream 110, is compressed, and is stored. After some duration, a sequential series of I-frame type still image video frame thumbnails have been generated and saved such that the video thumbnail 116 may be generated. The video thumbnail 116 may then be incorporated into a presented video thumbnail EPG 104 such that the user views the short video thumbnail 116 of the program content on corresponding channels that are listed on the presented video thumbnail EPG 104. That is, the user is presented a thumbnail video clip derived from previously received program content for the currently presented program.
An exemplary media content stream 110 formatted under an MPEG standard may, for example, have an I-frame in the content stream approximately every second. Accordingly, the video thumbnail 116 may be comprised of a series of still image video frame thumbnails that are presented at a rate of approximately one frame per second. In comparison with a typical frame rate of thirty frames per second, the exemplary video thumbnail 116 may present a video clip that is relatively choppy. For example, the motion of a moving person may appear rather “jerky” in the presented video thumbnail 116. However, the user will perceive sufficient information to gain an improved understanding of the subject matter of the program listed on the presented video thumbnail EPG 104.
Any MPEG standard, or other video standard, may be used to compress the communicated video information residing in the media content streams 110. In situations where the media content stream 110 communicates video frames that are all independently reproducible, or where there are a large number of such video frames provided, embodiments may be configured to selectively pick ones of the complete video frames from the media content stream 110 based on a predefined duration or based upon a specified number of frames (e.g.: pick every third frame).
Audio information, in an exemplary embodiment, is not picked from the media content stream 110. In such embodiments, audio information is not presented with the video thumbnail 116. In an alternative embodiment, video information is picked from the media content stream 110 and is saved. The user may selectively listen to the audio portion of the video thumbnail 116.
An exemplary video thumbnail EPG 104 comprises a series of rows corresponding to information that identifies one of the received media content streams 110. Each of the rows are subdivided into portions that form columns of related information. In the exemplary video thumbnail EPG 104, the first left hand column corresponds to channel identifiers 112 that are uniquely assigned to each one of the received media content streams 110. The second column presents the generated video thumbnail 116 that corresponds to that particular one of the received media content streams 110. The remaining portion of the video thumbnail EPG 104 corresponds to columns arranged by time of day. Below the time of day columns, the program descriptors 114 present selected program information pertaining to that particular one of the received media content streams 110. Presented program information may include, for example, the title of the program that is currently being presented in that particular one of the received media content streams 110. Other information of interest may also be presented. An end of the current program may be identified by the time at which a transition to a new program title begins.
Alternative embodiments may present the channel identifiers 112, the program descriptors 114 and the generated video thumbnail 116 in a different order. For example, the video thumbnails 116 may be presented on the far left hand side of the video thumbnail EPG 104.
The generated video thumbnail 116 illustrated in the exemplary video thumbnail EPG 104 is relatively small. Actual size of the presented video thumbnail 116 will vary depending upon the size of the display 106 and/or the number of programs listed on the video thumbnail EPG 104. In some embodiments, the user may highlight or otherwise select a particular one of the video thumbnails 116 presented on the video thumbnail EPG 104. Upon highlighting or selecting, the size of the video thumbnail 116 may be increased to improve visibility of the video thumbnail 116 to the user.
In the illustrative video thumbnail EPG 104, the top row of the exemplary video thumbnail EPG 104 indicates that “Station A” is currently presenting a “Program A” that started at 8:00 p.m. on the current date, Apr. 1, 2010. A video thumbnail 110a (illustrating a talking man) is presented between the channel identifier 112 and the program descriptor 114. The video thumbnail 110a imparts information that may assist the user in ascertaining their level of interest in the Program A. For example, in the video thumbnail 110a, the man may be a famous recognizable actor performing a dialogue scene. If the user enjoys programs with that particular actor, they will readily appreciate that the program may be of interest. Accordingly, the user may choose to select Program A for presentation by suitably navigating about the video thumbnail EPG 104 and selecting that program for presentation using their remote control 118.
The next row of the exemplary video thumbnail EPG 104 indicates that “Station B” is currently presenting a “Program B-1” that started on or before 8:00 p.m., and is scheduled to conclude at 9:00 p.m. The video thumbnail 116b is of a person taking a photograph. The video thumbnail 116b may present actions by the photographer, and then might switch to the subject being photographed, to impart that the subject matter of Program B-1 pertains to a photography program.
Upon the conclusion of the presentation of the Program B-1, the Program B-2 is scheduled for presentation. When the currently presented Program B-1 concludes, the still image video frame thumbnails for the video thumbnail 116b may be optionally deleted. Alternatively, the still image video frame thumbnails for the video thumbnail 116b may be retained for later use, such as in instances where the Program B-1 is scheduled for later presentation. At that time, when the Program B-2 is being presented, a still image video frame thumbnails derived from the program content for Program B-2 will be used for the video thumbnail 116b.
The next row of the exemplary video thumbnail EPG 104 indicates that “Station C” is currently presenting a “Program C-1” that started on or before 8:00 p.m., and is scheduled to conclude at 9:00 p.m. The video thumbnail 116c is of a panoramic landscape scene. The video thumbnail 116c may present a panning view of the landscape scene to impart, for example, that the subject matter of Program C-1 pertains to a travel documentary program.
The next row of the exemplary video thumbnail EPG 104 indicates that “Station D” is currently presenting a “Program D” that started on or before 8:00 p.m., and is scheduled to conclude at, or after, 9:00 p.m. The video thumbnail 116d is of a running deer. The video thumbnail 116d may impart, for example, that the subject matter of Program D pertains to a wildlife program or a hunting program. Some embodiments of the video thumbnail EPG system 100 are configured to update the video thumbnail 116d using a newer generated series of still image video frame thumbnails. That is, the video thumbnail 116d may correspond to an earlier received portion of the received media content stream 110 corresponding to the Program D. As a current portion of the media content stream 110 for the Program D is received, a series of newly received consecutive still image video frames are picked from the content stream and are compressed into a series of new still image video frame thumbnails. When a sufficient number of new still image video frame thumbnails are saved, a new video thumbnail 116d may be presented on the video thumbnail EPG 104.
The next row of the exemplary video thumbnail EPG 104 presents the video thumbnail 116e of a mountain to indicate that “Station E” is currently presenting a “Program E” with the subject matter pertaining to a mountain climbing program or a skiing program, for example. The last row of the exemplary video thumbnail EPG 104 presents the video thumbnail 116f of a running football player to indicate that “Station F” is currently presenting a “Program F” that corresponds to a football game or related sports program.
Like conventional EPGs, the user may navigate about the video thumbnail EPG 104 in any suitable manner. For example, a program of interest may be selected depending upon the user's interest. The user may scroll up or down the video thumbnail EPG 104 to view information for additional ones of the received media content streams 110 using their remote control 118.
Alternative embodiments of the video thumbnail EPG 104 may present available programming on less than, or more than, the exemplary six program channels illustrated in
The functionality of the media device 102, here a set top box, is now broadly described. A media content provider provides program content that is received in one or more media content streams 110 multiplexed together into one or more transport channels. The transport channels with the media content streams 110 are communicated to the media device 102 via a media system sourced from a remote head end facility (not shown) operated by the media content provider. Non-limiting examples of such media systems include satellite systems, cable system, and the Internet. For example, if the media content provider provides programming via a satellite-based communication system, the media device 102 is configured to receive one or more broadcasted satellite signals detected by an antenna (not shown). Alternatively, or additionally, the media content stream 110 can be received from one or more different sources, such as, but not limited to, a cable system, a radio frequency (RF) communication system, or the Internet.
The one or more media content streams 110 are received by the media content stream interface 202. One or more tuners 202a, 202b in the media content stream interface 202 selectively tune to one of the received media content streams 110 in accordance with instructions received from the processor system 204. The processor system 204, executing the media content processing logic 218 and based upon a request for a program of interest specified by a user, parses out program content associated with the program of interest. The program of interest is then assembled into a stream of video and/or audio information which may be stored by the program buffer 208 such that the program content can be streamed out to the media presentation device 108, such as the exemplary television, via the presentation device interface 212. Alternatively, or additionally, the parsed out program content may be saved into the DVR 210 for later presentation.
From time to time, information populating the current EPG information 224 is communicated to the media device 102, via a special media content stream 110 or via another suitable media. The current EPG information 224 stores the information pertaining to currently scheduled programming. The current EPG information 224 may include, but is not limited to, a scheduled presentation start and/or end time, a program channel, and descriptive information. The program's descriptive information may include the title of the program, names of performers or actors, date of creation, and a summary describing the nature of the program. Any suitable information may be included in the program's supplemental information.
The above processes performed by the media device 102 are generally implemented by the processor system 204 while executing the media content processing logic 218. Thus, the media device 102 may perform a variety of functions, including preparing program content for presentation on the display 106 of the media presentation device 108.
The processor system 204 executes the video thumbnail generator 220 to pick selected still image video frames from one of the received media content streams 110. The picked still image video frames, such as the exemplary I-frames, are each compressed into the still image video frame thumbnail in accordance with a suitable video information processing algorithm stored in the video thumbnail generator 220.
Upon receipt of a command from the user requesting presentation of the video thumbnail EPG 104, the program schedule information residing in the current EPG information 224 is retrieved, formatted, and integrated with corresponding ones of the video thumbnails 116 stored in the video thumbnail file 222. The video thumbnail EPG 104 may then be presented on the display 106.
Some embodiments may include the optional portable media device interface 216 that communicatively couples the media device 102 to another electronic device, such as the portable media device 226, via a communication network 228. Non-limiting examples of the portable media device 226 include a cellular phone, a personal device assistant (PDA), a laptop computer, or the like. The video thumbnail EPG 104 may be communicated to the portable media device 226 for presentation on its display 230.
The communication network 228 is illustrated as a generic communication system. In one embodiment, the communication network 228 comprises a radio frequency (RF) wireless system. Accordingly, the portable media device interface 216 is a suitable cellular transmitter. Alternatively, the communication network 146 may be a telephony system, the Internet, a microwave communication system, a fiber optics system, an intranet system, a local access network (LAN) system, a local network, an Ethernet system, a cable system, a radio frequency system, a cellular system, an infrared system, a satellite system, or a hybrid system comprised of multiple types of communication media. Alternative portable media device interfaces 216 may be configured to provide connectivity to any suitable communication network 228.
When the media device 102 is not currently used for program presentation and/or recording, the tuners 202a and 202b will not be actively retrieving a media content stream 110 for presentation and/or recording. Embodiments of the thumbnail EPG system 100 may be configured to use one or both of the tuners 202a and 202b to pick still image video frames from a selected media content stream 110. For example, the tuner 202a may be receiving a first media content stream 110 from which the still image video frames are picked from. Concurrently, the tuner 202b may be receiving a second media content stream 110 from which still image video frames are picked from. The processor system 204 receives the picked still image video frames, generates the associated still image video frame thumbnails, and saves them into the video thumbnail file 222. The saved image video frame thumbnails may be later retrieved and assembled into a video thumbnail 116. Accordingly, the first series of still image video frame thumbnails picked off by the first tuner 202a from the first media content stream 110 may be saved to later generate a first video thumbnail 116. The second series of still image video frame thumbnails picked off by the second tuner 202a from the second media content stream 110 may be saved to later generate a second video thumbnail 116.
Alternatively, a first video thumbnail 116 associated with the first media content stream 110 may be generated and saved into the video thumbnail file 222. A second video thumbnail 116 associated with the second media content stream 110 may be generated and saved into the video thumbnail file 222.
The video thumbnails 116 are of a relatively short duration. An exemplary embodiment generates video thumbnails 116 that are approximately thirty seconds long, though any suitable duration may be used. In some embodiments, durations of the various video thumbnails 116 may be different. For example, the durations of video thumbnails 116 associated with a favorites channel list and/or most frequently watched channels may have a longer duration than other video thumbnails 116.
Once the series of still image video frame thumbnails, or alternatively the video thumbnail 116, for a particular one of the media content streams 110 have been generated, a different media content stream 110 is tuned to and a new series of still image video frame thumbnails, or alternatively a new video thumbnail 116, are generated for the new media content stream 110. For example, after a sufficient number of still image video frames from the first media content stream 110 have been picked to construct the first video thumbnail 116, the tuner 202a may be re-tuned to a third media content stream 110 such that a third series of still image video frame thumbnails may be picked, or alternatively a third video thumbnail 116, are generated and saved. Similarly, after a sufficient number of still image video frames from the second media content stream 110 have been picked to construct the second video thumbnail 116, the tuner 202b may be re-tuned to a fourth media content stream 110 such that a fourth series of still image video frame thumbnails, or alternatively a fourth video thumbnail 116, are generated and saved. The process of generating video thumbnails 116 for the plurality of received media content streams 110 continues such that a plurality of video thumbnails 116 may generated.
Some embodiments are configured to generate a video thumbnail 116 for each one of the received media content streams 110. However, it is appreciated that some media content providers provide hundreds, even thousands, of different media content streams 110. In such applications, generating a video thumbnail 116 for each one of the received media content streams 110 may not be practical since there may not be a sufficient amount of time to generate video thumbnails 116 for each of the received media content streams 110. Accordingly, some embodiments of the thumbnail EPG system 100 may be configured to generate and save a video thumbnail 116 for selected ones of the received media content streams 110. Accordingly, the number of media content streams 110 for which a series of still image video frame thumbnails (or video thumbnails 116) are generated and saved is limited to a more manageable number.
For example, video thumbnails 116 for media content streams 110 associated with channels of a favorites list and/or a most watched list may be generated. In another embodiment, the media content provider may provide the same program content in a high definition (HD) format and a standard definition format. Here, a single series of still image video frame thumbnails (or a single video thumbnail 116) may be generated using one of the media content streams 110, and then used when that particular channel (HD or standard definition) is shown on the presented video thumbnail EPG 104. Some embodiments may predefine which of the media content streams 110 that the video thumbnails 116 will be generated. For example, the media content provider may define which of the media content streams 110 will have a video thumbnail 116 generated based on marketing criteria or other criteria. Alternatively, or additionally, the user may select which of the media content streams 110 will have a video thumbnail 116 generated.
Because the series of still image video frame thumbnails (or video thumbnails 116) are generated and saved prior to inclusion into a presented video thumbnail EPG 104, the presented ones of the video thumbnails 116 represent a prior presented portion of the program associated with that particular media content stream 110. When the series of still image video frame thumbnails (or video thumbnails 116) have been generated and saved for the plurality of media content streams 110, or for the selected media content streams 110, the process of generating and saving the series of still image video frame thumbnails (or video thumbnails 116) may restart. Accordingly, more current video thumbnails 116 will be available for presentation on the presented video thumbnail EPG 104. In embodiments where the series of still image video frame thumbnails (or video thumbnails 116) are being generated and saved for a limited number of media content streams 110, such as those associated with a favorites list and/or a most watched list, the video thumbnails 116 for those media content streams 110 may be relatively current, and may even be available on a near-real time basis.
Some embodiments may be configured to generate and save the series of still image video frame thumbnails (or video thumbnails 116) for selected media content streams 110 on a more frequent basis than other ones of the media content streams 110. For example, video thumbnails 116 may be generated for media content streams 110 associated with the favorites list and/or the most watched list on a more frequent basis than other media content streams 110. Accordingly, the video thumbnails 116 for the favorites list and/or the most watched list may be relatively current, while other video thumbnails 116 for the other media content streams 110 would not be as current.
When the video thumbnail EPG 104 is presented to the user, some embodiments may be configured to generate and save the series of still image video frame thumbnails (or video thumbnails 116) for those particular media content streams 110 that are currently identified on the presented video thumbnail EPG 104. For example, the presented video thumbnail EPG 104 is presenting information for media content streams 110 associated with Stations A-F in
Further, some embodiments may be configured to generate and save the video series of still image video frame thumbnails (or video thumbnails 116) for the media content streams 110 that are associated with channels that are adjacent to those channels presented on the video thumbnail EPG 104. For example, Station G, H and I are adjacent to Station F in the exemplary presented video thumbnail EPG 104 of
When the media device 102 is currently in use for program presentation and/or recording, one of the tuners 202a and 202b will be actively retrieving a media content stream 110 for presentation and/or recording. Embodiments may be configured to utilize the remaining one of the tuners 202a and 202b to receive a selected media content stream 110 from which the still image video frames are picked. For example, the tuner 202a may be receiving the first media content stream 110 for presentation and/or recording. Accordingly, the unused tuner 202b may be receiving the second media content stream 110. That is, a video thumbnail 116 that is associated with the second media content stream 110 is generated. When that series of still image video frame thumbnails (or video thumbnail 116) have been generated and saved, the tuner 202b may be re-tuned to a different media content stream 110 so that a different series of still image video frame thumbnails (or a different video thumbnail 116) may be generated and saved for a different media content stream 110.
Some media devices 102 only have the two tuners 202a and 202b. In situations where the tuners 202a and 202b are both being used, some embodiments of the thumbnail EPG system 100 will not be able to generate and save a new series of still image video frame thumbnails (or generate a new video thumbnail 116). For example, one media content stream 110 may be currently presented to the user and another media content stream 110 may be currently recorded into the DVR 210. As another example, one media content stream 110 may be currently presented on a first media presentation device 108 and another media content stream 110 may be currently presented on a different media presentation device 108 in a different location. As yet another example, one media content stream 110 may be currently presented on the main viewing area of the display 106 of a media presentation device 108, and another media content stream 110 may be currently presented as a picture-in-picture (PIP) mode or presented using another dual image presentation mode. Accordingly, when the video thumbnail EPG 104 is presented, a current video thumbnail 116 may not be available for inclusion in the presented video thumbnail EPG 104. (However, if the series of still image video frame thumbnails or video thumbnail 116 has already been saved, the video thumbnail 116 may be incorporated into the presented video thumbnail EPG 104.)
Alternatively, some embodiments may be configured to pick I-frames from a received media content stream 110 that is being presented and/or saved into the DVR 210. The picked I-frames are compressed into a still image video frame thumbnail and saved. In the event that the video thumbnail EPG 104 is presented, the video thumbnail 116 may then be generated and incorporated into the presented video thumbnail EPG 104 for the currently presented and/or saved media content stream 110. Further, if the user changes presentation to a different media content stream 110, the video thumbnail 116 for the previously presented media content stream 110 will be available in the event that the video thumbnail EPG 104 is presented.
Some embodiments of the media device 102 may include more than two tuners. In such embodiments, the likelihood of having an unused tuner may increase. If a tuner is not being actively used to receive a media content stream 110 for another purpose, then the unused tuner may be operated to pick still image video frame thumbnails that are used to generate and save a video thumbnail 116. Some embodiments may include one or more dedicated tuners and/or processing systems that are dedicated to receiving media content streams that are used for generating video thumbnails 116.
Some embodiments may be alternatively configured to store the generated video thumbnails 116 in a different memory medium. For example, an alternative embodiment may store generated video thumbnails 116 into the DVR 210. As another example, a dedicated solid state memory device may be used to store the still image video frame thumbnails and/or the generated video thumbnails 116. The memory medium may reside in the media device 102 or may be an external memory medium that is accessibly by the media device 102.
The remote media device 302 includes a media device interface 304 that is configured to communicate the generated and saved still image video frame thumbnails and/or the video thumbnails 116 to a plurality of media devices 102 via the communication network 228. When the media device 302 has a relatively large number of tuners 202i, a relatively large number of still image video frame thumbnails and/or video thumbnails 116 may be generated and saved. Further, the video thumbnails 116 may be refreshed at a faster rate to provide video thumbnails 116 having more current media content at a relatively faster rate.
The video thumbnails 116 may be communicated to the plurality of media devices 102 over a dedicated communication channel receivable by the media devices 102. Alternatively, or additionally, the video thumbnails 116 may be aggregated into a media content stream 110 and communicated to the media devices 102 along with other media content.
It should be emphasized that the above-described embodiments of the video thumbnail EPG system 100 are merely possible examples of implementations of the invention. Many variations and modifications may be made to the above-described embodiments. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6421067 | Kamen et al. | Jul 2002 | B1 |
| 6870573 | Yeo et al. | Mar 2005 | B2 |
| 7509580 | Sezan et al. | Mar 2009 | B2 |
| 7685619 | Herz | Mar 2010 | B1 |
| 20020059584 | Ferman et al. | May 2002 | A1 |
| 20020166122 | Kikinis et al. | Nov 2002 | A1 |
| 20020171686 | Kamen et al. | Nov 2002 | A1 |
| 20060064716 | Sull et al. | Mar 2006 | A1 |
| 20070192791 | Sullivan et al. | Aug 2007 | A1 |
| 20080072260 | Rosin et al. | Mar 2008 | A1 |
| 20080270449 | Gossweiler et al. | Oct 2008 | A1 |
| 20090199241 | Unger et al. | Aug 2009 | A1 |
| 20090265739 | Arora et al. | Oct 2009 | A1 |
| 20110138416 | Kang et al. | Jun 2011 | A1 |
| Number | Date | Country |
|---|---|---|
| 9963753 | Dec 1999 | WO |
| 2004056098 | Jul 2004 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20110321095 A1 | Dec 2011 | US |
