Patent Application
20140089424
The present disclosure generally relates to linking social media applications to broadcast media delivery, and in particular, to enabling users to share content from broadcast media programs in real-time.
Users of Internet-enabled electronic devices, such as computers, tablets and smartphones, are increasingly interested in sharing media viewing and listening experiences with others. Sharing media content is relatively straightforward when the media content is available online (e.g. streaming video, web pages, quotes from scripts, downloadable music or videos) in which case the user can simply send electronic messages with links to the media content of interest. However, it is more difficult for a user to share information in real-time about broadcast media content because such content is typically not yet available online. For example, if a viewer wants to share a quote from a TV sitcom or movie, that viewer would need to send an email, text, tweet or a social network update, or make one or many phone-calls and/or instant messages to his or her friends with the pertinent quote. It is even harder, if at all possible, for a user to send a friend a link to, or a snippet of, or a quote from broadcast media content airing when the content is airing due to the lack of integration between the broadcast media content (e.g. television) and whatever communication device is employed by the user to share information about the media content.
In other words, it is inefficient for users to share information related to media content they are viewing on TV because sharing such information currently requires users to take some action beyond the viewing experience to link the media content from one medium to another. Returning to the example above, a user attempting to share a quote from a TV sitcom on a social networking website would either have to type the quote or search for the text of the script online in order to locate the quote. And even if the text of the script is available online, cutting and pasting the online text can be cumbersome.
Systems, methods and devices described herein enable users of Internet-enabled devices to share content from broadcast media programs in real-time. For example, in some implementations systems, methods and devices are operable to share and view comments associated with broadcast media content presented on a first type of device using respective Internet-enabled second devices.
More specifically, in some implementations, systems, methods and devices are operable to supplement electronic messages from viewers about a broadcast media program with content from the program, such as quotes, screenshots, video-snippets, etc. For example, a viewer of a broadcast media program uses client device (e.g. laptop, tablet computer, smartphone, etc.) to at least transmit an electronic message to a server. In turn, the server parses the electronic message received from the client device to determine whether the electronic message is associated with a particular currently broadcast media program. In response to determining that the received electronic message is associated with a particular currently broadcast media program, the server generates a corresponding supplemented electronic message, from the received electronic message, by including content from the currently broadcast media program. The server then provides the supplemented electronic message to a service (e.g. a micro-blog application) for display. Alternatively, in response to determining that the received electronic message is not associated with a particular currently broadcast media program, the server provides the received electronic message to the aforementioned service for display.
A more particular description of this disclosure may be had by reference to the features of various implementations, some of which are illustrated in the appended drawings. The appended drawings, however, illustrate only some example features of the present disclosure and are therefore not to be considered limiting, for the description may admit to other effective features.
In accordance with common practice the various features illustrated in the drawings may not be drawn to scale. Accordingly, the dimensions of the various features may be arbitrarily expanded or reduced for clarity. In addition, some of the drawings may not depict all of the components of a given system, method or device. Finally, like reference numerals may be used to denote like features throughout the specification and figures.
Systems, methods and devices described herein enable users of Internet-enabled devices to share content from broadcast media programs in real-time. In particular, in some implementations systems, methods and devices are operable to supplement electronic messages from viewers about a broadcast media program with content from the program, such as quotes, screenshots, video-snippets, etc. For example, a viewer of a broadcast media program uses a client device (e.g. laptop, tablet computer, smartphone) to at least transmit an electronic message to a server system. In turn, the server system parses the electronic message received from the client device to determine whether the electronic message is associated with a particular currently broadcast media program. In response to determining that the received electronic message is associated with a particular currently broadcast media program, the server system generates a corresponding supplemented electronic message, from the received electronic message, by including content from the currently broadcast media program. The server system then provides the supplemented electronic message to a service (e.g. a micro-blog application) for display. Alternatively, in response to determining that the received electronic message is not associated with a particular currently broadcast media program, the server system provides the received electronic message to the aforementioned service for display.
Numerous details are described herein in order to provide a thorough understanding of the example implementations illustrated in the accompanying drawings. However, the invention may be practiced without these specific details. And, well-known methods, procedures, components, and circuits have not been described in exhaustive detail so as not to unnecessarily obscure more pertinent aspects of the example implementations.
In some implementations, the media monitoring server 130 is implemented as a single server system, while in other implementations it is implemented as a distributed system of multiple servers. Solely for convenience of explanation, the media monitoring server 130 is described below as being implemented on a single server system. Similarly, in some implementations, the social network server 170 is implemented as a single server system, while in other implementations it is implemented as a distributed system of multiple servers. Solely, for convenience of explanation, the social network server 170 is described below as being implemented on a single server system. Similarly, in some implementations, the broadcast system 140 is implemented as a single server system, while in other implementations it is implemented as a distributed system of multiple servers. Solely, for convenience of explanation, the broadcast system 140 is described below as being implemented on a single server system. Similarly, in some implementations, the content provider 150 is implemented as a single server system, while in other implementations it is implemented as a distributed system of multiple servers. Solely, for convenience of explanation, the content provider 150 is described below as being implemented on a single server system. Moreover, the functionality of the broadcast system 140 and the content provider 150 can be combined into a single server system. Additionally and/or alternatively, while only one broadcast system and only one content provider is illustrated in
In some implementations, the set-top box 102 and the TV 110 are provided in combination. The set-top box 102 is configured to receive and decode signals including media content from the broadcast system 140 or the like. In some implementations, the set-top box 102 is also Internet-enabled in order to receive signals including media content or the like. In operation, the set-top box 102 decodes the signal received from the broadcast system 140 or the like and provides audio and video content to the TV 110 for display. While a TV has been used in the illustrated example, those skilled in the art will appreciate from the present disclosure that any number of displays devices, including computers, laptop computers, tablet computers, smart-phones and the like, can be used to display a video stream and play the associated audio stream. Additionally and/or alternatively, the functions of the set-top box 102 and the TV 110 may be combined into a single device.
In some implementations, the set-top box 102 is any computer device capable of connecting to the communication network 104, receiving video streams, extracting information from video streams and presenting video streams for the display using the TV 110 (or another display device). In some implementations, the set-top box 102 may be configured as a receiver for cable TV and/or satellite TV, a digital video recorder (DVR), a digital media receiver, a TV tuner, a computer, and/or any other device that outputs TV signals. In some implementations the TV 110 can be a conventional TV display that is not connectable to the Internet and that displays digital and/or analog TV content received via over the air broadcasts or a satellite or cable connection. As is typical of televisions, the TV 110 includes a display 118 and speakers 119.
As used herein, a TV signal is an electrical, optical, or other type of data transmitting medium that includes audio and/or video components corresponding to a TV channel. In some implementations, the TV signal is a terrestrial over-the-air TV broadcast signal or a sign distributed/broadcast on a cable-system or a satellite system. In some implementations, the TV signal is transmitted as data over a network connection. For example, the set-top box 102 can receive video streams from an Internet connection. Audio and video components of a TV signal are sometimes referred to herein as audio signals and video signals. In some implementations, a TV signal corresponds to a TV channel that is being displayed on the TV 110.
The second screen client device 120 may be any computer device that is capable of connecting to one or more communication networks 104, such as a computer, a laptop computer, a tablet device, a netbook, an Internet kiosk, a personal digital assistant, a mobile phone, a gaming device, or any other device that is capable of communicating with the media monitoring server 130. In some implementations, the second screen client device 120 includes one or more processors 121, non-volatile memory 122 such as a hard disk drive, a display 128, speakers 129, and a microphone 123. The second screen client device 120 may also have input devices such as a keyboard, a mouse and/or track-pad (not shown). In some implementations, the second screen client device 120 includes a touch screen display, a digital camera and/or any number of supplemental devices to add functionality.
In some implementations, the second screen client device 120 may be connected to the set-top box 102 via a wireless or wired connection. In some implementations where such connection exists, the second screen client device 120 may optionally operate in accordance with instructions, information and/or digital content (collectively “second screen information”) provided by the set-top box 102 (and vice versa). In some implementations, the set-top box 102 issues instructions to the second screen client device 120 that cause the second screen client device 120 to present on the display 128 and/or the speaker 129 digital content that is complementary, or related to, digital content that is being presented by the client 102 on the TV 110.
In some implementations, the second screen client device 120 includes a microphone 123 that enables the client device to receive sound (audio content) from, for example, the speakers 119 of the TV 110. The microphone 123 enables the second screen client device 120 to record the audio content/soundtrack that is associated with the video content as it is presented, so that it may be fingerprinted on the second screen client device 120.
In some implementations, the second screen client device 120 includes one or more applications 125 stored in the memory 122. The processor 121 executes the one or more applications in accordance with a set of instructions received from the media monitoring server 130.
The communication network 104 may be any combination of wired and wireless local area network (LAN) and/or wide area network (WAN), such as an intranet, an extranet, including a portion of the Internet, or a wireless network provided by a wireless carrier. It is sufficient that the communication network 104 provides communication capability between the second screen client device 120 and the media monitoring server 130. In some implementations, the communication network 104 uses the HyperText Transport Protocol (HTTP) to transport information using the Transmission Control Protocol/Internet Protocol (TCP/IP). HTTP permits the client device 120 to access various resources available via the communication network 104. However, the various implementations described herein are not limited to the use of any particular protocol.
In some implementations, the media monitoring server 130 includes a front end server 134 that facilitates communication between the media monitoring server 130 and the communication network 104. The front end server 134 receives electronic messages from the second screen client device 120. As described in greater detail below, in some implementations, an electronic message is at least one of a micro-post, a social networking message, a chat room message, an instant message, content information is a video stream, a portion thereof, and/or a reference to a portion thereof. A reference to a portion of a video stream may include a time indicator and/or a digital marker referencing the content of the video stream. In some implementations, the content information is derived from a video stream being presented (i.e. playing) by the combination of the TV 110 and the set-top box 102.
In some implementations, the front end server 134 is configured to send a set of instructions to the second screen client device 120. In some implementations, the front end server 134 is configured to send content files, links to content files and/or metadata associated with the content files. The term “content file” includes any document or content of any format including, but not limited to, a video file, an image file, a music file, a web page, an email message, an SMS message, a content feed, an advertisement, a coupon, a playlist or an XML document. In some implementations, the front end server 134 is configured to send or receive one or more video streams. In some implementations, the front end server 134 is configured to receive content directly from the broadcast system 140 and/or the content provider 150 over the communication network 104.
In some implementations, the media monitoring server 130 includes a broadcast monitor module 135 that is configured to receive and record broadcast media programming, and to create fingerprints of broadcast media programs, capture subtitles and/or closed caption information, and capture screenshots of media content broadcast by the broadcast system 140 and/or the content provider 150. In some implementations, the media monitoring server 130 includes a program content database 132 that stores content fingerprints, subtitle and/or closed caption information, and screenshots. In some implementations, the program content database 132 is a distributed database.
In some implementations, the media monitoring server 130 includes an electronic message processing module 131. In operation, the electronic message processing module 131 receives an electronic message from a client device (e.g. client device 120) via the front end server 134. The electronic message processing module 131 parses the received electronic message to determine if the electronic message is associated with a particular currently broadcast media program, provided for example, by the broadcast system 140 or the content provider 150. For example, the electronic message processing module 131 parses a micro-post or the like in order to determine if the micro-post is related to (i.e. about) a particular sitcom or other television program. In response to determining that received electronic message is associated with a particular currently broadcast media program, the electronic message processing module 131 generates a corresponding supplemented electronic message, from the received electronic message, by including content from the currently broadcast media program retrieved from the program content database 132. The electronic message processing module 131 then provides the supplemented electronic message to a service (e.g., a micro-blog application) for display. For example, the electronic message may be a micro-blog associated with a micro-blog application provided by the social network server 170. As such, instead of receiving and posting the original micro-post from the client device 120, the social network server 170 receives and posts the supplemented micro-post from the media monitoring server 130, which includes content from a particular currently broadcast media program. Alternatively, in response to determining that the received electronic message is not associated with a particular currently broadcast media program, the electronic message processing module 131 provides the received electronic message to the aforementioned service for display (e.g. a micro-post as describe above).
In some implementations, the broadcast system 140 includes media content such as TV programs 141. In other words, the broadcast system 140 includes electronic copies of the media content, such as television programs. In some implementations, the broadcast system 140 also includes metadata 142 associated with one or more of the TV programs 141, and application program interface instructions 143. In some implementations, the application program interface instructions 143 include instructions that can be provided to a client device and/or may be executed by the broadcast system 140 under a client-server model or the like in order to link a particular TV program 141 with the associated metadata 142 and/or link the TV program 141 and the associated metadata 142 with external data and/or services, such as a social networking application. In some implementations, the metadata 142 may include subtitles and/or closed caption information. In some implementations, subtitles and/or closed caption information are embedded in the TV program content 141. Similarly, in some implementations, the content provider 150 additionally and/or alternatively includes media content such as TV programs 151, as well as metadata 152 associated with one or more of the TV programs 151.
In some implementations, the social network server 170 includes profiles 171, which include profiles of users, brands, companies and/or groups. In some implementations, the social network server 170 provides an application that allows a user to post electronic messages that are viewable by other users associated with the posting user.
In some implementations, the first section 221 is configured to display an image associated with the television program in order to indicate that the user interface 220 has been synchronized with the television program. For example, the first section 221 may display a recent screenshot (i.e., video frame) from the television program. Additionally and/or alternatively, a logo and/or a promotional image associated with the television program may also be displayed.
In some implementations, the second section 222 is configured to display one or more fields allowing a user to write and post a mircropost to one or more social network applications. For example, the second section 222 includes a micro-post application field 231 in which a user can enter a micro-post message. Additionally, in some implementations, the second section includes first and second post fields 232 and 233, which enable a user to enter a micro-post message for respective first and second social network applications.
To that end, in some implementations, the media monitoring server 130 includes one or more processing units (CPU's) 302, one or more network or other communications interfaces 308, memory 306, and one or more communication buses 304 for interconnecting these and various other components. The communication buses 304 may include circuitry (sometimes called a chipset) that interconnects and controls communications between system components. The memory 306 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM or other random access solid state memory devices; and may include non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. The memory 306 may optionally include one or more storage devices remotely located from the CPU(s) 202. The memory 306, including the non-volatile and volatile memory device(s) within the memory 306, comprises a non-transitory computer readable storage medium. In some implementations, the memory 306 or the non-transitory computer readable storage medium of the memory 306 stores the following programs, modules and data structures, or a subset thereof including an operating system 316, and a network communication module 318.
In some implementations, the memory 306 also includes virtual implementations of one or more of the modules discussed above with respect to
The operating system 316 includes procedures for handling various basic system services and for performing hardware dependent tasks.
The network communication module 318 facilitates communication with other devices via the one or more communication network interfaces 308 (wired or wireless) and one or more communication networks, such as the Internet, other wide area networks, local area networks, metropolitan area networks, and so on. With further reference to
As noted above, the program content database 132 may be configured to store a suitable combination of fingerprints, screenshots and subtitles and/or closed caption information associated with various broadcast media programs, such as, but not limited to, TV programs. For example, the program content database 132 stores electronic program guide information 331, screenshots 332, subtitles (and/or closed caption information) 333, and fingerprints 334 associated with one or more broadcast media programs.
Generally, electronic program guides provide users of TV, radio and/or other media with menus of displayable and/or audible scheduling information for current and upcoming programming. Often, on a per program basis, in addition to program titles, electronic program guides include information about characters, plot lines, hashtags, etc. As such, in some implementations information in electronic program guides may be searched and elements such as keywords and character names stored in the electronic program guide information 331, of the program content data base 132. In some implementations, the associated program content data is indexed on a per program basis. For example, with further reference to
As discussed above, in some implementations, the electronic message processing module 131 is configured to utilize the program content database 132 to determine when to supplement electronic messages received from client devices, and add associated content to some of the received electronic messages as determined. To those ends, in some implementations, the electronic message processing module 131 includes a message parsing module 310, a content matching module 311, and a supplementing module 312.
In some implementations, the messaging parsing module 310 assesses a received electronic message (sent by a user from the second screen device) based on media program content data stored in the memory and associated with at least one currently broadcast media program to determine whether the received electronic message is associated with a particular currently broadcast media program. For example, as discussed in greater detail below, an electronic message is analyzed with respect to keywords and other factors in the electronic message, and is assigned a value (e.g., a score) indicative of a relation between the received electronic message and a particular currently broadcast media program based on matching the data from the electronic program guide and/or captured subtitles and/or closed caption data. Some other factors increasing a match score include, but are not limited to, the following. Some broadcasters display a hashtag or the like on-screen during the show (e.g., #DWTS for “Dancing with the Stars). System servers can extract such an indicator by applying optical character recognition (OCR) to the portion of the video stream captured by a client device. A micro-post that is posted during the airing of the program with such an on screen indicator is highly likely to be about the program. For example, micro-posts may include references to actor names, character names, product placements, sights, sounds, locales, etc. As such, a micro-post that refers to both the program name and an actor or some other associated program element, is highly likely to be about the program. The assigned value can be used to gauge the probability that the received electronic message is associated with a particular program that is being broadcast. To that end, the messaging parsing module 310 includes a set of instructions 310a, and heuristics and metadata 310b.
In some implementations, the content matching module 311 determines whether a received electronic message, determined to be associated with a particular broadcast media program, also includes a quote and/or a character reference. For example, as discussed in greater detail below, the presence of a quote is identified by comparing text from the received electronic message to one or more subtitles from the referenced currently broadcast media program to determine whether the text matches at least one of the one or more subtitles. Similarly, the presence of a character reference is identified by comparing character names with the text of the received electronic message. To that end, the content matching module 311 includes a set of instructions 311a, and heuristics and metadata 311b.
In some implementations, the supplementing module 312 generates a corresponding supplemented electronic message from the received electronic message by adding at least a displayable indicator of content from the referenced currently broadcast media program. For example, the supplementing module 312 retrieves a quote, a screenshot, a thumbnail link to a screenshot, and/or a video clip identifier from the program content database 132, and links the retrieved content item to the received electronic message to generate a supplemented electronic message. To that end, the supplementing module 312 includes a set of instructions 312a, and heuristics and metadata 312b.
In some implementations, the broadcast monitor module 135 is configured to collect information about broadcast media programs from electronic program guides, the broadcast media programs during broadcast, and/or third party sources (e.g., Tribune Media Services). The broadcast monitor module 135 then stores the collected information in the program content database 132. To those ends, in some implementations, the broadcast monitor module 135 includes a monitoring module 321, a content acquiring module 322, and an indexing module 323.
In some implementations, the monitoring module 321 identifies current and upcoming media broadcasts. For example, the monitoring module 321 may search information in electronic program guides and third party sources in order to identify elements such as keywords and character names that are subsequently stored in the electronic program guide information 331, of the program content data base 132. To that end, the monitoring module 321 includes a set of instructions 321a, and heuristics and metadata 321b.
In some implementations, the content acquiring module 322 acquires content associated with currently broadcast media programs during broadcast in order to add content to the program content database 132. To that end, the content acquiring module 322 includes a set of instructions 322a, and heuristics and metadata 322b. Examples of content acquisition are described below with reference to
In some implementations, the content indexing module 323 operates to index content, acquired by the content acquiring module 322, into the program content database 132 so that the acquired content can be retrieved for later use. In some implementations, the acquired content is indexed on a per program basis. To that end, the content indexing module 323 includes a set of instructions 323a, and heuristics and metadata 323b.
With continued reference to
In some implementations, the user interface 520 is configured to include three sections 521, 524, 525. While three sections are included in the example implementation described with reference to
In some implementations, the first section 521 is configured to display an image associated with a particular social networking application in order to indicate to the user that the user interface 520 is displaying content specifically associated with the social networking application. For example, the first section 521 may display a logo and/or a promotional image associated with the social networking application.
In some implementations, the second section 524 is configured to display a user interface of the social networking application the user employs to share micro-posts, which may be associated with the television program 502. For example, when the user is interested in the post-stream associated with the television program 502 the second section displays the post stream root 524a associated with the television program. In some implementations, the post stream root 524a may be displayed in response to the user searching for and selecting the post stream root 524a. In some implementations, the post stream root 524a may be displayed in response a client application fingerprinting the television program 502 and requesting the post stream root 524a from a social networking server without engaging the user.
The post stream root 524a may be associated with one or more user micro-posts. In the example depicted in
In some implementations, the third section 525 is configured to display a number of selectable commands associated with using the social networking application. In some implementations, each selectable command is displayed in an icon or button or the like. For example, as illustrated in
To that end, the method includes determining if the program is currently being broadcast (601, i.e., determining whether the program duration is valid). If the program duration is valid (601—Yes), the method includes capturing subtitles or closed caption data associated with the program. For example, with reference to
On the other hand, when the program is over, (601—No), the method includes ceasing to collect content data associated with the particular program (605), because the program broadcast has ended. Optionally, the method includes clearing or paring down the search index to remove unused quotes and/or other data (606) to free memory space.
To that end, the method includes determining if the program is currently being broadcast (701, i.e., determining whether the program duration is valid). If the program duration is valid (701—Yes), the method includes waiting a preset amount of time to ensure that there is a noticeable difference between screen shots (702). The method then includes capturing a screenshot after the preset delay (703), and saving the screenshot in the search index with a respective timestamp. For example, with reference to
On the other hand, when the program is over, (701—No), the method includes ceasing to collect content data associated with the particular program (705), because the program broadcast has ended. Optionally, the method includes clearing or paring down the search index to remove unused screenshots and/or other data (706) to free memory space.
To that end, the method includes determining if the program is currently being broadcast (801, i.e., determining whether the program duration is valid). If the program duration is valid (801—Yes), the method includes receiving a micro-post (or the like) to determine whether or not the received micro-post is related to the particular program (802). On the other hand, when the program is over, (801—No), the method includes ceasing to determine whether or not received micro-posts are related to the particular program (806), because the program broadcast has ended. In some implementations, a time margin is appended at the end of the program time to allow for posts about the show immediately after the show has ended. For example, people of comment on a program within the 30 minutes of the program ending.
However, during the duration of the program, the method includes analyzing received micro-posts so that each micro-post may be assigned a value indicative of a relation between the received electronic message and a particular currently broadcast media program (803). More specifically, analysis of a received micro-post includes parsing the words of the received micro-post (803a), marking the words against various factors (803b), and assigning the received micro-post a score based on the how the words of the micro-post relate to the various factors (803c).
For example, filtering may include any one of the following, without limitation. In some implementations, a micro-post is matched against program titles (e.g., “Mad Men”, “Archer”, “Morning Drive”, “House Hunters”, etc.). In some implementations, a micro-post is matched against one or more secondary titles associated with respective program titles (e.g., “Star Wars: Return of the Jedi” can be matched against micro-posts containing both “Star Wars” and “Return of the Jedi”). In some implementations, a micro-post is matched against shortened or paraphrased program titles. In some implementations, a micro-post is matched against one or more of character names, actor names, host names, guest names, etc. in the program. In some implementations, a micro-post is matched against a hastag or the like displayed by the broadcaster or content creator. In some implementations, a micro-post is matched against a user handle (e.g., of the form “@user”) displayed by a broadcaster or content creator, which may belong to one or more of an advertiser, a character, an actor, a host and/or a guest on the program. In some implementations, a micro-post is matched against program description data extracted from electronic program data.
By contrast, there are also terms that have a negative impact on a match score for a micro-post. For example, in some implementations, commonly occurring words (e.g., “today”) have a negative impact on a match score because they do not tend to limit search results. Additionally and/or alternatively, in some implementations, a micro-post including too little text in addition to the program name may have a negative impact on a match score (e.g., “I am watching the tonight show”).
Once the micro-post has been scored, the method includes determining whether or not the score satisfies a threshold (804). If the score satisfies a threshold (804—Yes), the method includes associating the received micro-post with the program. In turn, as discussed in greater detail below, the received micro-post is analyzed to determine whether or not to enrich or supplement the received micro-post. Subsequently, the method includes receiving and analyzing additional micro-posts for the duration of the program. On the other, hand if the score does not satisfy the threshold (804—No), the method includes receiving and analyzing additional micro-posts for the duration of the program.
To that end, the method includes receiving a micro-post associated with a particular program (901). In some implementations, as discussed above with reference to
For each received micro-post associated with a particular program, the method includes comparing the words of the micro-post to quotes extracted from subtitles or closed caption data (902). In some implementations, the one or more subtitles employed in the comparison are limited to one or more subtitles from a particular elapsed duration relative to a time indicator associated with the received electronic message (e.g., the last N seconds). The method then includes determining whether word in the micro-post match a particular quote within a threshold (903). In other words, the comparison is fault-tolerant so as to account for factors such as spelling mistakes, grammar, and inadvertent paraphrasing. If the micro-post does not match a quote within the threshold (903—No), the method includes posting the received micro-post to the post stream associated with the particular program (908).
On the other hand, if the micro-post matches a quote (903—Yes), the method includes associating the micro-post with the identified quote (904). The method includes identifying the timestamp of the quote (905), and optionally retrieving a screenshot having a respective timestamp proximate the timestamp of the quote (906). In some implementations, additional logic may be applied to improve the quality of the enrichment data. For example, in addition to identifying the timestamp of the subtitle that matches the quote from the micro-post, the sentence and/or collection of sentences that includes the quoted words in identified and extracted as a whole. In some instances, this may provide more information from which the context of a micro-post can be understood.
Additionally and/or alternatively, some programs have richer subtitles where the speech of different people is indicated with different-colored subtitles. For such programs, instead of going back to the beginning of the sentence, it is possible to go back to the beginning of the group of sentences uttered by one specific on-screen character, to give users more information to understand the context of a micro-post.
In some implementations, selecting the screenshot is also based on image quality. In other words, the method includes assessing and selecting the screenshot with the best available quality that is proximate the timestamp of the quote. For example, one way of determining screenshot quality is detecting screenshots where an actor's face is visible. A range of times may be preset to limit how different the timestamp of a selectable screenshot can be in relation to the timestamp of the quote. Having identified the pertinent program content data available, the method includes generating a supplemented micro-post by adding at least a displayable indicator of content from the referenced currently broadcast media program to the received micro-post. In some implementations, generating the supplemented micro-post may include replacing a portion of the received micro-post with program content data. For example, a paraphrased quote in a micro-post may be replaced with an accurate quote from the program.
To that end, the method includes receiving a micro-post associated with a particular program (1001). In some implementations, as discussed above with reference to
For each received micro-post associated with a particular program, the method includes comparing the words of the micro-post to keywords or key-phrases extracted from electronic program guides or the like (1002). The method then includes determining whether word in the micro-post match a particular keyword or key-phrase within a threshold (1003). In other words, the comparison is fault-tolerant so as to account for factors such as spelling mistakes, grammar, and inadvertent paraphrasing. If the micro-post does not match a keyword or key-phrase within the threshold (1003—No), the method includes posting the received micro-post to the post stream associated with the particular program (1007).
On the other hand, if the micro-post matches a keyword or key-phrase (1003—Yes), the method includes identifying the timestamp of the micro-post (1004). For example, a micro-post may include a data field with a timestamp, or the timestamp may be time at which the micro-post was received by the server system. The method includes retrieving a program content element (e.g., a screenshot or video-clip) having a respective timestamp proximate the timestamp of the micro-post (1005). In some implementations, selecting the screenshot is also based on image quality. In other words, the method includes assessing and selecting the screenshot with the best available quality that is proximate the timestamp of the micro-post. A range of times may be preset to limit how different the timestamp of a selectable screenshot can be in relation to the timestamp of the micro-post. Having identified the pertinent program content data available, the method includes generating a supplemented micro-post by adding at least a displayable indicator of content from the referenced currently broadcast media program to the received micro-post (1006).
A content fingerprint includes any type of condensed or compact representation, or signature, of the content of a video stream and/or audio stream. In some implementations, a fingerprint may represent a clip (such as several seconds, minutes, or hours) of a video stream or audio stream. Or, a fingerprint may represent a single instant of a video stream or audio stream (e.g., a fingerprint of single frame of a video or of the audio associated with that frame of video). Furthermore, since video content may change over time, corresponding fingerprints of that video content may also change over time.
Various aspects of embodiments within the scope of the appended claims are described below. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the present disclosure one skilled in the art should appreciate that an aspect described herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method may be practiced using any number of the aspects set forth herein. In addition, such an apparatus may be implemented and/or such a method may be practiced using other structure and/or functionality in addition to or other than one or more of the aspects set forth herein.
It will also be understood that, although the terms “first,” “second,” etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first contact could be termed a second contact, and, similarly, a second contact could be termed a first contact, which changing the meaning of the description, so long as all occurrences of the “first contact” are renamed consistently and all occurrences of the second contact are renamed consistently. The first contact and the second contact are both contacts, but they are not the same contact.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the claims. As used in the description of the embodiments and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, the term “if” may be construed to mean “when” or “upon” or “in response to determining” or “in accordance with a determination” or “in response to detecting,” that a stated condition precedent is true, depending on the context. Similarly, the phrase “if it is determined [that a stated condition precedent is true]” or “if [a stated condition precedent is true]” or “when [a stated condition precedent is true]” may be construed to mean “upon determining” or “in response to determining” or “in accordance with a determination” or “upon detecting” or “in response to detecting” that the stated condition precedent is true, depending on the context.
The foregoing description, for purpose of explanation, has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, to thereby enable others skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
