Viewing streaming video is a staple of home entertainment. Users employ streaming devices or smart televisions to access video content from countless online services. Users also access video content via portable devices such as wireless telephones, tablet computers, and personal computers. Those users may wish to view that content or share that content with others on a larger screen through the use of a casting device, such as a Google Chromecast® or a similar device. Using such a device, a user is able to send a media request to a media service that communicates with a requested device, such as a television, which includes or is associated with a streaming device to which the media service sends the requested media for presentation on the requested device.
Once the user sends the media request via their wireless telephone or other input device, it may take several seconds before the media service is able to deliver the requested media to the requested device for presentation to the user. During this interval, the user may be presented with a blank screen or a mainly static image that may present some moving indicator that indicates that a video stream is being prepared and/or transmitted. This leaves the user with several seconds in which the user is not engaged, because it takes time to process the media request, retrieve the requested media, and prepare or format the requested media for presentation to the requested device, as well as additional time to actually transmit the requested media to the requested device and cause it to be presented to the user. In an era when so many users are privileged to be able to quickly access content of their choice, it may be unsatisfying for a user to have to wait even a few seconds for interesting media content to be presented.
This document describes systems and techniques for presenting intermediate media to a user that has presented a media request, where the intermediate media includes one or more images that are presented while media responsive to the media request is being prepared for presentation to the user. From the time that the user presents the media request, it may take several seconds or longer to access the requested media, prepare the requested media for the user, and deliver the requested media to the user. Intermediate media is selected or generated for the user based on content of the media request so that the intermediate media is topically related to the object of the media request. The intermediate media provides content to engage the user while the user waits for the requested media to be delivered.
For example, a media request is received for streaming content from an input device. The media request is presented to a media service to serve the streaming content to a requested device. The media request is processed to identify attributes of the media request indicative of the subject matter of the requested content. Based on identified attributes of the media request, intermediate media is accessed that includes one or more images related to the identified attributes. The intermediate media is delivered to the requested device in an interim period generally before the streaming content is served to the requested device or before the streaming content is rendered. The intermediate media also could be presented over unpaid advertisements or miscellaneous content that may not be of interest as compared to the intermediate media generated in response to the user's interests manifested in the media request.
In an implementation, a method includes receiving a media request for requested media from an input device. The media request is provided to a media service to serve the requested media to a requested device. The media request is processed to identify attributes of the media request indicative of a subject matter of the requested media. Based on the identified attributes of the media request, intermediate media is accessed including one or more images related to the identified attributes. The intermediate media is delivered to the requested device.
In another implementation, a system includes an intermediate media service configured to analyze a media request received from an input device and directed to a media service, the media request being configured to initiate delivery of requested media at a requested device. The intermediate media service being configured to analyze the media request to identify attributes of the media request, the identified attributes being indicative of the subject matter of the requested media. Based on the identified attributes of the media request, the intermediate media service is configured to access intermediate media including one or more images related to the identified attributes. The intermediate media service is configured to deliver the intermediate media to the requested device.
This Summary is provided to introduce systems and techniques for presenting intermediate media to a user that has presented a media request, such as while media responsive to the media request is being prepared for presentation to the user, as further described below in the Detailed Description and Drawings. This Summary is not intended to identify essential features of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter.
The details of one or more aspects of systems and techniques for presenting intermediate media to a user that has presented a media request while media responsive to the media request is being prepared for presentation to the user are described in this document with reference to the following drawings. The same numbers are used throughout the drawings to reference like features and components:
Streaming media techniques enable users to request media over a network from media services and to have the media presented in a matter of seconds. One form of requesting streaming media involves a user entering a media request on a computing device, such as a mobile telephone or a computer, to be cast to a streaming device coupled with a television or a television that incorporates an integrated streaming device. Depending on the media request, available bandwidth, network traffic, and hardware capabilities, the requested media may be delivered after an interval ranging from a few seconds to several seconds while the media request is being serviced.
The length of the interval between the media request and initiating presentation of the requested media on the streaming device may depend on many factors. Part of the delay may be a result of network traffic. It is understood that the media is not directly cast from the input computing device to the streaming device. To the contrary, the media is requested from a media service operating on one or more remote servers over a network by the input device. The media service then sends the media back to the streaming device via the network. As a result, casting of the media to the streaming device may be slowed by transmission speeds of a wide-area network and a local-area network, as well as by demands placed on those networks by other devices. In addition, a significant portion of the interval that a user waits for the requested media may be consumed at the media service and/or media storage while the requested media is being retrieved and/or prepared for transmission. For example, the requested media may have to be formatted or otherwise adjusted for the available display resolution of the streaming device or for available network bandwidth between the media service and the streaming device. In addition, handshaking between the media service and the streaming device to establish communications between the media service and the streaming device may take time. Redirecting the streaming device to accept the requested media instead of other media currently being presented may result in an additional delay. During the time required for these processes to occur, the television may be in a waiting state during which the television displays a title of the requested media but is generally idle while the user waits for service of the requested media.
Intermediate media, such as a series of generated still images, may be generated and presented in less time than may be required to present the requested media on the streaming device. Generating and/or retrieving a series of still images may take less time than is required to format or otherwise prepare a stream of requested media for presentation on the streaming device. Also, far less bandwidth and transmission time is required to transmit still images over a network than to transmit the volume of data included in a stream of video data. Thus, for example, a “generative short” comprised of a series of still images may be prepared and transmitted to the streaming device in less time than is required to send the requested media to the streaming device, providing some media to engage the attention of the viewer while the viewer waits for the requested media to be presented.
In implementations, an intermediate media service processes the media request to identify attributes from data and/or metadata that present attributes of the requested media. Using the identified attributes, the intermediate media service prepares intermediate media, either from stored media or produced by generative media, that may include one or more images that relate to the data and/or metadata included in the media request and presents the intermediate media to the user via the streaming device of or coupled with the television. The user thus may be engaged by the intermediate media while waiting for the requested media to be served. In other words, the intermediate media fills at least a portion of the interval during which the user otherwise would be waiting for their requested media and, thus, gives the user something to look at while waiting for their requested media.
This document describes systems and techniques for presenting intermediate media to a user that has presented a media request, where the intermediate media includes one or more images that are presented while media responsive to the media request is being prepared for presentation to the user. From the time that the user presents the media request, it may take several seconds or longer to access the requested media, prepare the requested media for the user, and deliver the requested media to the user. Intermediate media is selected or generated for the user based on content of the media request so that the intermediate media is topically related to the object of the media request. The intermediate media provides content to engage the user while the user waits for the requested media to be delivered.
For example, a media request is received for streaming content from an input device. The media request is presented to a media service to serve the streaming content to a requested device. The media request is processed to identify attributes of the media request indicative of a subject matter of the requested content. Based on the identified attributes of the media request, intermediate media is accessed that includes one or more images related to the identified attributes. The intermediate media is delivered to the requested device in an interim period before the streaming content is served to the requested device.
In other environments, the input device 104, the requested device 112, and the streaming device 114 may be an integrated device 116 (shown in dotted lines in
The media request 106 generated by the input device 104 is transmitted via a communications link 118, such as an IEEE 802.01-type Wi-Fi connection, to a network access point 120, such as a wireless router or access point. The network access point 120 transmits the media request 106 via a wireless or wired communications link 122 to a network 124, such as the Internet. The media request 106 is communicated from the network 124 via another communications link 126 to the media service 110. The media service 110 processes the media request 106 to initiate the process of serving the requested media 108. As part of this processing, the media service 110 generates a trigger 128 that contains some information about the requested media 108 and that is sent to the streaming device 114 to ready the requested device 112 to receive the requested media 108.
The media service 110 communicates the media request 106 and the trigger 128 to an intermediate media service 130 that processes data and/or metadata included in the media request 106 and/or the trigger 128 to identify attributes about the media request 106. The intermediate media service 130 may use the identified attributes to retrieve and/or generate intermediate media 132 that is relevant to the media request 106 and, thus, of possible interest to the user 102. The media service 110 and the intermediate media service 130 may be incorporated within a single system or may constitute separate systems that communicate via a communications link (not shown in
As described further below, the intermediate media 132 includes one or more images that relate to the identified attributes. As also described further below, the one or more images may be presented in a sequential, random, or continuous loop via the streaming device 114 to the requested device 112 to engage the user 102 while the media service 110 retrieves the requested media 108. The intermediate media 132 is transmitted via a communications link 134 to the network 124, from which the intermediate media 132 is then transmitted via the communications link 122, the network access point 120, and a communications link 136 to the streaming device 114. The intermediate media 132 is then presented to the user 102 via the requested device 112. Responsive to the media service 110 completing a process of retrieving and/or preparing the requested media 108, the media service 110 transmits the requested media 108 via the communications link 126 to the network 124 and via the communications link 122, the network access point 120, and the communications link 136 to the streaming device 114. At this time, the requested media 108 is presented to the user 102 via the requested device 112. In implementations, once the requested media 108 is presented at the streaming device 114 and the requested device 112, the requested media 108 is presented to the user 102, superseding presentation of the intermediate media 132. It will be appreciated that, in delivering the requested media 108 or the intermediate media 132 to the requested device 112, the requested media 108 and the intermediate media 132 may engage the streaming device 114, whether or not it is specifically mentioned.
The media request 106 is presented to the media service 110 at time trequest 202. Following receipt of the media request 106 at time trequest 202, the media service 110 initiates retrieval of the requested media 108 from media storage 212. The media service 110 also generates the trigger 128 and sends it to the requested device 112 at time ttrigger 204. The media service 110 presents the media request 106 and the trigger 128 to request processing 214. As further described below with reference to
The identified attributes 216 may include terms identified in the media request 106, identifying information included in metadata accompanying the media request 106, or other identifiable information from the media request 106. For example, if the media request 106 includes the name of a city or other location, that location may be selected as one of the identified attributes 216. Similarly, terms that identify a type of subject matter, such as a type of sport, an entertainment topic such as movies or music, or type of animal, plant, or other nature phenomenon, may be selected as one of the identified attributes 216. The name of a celebrity or another well-known individual may be flagged as an identified attributes 216. Any words included in the media request 106 may be regarded as one of the identified attributes 216. The identified attributes 216 are then presented for intermediate media processing 218, which uses the identified attributes 216 to select subject matter relevant to the media request 106 in retrieving and/or generating the intermediate media 132.
In implementations, the intermediate media processing 218 uses the identified attributes 216 to retrieve pre-existing actual or previously created images. The intermediate media processing 218 formulates a query using terms or other information in the identified attributes 216 to retrieve one or more images from an intermediate media source 220, which are then sent to the requested device 112 as the intermediate media 132 at time tintermediate 206. In other implementations, instead of retrieving pre-existing actual or previously created images from the intermediate media source 220, the intermediate media processing 218 presents a query based on the identified attributes 216 to generative media processing 222, which generates one or more images based on the query. The generative media processing 222 may engage prompt engineering 224 to form or refine the query to facilitate the generative media processing 222 being able to generate the one or more images. The one or more images generated by the generative media processing 222 are then sent to the requested device 112 as the intermediate media 132 at time tintermediate 206.
The one or more images included in the intermediate media 132 and delivered at time tintermediate 206 are presented during the interval Δt 208 before the requested media 108 is presented at tmedia 210. Here, the requested media 108 supersedes presentation of the intermediate media 132 at the requested device 112.
Using the identified attributes 216, the intermediate media processing 218 prepares a query 320 for the intermediate media source 220 from the identified attributes 216. The query 320 may be, for example, “Basketball Championship+Highlights+San Francisco.” In response to the query 320, the intermediate media source 220 generates intermediate images of San Francisco 304, 306, and 308, including an image of the skyline of San Francisco, an interior of the basketball arena in San Francisco, and an image of a San Francisco player, respectively. The intermediate images 304, 306, and 308 are presented to the user 102 while awaiting service of the requested media 108. The intermediate images 304, 306, and 308 include pre-existing images, either captured or created and retrievable from the intermediate media source 220.
Instead of retrieving the intermediate images 304, 306, and 308 or other pre-existing images, from the intermediate media source 220, as described with reference to
The query 412 is then presented to the generative media processing 222. The generative media processing 222 may, for example, identify seeds from the query 412 and use content-guided generative inferences to generate images from a large diffusion model. The diffusion model may run in parallel with different seeds so as to generate different sets of intermediate images 404, 406, and 408. As a result, the generative media processing 222 generates, for example, the intermediate images 404, 406, and 408 of a basketball game being played in San Francisco. The intermediate images 404, 406, and 408 are delivered to the user 102 while awaiting service of the requested media 108.
As part of the generative media processing 222, elements within the intermediate images 404, 406, and 408 may be linked to facilitate creating transitions between the images 404, 406, and 408. Referring to
In addition to presenting the generative short 510 as described with reference to
Although the examples described herein include groups of three intermediate images, including the retrieved intermediate images 304, 306, and 308 and the generated intermediate images 404, 406, and 408, it should be appreciated that groups of three intermediate images are used only for the sake of illustration; there is neither a requirement that three intermediate images be retrieved or generated nor a requirement that a maximum of three intermediate images be used.
Moreover, while the preceding examples describe the presentation of intermediate media in the form of a generative short comprised of a series of images, the intermediate media may include other forms of media. Referring to
Alternatively or additionally, the intermediate media may include audio data 702 that may be accessed or generated in response to user input. It is understood that the audio data 702, which may include spoken words or other sounds, does not require the bandwidth of video data and that presenting the audio data 702 does not require the kind of formatting or handshaking that may be required to present video data. As a result, the audio data 702 may be delivered more quickly than the requested media 108 and, thus, may be presented to engage a viewer while the viewer awaits delivery of the requested media 108. Finally, the intermediate media 132 may include music 704 that may be retrieved based on the user data. Like the audio data 702, delivering the music 704 does not require the type of preparation, bandwidth requirements, or handshaking that is involved in delivering the requested media 108. The video clip 700, the audio data 702, and/or the music 704 may be combined and delivered as the intermediate media 132 to engage the viewer while awaiting delivery of the requested media 108.
As previously described, the intermediate media 132 may be sourced from a media service 110 that is remote from the input device 104 and the requested device 112 (see
Thus, for example, the intermediate media 132, such as the intermediate images 404, 406, and 408, may be retrieved and/or generated at the input device 104. Along with the media request 106, the intermediate media 132 produced at the input device 104 is sent via the network access point 120 over the network 124 (not shown in
Referring to
For example, the controls 904 may include a pause/play toggle 906 to permit the user 102 to pause and/or resume play of the intermediate media 132. The controls 904 also may include rewind 908 and fast forward 910 controls to permit the user 102 to rewind or advance the intermediate media 132, respectively. Thus, the user 102 can engage or reengage portions of the intermediate media 132 of particular interest. In implementations, once the user 102 begins to engage the intermediate media 132, the requested media 108 is held until the user 102 is done engaging with the intermediate media 132. The user 102 then may use an advance input 912 to skip from the intermediate media 132 to the requested media 108. User settings (not shown) may allow the user 102 to specify that the requested media 108 is not to be presented until the user 102 requests to advance from the intermediate media 132.
In aspects, the intermediate media 132 may include a game 914, such as a casual game, retrievable or generated for the amusement of the user 102 while waiting for the requested media 108. The game 914 may be related to content of the requested media 108 and, thus, in the continuing example, may include a basketball shooting game for the user 102 to play while awaiting the requested media 108 about basketball. For example, the user 102 may manipulate the rewind control 908 to direct action of the game 914 to one side and manipulate the fast forward control 910 to direct action of the game 914 to the other side, while using the pause/play button 906 to initiate action, such as shooting a ball 916. When the user 102 is done with the game 914, the user 102 may engage the advance input 912 to leave the game 914 to engage with the requested media 108.
In the method 1000, at a block 1002, a media request 106 is received for requested media 108 from an input device 104, as also previously described with reference to
For example, as previously described with reference to
This document describes systems and techniques for presenting intermediate media to a user that has presented a media request while media responsive to the media request is being prepared for presentation to the user. From the time that the user presents the media request, it may take several seconds or longer to access the requested media, prepare the requested media for the user, and deliver the requested media to the user. Intermediate media is selected or generated for the user based on content of the media request so that the intermediate media is topically related to the object of the media request. The intermediate media provides content to engage the user while the user waits for the requested media to be delivered. These systems and techniques may be realized using one or more of the entities or components shown in
Unless context dictates otherwise, use herein of the word “or” may be considered use of an “inclusive or,” or a term that permits inclusion or application of one or more items that are linked by the word “or” (e.g., a phrase “A or B” may be interpreted as permitting just “A,” as permitting just “B,” or as permitting both “A” and “B”). Also, as used herein, a phrase referring to “at least one of”' a list of items refers to any combination of those items, including single members. For instance, “at least one of a, b, or c” can cover a, b, c, a-b, a-c, b-c, and a-b-c, as well as any combination with multiples of the same element (e.g., a-a, a-a-a, a-a-b, a-a-c, a-b-b, a-c-c, b-b, b-b-b, b-b-c, c-c, and c-c-c, or any other ordering of a, b, and c). Further, items represented in the accompanying figures and terms discussed herein may be indicative of one or more items or terms, and thus reference may be made interchangeably to single or plural forms of the items and terms in this written description.
Although implementations of systems and techniques for presenting intermediate media to a user that has presented a media request while media responsive to the media request is being prepared for presentation to the user have been described in language specific to certain features and/or methods, the subject of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are disclosed as example implementations of systems and techniques for presenting intermediate media to a user that has presented a media request, such as during an interval during which media responsive to the media request is being prepared for presentation to the user.
This application claims priority to U.S. Provisional Patent Application Ser. No. 63/587,906, filed on Oct. 4, 2023, the disclosure of which is incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
63587906 | Oct 2023 | US |