The present disclosure generally relates to transmission of media content and more particularly, to systems and methods for providing product information during a live broadcast.
Application programs have become popular on smartphones and other portable display devices for accessing content delivery platforms. With the proliferation of smartphones, tablets, and other display devices, people have the ability to view digital content virtually any time, where such digital content may include live streaming by a media broadcaster. Although individuals increasingly rely on their portable devices for their computing needs, however, one drawback relates to the relatively small size of the displays on such devices when compared to desktop displays or televisions as only a limited amount of information is viewable on these displays. Therefore, it is desirable to provide an improved platform for allowing individuals to access content.
In accordance with one embodiment, a computing device obtains a media stream from a server, where the media stream obtained from the server corresponds to live streaming of an event for promoting a product. The computing device receives product information from the server and displays the media stream in a first viewing window. The media stream is monitored for at least one trigger condition, and based on monitoring of the media stream, the computing device determines at least a portion of the product information to be displayed in a second viewing window.
Another embodiment is a system that comprises a memory storing instructions and a processor coupled to the memory and configured by the instructions to obtain a media stream from a server, wherein the media stream obtained from the server corresponds to live streaming of an event for promoting a product. The processor is further configured to receive product information from the server, display the media stream in a first viewing window, and monitor the media stream for at least one trigger condition. Based on the monitoring, the processor is configured to determine at least a portion of the product information to be displayed in a second viewing window.
Another embodiment is a non-transitory computer-readable storage medium storing instructions to be implemented by a computing device having a processor, wherein the instructions, when executed by the processor, cause the computing device to obtain a media stream from a server, wherein the media stream obtained from the server corresponds to live streaming of an event for promoting a product. The processor is further configured to receive product information from the server, display the media stream in a first viewing window, and monitor the media stream for at least one trigger condition. Based on the monitoring, the processor is configured to determine at least a portion of the product information to be displayed in a second viewing window.
Other systems, methods, features, and advantages of the present disclosure will be or become apparent to one with skill in the art upon examination of the following drawings and detailed description. It is intended that all such additional systems, methods, features, and advantages be included within this description, be within the scope of the present disclosure, and be protected by the accompanying claims.
Various aspects of the disclosure can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, with emphasis instead being placed upon clearly illustrating the principles of the present disclosure. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views.
Various embodiments are disclosed for conveying product information during live streaming where supplemental information is provided to a user while the user is viewing a media stream. For some embodiments, the media stream is received from a video streaming server, where the media stream includes product information transmitted by the video streaming server with the media stream. The media stream may correspond to live streaming of a host (e.g., a celebrity) promoting one or more cosmetic products, where the products being promoted include product information that may be embedded in the media stream. In other embodiments, the product information may be transmitted separately from the media stream by the video streaming server. For example, the product information may be transmitted by the video streaming server prior to initiation of the live streaming event.
In some embodiments, the presentation of such product information is triggered by conditions that are met during playback of the live video stream. For example, such trigger conditions may be associated with content depicted in the live video stream (e.g., a gesture performed by an individual depicted in the live video stream). As another example, such trigger conditions may correspond to input that is generated in response to manipulation of a user interface control at a remote computing device by the individual depicted in the live video stream. Respective viewing windows for presenting the live video stream and for presenting the product information are configured on the fly based on these trigger conditions and based on input by the user viewing the content. For example, a panning motion performed by the user while navigating a viewing window displaying product information may trigger additional product information (e.g., the next page in a product information document) to be displayed in that window.
A description of a system for conveying product information during live streaming of an event is now described followed by a discussion of the operation of the components within the system.
A user interface (UI) generator 104 executes on a processor of the computing device 102 and includes a data retriever 106, a viewing window manager 108, a trigger sensor 110, and a content generator 112. The UI generator 104 is configured to communicate over a network 120 with a video streaming server 122 utilizing streaming audio/video protocols (e.g., real-time transfer protocol (RTP)) that allow media content to be transferred in real time. The video streaming server 122 executes a video streaming application and receives video streams from remote computing devices 103a, 103b that record and stream media content by a host. In some configurations, a video encoder 124 in a computing device 103b may be coupled to an external recording device 126, where the video encoder 124 uploads media content to the video streaming server 122 over the network 120. In other configurations, the computing device 103a may have digital recording capabilities integrated into the computing device 103a. For some embodiments, trigger conditions may correspond to actions taken by the host at a remote computing device 103a, 103b. For example, for some embodiments, the host at a remote computing device 103a, 103b can manipulate a user interface to control what content is displayed to the user of the computing device 102.
Referring back to computing device 102, the data retriever 106 is configured to obtain a media stream obtained by the computing device 102 from the video streaming server 122 over the network 120. The media stream may be encoded in various formats including, but not limited to, Motion Picture Experts Group (MPEG)-1, MPEG-2, MPEG-4, H.264, Third Generation Partnership Project (3GPP), 3GPP-2, multimedia, Audio Video Interleave (AVI), Digital Video (DV), QuickTime (QT) file, Windows Media Video (WMV), Advanced System Format (ASF), Real Media (RM), Flash Media (FLV), 360-degree video, or any number of other digital formats. The data retriever 106 is further configured to extract product information transmitted by the video streaming server 122 with the media stream. In some embodiments, the product information may be embedded in the media stream. However, the product information may also be transmitted separately from the media stream.
The viewing window manager 108 is configured to display the media stream in a viewing window of a user interface. The trigger sensor 110 is configured to analyze content depicted in the media stream to determine whether trigger conditions exist during streaming of the media content. Such trigger conditions are utilized for displaying portions of the product information in conjunction with the media stream. The viewing window manager 108 is configured to display this product information in one or more viewing windows separate from the viewing window displaying the media content. The trigger sensor 110 determines what portion of the product information to be displayed in one or more viewing windows. For example, certain trigger conditions may cause step-by-step directions relating to a cosmetic product to be displayed while other trigger conditions may cause purchasing information for the cosmetic product to be displayed.
The content generator 112 is configured to dynamically adjust the size and placement of each of the various viewing windows based on a total viewing display area of the computing device 102. For example, if trigger conditions occur that result in product information being displayed in two viewing windows, the content generator 112 is configured to allocate space based on the total viewing display area for not only the two viewing windows displaying the product information but also for the viewing window used for displaying the media stream. Furthermore, the content generator 112 is configured to update content shown in the second viewing window in response to user input received by the computing device 102. Such user input may comprise, for example, a panning motion performed by the user while viewing and navigating the product information displayed in a particular viewing window. The content generator 112 may be configured to sense that the panning motion exceeds a threshold angle and in response to detecting this condition, the content generator 112 may be configured to update the content in that particular viewing window. Updating the content may comprise, for example, advancing to the next page of a product manual.
The processing device 202 may include any custom made or commercially available processor, a central processing unit (CPU) or an auxiliary processor among several processors associated with the computing device 102, a semiconductor based microprocessor (in the form of a microchip), a macroprocessor, one or more application specific integrated circuits (ASICs), a plurality of suitably configured digital logic gates, and other well known electrical configurations comprising discrete elements both individually and in various combinations to coordinate the overall operation of the computing system.
The memory 214 may include any one of a combination of volatile memory elements (e.g., random-access memory (RAM, such as DRAM, and SRAM, etc.)) and nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, etc.). The memory 214 typically comprises a native operating system 216, one or more native applications, emulation systems, or emulated applications for any of a variety of operating systems and/or emulated hardware platforms, emulated operating systems, etc. For example, the applications may include application specific software which may comprise some or all the components of the computing device 102 depicted in
Input/output interfaces 204 provide any number of interfaces for the input and output of data. For example, where the computing device 102 comprises a personal computer, these components may interface with one or more user input/output interfaces 204, which may comprise a keyboard or a mouse, as shown in
In the context of this disclosure, a non-transitory computer-readable medium stores programs for use by or in connection with an instruction execution system, apparatus, or device. More specific examples of a computer-readable medium may include by way of example and without limitation: a portable computer diskette, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM, EEPROM, or Flash memory), and a portable compact disc read-only memory (CDROM) (optical).
Reference is made to
Although the flowchart of
At block 310, the computing device 102 obtains a media stream from a video streaming server 122. The media stream obtained from the video streaming server 122 may correspond to live streaming of an event for promoting a product. For example, the event may comprise an individual promoting a line of cosmetic products during a live broadcast.
At block 320, the computing device 102 receives product information from the video streaming server 122. The product information may comprise different types of data associated with one or more cosmetic products where the data may include step-by-step directions on how to apply one or more cosmetic products, purchasing information for one or more cosmetic products, rating information, product images, a Uniform Resource Locator (URL) of an online retailer for a product web page selling a cosmetic product, a video promoting one or more products, a thumbnail graphical representation accompanied by audio content output by the computing device 102, a barcode for a product, and so on. Where the product information comprises step-by-step directions, such product information may be partitioned into pages. The different pages of the step-by-step directions may be accessed by user input received by the computing device 102, as described in more detail below. The product information may also comprise a Uniform Resource Locator (URL) of an online retailer for a product web page selling a cosmetic product.
At block 330, the computing device 102 displays the media stream in a first viewing window. At block 340, the computing device 102 monitors the media stream for one or more trigger conditions. In response to detecting one or more trigger conditions, the computing device 102 generates at least one trigger signal. The type of generated trigger signal will then be used to determine which portions of the product information to display. For example, one trigger signal may cause step-by-step directions on how to apply the cosmetic product to be displayed in a viewing window while another trigger signal may cause purchasing information for the cosmetic product to be displayed in the viewing window (or in a new viewing window).
The computing device 102 may be configured to monitor for the presence of one or more trigger conditions. One trigger condition may comprise a voice command expressed in the media stream. For example, a word or phrase spoken by an individual depicted in the media stream may correspond to a trigger condition. Another trigger condition may comprise a gesture performed by an individual depicted in the media stream. Yet another trigger condition may comprise an input signal received from the individual depicted in the media stream being displayed, where the input signal is received separately from the media stream, and where the input is generated responsive to manipulation of a user interface control by the individual at a remote computing device. For example, the individual depicted in the media stream may utilize a remote computing device 103a, 103b (
At block 350, the computing device 102 determines at least a portion of the product information to be displayed in a second viewing window based on the monitoring. For some embodiments, this is performed based on the one or more trigger signals, where different portions of the product information are displayed based on the type of the generated trigger signal.
For some embodiments, the computing device 102 updates content shown in the second viewing window responsive to user input. This may comprise receiving user input from a user viewing the media stream and based on the user input, performing a corresponding action for updating the content displayed in the second viewing window. For some embodiments, the user input may comprise a panning motion exceeding a predetermined threshold performed by the user while viewing the content in the second viewing window, where the corresponding action comprises updating the second viewing window to display another portion of the product information. For some embodiments, the panning motion is performed using one or more gestures performed on a touchscreen interface of the computing device 102, a keyboard of the computing device 102, a mouse, and/or panning or tilting of the computing device 102. Thereafter, the process in
Having described the basic framework of a system for conveying product information during live streaming of an event, reference is made to
As discussed above, the product information may be embedded within the media stream received by the data retriever 106. However, the product information may also be received separately from the media stream. In such embodiments, the product information may be obtained by the data retriever 106 directly from the remote computing device 103a. In various embodiments, the presentation of such product information is triggered by conditions that are met during playback of the live video stream. For example, such trigger conditions may be associated with content depicted in the live video stream (e.g., a gesture performed by an individual depicted in the live video stream).
The viewing window manager 108 displays the media stream obtained by the viewing window manager 108 in a first viewing window 404 of a user interface 402 presented on a display of the computing device 102. As described in more detail below, the user interface 402 may include one or more other viewing windows 406, 408 for displaying various portions of the product information obtained by the data retriever 106.
The trigger sensor 110 analyzes content depicted in the media stream and monitors for the presence of one or more trigger conditions. For example, such trigger conditions may comprise a specific gesture performed by an individual depicted in the live video stream. Based on the analysis, the trigger sensor 110 determines at least a corresponding portion of the product information to be displayed in a second viewing window 406, 408.
The content generator 112 adjusts the size and placement of the first viewing window 404 and of the one or more viewing windows 406, 408 displaying product information, where the size and placement of the viewing windows 404, 406, 408 are based on a total viewing display area of the computing device 102. The content generator 112 also updates the content shown in the one or more viewing windows 406, 408 displaying product information, where this is performed in response to user input.
In the examples shown in
In some embodiments, only product information is displayed in a single viewing window 404 of the user interface 402, as shown in
It should be emphasized that the above-described embodiments of the present disclosure are merely possible examples of implementations set forth for a clear understanding of the principles of the disclosure. Many variations and modifications may be made to the above-described embodiment(s) without departing substantially from the spirit and principles of the disclosure. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.
This application claims priority to, and the benefit of, U.S. Provisional Patent Application entitled, “Function for viewing detail information for certain products when watching live broadcasting shows,” having Ser. No. 62/630,170, filed on Feb. 13, 2018, which is incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
62630170 | Feb 2018 | US |