Patent Application
20150365730
Currently, a user is able to enjoy viewing programs from many sources and delivery mechanisms (e.g., downloading, streaming, and recorded). For example, the user may enjoy streaming programs via a handheld device, a desktop computer, or a television.
The following detailed description refers to the accompanying drawings. The same reference numbers in different drawings may identify the same or similar elements. Also, the following detailed description does not limit the invention.
The term “program” as used herein, is intended to include visual data, audio data, or a combination of audio data and visual data. The program may originate from various sources, such as, for example, a television service, an Internet service, a digital video recording (DVR) service, data stored on a user device, a mobile service, etc. The program may be for example, television content, Internet content, user content, or other form of media. By way of further example, a program may be a movie, a television show, video-on-demand (VoD) content, live content, premium channel content, pay-per-view (PPV) content, music, a podcast, or other form of media (e.g., a slide show of pictures, etc.).
When a user digests (e.g., views and/or listens to) a program via a user device, the user may provide certain inputs during the course of experiencing the program. For example, the user may invoke what may be referred to as a ‘trick play” operation. The trick play operation may include fast-forwarding, rewinding, playing, stopping, pausing/resuming, advancing to a next item or place in time, returning to a previous item or place in time, instantly replaying (e.g., replay a segment of the program), repeating, etc. The fast-forward operation and the rewind operation may operate at different speeds (e.g., 1×, 2×, 3×, 4×, 8×, etc.) or as predefined time intervals, such as jumping forward 30 seconds or jumping backward 30 seconds. The user may invoke the trick play operation by pressing a trick play button of a remote control device, inputting a trick play command via a user interface or an input device (e.g., a keyboard, a mouse, etc.), uttering a voice command, etc.
The list of exemplary trick play operations is not intended to be exhaustive. Depending on the program (e.g., a movie, a song, etc.), a program player or other application involved in providing the program to the user, type of user device 120, etc., the trick play operation may include another type of input (e.g., zoom, etc.) and/or setting (e.g., audio setting (e.g., equalization, etc.), closed-caption, video setting, etc.) not specifically mentioned herein.
According to an exemplary embodiment, a user device captures behavioral data stemming from a user's behavior during the experiencing of a program. For example, the user device captures trick play inputs when the user is playing a movie. According to an exemplary embodiment, the user device stores the behavioral data. For example, in a scenario in which the program was downloaded and stored on the user device, the user device may store the behavioral data as metadata to the program file. According to other examples, the user device may store the behavioral data in a data structure or a database. The data structure or the database may be separate from the program file.
According to an exemplary embodiment, the user device uses the behavioral data as a basis for governing how playback of the program is to take place during a next time the user digests the program. For example, assume the user decides to play the same movie a month later, the user device uses the behavioral data stemming from the first time the user played the movie as a basis to govern how the movie is played for the user during the second time.
According to an exemplary embodiment, the user device includes an agent that provides the logic for user behavioral playback (i.e., capture, storage, and use of user behavioral data). The agent may operate at the application level. For example, the agent may be included in a program player or may be a stand-alone component of the user device. Alternatively, the agent may operate at a system level (e.g., operating system level).
The number of devices and configuration in environment 100 is exemplary and provided for simplicity. According to other embodiments, environment 100 may include additional devices, fewer devices, different devices, and/or differently arranged devices than those illustrated in
Network 105 includes one or multiple networks of one or multiple types. For example, network 105 may include the Internet, a wide area network, a private network, a public network, an intranet, a local area network, a packet-switched network, a wired network (e.g., an optical network, a cable network, etc.), a wireless network (e.g., a mobile network, a cellular network, etc.), etc. Although not illustrated, network 105 may include various other network devices, such as, one or multiple security devices, routing devices, gateways, access points, etc.
Network device 110 includes a computing device that is capable of streaming and/or downloading a program to another device, such as user device 120. For example, network device 110 may correspond to a server device. The server device may take the form of a web server, an application server, a virtual server, an audio/video server, a file server, or some other type of network server.
User device 120 may correspond to various types of user devices. User device 120 may be a stationary device, a portable device, a handheld, a palmtop device, or a mobile device. For example, user device 120 may take the form of a computer (e.g., a desktop computer, a laptop computer, a palmtop computer, a tablet computer, a netbook, etc.), a personal digital assistant (PDA), a personal communication system (PCS) terminal, a smartphone, a Web or Internet access device, a set top box, or some other communication device (e.g., a vehicular infotainment system). User device 120 may include multiple devices (e.g., a set top box and a television, etc.). User device 120 may be able to record and playback programs.
Agent 125 includes the logic to provide user behavioral playback, as described herein. According to an exemplary implementation, agent 125 is implemented at an application layer. For example, agent 125 is included in a program player or is a stand-alone application. According to another exemplary implementation, agent 125 is implemented at a system level (e.g., operating system of user device 120). According to an exemplary implementation, behavioral data may be stored in a file (e.g., a registry file, a hidden data file, or some other type of system file depending on the platform in which user device 120 operates). The file may be loaded during boot-up of user device 120. For example, the file may be loaded during a Basic Input/Output System (BIOS) process or some other initialization process. The agent may include an application programming interface (API) to provide the control of an application (e.g., a program player, etc.) based on the behavioral data.
Referring to
Referring to
As described further below, agent 125 may also select from existing data (e.g., metadata associated with the movie) or generate data 143 that does not necessarily stem from rewind request 134 and play request 137, such as name of the movie, date and time the user is watching the movie, an identifier that identifies the user, etc. Agent 125 may use this additional data when, for example, selecting and using the behavioral data on behalf of the user for a future viewing session of the movie. The additional data may be also stored as behavioral data.
Referring to
As further illustrated, agent 125 determines whether behavioral data exists for the program. For example, agent 125 identifies the name of the program (e.g., the name of the movie), and uses this data as a key to determine whether behavioral data exists (e.g., is stored) for the program. Agent 125 may use other data to determine whether behavioral data exists. For example, agent 125 identifies the user of user device 120 and determines whether behavioral data exists for this user and this program. According this example, agent 125 determines that there is behavioral data for the selected movie and for this user. Referring to
The scenarios described in reference to
According to an exemplary embodiment, agent 125 provides a user interface that allows the user to turn on and turn off (i.e., enable and disable) agent 125. Additionally, according to an exemplary embodiment, agent 125 provides other user interfaces that allow the user to set various control mechanisms. For example, agent 125 may provide a user interface that allows a user to be prompted whether behavioral data is to be used. As an example, upon commencement of a session, agent 125 determines that behavioral data exists. Subsequently, agent 125 prompts the user to confirm that user behavioral playback is desired.
According to an exemplary embodiment, agent 125 allows the user to override the user behavioral playback. For example, assume a program is being presented to the user in accordance with the behavioral data. During this time, the user wishes to skip a scene even though the behavioral data does not indicate to do so. The user may skip the scene. In this case, according to an exemplary embodiment, agent 125 adds this new input data to the behavioral data. Alternatively, agent 125 creates a new file for the behavioral data. That is, agent 125 may store different versions of the behavioral data. Agent 125 may provide a user interface to allow the user to name a version. For example, the user may store one version that highlights all the action sequences in the movie (e.g., for the user) and another version that provides a shortened or summary version of the movie (e.g., when viewing the movie with a friend, etc.). When multiple versions exist for the same program, agent 125 may prompt the user to select the correct version to use for user behavioral playback.
Agent 125 may also provide other functions. For example, assume that user device 120 establishes a program streaming session and behavioral data is to be used. Agent 125 may inspect the behavioral data to determine the type of trick play inputs. As an example, assume that agent 125 determines that a fast-forward input is coming up based on an inspection of the behavioral data. Agent 125 may pass this information, issue a request, and/or pass a value to the appropriate component (e.g., a program player or streaming logic), in an attempt to regulate the amount of program data stored in the buffer. In this way, agent 125 may improve the user's experience when viewing the program by minimizing potential latency caused by the fast-forwarding and the available program data in the buffer. Thus, for example, the streaming algorithm logic may increase the buffer level to the maximum in response to receiving the request from agent 125. Indeed, since the playback signature of the program is known based on the behavioral data, absent receiving any overriding inputs from the user, agent 125 may treat the behavioral data as predictive data and use this data to govern the program streaming session.
While the above scenario provides an example of the predictive playback function of agent 125, the program player or streaming logic may consider data, other than data or requests from agent 125, to govern buffer levels. For example, the program player or streaming logic may consider connection states and metrics (e.g., received signal strength during the program session, available bandwidth, etc.). Additionally, although the above example is illustrative for adjusting a buffer level based on the behavioral data, during an adaptive programming session, parameters other than or in addition to buffer levels may be influenced based on the predictive playback function of agent 125 such as selection of program segment bit-rates, when requests to refill the buffer are made, etc.
Program identifier field 205 stores data that identifies a program. For example, the data may indicate a title of the program, a file name, a user-created string, or other suitable form of a program identifier. User identifier field 210 stores data that identifies the user. For example, the data may indicate the user's name, a user-created string, or some other suitable form of a user identifier.
Input field 215 stores data that identifies a trick play operation. For example, the data may indicate a fast-forward, a rewind, a stop, a pause, a resume, etc., as previously described.
Timestamp field 220 stores data that indicates a time pertaining to the trick play operation. Depending on the type of program, the time may be a time code (e.g., hours, minutes, seconds; hours, minutes, seconds, frames, etc.). For example, when the program is an episode of a television series, a movie, or music (e.g., a song), the time code that indicates a progress point of the program. According to other examples, the time may be another type of referent. For example, assume the program is a slide show of pictures in which the user selects next or previous inputs to control the flow of the presentation of pictures. The time may indicate a real-time value within a real-time time window corresponding to the start of the slide show to the end of the slide show. For example, the user may select a next button at irregular times to view pictures. Each next button would be assigned a timestamp that is relative to the start of the slide show.
Age field 225 stores data that indicates the age of the program session. For example, the data may indicate a date and timestamp, a string that indicates a time period (e.g., months or months and days, etc.), or some other suitable form of time-based indicator.
According to other implementations, table 200 may include additional fields, fewer fields, and/or different fields than those illustrated in
As previously described, according to an exemplary embodiment, user device 120 may store the program. For example, user device 120 may download the program from another device. In a manner similar to that previously described, agent 125 monitors trick play operations during the digestion of the program and store behavioral data resulting from the monitoring. Additionally, agent 125 may store additional data (e.g., setting data, etc.) as behavioral data. Since the program is stored (e.g., on user device 120), agent 125 may store the behavioral data as metadata for the program.
Subsequently, in a manner similar to that previously described in relation to
Processor 405 includes one or multiple processors, microprocessors, data processors, co-processors, multi-core processors, application specific integrated circuits (ASICs), controllers, programmable logic devices, chipsets, field programmable gate arrays (FPGAs), system on chips (SoCs), programmable logic devices (PLSs), microcontrollers, application specific instruction-set processors (ASIPs), central processing units (CPUs), or some other component that interprets and/or executes instructions and/or data. Processor 405 may be implemented as hardware (e.g., a microprocessor, etc.) or a combination of hardware and software (e.g., a SoC, an ASIC, etc.). Processor 405 may include one or multiple memories (e.g., memory/storage 410), etc.
Processor 405 may control the overall operation, or a portion of operation(s) performed by device 400. Processor 405 may perform one or multiple operations based on an operating system and/or various applications or programs (e.g., software 415). Processor 405 may access instructions from memory/storage 410, from other components of device 400, and/or from a source external to device 400 (e.g., another device, a network, etc.).
Memory/storage 410 includes one or multiple memories and/or one or multiple other types of storage mediums. For example, memory/storage 410 may include one or multiple types of memories, such as, random access memory (RAM), dynamic random access memory (DRAM), cache, read only memory (ROM), a programmable read only memory (PROM), a static random access memory (SRAM), a single in-line memory module (SIMM), a dual in-line memory module (DIMM), a flash memory, and/or some other type of memory. Memory/storage 410 may include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optic disk, a solid state disk, etc.) and a corresponding drive. Memory/storage 410 may include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optic disk, a solid state disk, etc.), a Micro-Electromechanical System (MEMS)-based storage medium, and/or a nanotechnology-based storage medium. Memory/storage 410 may include drives for reading from and writing to the storage medium.
Memory/storage 410 may be external to and/or removable from device 400, such as, for example, a Universal Serial Bus (USB) memory stick, a dongle, a hard disk, mass storage, off-line storage, or some other type of storage medium (e.g., a compact disk (CD), a digital versatile disk (DVD), a Blu-Ray® disk (BD), etc.). Memory/storage 410 may store data, software, and/or instructions related to the operation of device 400
Software 415 includes an application or a program that provides a function and/or a process. In this context, the term “program” is used in the sense of a sequence of instructions designed for execution on a computer system. A “program” or a “computer program” may include a subroutine, a function, a procedure, an object method, an object implementation, an applet, a servlet, a source code, an object code, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer system. The term “program,” when used to mean, for example, audio and/or video data versus used to mean a set of instructions will be apparent from the context of use in the present document.
Software 415 may include firmware. For example, with reference to user device 120, software 415 may include an application that, when executed by processor 405, provides the functions of agent 125, as described herein.
Communication interface 420 permits device 400 to communicate with other devices, networks, systems and/or the like. Communication interface 420 includes one or multiple wireless interface(s) and/or wired interface(s). For example, communication interface 420 may include one or multiple transmitter(s) and receiver(s), or transceiver(s).
Input 425 provides an input into device 400. For example, input 425 may include a keyboard, a keypad, a touchscreen, a touch pad, a touchless screen, a mouse, an input port, a button, a switch, a microphone, a knob, and/or some other type of input.
Output 430 provides an output from device 400. For example, output 430 may include a display, a speaker, a light (e.g., light emitting diode(s), etc.), an output port, a vibratory mechanism, and/or some other type of output.
Device 400 may perform a function or a process in response to processor 405 executing software instructions stored by memory/storage 410. For example, the software instructions may be read into memory/storage 410 from another memory/storage 410 or read from another device via communication interface 420. The software instructions stored in memory/storage 410 may cause processor 405 to perform processes described herein. Alternatively, according to another implementation, device 400 may perform a process or a function based on the execution of hardware (e.g., processor 405, etc.).
Referring to
In block 510, a trick play input is received and executed. For example, the user of user device 120 inputs a trick play input during the viewing and/or listening of the program. The trick play input may be a fast-forward request, a rewind request, a pause request, or some other type of input to cause the program to fast-forward, rewind, pause, or perform some other operation.
In block 515, behavioral data pertaining to the trick play input is captured. For example, agent 125 of user device 120 captures behavioral data pertaining to the trick play input. For example, as previously described, the behavioral data may include input data (e.g., a command code, etc.) and time information. As previously described, agent 125 may select, obtain, or generate additional data (e.g., title of program, date and time of session, user identifier, etc.).
In block 520, the behavioral data is stored. For example, agent 125 stores the behavioral data. The behavioral data may be stored as a part of the program file or separate from the program file. For example, the behavioral data may be stored as metadata to the program file or in a data structure or a database, such as table 200.
In block 525, it is determined whether the program session has ended. For example, agent 125 determines whether the program session has ended or agent 125 is informed that the program session is ended. By way of example, the user may close a program player, a tear down of a connection may take place, etc., which in effect constitutes the end of a program session. If it is determined that the program session has not ended (block 525—NO), then the process 500 continues to block 505. If it is determined that the program session has ended (block 525—YES), then process 500 ends.
Although
Referring to
In block 560, it is determined whether there is behavioral data. For example, agent 125 determines whether there is behavioral data for the program. For example, as previously described, agent 125 may use a program identifier as a key to search a data structure or a database (e.g., table 200) to determine whether there is behavioral data. Alternatively, when the behavioral data is stored as metadata, agent 125 may determine whether there is behavioral data from a program file (e.g., that includes the program and the metadata).
If it is determined that there is no behavioral data (block 560—NO), then process 500 is performed. For example, agent 125 performs process 500, as described in relation to
If it is determined that there is behavioral data (block 560—YES), it is determined whether this is a streaming session (block 565). For example, agent 125 determines whether the program session is an adaptive streaming session. Alternatively, agent 125 is informed (e.g., by another component of user device 120) of the type of program session. As previously described, the program may be stored on user device 120 or the program may be streamed (e.g., adaptively streamed) from another device (e.g., network device 110).
If it is determined that the program session is not a streaming session (block 565—NO), then the program is played based on the behavioral data (block 570). For example, agent 125 governs the playback of the program based on the behavioral data. As previously described, according to an exemplary embodiment, agent 125 may perform other operations during playback. These operations are optional and described in relation to blocks 575 and 580.
In block 575, trick play inputs are analyzed. For example, agent 125 analyzes the trick play inputs included in the behavioral data based on policies or heuristics. For example, agent 125 may identify the presence of a long pause or a long period of fast-forward. As previously described, in one example, agent 125 analyzes the long pause and concludes that the long pause should be shortened or omitted. According to another example, agent 125 may identify a long period of fast-forward and conclude that a skip input (when available) may be more efficient to reach the endpoint of the fast-forward versus a long period of fast-forward.
In block 580, playback is edited based on the analysis. For example, agent 125 edits the behavioral data and/or modifies the playback of the program based on the analysis. For example, as previously described, agent 125 may ignore or shorten the pause, or invoke a skip input and shorter period of fast-forward to reach the endpoint of the fast-forward.
If it is determined that the program session is a streaming session (block 565—YES), then the program is played based on the behavioral data (block 585). This step is the same as that described in relation to block 570. As previously described, according to an exemplary embodiment, agent 125 may perform other operations during a program streaming session. These operations are optional and described in relation to blocks 590 and 595.
In block 590, trick play inputs are analyzed. For example, agent 125 analyzes up-coming trick play inputs. Agent 125 may apply rules that identify trick play inputs that may disrupt the user's experience. For example, as previously described, a fast-forward input of a particular duration may cause a latency problem in view of the current buffer level.
In block 595, streaming parameters are regulated based on the analysis. For example, agent 125 may pass information or issue a request to the appropriate streaming component to regulate a parameter associated with the streaming session. As an example, agent 125 may pass a value or issue a request to increase the buffer level to the maximum based on the analysis of the fast-forward input.
Although
The foregoing description of implementations provides illustration, but is not intended to be exhaustive or to limit the implementations to the precise form disclosed. Accordingly, modifications to the implementations described herein may be possible.
The terms “a,” “an,” and “the” are intended to be interpreted to include one or more items. Further, the phrase “based on” is intended to be interpreted as “based, at least in part, on,” unless explicitly stated otherwise. The term “and/or” is intended to be interpreted to include any and all combinations of one or more of the associated items.
In addition, while series of blocks are described with regard to the processes illustrated in
The embodiments described herein may be implemented in many different forms of software and/or firmware executed by hardware. For example, a process or a function may be implemented as “logic” or as a “component.” The logic or the component may include, for example, hardware (e.g., processor 405, etc.), or a combination of hardware and software (e.g., software 415). The embodiments have been described without reference to the specific software code since software can be designed to implement the embodiments based on the description herein.
In the preceding specification, various embodiments have been described with reference to the accompanying drawings. It will, however, be evident that various modifications and changes may be made thereto, and additional embodiments may be implemented, without departing from the broader scope of the invention as set forth in the claims that follow. The specification and drawings are accordingly to be regarded as illustrative rather than restrictive.
In the specification and illustrated by the drawings, reference is made to “an exemplary embodiment,” “an embodiment,” “embodiments,” etc., which may include a particular feature, structure or characteristic in connection with an embodiment(s). However, the use of the phrase or term “an embodiment,” “embodiments,” etc., in various places in the specification does not necessarily refer to all embodiments described, nor does it necessarily refer to the same embodiment, nor are separate or alternative embodiments necessarily mutually exclusive of other embodiment(s). The same applies to the term “implementation,” “implementations,” etc.
Additionally, embodiments described herein may be implemented as a non-transitory storage medium that stores data and/or information, such as instructions, program code, data structures, program modules, an application, etc. The program code, instructions, application, etc., is readable and executable by a processor (e.g., processor 405) of a computational device. A non-transitory storage medium includes one or more of the storage mediums described in relation to memory/storage 410.
No element, act, operation, or instruction described in the present application should be construed as critical or essential to the embodiments described herein unless explicitly described as such.
