Patent Grant
11172164
The invention generally relates to the fields of media and advertising. In particular, the invention relates to a system and method for taking control of a service or device during a commercial break whereby control and output is switched to provide alternative content during the television commercial break.
A wide variety of multimedia content is currently available to consumers. Digital content ranges from low-bandwidth, unidirectional data streams such as low-fidelity audio-only content, through high-bandwidth, bi-directional data streams that support interactive, real-time, virtual game environments.
Many consumer devices and services are available to generate, present, transform, store, replay and otherwise manipulate multimedia streams. Televisions, digital video recorders (“DVRs”), game consoles, cable television receivers, Video On Demand (“VOD”) services and even cellular telephones are capable of providing rich media experiences for consumers.
Media distribution has long been supported by revenue from product advertisements and “commercial breaks.” However, many consumers prefer to avoid commercials by switching to a different media channel during a commercial break, or by fast forwarding through commercials that appear in a recorded stream.
No system has been put forth that automatically, upon detection of a commercial break, will cause a context switch to enable other services, programming or devices to gain control of the output of a display, speaker, process or system during the period of the commercial break then rejoin with the original programming context when the commercial break is over.
During playback of a primary media stream and on detection of a predetermined condition, signal or indication of a commercial break, a context switch occurs enabling other services, programming or devices to output a secondary stream to a display, speaker, process or system. The secondary stream may be processed during the period of the commercial break. When the commercial break is over, a change in the predetermined condition will optionally cause the system to rejoin with the original programming context.
Embodiments of the invention are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to “an” or “one” embodiment in this disclosure are not necessarily to the same embodiment, and such references mean “at least one.”
Embodiments of the invention provide alternative media that a user may be subjected to during the period of a commercial break. The present invention may also allow a user to tailor a multimedia experience to suit her particular interests. Furthermore, the present invention may provide a means for controlling the advertising time slot in a commercial break and give control of it to the adopters of the present invention.
In one embodiment, the user can select desired and undesired features of various content streams, and a system of the present invention will automatically select material from among available streams to produce an aggregate stream that more closely approximates the user's ideal experience than any single stream alone.
Desired and/or undesired features of various streams may be selected by the user (optional step 120). For example, the user may specify that certain programs or genres are of particular interest, or that certain material (e.g., programming containing mature themes) is to be avoided. In a preferred embodiment, commercial interruptions in a content stream can be specifically selected to seek out or avoid.
Once the user's preferences are configured, the system begins rendering the content of a primary stream (130). For example, the primary stream may be a radio program, played through an audio system; or a television program, displayed on a monitor. Rendering may include processing, routing or conditioning the stream to enable its output. The primary stream's content is monitored (140) for the occurrence of a signal or indication of a commercial break or material that is to be avoided. In some embodiments, streams other than the primary stream are also monitored (145) for the occurrence of material of interest. Monitoring may be accomplished by a number of different techniques, discussed below.
When a commercial break or undesired segment of the primary stream is detected (150) (or, in some embodiments, where a segment of a secondary stream that is of greater interest than the primary stream occurs, 155), the system discontinues the primary stream (160) and begins to render a secondary stream (170). Monitoring continues while the secondary stream is being played, and the system will switch back to the primary stream (180) when the commercial break is over or when its programming is of greater interest to the user than the secondary stream. In some embodiments, a secondary stream may itself be interrupted by a tertiary stream, and the system may return either to the secondary stream, or directly to the primary stream.
When switching from a primary stream to a secondary stream (or vice versa), an embodiment may perform a brief transition operation to avoid discontinuity. For example, the audio volume of the primary stream may be reduced to a low level, and the volume of the secondary stream may be started at a low level and increased to match the pre-switch volume of the primary stream. Video content may joined by a fade-out, fade-in transition or an alpha blend. (An alpha blend is a transition where a first video signal is modified to become increasingly transparent, while a second video signal is modified from transparent to opaque. The effect switches smoothly from the first video signal to the second video signal.)
When switching away from a multimedia stream at the commercial break or to avoid undesired content, the primary stream will typically not be suspended. However, in some configurations the user may choose to override or engage a further connection to the secondary stream even after a resumption signal has indicated the end of a commercial break. In certain circumstances when switching away from a primary stream to present material on a secondary stream, the secondary stream may be extended beyond a commercial break transition and the primary stream may be buffered, suspended, or even rewound when context switching back to the primary stream to avoid missing a portion of the primary stream after the commercial break ends. Similarly, when a selected secondary stream is discontinued, an embodiment may pause, suspend or rewind the secondary stream so that no portion of the secondary stream is missed.
Although the aggregate stream 240 in
In some environments, a user may not be adamantly opposed to viewing commercial content, but may prefer to receive commercials that are relevant to her interests, rather than commercials selected to appeal to a hypothetical viewing audience. In this case, a secondary stream may provide alternate commercials to replace material presented during a commercial break in the primary stream. Content for the secondary stream may be stored locally on a component of the user's multimedia system (i.e., her home entertainment system), or may be delivered via a wired or wireless connection. In one embodiment, a low-bandwidth text “crawl” (text that scrolls across a narrow horizontal band on the screen) displays targeted advertising, as shown at 340.
In some environments, a network comprised of consumer electronic devices incorporating the present invention may monetize the present invention by providing alternate commercials to replace material presented in existing commercial breaks in the primary stream. Content for the secondary stream may be stored locally on a component of the user's multimedia system (i.e., her home entertainment system), or may be delivered via wired or wireless connection. The local storage may be refreshed in a variety of ways, including from a network, removable media, BlueRay®, HD-DVD's, memory cards, etc.
Some users may prefer to use the time when undesired content is present on the primary media stream to play an interactive game. Mini-games—small tests of logic and/or dexterity—have proven to be popular with computer gamers, and can be presented for a user's enjoyment while display of a primary media stream is suspended. These games may be augmented with advertising.
In an environment where the duration of undesired content on a media stream is known or can be estimated, the time remaining until the primary stream resumes can be displayed to the user, or some other indication, such as an audio or visual cue or signal, may be used to aid the user or process to smoothly handle or render the transition of context switch. This can make the context switch enjoyable, informative and/or entertaining.
In some multimedia systems that implement an embodiment of the invention, several components (e.g., a display screen, content receiver, audio system and game console) can cooperate to create an improved user experience. For example, the content receiver can obtain information about the media streams it is processing from an Internet database. (Alternative embodiments may extract similar information from the media streams themselves.) The receiver may coordinate stream switching to provide smoother transitions. It may also provide control signals to the audio system and game console to start and stop those streams. A content receiver that includes an analog or digital recording mechanism such as a videotape recorder or a hard disk drive may be able to provide “pause” and “rewind” functionality to improve the user experience.
In some embodiments, a user may influence the automatic selection and stream-switching process. For example, the user might send a signal to a controlling system to cause it to switch media streams even though no desired or undesired program features that would cause an automatic context switch have been detected. Alternatively, the user may reverse an automatic context switch that caused a stream of interest to be discontinued. Even when a context switch is initiated (or canceled) by the user, the system may automatically pause and/or start certain streams. For example, when switching away from an interactive, real-time game due to either an automatic or manual context switch signal, the system may pause the game. The system may also search for appropriate time in the secondary stream to cause a transition from a secondary stream back to a primary stream. The process for switching back to the primary stream may also be orchestrated based on monitoring the secondary stream. For example, instead of cutting out in the middle of a game to switch back to the primary stream after the commercial break in the primary stream is over, the system may start a DVR process and record the primary stream to enable the system to determine an appropriate opportunity to trigger the context switch back to the primary stream. Such opportunities may include black screen cut, end of game level, death of a game character, completion of a game mission, or any metric, including those based on state of a process and reaching a predetermined characteristic. Once the opportunity is determined the system may switch back to the primary stream and rewind to the start of the primary stream after the commercial break ends. In this example, the user would be “viewing” a primary stream under time-delay. Recognizing that the primary stream is no longer “live”, the present invention may reference user settings to determine to determine how to handle the next commercial break period. For example, a settings profile may be referenced and user options provided to allow a user to try to catch up to the “live” stream by viewing an alternative set of advertisements during the commercial breaks and where the advertisements are provided in a time-compressed format. For example, instead of watching 2 minutes of live commercial breaks or engaging in a context switch per the present invention, a user who is watching the live program under DVR time-shift delay would have the option to view, say, 15 seconds of banner advertisements during the next commercial break and this would move the user 1 minute 45 seconds closer to the time-base of the live program. Needless to say, it would also provide significant revenue potential to adopters of the present invention who would receive payment for selling the 15 second spots.
When manually or automatically switching away from a stream that contains desirable material, the stream may be paused, but when manually or automatically switching away from a stream that contains neutral or undesirable material, the stream may be permitted to proceed, so that the material will be skipped.
An embodiment can determine what type of material a stream is carrying by a number of different means. Some streams will carry machine-processable data in-band or in a sub-channel. Information about other streams may be obtained from an Internet data service. An embodiment may calculate a “hash” or “fingerprint” of a portion of a media stream and search for the hash in a database. A microphone may capture an impression of the audio content of a program, and software similar to voice recognition software may be used to categorize the audio content.
The operation of an audio visual system 400, according to one embodiment of the invention, will now be discussed with reference to
Alternatively, the television signal may be received via one of audio visual input modules 435a-435n. As examples, the modules may provide for an Ethernet interface for receiving a television signal over a network such as an intranet or the Internet, a cable set-top box for receiving a television signal via a coaxial cable, a power supply via which to receive a broadband transmission over a power line, or a telephone jack via which to receive Digital Subscriber Line (DSL), ADSL, or xDSL transmission over the wires of a local telephone line. Additionally, the audio visual inputs 435a-435n may include “line-in” jacks to which can be coupled any one of a number of devices that provide television programming, such as a Video Cassette Recorder (VCR), an optical disc storage media player such as a Digital Video Disc (DVD) player, a Digital Video Recorder (DVR), a video game console such as a Sony Playstation™ 3 (PS3), and a computing device such as a personal computer (PC).
Television set 405 includes a control module 410 that receives and processes the television signal from one of the input modules 420a-420n and 435a-435n. Control module 410 includes a processor 411 that executes computer program code maintained in memory 413 that controls the operation of the television set 405, including directing the control module to receive and process a television signal from an input module. The signal may further be decoded at decoder module 412 before being output at step 520 to a display device. For example, the television signal may be received as a compressed digital transmission signal encoded according to Motion Pictures Expert Group-2 (“MPEG-2”), a standard for generic coding of moving pictures and associated audio information. The decoder decompresses and provides the video component and the audio component of the television signal to respective audio output and video output modules 425 and 430. The audio output module includes amplifier circuitry and related circuitry known to those of ordinary skill in the art to convert the audio component of the television signal into sound waves output at 520 by one or more speakers (not shown) coupled to audio output module 425. The video output module 430, in turn, outputs at 520 the video component of the television signal to a monitor or display device (not shown) such as a cathode ray tube (CRT) screen or a liquid crystal display (LCD) screen.
The television signal comprises television programming, for example, a network television situation comedy program. As is well known, television programming is interspersed with “commercial breaks”—advertisments regarding products and services, political advertisements, advertisements regarding upcoming television programming events such as televised sporting events, network news, public service announcements, etc., are transmitted during such commercial breaks. Multiple television programs may be broadcast over a period of time, e.g., one or more hours. A series of one or more television commercials may be “aired” during a commercial break in a particular program or between any two of the multiple television programs.
In one embodiment of the invention, at step 525, the control module monitors the received television signal for an event, such as a commercial break, and at 530 directs the output of an audio visual program that is not part of the received television signal to the display device. The television set receives input from a user, that is, a television viewer, indicating preferences as to the audio visual program to output to the display device upon the occurrence of the event.
The user's preferences may be input via a remote control device 555 or other user input device 450 such as a keyboard, mouse, lightpen, and the like. The user's preferences may be stored in a memory such as memory 413, retreived from memory 413 and provided as input to control module 410 to direct the control module as to the audio visual program to output when a particular event or type of event occurs. Alternatively, the user's preferences may be maintained in a permanent store such as permanent storage medium 440, and fetched from permanent store 440 for caching in memory 413 when needed.
It is appreciated that there are a variety of ways to define and detect an event in the received television signal. One or more techniques such as black screen detection, change in amplitude of the audio signal component of the received television signal, embedded codes in the received television signal, etc., may be employed, and may be known to those of ordinary skill in the art. An event may further be defined within a television program, such as: a scene subject to viewing controls or restrictions, in which case the viewer preference may be that the scene not be displayed at all; a repeated segment of a television program, such as slow motion replay of a controversial or key play in a televised sporting event; scenes from a previous television broadcast of a weekly televised drama; and the opening or closing credits of a television program.
Returning to the discussion of user preferences, a user may indicate a preference for viewing highlights of recent televised sporting events upon the occurrence of a particular event. Upon the occurrence of the event, such as the start of a commercial break in a television program being displayed on the display device, an audio visual program comprising highlights of the recent sporting events is retreived and output to the display device. In one embodiment of the invention, the display of the audio visual program comprising the highlights of the recent sporting events replaces the display of the television commercials that otherwise would be displayed on the display device during the commercial break in the television program.
In an alternative embodiment of the invention, the context switch may not entirely remove the user from experiencing the primary stream. The secondary steam may be occupy the screen along with the primary stream via various display formats. The audio secondary stream program may be displayed as a picture within a picture of the television commercials, or conversely, the television commercials may be displayed as a picture within a picture of the audio visual program. Additional methods of concurrently displaying both the audio visual program and the television commercials are possible, such as displaying either as a reduced size version of itself, such as in a “thumbnail” video picture, in conjunction with the original size version of the other, or displaying each in a separate nonoverlapping window on the display device.
While the example discussed above contemplates outputting another television program that is not part of the received television signal upon detecting, and during at least some portion of, an event associated with the television signal, such as the occurrence of a stream of one or more advertisements in the television signal, it is appreciated that other audio visual program content may be output for display. For example, advertising indicated as being preferred by the user may be displayed instead. Alternatively, the television program that is not part of the received television signal may include its own set of commercials embedded or interspersed with the television program. In one embodiment, the television program and/or commercials that are not part of the received television program may be obtained by control module 410 from a repository, such as permanent storage device 440, and transferred to the display device. In another embodiment, the television program and/or commercials are received from a different television channel.
In another embodiment, the audio visual system 400 may incorporate a number of devices from which an audio visual program may be obtained for display on the display device upon the occurrence of an event in the received television signal.
It should be appreciated that detecting an event is not necessarily a binary situation, that is, merely whether the event is detected or not. In one embodiment of the invention, an event can be represented by multiple values, and can trigger the switch module to take one of multiple actions in switching control of the audio visual system, depending on the “value” of the event. Moreover, the user's preferences may vary depending on the “value” of the event, which may also affect the actions to switch control.
Alternatively, the computing device 460 may access and transmit for display on the display device a web site with which the user may interact. For example, the user may interact with the web site while at least some portion of the event occurs in the received television signal. In yet another embodiment, computing device 460 may execute a program that displays a graphical user interface, or a graphical user interface element, such as a free application platform branded as a Yahoo! Widget, on the display device, via which the user may interact with the computing device 460.
Audio visual system 400 may further comprise a video game console 465, such as a Sony PS3. When an event is detected in the received television signal, switch module 414 may switch control to video game console 465, thereby providing the viewer the ability to interact with video game console 465 during the event, or some period of time, in accordance with the user preferences. The audio and video components of a video game being played by the user on the video game console are directed to the audio and video output modules 425 and 430 of television set 405, so that the audio visual program components of the video game are output. In like manner, upon the occurrence of an event, a user may obtain control of the VCR, DVD player, or DVR 475 by way of switch module 414, and see audio visual program content obtained therefrom output to the display device. An embodiment of the invention contemplates other devices, such as telephone 470 or audio device 480 (e.g., an MP3 player or FM radio receiver) being coupled to television set 405 so that audio and/or visual program content obtained therefrom may be forwarded to the television's display device when an event is detected in the received television signal. As with computing device 460, these devices may couple to the television set 405 via one of audio visual inputs 435a-435n.
Regardless of what device provides the audio visual program output directed to the display device upon the detection of an event in the received television signal, at some point the audio visual program output is terminated. For example, in one embodiment of the invention, upon detection of the end of the event at 535, either the output of the audio visual program to the display device terminates, and output of the received television signal to the display device resumes, if previously suspended, or continues, as the case may be, as described above. In the event the audio visual program output at 535 is obtained from one of the devices (460-480) controlled by switch module 414, the switch module stops the transfer of the audio visual program from such device responsive to detection of the end of the event.
In one embodiment of the invention, television set 405 comprises control module 410 which in turn comprises switch module 414 that switches control from television set 405 to other devices in the audio visual system such as video game console 465. However, in another embodiment, any number of devices may include the logic to switch control from one of such devices to another device. For example, it is appreciated that an embodiment of the invention may involve a video game console that receives and displays an audio visual signal on a display device, and upon detection of an event, e.g., the loading of a video game software application, switches control to another device, such as television set 405, while the video game is loading, so that a received television signal from the television set is displayed. Moreover, control may switch between multiple devices depending on the user preferences. For example, the display device may initially display output from a television signal received at television set 405, then control is switched to game console 465 which outputs its audio visual program display to display device, upon the occurrence of an event in the received television signal.
Further, the manner of transitioning control from one device to another may differ depending on the type of device. For example, given the television set primarily provides output to a display device, the transition from the displaying the received television signal from the television set to displaying the audio visual program from another device such as a video game console can be a relatively quick and abrupt. However, the transition from displaying an audio visual program from a video game console, which is an interactive device, may benefit from a relatively slow and considered approach, ensuring that the video game software application is terminated properly, and any user data associated therewith saved for later use.
While
In one embodiment of the present invention, the various content streams are selected by a selector 625, which selects one of the streams to couple for output according to an automatic selection signal 630. The selection signal 630 may be produced by a number of means and from various services. It may also be produced by an output of a content analyzer 635. The selected stream is delivered to an output module and may be coupled to a High Definition Television (“HDTV”) 640, audio speaker system 645, or headphones 650. Note that an “output module” is a device, circuit or process that couples a media stream to an output such as a monitor or speaker, or other sensory output. A stream may be audio-only, so a speaker system 645 or headphones 650 may participate in rendering the stream adequately.
Again, some or all of the elements of this apparatus may be integrated into a single device. For example, a game console 660 may contain hardware and/or software to implement content analyzer 635 and stream selector 625. Game console 660 may accept content streams from external devices, and may also generate a content stream of an interactive computer game, which may be selected by stream selector 625. A transition module 655 may smooth the transition from one stream to another, as discussed previously.
An embodiment of the invention may be a machine-readable medium having stored thereon instructions which cause a programmable processor to perform operations as described above. In other embodiments, the operations might be performed by specific hardware components that contain hardwired logic. Those operations might alternatively be performed by any combination of programmed computer components and custom hardware components.
A machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including but not limited to Compact Disc Read-Only Memory (CD-ROM), Read-Only Memory (ROM), Random Access Memory (RAM), and [Electrically] Erasable Programmable Read-Only Memory ([E]EPROM).
The applications of the present invention have been described largely by reference to specific examples and in terms of particular allocations of functionality to certain hardware and/or software components. However, those of skill in the art will recognize that the present invention may be configured in various contexts. For example, although this example provided was targeting “audio visual” programs the “gist” of the present invention can be suited to audio only systems. For example, a device that is primarily an audio device like a networked iPod® or Zune® may receive an FM broadcast of a primary stream containing commercials. In certain embodiments of the present invention, the content analyzer does not need to be present in an end-user device of the present invention. In these cases, the content analysis function may be done remotely over a network by other devices and the signal output from the content analyzer may be transmitted over a WAN, LAN, wired or wireless it may be carried at or near the spectrum of the transmission and including but not limited to AM or FM broadcast bands, Cellular, Satellite bands, etc. Data output from the content analyzer may be modulated in any fashion so long as the end-user device can be prompted of commercial events and discriminate to determine the commercial break status for a currently tuned channel or for a primary or a reference stream. Content analysis function may broadcast signals for a plurality of channels on a signal or multiple channels, sidebands of channel or channels, etc. The device may detect itself or receive from another device or process a notice of a commercial break then causing it to play a secondary stream during the break then resume back to the program upon notice of resumption event. Again, the secondary stream may be alternative set of advertisements. Such variations and implementations are understood to be captured according to the following claims.
This application is a continuation of and claims priority to and the benefit of U.S. application Ser. No. 11/756,508 filed on May 31, 2007, entitled “System and Method for Taking Control of a System During a Commercial Break,” the disclosure of which is incorporated herein by reference in its entirety for all purposes.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5643088 | Vaughn | Jul 1997 | A |
| 5973723 | DeLuca | Oct 1999 | A |
| 6181364 | Ford | Jan 2001 | B1 |
| 6512551 | Lund | Jan 2003 | B1 |
| 6698020 | Zigmond | Feb 2004 | B1 |
| 6704930 | Eldering | Mar 2004 | B1 |
| 6769128 | Knee | Jul 2004 | B1 |
| 6804825 | White | Oct 2004 | B1 |
| 6942574 | LeMay | Sep 2005 | B1 |
| 7400364 | Chen | Jul 2008 | B2 |
| 7895625 | Bryan | Feb 2011 | B1 |
| 8402503 | Malik | Mar 2013 | B2 |
| 20010042249 | Knepper | Nov 2001 | A1 |
| 20020095674 | Lowthert | Jul 2002 | A1 |
| 20020144262 | Plotnick | Oct 2002 | A1 |
| 20030063224 | Iwamoto | Apr 2003 | A1 |
| 20030066077 | Gutta | Apr 2003 | A1 |
| 20040189873 | Konig | Sep 2004 | A1 |
| 20040194130 | Konig | Sep 2004 | A1 |
| 20040247139 | Wang | Dec 2004 | A1 |
| 20040255336 | Logan | Dec 2004 | A1 |
| 20040261125 | Ellis | Dec 2004 | A1 |
| 20050026690 | Silver | Feb 2005 | A1 |
| 20060068861 | Triestram | Mar 2006 | A1 |
| 20070033633 | Andrews | Feb 2007 | A1 |
| 20070115391 | Anderson | May 2007 | A1 |
| 20080062336 | Dooms | Mar 2008 | A1 |
| 20080168500 | Carlson | Jul 2008 | A1 |
| 20080320513 | Wong | Dec 2008 | A1 |
| 20090141168 | Chen | Jun 2009 | A1 |
| 20090222866 | Jenzowsky | Sep 2009 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20190342523 A1 | Nov 2019 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11756508 | May 2007 | US |
| Child | 16513609 | US |
