The technology is related to systems and methods that are used to synchronize the display of content on multiple displays screens or televisions that are in different locations.
Televisions and other similar display devices can now receive video programming from different sources. For example, a television could receive broadcast signals from multiple television broadcasters. Alternatively, a television could receive video programming from a cable television service provider or from a satellite television service provider. In still other instances, a television could receive video programming via the Internet, or from any number of storage devices.
When programming is received from cable and/or satellite service providers, it is common for the service provider to provide a customer with a “set top box” that acts as an interface between the communications medium and the television. However, some televisions now have similar capabilities built in. Likewise, if video programming is to be received via the Internet, it is common for the user to employ an interface device that is connected to the Internet and which provides a signal that the television can use to display the video programming.
Although the above examples related to televisions, it is also possible to receive and play video programming on alternate display devices, such as computer display screens. Desktop and laptop computers, as well as various other portable computing devices are now capable of receiving video programming from the Internet or from other sources, and displaying such video programming in a manner similar to a television.
The expanding availability of high speed Internet access has also allowed users to conduct audio and video conferencing with other parties using desktop and laptop computers, portable computing devices and televisions. And such video conferencing can be conducted at the same time that a video program is being played on the display device.
With a television or computer display as illustrated in
The above-described functionality allows multiple users at different physical locations to watch the same video program at the same time, and the users can also talk and interact with each other while the video program is being displayed. This creates an atmosphere similar to the one which would exist if the different users were all physically present at the same location and were watching the video program on the same display device.
One problem with such a system relates to the synchronization of the video program being displayed on the different users' display devices. Even when two users are receiving a video program from the same content provider, transmission variations often result in same video program being displayed on two different display devices at two different locations at slightly different times. And when two users are receiving the same video program from different content providers, this problem can become even worse.
When a video program is displayed on two different display devices at slightly different points in time, multiple problems can occur. A first user at a first location may hear the video program in the background of a second user's video feed as part of the video conference link. This means the first user will hear the audio portions of the video program twice, once from his own display device, and again at a slightly different time through the video conference link to the second user. And hearing the same audio information twice at different points in time can be disorienting or confusing.
In addition, if the video program is a live broadcast, such as a sporting event, a first user who is watching the advanced video feed will react to actions which occur during the broadcast before a second user watching the delayed video feed sees the actions. This can be somewhat frustrating for the person watching the delayed video feed.
In the following discussion, the terms “video,” “video program” and “video presentation” are used to refer to video programs that are presented to users on a display device. These terms are intended to encompass video programs such as television programs and movies, as well as video presentations that do not include an audio track. These terms also cover any sort of video programming, video recordings or video presentations, regardless of how they are captured, created or delivered to an end user. The terms are intended to encompass virtually any material which could be displayed to a user on a display device such as a television or a computer display screen.
In addition, multiple different types of video display devices will be discussed. The term “display device” is intended to encompass any device or combination of devices that allow a user to watch a video program. For example, the term display device encompasses any type of television, audio/video projectors, computer display screens with or without associated speakers, hand-held devices such as smart phones having a display screen and a speaker, as well as any other device or combination of devices which can play the audio and video portions of a video program.
The invention relates to systems and methods used to synchronize the display of a video program on multiple display devices. However, before the synchronization methods and systems are described, a description of how various display devices and audio/video conferencing devices can be coupled to each other will be provided in conjunction with
As illustrated in
A second user has a television 208 that is connected to a video interface device, such as a set top box 206. The second user's set top box 206 receives video programming content from a cable television service provider 252. The second user's set top box 206 is also connected to the Internet 240, which allows the second user to receive and watch video programming from an Internet based content provider 254. The second user also has an audio/video unit, such as a telephone, that is coupled to the telephony system and network 230.
When the first and second users have the equipment described above, the first and second users can watch the same video program while they are speaking with each other over their respective telephones. The first user would be receiving the video program from the TV broadcaster 250, while the second user obtains the same video program via the cable television service provider 252. Due to the different sources of the video program, it is unlikely that the video program would be displayed on the first user's television 202 and the second user's television 208 in a synchronized fashion.
A third user television 214 is also connected to a set top box 212. The third user's set top box 212 is also connected to the cable television service provider 252 and to the Internet 240. The third user also has an audio/video unit 216 that is coupled to the Internet 240.
The third user's audio/video unit could be a computer with a video capability, or possibly a smartphone with video conferencing abilities, such as the Apple iPhone™. This allows the third user to conduct a video conference call with other users. The third user's audio/video unit 216 may also be integrated with the third user's television 214 and/or with the third user's set top box 212. This would allow the third user to watch a video program on his television 214, and also conduct a video conference with another user, where the video feed from the other user appears in a window on the third user television, as illustrated in
The second user and the third user could watch the same video program at the same time, and both users would obtain the video program from the cable television service provider 252. However, due to transmission delays, it is unlikely that the video program would be shown on the second user's television 208 and the third user's television 214 in a synchronized fashion.
A fourth user's television 220 is also coupled to a set top box 218 which receives a signal from a satellite television services provider 256 via a satellite antenna 219. The fourth user also has an audio/video unit 222 that is coupled to the Internet 240. The fourth user's audio/video unit is also coupled to the fourth user's television 220 and/or the fourth user's set top box 218 so that the user can watch a video program and conduct a video conference with one or more other users.
A first system and method for synchronizing the display of a video program on multiple display devices in accordance with the present invention will now be described in conjunction with
The lines connecting the elements in
In this embodiment, the synchronized content distribution (SCD) unit 330 receives a video program from the content provider 320. The SCD unit 330 then sends the video program to the set top boxes 302, 308, 314 of the three users. The set top boxes feed the video program to the users' display devices 304, 310, 316.
In some embodiments, the fact that the video program is being sent to all of the display devices by a single device may be sufficient for the video program to appear on all three display devices 304, 310, 316 in a synchronized fashion.
In other embodiments, the SCD unit 330 may encode the video program signal sent to the set top boxes 302, 308, 314 with timing or synchronization information. The set top boxes 302, 308, 314 would then use this encoded information to cause the video program to be displayed on all three user display devices 304, 310, 316 in a synchronized fashion. For example, one or more of the set top boxes may use this encoded information to slightly delay the display of the video program on its associated display device so that the display device shows the video program in synchronization with the other display devices.
In still other embodiments, the SCD unit may receive timing or synchronization information sent from the set top boxes 302, 308, 314. The SCD unit would then use this information to control when the video program is sent to each of the set top boxes 302, 308, 314. By slightly varying when each set top box receives the video program signal, the SCD unit can ensure the video program is displayed on all three display devices in a synchronized fashion.
In still other embodiments, the SCD unit might use the synchronization information to create delay signals for each of the set top boxes. The delay signals could be transmitted from the SCD unit to the set top boxes, or the delay information might be encoded in the video program signal sent to the set top boxes. The set top boxes would then use the delay information to selectively delay the display of the video program so that the video program is displayed on all display devices in a synchronized fashion.
As also illustrated in
In alternate embodiments, one or more of the user's audio/video units 306, 312, 318 may provide a stream of text communications from a user. In that instance, the text stream provided by a user would be combined with the video program received from the content provider to produce a combined video program. Thus, a combined video program could include the video program from a content provider, an audio feed from a first user, a video feed from a second user, and a text feed from a third user. Any other combination of communications streams from the users could also be combined with a video program from a content provider to produce a combined video program.
In still other embodiments, a separate text communications source 356 could provide a text communications stream from some other source. The text stream could be provided by a party that is not watching the video program being viewed by other users. However, if the synchronized content distribution unit 330 combines the text communication stream from the text communication source 356 with the video program from the content provider 320 and the audio/video streams from the users, and then ensures that the combined video program is displayed to all users in a synchronized fashion, then all users will see and react to the text communications stream from the text communications source 356 at the same time.
The combined video program could, for example, cause the display devices 304, 310, 316 to play an image as illustrated in
In other embodiments, the SCD unit could create a different combined video program for each user. For example, a first combined video program sent to the first user would include the video program received from the content provider 320, as well as two windows that display the text/video feeds from the second and third users. Similarly, a second combined video program sent to the second user would include the video program received from the content provider 320, as well as two windows that display the text/video feeds from the first and third users.
Of course, the combined video program might also include a separate window that displays text from a text communications source 356 in addition to the text/video feeds from the users.
The windows depicted in
In an alternate embodiment, the windows can moved automatically about the screen based on activity in the video program. For example, if there is a temporary high degree of interest in what is being depicted near the right side of the display, the windows will move to areas of a lower degree of interest. The level of interest can be determined by one or more methods including but not limited to motion detection processing, color analysis, predetermined timing of the video program and the like. Also some type of context analysis could be performed on the images being displayed to determine the best location for the windows.
In other embodiments, a synchronization manager 340 is used to help synchronize the presentation of the video program on the three display screens 304, 310, 316. In this embodiment, the synchronization manager could receive synchronization signals from the set top boxes 302, 308, 314. The synchronization manager 340 uses the information in the synchronization signals to create individual delay signals for each set top box. The various delay signals are then transmitted to their respective set top boxes, and each set top box uses its received delay signal to slightly delay the presentation of the video program received from the SCD unit 330 so that the video program is displayed on the three display devices in a synchronized fashion.
In still other embodiments, the synchronization manager 340 could use the information in the synchronization signals received from the set top boxes to create delay information that is transmitted to the SCD unit. The SCD unit could then selectively delay the transmission of the video program to individual ones of the set top boxes to cause the video program to be displayed in a synchronized fashion. Alternatively, the SCD manager might encode delay information into the video program signal sent to the set top boxes, and the set top boxes could use the encoded information to cause the video program to be displayed in a synchronized fashion.
In some instances, the synchronization signals sent from the set top boxes to the SCD unit 330 or the synchronization manager 340 could include the audio track from the video program which has been sent to the set top boxes. The SCD unit or the synchronization manager could then compare the sound tracks received from each of the set top boxes to determine how much each set top box needs to delay the presentation of the video program to achieve a synchronized presentation across all display devices.
As illustrated in
In some alternate embodiments, the synchronization manager 440 might send delay signals to the content providers 420, 430. This delay signal could be used by the content providers themselves to delay their transmissions to the set top boxes. Alternatively, the content providers might encode this delay information into the video program signal being sent to the set top boxes, and the individual set top boxes would then used the encoded delay information to cause the video program to be displayed in synchronized fashion by all the display devices.
As also illustrated in
In the embodiments discussed above, set top boxes receive a video program signal and provide the video program signal to a display device. In alternate embodiments, the functions performed by the set top boxes could be performed by the display device itself. In still other embodiments, some or all of the functions could be performed by the devices that send the video signal to the display devices.
While the technology has been described in connection with what is presently considered to be the most practical and preferred embodiments, it is to be understood that the technology is not to be limited to the disclosed embodiments, but on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.