Patent Application
20080165176
1. Field of the Invention
The present invention relates to the display of multimedia content on a video display. The present invention also relates to the enablement of multiplayer video games.
2. Description of the Related Art
Video games are a popular form of interactive entertainment in which a video display, such as a monitor or a television, is the primary feedback device. A computer game is one type of video game, which is played on a personal computer (PC). The personal computer may run computer games in the form of game software written or adapted for its use, and displays the visual feedback on the computer's monitor. The game software may be stored on the computer's hard drive, or on a CD, DVD, or other readable media. A console game is another type of video game, which may be played on an electronic console that typically interfaces with a standard television set. The electronic console is itself a special purpose computer capable of running software written or adapted for its use, and which displays visual feedback on the television. The game software may be stored on a cartridge, CD, DVD, other readable media adapted for use with the electronic console. Many video games written for use on computers have similar or identical counterparts written for consoles. Some video games also emulate video games that were originally available on standalone arcade games. As used herein, the term “computer” is intended in its broad sense and includes consoles and other interactive gaming systems that include a processor.
In all video game systems, one or more input devices are provided, allowing each player to control some aspects of game play, the effects of which include generating and manipulating images on a screen. Input devices are commonly referred to as “controllers,” and include a game pad, joystick, paddle, or any other device for gaming that can receive input. Other devices, such as steering wheels for driving games and light guns for shooting games, may also be included as input devices. A keyboard, mouse, trackball, microphone or touch screen included with a personal computer may also be used as controllers for computer games.
Multiplayer games are popular in the world of interactive entertainment. Some games allow multiple players to participate remotely, each on separate computers. For example, online gaming allows players to play a game remotely with others via the Internet. Online gaming has certain disadvantages, however, including the fact that each user must have his or her own computer, at least one video display, and access to a reliable broadband connection. Online gamers also experience no real interaction with their opponents or teammates beyond what occurs on each of their electronic video displays.
Another popular type of multiplayer gaming involves multiple players playing together in person using a shared computer. A typical scenario for this type of multiplayer gaming is a group of friends gathered around a television or PC to play their favorite video game. The added social dynamic of group play in such a setting adds a dimension of enjoyment that is not available with online gaming. On conventional game systems, however, this type of multiplayer gaming also has disadvantages or limitations. Most commonly, some types of games employ a split-screen technique, wherein the screen of a video display is sectioned into parts according to the number of players. Each player is assigned a section of the screen. Each player's section of the screen has its own image content, which typically differs from that of other players. The input provided by each player controls the image content for that player, and may also affect the image content of the other players.
While convenient, a conventional split screen has some limitations. In many games, the ability for one player to see activity occurring on another player's screen is tantamount to cheating. Players may glance away momentarily to another player's section of the screen to ascertain valuable information. In a football video game, for example, one player can simply watch another player's selection of an offensive play, and anticipate that offense with a defensive move. Numerous other examples exist. This ability to “cheat” can make some games less enjoyable.
The split-screen technique also detracts from the gaming experience by reducing the size and/or changing an aspect ratio of each player's section of the screen. Ordinarily, a single player game occupies substantially all of the available viewing area of the video display. The image on the screen is as large as the video display will allow. Using split-screen techniques, however, each player's section of the screen is reduced accordingly, each occupying only a portion of the screen. In a two-person game, for example, the size of each player's section of the screen will be no greater than half of the available viewing area. In a four-person game, each player's section of the screen will be no greater than one fourth of the available viewing area. An odd number of players may produce an even less optimal result. In a three-player game, for example, the screen may still be divided into four equal parts, one of which remains unoccupied due to the lack of a fourth player. Split-screen techniques therefore result in a reduction in size, loss of detail, and a corresponding decrease in enjoyment.
An improved gaming system is therefore needed for enabling multiplayer gaming. It would be desirable to retain the advantages of playing multiplayer games on a shared computer, while avoiding the drawbacks inherent to a conventional split-screen display, such as the ability of players to cheat, as well as the reduction in size and altered aspect ratios of screen images.
The present invention includes improved video display systems and methods allowing multiple users to simultaneously watch different video content on the same video display. Embodiments of the invention include gaming systems and methods allowing each player in a multiplayer game to enjoy a substantially full-screen view using only a single video display. In one embodiment, a system includes a computer, a video display, and first and second personal viewing devices. The computer in this embodiment may include or interface with a personal computer or a video game console. The computer interleaves frames of first and second images and sequentially displays the interleaved frames at a controlled rate on the video display. A synchronizer included with the computer synchronizes the first and second personal viewing devices with the video display for selectively enabling a first user to view only the frames of the first image and a second user to view only the frames of the second image.
The present invention includes the provision of gaming systems and methods for improved multiplayer gaming. Each player in a multiplayer game may now enjoy a substantially full-screen view using only a single video display and a shared computer. In one embodiment, rather than splitting the video display into multiple sections, each player's screen content is instead separated into frames. The frames of all the players are interleaved and displayed sequentially on the video display at a controlled frequency. Each player is assigned his or her own personal viewing device, which is synchronized with the display of the interleaved frames, such that each user only sees the frames associated with his or her screen content. As a result, each player may see a full screen display without the ability to see the screen content of other players. The invention thereby improves the enablement and display of multiplayer games. Players may use a single, shared computer, without the expense and complication of a separate display and computers for each player. No broadband connection is necessary. Some embodiments of a gaming system according to the invention may be enabled in a standalone unit, while other embodiments may piggyback on an existing computer, including either a game console or general purpose computer. Previously existing game software may be played on a game system according to the invention, with little or no modification to the game software itself. Alternatively, new games may also be written that further take advantage of various features made possible by the present invention.
The present invention is not limited to gaming applications. More generally, the present invention provides improved video display systems and methods allowing multiple users to simultaneously watch different video content on the same video display. According to an embodiment of multi-source video display, video signals are received from multiple sources and displayed simultaneously in a full-screen format on a video display. For example, a television broadcast, a DVD player, and a VCR are examples of multimedia sources that may each provide a video signal, as well as a corresponding audio signal. Each video signal is separated into frames. The frames of the multiple video signals are interleaved in a regular, repeating order. The interleaved frames are displayed sequentially on a television or video display at a controlled rate. Each user is assigned his or her own personal viewing device, such as a wearable optical device that is synchronized with the displaying of the interleaved frames, such that each user only sees the frames associated with one of the video signals. Each user may thereby selectively view content from just one of the video signals. For example, a first user may watch a DVD while a second user watches a television broadcast on the same television. Audio related to the video signals may also be separated and delivered to each user through a personal audio device, such as headphones, so that each user both sees and hears the content from just one of the multimedia sources.
The video system 10 allows the first user 12 and the second user 14 to simultaneously view different video content on a shared video display 22. A first signal generator 16 (“signal generator A”) and a second signal generator 18 (“signal generator B”) each output different video signals, labeled in the figures as SA and SB. The first and second signal generators 16, 18 may each be, for example, a DVD player, a VCR, or a television broadcast. The first and second signal generators 16, 18 need not be the same type of device. For instance, the first signal generator 16 may be a DVD player, and the second signal generator 18 may be a VCR. The first signal generator 16 outputs the signal SA and the second signal generator 18 outputs the second signal SB to a computer 20. The computer 20 includes a processor and/or a synchronizer for synchronizing the display of the signals SA and SB with personal viewing devices (PVDs) 24 and 26.
The computer 20 selects or generates “frames” of each of the first and second signals SA and SB. A frame may be described as one of the many still images which compose a so-called “moving picture,” but may also include more than one still images or a discrete segment of a moving image. Frames may be contained on or captured from a video medium, and may be transmitted by a video signal. Historically, frames of a moving picture were recorded on a long strip of photographic film, and each image looked like a framed picture when examined individually. Those skilled in the art will appreciate, however, that the term “frame” has a broader meaning in multimedia today, and that individual images of a moving picture may be stored or captured in a variety of formats. Video frames are commonly stored electronically, such as on video tape or on a digital medium such as a DVD. Playback devices, such as VCRs and DVD players, generally have the capability of extracting these electronically stored frames and transmitting multimedia content frame by frame. A conventional DVD player, VCR, or other video player typically displays these images sequentially on a screen to create the appearance of continuous motion.
The computer 20 may selectively process frames contained within the video signals SA and SB. The invention also encompasses any present or future mediums wherein video content is initially stored in a “frameless” fashion, in which case the computer 20 may alternatively generate frames by capturing a chronological series of still images or segments of moving images from the video signals. In
The composite signal SAB is output to and displayed on a video display 22 at a selected frequency. To the naked eyes of the first user 12 and the second user 14, the video display might look blurry and nonsensical, because the display has the effect of alternating back and forth between the first and second video signals, each having different image content. This is resolved using the first personal viewing device (“PVDA”) 24 provided to first user 12 and the second personal viewing device (“PVDB”) 26 provided to the second user 14. The PVDs 24, 26 selectively block light from the display 22 from reaching the users 12, 14, so that the first user 12 only sees the content of the first signal SA (A1, A2, A3 . . . ), and the second user 14 only sees the content of the second signal SB (B1, B2, B3 . . . ). To the first user 12, the video display 22 appears to be displaying only the signal SA from the first signal generator 16. To the second user 14, the video display 22 appears to be displaying only the signal SB from the second signal generator 18. To each user 12, 14 the experience is the same as or similar to watching the content of just one of the video signals SA and SB. For example, if the first signal generator 16 is a DVD player and the second signal generator 18 is a television channel, the first user 12 may have the experience of watching a DVD on the display 22 and the second user 14 may have the experience of watching a TV show on the display 22.
A number of devices are known in the art for selectively blocking light that may be adapted for use with the computer 20 according to the invention. For example, there are known ways to electrically or chemically manipulate light through a glass lens to alternate the lens between a transparent condition and a non-transparent or substantially opaque condition. These devices include so-called shutterglasses and LCD glasses. Shutterglasses are generally worn like other forms of eyewear, and include a left eye lens and a right eye lens that is electronically controlled to selectively block and unblock light from passing through each lense. Typically, shuggerglasses alternate back and forth between blocking light through the left lens and right lens, which in some applications creates a three-dimensional viewing effect. However, in embodiments of the present invention, both lenses are generally intended to be simultaneously blocked during the display of images that are not part of that user's video. Alternatively, there are known ways to mechanically control light passing through a glass lens, such as with a shutter used to alternately block and pass light. Any of these devices may be electronically controlled by the computer 20 to control their frequency of alternating between a blocked and unblocked condition, in synchronization with the display of associated frames on the video display 22.
Referring again to
The computer 20 controls the frequency at which the composite signal SAB is displayed. The frequency may be defined herein as the inverse of the time period between the display of consecutive frames from a common signal generator. An appropriate frequency for displaying the composite signal SAB may be selected according to a number of parameters, including the refresh rate of the video display 22 and the number of users (in this example, two users). Under a wide range of conditions, it has been shown that most users will experience flicker below a rate of 16 frames per second. However, the appearance of flicker also depends somewhat on the intensity of an image displayed. At a given frequency, a brighter image may be retained by a human retina for a longer period of time, reducing the appearance of flicker. Thus, the selected frequency will generally be suitable if it is 10 Hz or greater, with a more typical frequency being 16 Hz or greater. Furthermore, the number of users and the refresh rate of the display may also affect the frequency. For example, the refresh rate of the video display 22 may determine an upper limit for the frequency.
The frequency of displaying the frames of composite signal SAB also affects the speed of the video content each user 12, 14 sees. Due to the interleaving of A frames and B frames, if the frequency of the composite signal SAB is the same as the frequency at which signals SA and SB would normally be played back, then the video seen by users 12, 14 will appear to be played at half speed. One way to display the content to each user 12, 14 at full speed is to double the frequency of playback of the composite signal SAB. Doubling the frequency may be more acceptable in some situations, such as with systems having fewer users and a higher refresh rate. Doubling the frequency may be less acceptable or impossible in other situations, such as with many users (such as in a four player game) and a lower refresh rate.
Another way to generate full-speed display to each user 12, 14 is by displaying the alternate composite signal schematically shown at row 25 of
Conceptually, any number “n” of players may play a multiplayer game according to the invention. As a practical matter a typical game may involve between two and four players. Many current game ROMs 88 limit the number of players that may be involved in a game. Furthermore, factors such as the refresh rate of the video display 92 may affect the number of players that can play simultaneously without a distracting level of flicker. In one example, optimal viewing may be provided with a refresh rate of at 72 Hz per player. For example, a two player game would then be displayed at about 140 Hz, and a 3 player game could be displayed at around 200 Hz. As display technology continues to evolve, as it has historically, corresponding improvements in refresh rates will further optimize video display for each user, as well as enable an increasing numbers of players to play multiplayer games according to the present invention.
A plurality of controllers 94-97 and a plurality of PVDs 98-101 are provided for the n players. Thus, the controllers 94-97 are labeled from “Controller 1” to “Controller n,” and the PVDs 98-101 are labeled from “PVD 1” to “PVD n.” One of the controllers 94-97 and one of the PVDs 98-101 may each be assigned to each player during a game. Each controller 94-97 may be a conventional controller, such as a joystick, game pad, keyboard, mouse, trackball, steering wheel, or combination thereof. The controllers 94-97 may interface with the computer 82 in any of a wired or wireless connection known in the art. Each PVD 98-101 may be, for example, a wearable shutterglass or other device that selectively blocks light from passing through it. The PVDs may interface with the computer 82 using a corded connection, or, as shown, with an optional wireless connection provided by a wireless access point 102.
During play of a multiplayer game, each player (1 to n) selects or is assigned one of the controllers 94-97 and one of the PVDs 98-101. As the multiplayer game proceeds, the processor 84 will process image content for each player. That image content for each player is what typically would be otherwise displayed on each player's section of a split screen using a conventional game system. Image content for each player (1 to n) is stored as images 104-110, which are labeled as Image 1, Image 2, Image 3, and Image n, corresponding to each player (1 to n). Images 104-110, and subsequent images, are manipulated in response to input from each player via the controllers 94-97, as well as in response to other aspects of game play according to the ROM 88.
To illustrate, if the ROM 88 simulates an American football video game, each player's image content may include graphical representations of different portions of a football field. Image content for a player on a defensive team may include information proprietary to the defense. Likewise, image content for a player on an offensive team may include information and graphical content proprietary to the offense. The processor 84 processes input from the controllers 94-97 according to input from the controllers 94-97, as governed by the ROM 88. For example, player 1 on an offensive team may push “up” on a joystick to move his electronic counterpart (e.g. an offensive football player) forward toward the defense's goal line. In response, image 104 is continuously updated to include player 1's position on the football field, as well as other information such as current yardage and scoring stats, and information proprietary to the offense such as what pre-designed “play” the offense is attempting to follow. Likewise, each of the other images 106-110 is continuously updated.
Typically, each image 104-110 is unique, in at least some respect, for each player 1 to n. The processor 84 may continuously keep track of and manipulate the images 104-110. This may be done at regular intervals. For example, the processor 84 may update images 104-110 several times per second. Each time the images are updated, each updated image may be treated by the processor as an equivalent “frame,” analogous to the frames discussed in connection with
According to the invention, a full-screen representation of the images 104-110 for each player (1 to n) may be displayed on the video display 92. In this embodiment, the processor 84 interleaves the frames of images 104-110 by sequentially displaying them at a controlled frequency. For example, the processor 84 may output the current frame for image 104, followed by the current frame for image 106, then image 108, and then image 110. This cycle may be repeated several times per second. The frames of images 104-110 are thereby interleaved. The synchronizer 86 synchronizes the cyclical display of images 104-110 with the PVDs 98-101, so that each player (1 to n) sees only the image assigned to that player. For example, PVD198 only allows light to pass to the eyes of player 1 while image 104 is being displayed, PVD299 only allows light to pass to the eyes of player 2 while image 106 is being displayed, and so on. As the processor cycles through the current frame of each image 104-110 several times per second, each player (1 to n) sees what appears to be a moving picture, to the extent that the images 104-110 change from frame to frame. The frames are displayed and synchronized with the PVDs 98-101, so that each player enjoys a full screen view of the game.
It should be noted that some games may pit one group or team of players against another group. For example, players 1 and 2 may compete as a team against other players. In such a situation, players 1 and 2 may share the same image. Typically, the game, itself, as embodied in the ROM 88, may control this aspect. For example, where players 1 and 2 are intended to see the same image content on the video display 92, the processor may compute image 104 and image 106 to be the same image. The frames for images 104 and 106, though identical, would still be output at separate instants, analogous to being output to separate sections of a conventional split screen. Alternatively, it may be desired in some instances for players 1 and 2 to see the frame of the same image, rather than frames of different but identical images. In that case, the processor 84 may selectively unblock the PVDs 98 and 99 when frames of a certain image are displayed, so that players 1 and 2 both see the same frames. This would desirably reduce the number of frames displayed in a cycle. For example, in a four player game pitting a two player team against another two player team, and wherein each team is intended to see the same image on the video display 92, the number of frames displayed in a cycle could be reduced from four frames to two frames, thereby allowing an increase in the frequency or duration of each frame.
The method of
Video content usually includes an accompanying audio component. For example, most movies for the past several decades have included an audio track. Likewise, games often generate much of their excitement from the sounds that accompany the visual feedback. The invention further encompasses embodiments wherein audio is separately fed to users. For example, when two users are each watching separate movies, one user would typically not want the distraction of hearing the audio that accompanies the other user's movie. To avoid this distraction, audio corresponding to one video signal could be routed to the intended user via a personal listening device (PLD). The PLD could be embodied, for example, in the form of a headset or pair of headphones that would allow a user to privately enjoy the audio that accompanies the video content being enjoyed by that user. In one embodiment, the PLD could be integrated with a PVD. A single piece of headwear could include shutter glasses or another form of PVD, with an integrated set of headphones. However, it should be recognized that the audio signals are preferably transmitted in a continuous signal that does not remove any of the audio content, rather than being blocked and unblocked in concert with the video display. This can be accomplished in a conventional manner using separate wires or separate wireless transmission frequencies.
The terms “comprising,” “including,” and “having,” as used in the claims and specification herein, shall be considered as indicating an open group that may include other elements not specified. The terms “a,” “an,” and the singular forms of words shall be taken to include the plural form of the same words, such that the terms mean that one or more of something is provided. The term “one” or “single” may be used to indicate that one and only one of something is intended. Similarly, other specific integer values, such as “two,” may be used when a specific number of things is intended. The terms “preferably,” “preferred,” “prefer,” “optionally,” “may,” and similar terms are used to indicate that an item, condition or step being referred to is an optional (not required) feature of the invention.
While the invention has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments can be devised which do not depart from the scope of the invention as disclosed herein. Accordingly, the scope of the invention should be limited only by the attached claims.
