The technical field is image display systems. More particularly, the technical field is augmenting a visual experience by expanding the field of view of imagery.
In general, apparatuses for displaying images are known. One type of display device is the large screen direct view television. Large screen direct view televisions can be cathode ray tube (CRT) displays, liquid crystal displays (LCD), or plasma screen displays, and can have diagonal sizes of up to 5 feet. Large screen direct view televisions provide high picture quality, but are very expensive. The cost of large screen direct view televisions increases dramatically with increased size.
An alternative to large screen televisions is the projection television. Projection televisions include a screen and a projector mounted either in front of or behind the screen. Projection televisions for home use can have large diagonal sizes, and provide a relatively large field of view at a reasonable cost. However, the field of view provided by projection televisions is limited to the area of the projection screen.
Public movie theaters use projection systems, typically film projectors, to display images on a screen at the front of a theater. These projection systems provide high quality images on the screen. However, the field of view in theater projection systems is also limited to the area of the projection screen.
The above systems are all capable of displaying images of high quality, but have limited visual effect because the viewing experience is limited to a relatively small region defined by the display screen. The peripheral regions of a human's sight provide an avenue to convey visual information that is not utilized by the conventional systems.
As shown in
There is therefore a need for a method of displaying images that presents images to an expanded region of a viewer's field of vision. There is also a need for expanding the field of view without incurring undue cost or complexity.
The present invention overcomes the shortcomings of the conventional art and may achieve other advantages not contemplated by the conventional art.
According to a first aspect, a display system includes a main screen, and a main projector arranged to project high resolution images on the main screen. The display system also includes augmentation light sources and projectors arranged to provide augmentation images on augmentation regions disposed around the main screen. The augmentation images are keyed to the color, motion, and brightness of the high resolution images.
According to the first aspect, the viewing experience of viewers is enhanced by expanding the field of view around the main screen. Viewers perceive all of the visual information from the main screen, plus additional information displayed in the augmentation images. In addition, the resolution displayed in each of the augmentation regions can be matched to the visual acuity of viewers in the room. By using augmentation images matched to the viewers' visual acuity, it is not necessary to use expensive high resolution display devices to augment the high resolution image. The viewing experience is therefore enhanced without an excessive increase in cost.
According to a second aspect, a display system displays augmentation images using active lighting arrays. The active lighting arrays display images to augment high resolution images displayed on a main screen. The augmentation images can be keyed to the color, motion, and brightness of the high resolution images. The active lighting arrays can be of progressively decreasing resolution towards the peripheral regions of the viewers' field of vision.
According to the second aspect, the viewing experience is enhanced by expanding the field of view around the main screen. By using active lighting arrays of decreasing resolution, the viewing experience may be enhanced without an excessive increase in cost.
Other aspects and advantages of aspects of the invention will be discussed with reference to the figures and to the detailed description of the preferred embodiments.
A display system and a method for displaying images will be described below by way of preferred embodiments and with reference to the accompanying drawings.
A first embodiment will be discussed with reference to
The display system 100 includes a main screen 110, a left augmentation panel 112, a right augmentation panel 114, a projector 120, and a control 150. The room 200 is illustrated as having a ceiling augmentation region 222, a first left side augmentation region 232, a first right side augmentation region 242, a second left side augmentation region 234, and a second right side augmentation region 244. These regions, along with the left augmentation panel 112 and the right augmentation panel 114, are “augmentation regions.” The display system 100 is arranged in the room 200 to display high resolution images on the main screen 110, and to display lower resolution, “augmentation images” on the augmentation regions.
The augmentation images displayed in the augmentation regions augment and supplement the visual effect of the high resolution images displayed on the main screen 110. Advantageously, the augmentation images may be matched, or “keyed” to visual characteristics of the high resolution images. By keying the augmentation images to visual characteristics of the images on the main screen 110, the perceived action and scenery in the high resolution image is extended, thereby enhancing the viewing experience for viewers located in a seating area 250.
The projector 120 includes a main projector 122 that projects the high resolution images onto the main screen 110. The projector 120 also includes a left panel projector 124 and a right panel projector 126. The left panel projector 124 projects augmentation images onto the left augmentation panel 112, and the right panel projector 126 projects augmentation images onto the right augmentation panel 114. The projector 120 can additionally include a first left side light source 130, a first right side 132 light source, a second left side light source 134, and a second right side light source 136. The first left and right side light sources 130, 132 project augmentation images onto the first left and right side augmentation regions 232, 242, respectively. The second left and right side light sources 134, 136 project augmentation images onto the second left and right side augmentation regions 234, 244, respectively.
The display system 100 can also include a left ceiling light source 116 and a right ceiling light source 118. The left and right ceiling light sources 116, 118 project images onto the ceiling augmentation region 222. The left and right ceiling light sources 116, 118 can be mounted on the left and right augmentation panels 112, 114, respectively.
The control 150 is operatively connected to the projector 120, the left ceiling light source 116, and the right ceiling light source 118, and provides display signals to each of the projectors and light sources in the display system 100. Each display signal may be specific to the resolution of the image to be projected by a respective projector or light source. Specifically, the control 150 provides a high resolution display signal to the projector 120, which the main projector 122 projects as a high resolution image onto the main screen 110. The control 150 also provides lower resolution augmentation display signals to the projector 120. For example, the control 150 provides augmentation display signals that the left and right panel projectors 124, 126 project as augmentation images onto the left and right augmentation panels 112, 114, respectively. The augmentation display signals are generated by the control 150 such that images projected onto the left and right augmentation panels 112, 114 are keyed to visual characteristics of the high resolution image.
The control 150 also provides augmentation display signals for display by the first left and right side light sources 130, 132. These augmentation display signals convey image data of lower resolution than the augmentation display signals provided for display by the left and right panel projectors 124, 126, and may be of low resolution. The augmentation display signals for display by the first left and right side light sources 130, 132 are also keyed to visual characteristics of the high resolution image.
The control 150 provides augmentation display signals of still lower resolution for display by the second left and right side light sources 134, 136. These images are displayed on the second left and right side augmentation regions 234, 244, respectively. The images displayed on the first left and right side augmentation regions 234, 244 may be of very low resolution.
The resolution of the images displayed in each of the augmentation regions decreases towards the rear of the room 200, and generally tracks the visual acuity of viewers in the room 200. The main screen 110 encompasses the central field of distinct vision—referred to as the field of “foveal” vision. The foveal field of vision is the generally conical field of view surrounding the line of sight (see
The resolution of the image projected by the main projector 122, as perceived by a viewer, may be measured in cycles per degree (CPD). 20:20 vision is defined to be 30 CPD, and 15 CPD equates to 20:40 vision. As viewed from an exemplary viewing location 255 in the room 200, the resolution of the image on the main screen 110 may be, for example, between 15 and 40 CPD.
The surrounding peripheral zone around the line of sight is sensitive to grosser features of the outer visual field, with the peripheral area of the retina being especially sensitive to movement. The left and right augmentation panels 112, 114 display images in the peripheral zone, yet which are relatively close to the main screen 110. The left and right panel projectors 124, 126 can therefore project images of moderate resolution. The left and right panel projectors 124, 126 may be, for example, film projectors, video projectors, low resolution video projectors, or an array of lights. The images displayed on the left and right augmentation panels 112, 114, as viewed from the viewing location 255, may have a resolution in the range of, for example, of 5 to 30 CPD.
The ceiling augmentation region 222, and the first left and right side augmentation regions 232, 242 are used to display images of low resolution, outside of the foveal field of view. The movement and brightness in the regions 222, 232, 242 need not be exactly matched to the images on the main screen 110. They may instead be matched in a “gross” sense. This gross matching allows for some discontinuity between the main screen 110 and the augmentation regions 222, 232, 242.
Preferably, the augmentation images displayed on the first left side augmentation region 232 are keyed to the images displayed on the left side of the left augmentation panel 112. Similarly, the images displayed on the first right side augmentation region 242 should be keyed to the images displayed on the right side of the right augmentation panel 114, and the images displayed on the ceiling augmentation region 222 should be keyed to the images displayed at the top of the main screen 110. In this manner, the movement and color perceived by the viewer would appear substantially continuous across the field of view.
As viewed from the viewing location 255, the resolution of the images projected by the left and right ceiling light sources 116, 118, and of the first left and right side light sources 130, 132 can be less than, for example, 30 CPD. The resolution of the images may lie in the range of, for example, 1 to 20 CPD. Because the resolution of these images may be relatively low, the light sources 116, 118, 130, 132 may be, for example, low resolution video projectors, or arrays of lights. An example of a suitable array of lights is an array of red, blue and green (RGB) lights. The RGB lights can be constructed of, for example, red, blue and green light bulbs, or LEDs.
The second left and right augmentation regions 234, 244 lie in the far peripheral field of view, which is primarily sensitive to motion. The second left and right side light sources 134, 136 can therefore project images of very low resolution. The second left and right side light sources 134, 136 may include, for example, an array of individually controlled white lights. The white lights can be controlled to convey enough motion information to improve the viewing experience for the viewer. Alternatively, if desired, an array of RGB lights may be used. An array of one or more spotlights can also be used to impart motion and color to the second left and right side augmentation regions 234, 244. For still grosser light effects, an array of one or more white or colored floodlights can be included in the second left and right side light sources 134, 136.
The augmentation regions 222, 232, 234, 242, 244 can be, for example, painted surfaces of the room 200, and projection screens are not required. The main screen 110 is preferably a reflective surface such as a screen found in a conventional projection television system. The left and right augmentation panels 112, 114 are preferably similar to the main screen 110. Alternatively, the left and right augmentation panels 112, 114 may be continuous with the main screen 110.
The control 150 will now be discussed with reference to
The display system 100 may also have audio capability, and an audio signal source can be included to provide source audio signals to the control 150. Speakers may be arranged to receive audio signals from the control 150 and to produce audio output from the audio signals. The audio output produced by the speakers can be correlated with the images displayed by the display system 100 in order to create, for example, a desired entertainment program for viewers in the seating area 250.
The image source 170 can be a storage device capable of storing or buffering image data from an image generating source, a camera device for receiving actual images and reducing the images to electronic form, a videocassette recorder, a DVD, or a combination of these devices. The image source can also be a remote source of image data, such a as a cable or satellite television service. The term “source image signal” is used in this specification to indicate, for example, a digital or an analog signal containing data capable of describing a series of frames of images. If the source image signal is an analog signal, it can be digitized at the ADC 158 before sampling. Alternatively, the source image signal can be forwarded directly to the sampler 156, and processed in the control 150 in the analog domain.
The control 150 uses the source image signal from the image source 170 to generate the high resolution display signals and the augmentation display signals. The generation of the display signals, and a method of displaying images, will now be discussed with reference to
As illustrated in
In step S10, the sampler receives a source image signal from the image source 170. The sampler 156 samples the source image signal in step S12, and sends the image signal data sampled from the source image signal to the processor 154.
In step S14, the processor 154 generates the high resolution display signal for projection by the main projector 122. The processor 154 generates the high resolution display signals by forwarding the sampled image signal data to the address calculator 160 (see
The high resolution display signal can be generated from the source image signal in any conventional manner. For example, if the source image signal is provided by a videocassette recorder, the control 150 can process the source image signal for projection as in conventional projection television devices. An electronic source image signal from a cable or satellite television service can be similarly processed to generate the high resolution display signal.
In step S16, the processor 154 generates each of the augmentation display signals using the high resolution display signal. The control 150 generates an augmentation display signal for each of the projectors 122, 124, 126, and the light sources 116, 118, 130, 132, 134, 136. The method for generating the augmentation display signals is discussed in detail below with reference to
In step S18, the high resolution and the augmentation display signals are transmitted to the projector 120 and to the ceiling light sources. The display signals are routed to their appropriate projector or light source. In step S20, the projectors and light sources project images corresponding to their respective display signals.
In step S24, the processor 154 detects the motion, brightness, and color of an image to be displayed from the high resolution display signal. In step S26, the left panel projector display signal is then generated so that the motion, brightness, and color of an image to be displayed on the left augmentation panel are imparted with the motion, brightness and color of an image to be displayed on the main screen 110.
The sense of motion conveyed by the high resolution display signal may be detected by an algorithm such as those used for creating MPEG motion vectors. The sense of motion from the high resolution signal can be imparted to the augmentation display signal by mapping current and extrapolated motion information into the augmentation display signal by predetermined information in the source image signal, or by predicted information from the motion vectors in the source image signal that are extended into the augmentation regions. The brightness and color conveyed by the high resolution display signal may be detected by analysis of the image information near the edges of the high resolution image, and by combining this information with motion vectors when broad movement (e.g. panning) is detected. The brightness and color of the high resolution image can be imparted to the lower resolution augmentation regions by generating illuminator control signals based on the analysis of brightness and color information in the original high resolution image information. Using the above operations, a display signal for the left panel projector 124 can be generated that will provide an image on the left augmentation panel 112 of lower resolution than the main screen 110, but that is imparted with the motion, brightness and color of the image on the main screen 110.
In step S28, the left panel projector augmentation display signal is adjusted to blend with the high resolution signal so that the left side of the high resolution image on the main screen 110 appears to be substantially continuous with the image on the left augmentation panel 112. One method of blending the high resolution image with the images on the augmentation panels would be to decrease the image resolution at the edges of the high resolution image to approximate the resolution of the images on the augmentation panels. This is referred to as creating a relatively continuous, or “soft” transition zone between the main screen 110 and the augmentation panels. The viewing experience can be enhanced by leaving a small gap between the main screen 110 and the left and right augmentation panels 112, 114.
After adjusting the display signals in step S28, the processor 154 then transmits formatted image data values to the frame buffer 160 in step S30. Referring back to
The augmentation display signals for the right panel projector 126 and the light sources 116, 118, 130, 132, 134, 136 can be generated in a manner similar to the augmentation display signal for the left panel projector 124. For example, the augmentation display signal for the first left side light source 130 can be generated as a further extrapolation of the augmentation image displayed on the left augmentation panel 112, at lower resolution.
According to the above embodiment, the viewing experience is enhanced by expanding the perceived action and scenery from the main screen 110. Therefore, viewers perceive all of the information contained in a source image signal, plus additional information generated in the display system 100. In addition, the resolution displayed in each of the augmentation regions can track the visual acuity of viewers in the room 200. By using augmentation regions matched to the viewers' visual acuity, it is not necessary to use expensive high resolution projection or other display devices to display images on the augmentation regions. The viewing experience is therefore enhanced without an excessive increase in cost.
The display system 100 is illustrated with a front projection device as the main projector 120. As an alternative, the display system 100 could include a rear projection device, with the high resolution image being projected from behind the main screen 110.
As another alternative to using a main projector 122, the main screen 110 can be replaced with a large screen direct view television, such as, for example, a cathode ray tube (CRT) television, a liquid crystal display (LCD) television, or a plasma screen television. The augmentation projectors and light sources would thus augment the images displayed on the large screen television.
The augmentation regions 112, 114, 222, 232, 234, 242, 244 illustrated in
The array 282 of white lights can be used to impart a sense of motion. The arrays 284 and 286 of RGB light sources may be of relatively small size, and can provide relatively high resolution color images. The arrays 288 and 290 of RGB light sources can provide lower resolution color images. The RGB arrays can include, for example, colored lights or LEDs.
In the display system 100, light boxes can be mounted on the walls and ceiling of the room 200. The control 150 would be operatively connected to each of the light boxes to transmit augmentation display signals for display by the light boxes. Light boxes of progressively lower resolution could be used toward the rear of the room 200, minimizing the cost of the display system 100.
In the method illustrated in
As another alternative, a source image signal can be generated by using a conventional recording of, for example, a feature film, television show, or other audiovisual work, and extrapolating the image data prior to providing it for use in the display system 100. The image data from the original work could be extrapolated at any time, such as, for example, in post-processing of a feature film, or prior to release to the public in, for example, videocassette format.
The image display system 300 is arranged to project a high resolution image onto the main screen 412, and reduced resolution augmentation images onto augmentation regions of the theater 400. The augmentation regions in the theater 400 include first, second and third ceiling augmentation regions 422, 424, 426, first, second, and third left side augmentation regions 432, 434, 436, and first, second and third right side augmentation regions 442, 444, 446. In general, the image display system 300 projects higher resolution images onto the augmentation regions at the front of the theater 400, and lower resolution images onto the augmentation regions at the back of the theater.
The display system 300 is illustrated in detail in
The main projector 380 is arranged in the theater 400 to project high resolution images on the main screen 412. The main projector 380 can be, for example, a film or video projector. The main projector 380 can project images, as viewed from an exemplary viewing location 455, having a resolution of, for example, between 15 and 40 CPD.
The right side light source 382, the left side light source 384, and the ceiling light source 386 are augmentation light sources. Each of the right side light source 382, the left side light source 384, and the ceiling light source 386 may include a plurality of separate light sources. In the embodiment illustrated in
The right side light source 382 includes a first light source of moderate resolution for projecting images on the first right side augmentation region 442 illustrated in
The moderate resolution light sources discussed above can project images having a resolution, as viewed from the location 455, in the range of, for example, 5 to 30 CPD. The moderate resolution light sources can include, for example, an array of RGB lights, LEDs, or a low resolution video projector.
The low resolution light sources can project images having a resolution of less than, for example, 30 CPD. The resolution may lie in the range of, for example, 1 to 20 CPD. The low resolution light sources can include, for example, an array of RGB lights, white lights, or LEDs.
The very low resolution light sources can be, for example, and array of RGB lights or LEDs. The very low resolution light sources can also include an array of white lights, spotlights, or floodlights.
The control 350 can generate display signals in a manner similar to the control 150 illustrated in
The image display system 500 illustrated
The image display system 500 includes a control 550, and a main projector 580 that projects images onto the main screen 612. The augmentation arrays of the image display system 500 comprise first, second and third ceiling arrays 522, 524, 526, first, second, and third left side arrays 532, 534, 536, and first, second and third right side arrays 542, 544, 546.
The main projector 580 is arranged to project a high resolution image onto the main screen 612. The control 550 transmits augmentation display signals to the augmentation arrays, so that the augmentation arrays can display augmentation images to augment the images on the main screen 612. In general, the resolution of the augmentation arrays at the front of the theater 600 is higher than the augmentation regions at the back of the theater 600.
The first ceiling array 522, the first left side array 532, and the first right side array 542 can be of low resolution, and can have resolution of, for example, less than 30 CPD. The resolution can lie in the range of, for example, 1 to 20 CPD, as viewed from a location 655. These arrays can include, for example, an array of RGB lights, or LEDs.
The second ceiling array 524, the second left side array 534, and the second right side array 544 can be of very low resolution. These arrays can include, for example, arrays of RGB lights or LEDs, arrays of white lights, floodlights, or spotlights.
The third ceiling array 526, the third left side array 536, and the third right side array 546 can be of lower resolution than the arrays 522, 532, 542. These arrays can also include, for example, arrays of RGB lights or LEDs, and arrays of white lights, floodlights, and spotlights.
The control 550 of the display system 500 is illustrated in detail in
The control 550 can generate display signals in a manner similar to the control 150 illustrated in
In the above embodiments, augmentation regions of moderate resolution are provided on the left and the right of the high resolution image on the main screen. If desired, augmentation regions of moderate resolution could be provided above and/or below the main screen.
The terms and descriptions used herein are set forth by way of illustration only and are not meant as limitations. Those skilled in the art will recognize that many variations are possible within the spirit and scope of the invention as defined in the following claims, and their equivalents, in which all terms are to be understood in their broadest possible sense unless otherwise indicated.
Number | Name | Date | Kind |
---|---|---|---|
4348186 | Harvey et al. | Sep 1982 | A |
4634384 | Neves et al. | Jan 1987 | A |
5071209 | Chang et al. | Dec 1991 | A |
5136675 | Hodson | Aug 1992 | A |
5242306 | Fisher | Sep 1993 | A |
5487665 | Lechner et al. | Jan 1996 | A |
5579026 | Tabata | Nov 1996 | A |
5886675 | Aye et al. | Mar 1999 | A |
5917460 | Kodama | Jun 1999 | A |
5963247 | Banitt | Oct 1999 | A |
5980044 | Cannon et al. | Nov 1999 | A |
6208318 | Anderson et al. | Mar 2001 | B1 |
6437759 | Turner et al. | Aug 2002 | B1 |
6547400 | Yokoyama | Apr 2003 | B1 |
20020057279 | Jouppi | May 2002 | A1 |
Number | Date | Country | |
---|---|---|---|
20030016236 A1 | Jan 2003 | US |