Patent Grant
8031271
Various techniques have been developed for geometrically calibrating the projectors of multi-projector displays. In some geometric calibration approaches, one or more cameras provide feedback data relating to the images that are projected by the different projectors and projector calibration data is computed from the camera feedback data. The images projected by the projectors are geometrically aligned in accordance with the projector calibration data to generate seamless composite images. However, this calibration process can be negatively affected by the occurrences of “hotspots”.
Hotspots are bright areas (diffuse versions of the projector's lamp and lens) that are seen by the viewer through the screen. These hotspots move with respect to the viewing angle and are more intense with higher gain screens. Because these hotspots move with respect to the viewing angle, it is possible to account for them at one angle (e.g looking straight at the screen from the front) but not at another angle (e.g. looking at the screen from the side). Consequently, these hotspots can adversely affect the calibration of the projection system and present a significant problem for the calibration process.
As shown in the drawings for purposes of illustration, a method of calibrating a projection system is disclosed. In an embodiment, the method calibrates a projection system whereby hotspots in the projection system are ignored. As previously articulated, hotspots are bright areas that are seen by the viewer through the screen. These hotspots move with respect to the viewing angle and are more intense with higher gain screens. By ignoring hotspots during the calibration sequence, a uniformly blended projection solution is created at any viewing angle.
The projectors 12, 14 may be implemented by a wide variety of different light sources. Exemplary light sources include strongly colored incandescent light projectors with vertical slit filters, laser beam apparatus with spinning mirrors, and computer-controlled light projectors (e.g., LCD-based projectors or DLP-based projectors). In the illustrated embodiments, the light projectors 12, 14 could be computer-controlled light projectors that allow the projected light patterns to be dynamically altered via software control components.
In general, the camera 16 may be any type of imaging device, including a computer-controllable digital camera (e.g., a Kodak DCS760 camera), a USB video camera, and a Firewire/1394 camera. USB video cameras or “webcams,” such as the Intel PC Pro, generally capture images 30 fps (frames per second) at 320×240 resolution, while Firewire cameras (e.g., Point Grey Research Dragonfly) can capture at higher frame rates and/or resolutions. The camera 16 typically remains fixed in place and is oriented toward the screen 24.
In embodiment, the video source 20 could be an independent unit such as a Digital Versatile Disk (DVD) player, a television tuner, or the like. Alternatively, the video source 20 could be an output from a generic personal computer as well. In either case, the video source 20 transmits video data to the respective projectors 12, 14 via the associated image processing components 12a, 14a.
The calibration control component 18 coordinates the calibration of the projectors 12, 14 in conjunction with the camera 16. Accordingly, in an embodiment, a calibration method is implemented via the calibration control component 18, the projectors 12, 14 and the camera 16.
During a geometric calibration phase of operation of the system, image data from which a correspondence mapping of the projection planes of the projectors 12, 14 with respect to a common reference coordinate system is generated. For example, as shown in
In an embodiment, the camera 16 is positioned to the side of the display 24 whereby the hotspots aren't visible. Because the image data received from the camera 16 is doesn't include image data related to hotspots, the calibration control component 18 can therefore geometrically calibrate the projectors 12, 14 by taking into account luminance differences on the screen 24 while ignoring any hotspots. The geometric calibration is then applied to the projectors 12, 14 via the respective image processing components of the projectors 12, 14.
Although the calibration control component and the image processing component are shown as separate control components, these components could be merged into a single processing block and implemented via a single computing platform (e.g. a personal computer). Furthermore, the image processing component could be implemented via a separate computer or hardware solution (e.g. ASIC, FPGA).
Additionally, although the above-delineated sequence is described as being mapped in the context of pixels, one of ordinary skill in the art will readily recognize that any area could be employed while remaining within the spirit and scope of the inventive concept.
Furthermore, although the above-described embodiment includes a single camera 16, the multi-projector system 10 may include more than one camera for providing feedback to the calibration control component 18 and calibrating the projection system. In these embodiments, multiple cameras capture respective sets of projected light patterns.
Accordingly, the calibration control component 418 receives image data from the first camera 416 and the second camera 417 and geometrically translates this data to a common coordinate space. The image data from the first camera 416 includes image data related to the hotspots whereas the image data from the second camera 417 doesn't include data related to hotspots since they are not seen by the second camera 417. The image data from the second camera 417 is then subtracted from the image data of the first camera 416 thereby identifying the image data related to any hotspots. Consequently, by identifying the image data related to the hotspots, this image data can be ignored during the subsequent geometric calibration of the multi-projection system 400.
An alternate multiple camera embodiment, is similar to the above-described embodiment but includes luminance value measurements. Accordingly, the calibration control component 418 receives image data from the first camera 416 and the second camera 417 and geometrically translates this data to a common coordinate space. The image data from the first camera 416 includes image data related to the hotspots whereas the image data from the second camera 417 doesn't include data related to hotspots since they are not seen by the second camera 417. Normalized luminance values are then determined based on the image data received from the first and second cameras 416, 417 respectively. Next, the images are compared pixel by pixel and at each pixel the minimum luminance value is utilized to form a calibration image. Consequently, the bright hotpots (i.e. higher luminance values) that move with respect to the viewer are ignored. The subsequent geometric calibration of the multi-projection system 400 is then performed utilizing the hotspot-free calibration image.
It should be noted that although the above described embodiments are disclosed in the context of employing two cameras, one of ordinary skill in the art will readily recognize that any number of cameras could be utilized while remaining within the spirit and scope of the inventive concepts.
A method of calibrating a projection system is disclosed. The method includes determining a location of at least one hotspot on a screen within the projection system, initiating a calibration sequence of the projection system and ignoring the at least one hotspot during the calibration sequence of the projection system.
The above-described embodiment may also be implemented, for example, by operating a computer system to execute a sequence of computer readable instructions. Accordingly, a computing device typically includes at least some form of computer readable media. Computer readable media can be any available media that can be accessed by computing device. By way of example, and not limitation, computer readable media may comprise computer storage media and communications media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage device, or any other medium which can be used to store the desired information and which can be accessed by a computing device.
Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media. Accordingly, an alternate embodiment includes a computer readable medium having computer executable components for calibrating a projection system.
Without further analysis, the foregoing so fully reveals the gist of the present inventive concepts that others can, by applying current knowledge, readily adapt it for various applications without omitting features that, from the standpoint of prior art, fairly constitute essential characteristics of the generic or specific aspects of this invention. Therefore, such applications should and are intended to be comprehended within the meaning and range of equivalents of the following claims. Although this invention has been described in terms of certain embodiments, other embodiments that are apparent to those of ordinary skill in the art are also within the scope of this invention, as defined in the claims that follow.
| Number | Name | Date | Kind |
|---|---|---|---|
| 7038727 | Majumder et al. | May 2006 | B2 |
| 20080100805 | Majumder et al. | May 2008 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20090009658 A1 | Jan 2009 | US |
