Referring now to the drawings in which like reference numbers represent corresponding parts throughout:
1. Overview
Although it is not possible to split a single input light source into a 60/60 pair of outputs with a beam splitter, it is possible to achieve a 60/60 pair of outputs when the outputs are combined as portions portions of two separate light source inputs (e.g. the separate LCD monitors). Thus, by taking advantage of proper light polarization and reflecting/transmission coatings, the output light can effectively be increased by approximately 10%; the total output becomes a 60/60 combination, with each part representing the captured light portion of each input monitor. Also note that by reflecting s-polarized light and transmitting p-polarized in the beam splitter device, the brighter outputs are both directed out of the same side of the beam splitter device, i.e. the viewer side.
Embodiments of the may utilize the same general configuration of components as illustrated in
2. Stereoscopic Display Brightness with a Beam-Splitter
Embodiments of the invention can enhance the light-throughput efficiency of a beam-combining half-mirror (i.e. a beam splitting device) used to optically superimpose the left eye and right eye views in a stereoscopic three-dimensional display. Enhanced brightness can improve visual comfort in this type of stereoscopic display by stopping down the user's pupils, thus increasing the depth of focus. This can permit longer, sustained use of the stereoscopic three-dimensional display.
When a ray of light impinges on an air-glass surface at an angle close to 45 degrees, nearly all of the reflected light is s-polarized, whereas almost none of the p-polarized light is reflected. According to Fresnel's laws of reflection, s-polarized light is more efficiently reflected, whereas p-polarized light is more efficiently transmitted, and this guides the choice for the orientation of the front polarizers on LCD panels used to make up a dual-display beamplitter-type three-dimensional stereoscopic display. If the rear LCD display of a stereoscopic display system is modified to have a vertical axis of polarization (p-polarization), while the side LCD monitor has a horizontal axis of polarization (s-polarization), the beamsplitter efficiencies will increase from 50/50, as a theoretical maximum, to 60/60 or more, due to the more efficient utilization of the natural tendencies of the beamsplitter device. Because most of the newer larger LCD monitors come from the factory with a vertical axis of polarization it is possible to use an unmodified LCD monitor in the back, to be viewed through the beamsplitter, whereas the top monitor, seen reflected in the beamsplitting mirror, should be polarized horizontally. Incidentally, previous LCD monitors, e.g. 17″ diagonal monitors and below, were nearly all diagonally polarized.
The polarization of the side LCD monitor can be altered from vertical (p) to horizontal (s) by a number of techniques. For example, the front and back polarizers can be stripped from the LCD glass and replaced with polarizers rotated 90 degrees to their original orientation. Various “half-wave retarder” sheets can be applied to the existing front polarizer in order to rotate the original axis of polarization from vertical to horizontal. A “quarter-wave retarder” sheet can be used to create circular polarization which is reversed in handedness by the beamsplitter to permit separation of the left and right eye channels.
One particularly efficient technique for modifying the side display is to remove the entire LCD panel, with its polarizers intact, flip it over and replace it on the monitor's backlight. By simply reversing the LCD panel relative to the backlight in this manner, the axis of polarization is changed from vertical to horizontal and the contents on the monitor become a mirror image, which is necessary for viewing the side monitor reflected from the beamsplitting mirror. Ordinarily, the image on the side monitor would have to be reversed electronically (e.g. in the video processor), which may cause processing delays, but by simply flipping the LCD panel on the backlight, both the image reversal and the polarization reversal are accomplished at the same time.
It can be seen that both s-polarization reflectance and p-polarization reflectance at the uncoated air-glass interface remain close to approximately 4% over the first 25 degrees of incidence angle, then they diverge. Past 60 degrees both rise rapidly to nearly 100% as the light rays become more and more inclined to the glass. It can be seen that s-polarized and p-polarized light have similar reflectance and transmittance curves for small angles of incidence, but diverge considerably after 30 degrees. However, the curves converge again as they approach 90 degrees.
Referring back to
3. Stereoscopic Three-Dimensional Display System
For example, in one particular application, the sterescopic camera system 202 may be designed to provide a view of a remotely controlled aircraft appendage 208, e.g. such as a refueling boom of a tanker aircraft. The sterescopic camera system 202 provides video input which is properly aligned in the alignable display system 200 to present a real time stereoscopic video of the aircraft appendage with exceptional clarity.
The separate camera input from the cameras 204A, 204B is communicated to a video processor 210 which prepares the separate camera signal input for their respective displays 212A, 212B. The video processor 210 may comprise one or more separable units to perform a range of video processing functions such as video switching between multiple different camera systems 202, each having a potentially different camera configuration and requiring different alignments of the stereoscopic display system 200. Note that only one camera system 202 is shown; other camera systems are similar, but designed for other sterescopic applications. During alignment of the display system 200, the video processor 210 can generate the separate test patterns which are shown on each display 212A, 212B to be superimposed by the BSD 216 through the common viewing aperture 214.
In order to achieve enhanced brightness of the output stereoscopic image, embodiments of the invention shall implement a BSD and displays according to the parameters and principles taught in the section 2, e.g. as described regarding the display 120 of FIG. IF. The alignable display system 200 includes two separate displays 212A, 212B arranged so that their delivered images are superimposed through a common viewing aperture 214 to an operator. Superimposing the delivered images may be accomplished through the use of a beam splitter device 216 known in the art. The beam splitter device (BSD) 216 essentially comprises a partially silvered mirror (which may also employ special coatings one or both surfaces). The BSD 216 reflects a significant portion of the incident light from the top-mounted display 212A through the common viewing aperture 214 to deliver its image to the common viewing aperture 214 (although some light is transmitted through the BSD 216 to be absorbed by a black backwall 218. Simultaneously, a significant portion of the light from the back-mounted display 212B is transmitted through the BSD 216 and through the common viewing aperture 214 to deliver its image superimposed with that from the top-mounted display. In a similar manner, some light from the back-mounted display 212B is reflected off the BSD 216 to be absorbed by the black wall 218. Importantly, the two separate displays 212A, 212B deliver differently polarized images through the common viewing aperture 214. The different polarizations of the superimposed images are used to isolate the respective images from the displays 212A, 212B to the separate eyes of the operator 220 when the display system 200 is being used. The displays 212A, 212B may be CRTs or LCDs or any other display technology known in the art capable of being filtered or directly generating a polarized image output. Special glasses having lenses with matching polarized filters (one for each eye) may be used to accomplish this as is known in the art.
In addition, the sterescopic display system 200 may also be accurately aligned by employing a superimposed view of both images (e.g. test patterns) from the separate displays 212A, 212B. Efficient alignment of the sterescopic display system 200 can be achieved through a number of techniques as taught in U.S. application Ser. No. ______ by Merritt et al., filed on this same day herewith and entitled “EFFICIENT AND ACCURATE ALIGNMENT OF STEREOSCOPIC THREE-DIMENSIONAL DISPLAYS,” which is incorporated by reference herein. Some adjustment controls for separate displays can be used to facilitate precise alignment of the system 200.
4. Example Stereoscopic Three-Dimensional Display
The exemplary design is directed to providing a comfortable two-channel stereoscopic three-dimensional video display that creates an ortho-stereoscopic percept of the refueling boom and receiver aircraft in the user's binocular visual space, scaled down by a hyper-stereo scale factor equal to the ratio between the camera separation and the user's eye separation. In the exemplary embodiment, the left and right cameras may be separated by approximately 17 inches, which is a scale factor of 6.8 times the average human eye separation of 2.5 inches. Key considerations include avoiding the so-called “stereo window frame violation”, and ensuring that the user's eyes are not required to diverge beyond parallel when fixating distant objects in the scene, and minimizing “focus/fixation” mismatch between the distance at which the user's eyes are converged or fixated and the distance at which the user's eyes have to focus when viewing the displayed images.
The exemplary two-channel stereoscopic three-dimensional display system uses a beam-splitter between to displays to create in binocular perceptual space the equivalent of two virtual display screens that have an optical distance of approximately 0.67 diopters (approximately 5 feet from the eyes), with a 34 degree horizontal field-of-view subtended by the central 1024 pixels in each eye's virtual display screen as shown in
In the exemplary stereoscopic three-dimensional system, the stereoscopic window is positioned by converging the two camera optical centerlines at a distance of approximately 13 feet (by toe-in of the cameras rather than by laterally sliding the sensor chips), which is the optical centerline distance at which the refueling boom intercepts the upper edge of the camera field of view. Since the left and right camera lenses may be separated by 17 inches in order to enhance depth acuity, (forming a convergence angle of 6.2 degrees), the two display modules in the BSD should be converged or “canted” to the same 6.2 degree angle, to minimize keystone distortion of binocular visual space. The optical distance of the display modules may be set to 0.67 diopters (approximately 5.5 ft) because the operator will spend most of the time viewing a distance of approximately 52.4 feet in the design application (which will appear to be approximately 7.7 feet in the 1/6.8 “scale model” view created by the hyper-stereo camera separation).
The exemplary embodiment comprises a hyper-stereoscopic video display to provide enhanced depth perception for the boom operator when performing aerial refueling. The display obtains a left and right stereoscopic pair of retinal images by means of the BSD rather than from a single shuttered stereoscopic panel-mounted CRT display, as in other previous systems. This difference should help minimize certain problems encountered with the previous shuttered display.
Previous system's using panel-mounted stereoscopic displays employed an electrically switchable polarizing shutter screen over a single CRT display faceplate. This permitted the use of passive polarized glasses for the operators, but there was some “ghosting” or cross-talk between the left and right images. Since the left-eye and right-eye imagery are no longer shuttered on the same screen in this example embodiment by employing separate polarized LCD displays, ghosting due to residual image decay is no longer present. However, there may still be some ghosting with the two-display BSD system due to “leakage” in the polarizing filters used to separate the left and right views for each eye, and thus quality of the optical means used to separate the left and right views, is important.
To minimize the adverse effects of ghosting, and to provide for a visually workable display in the event of shutter failure, the previous systems have converged the left and right cameras at the distance where the primary observation is to occur in the intended application, e.g. the location where a refueling appendage will dock. This convergence, however, created a visually disturbing stereoscopic effect: Operators have complained that it appeared unnatural for the refueling boom, which appeared to be sticking out in front of the stereo window, to be cut off by the top of the stereo window, which was seen as being behind it. This was due to the convergence of the cameras at the distance of the center of the viewing envelope, about 60 feet from the cameras. Everything in the scene that was closer than that convergence distance, particularly the aircraft appendage, would appear in stereoscopic depth to be in front of the display screen window.
This well-known problem in stereoscopic display design is often referred to as a “frame violation,” or “window violation,” which occurs when an virtual three-dimensional object is closer than the stereoscopic display window frame, but is paradoxically cut off by the frame behind it. In normal “direct” viewing, a window frame cuts off only those objects behind the window, and thus it can appear unnatural and perceptually disturbing for the stereo window (usually corresponding to the edges of the display) to cut off three-dimensional objects that appear to be in front of the window.
In the exemplary embodiment, the BSD affords the opportunity to create a stereoscopic window frame that naturally appears at an optical distance just in front of the closest object in the scene, e.g. the aircraft appendage at the point where it disappears from view at the center of the upper edge of the stereoscopic display window. In doing this, the left and right BSD displays are canted so their optical centerlines cross at approximately 23 inches from the user, creating a stereoscopic window frame that is about 21 inches from the observer's eyes.
Generally, to avoid “frame violations” in a stereoscopic display, the left and right display windows may be “converged”, by various techniques, to make the edges of the stereo window appear in front of the scene objects that are cut off by the window. However, if the optical distance of the individual display elements is behind the window (in order to minimize focus/fixation mismatch when viewing objects through the window), the stereo window edges will still appear in sharp focus, inconsistent with their binocularly doubled appearance.
The “mid-window” concept involves creating a physical aperture at the location of the stereo window with an optical distance that is consistent with its apparent binocular distance, and thus it appears naturally blurred when looking “through” the stereo window at more distant objects in the scene. This mid-window concept involves the use of a BSD with a “mid-window aperture” inserted between the display screen and the observer. Basically, the BSD physical mid-window, placed between the physical display and the viewing aperture, creates a more natural stereoscopic frame by giving observers natural focus cues as well as binocular fixation cues that are consistent with looking through an actual window at more distant objects of interest in the scene.
The toe-in method of converging the cameras and BSD modules is used because both left and right cameras must be identical, with no horizontal shift of lens or sensor chip relative to each other. The generally preferred method of convergence by the lateral shift method would require symmetrically opposite shifts in the left and right cameras, and that would require two different types of cameras, a “left” and a “right” version. It is generally recognized that lateral shifting of the lenses or chips as a means of convergence is superior to the toe-in method of convergence; however, toe-in, with its attendant complexities of imaging geometry, allows use of a single camera type. This requires toe-in as the method for corresponding convergence of the left and right BSD modules, as is presently done in some existing BSD units by canting the left and right modules inward to match the toe-in convergence angle of the left and right cameras.
The complex display alignment requires precise positional adjustments of displays and other components. Note the lateral shift and rotation of the virtual images of the display screens, required to make display geometry match camera geometry. This can be tedious and inaccurate without proper test patterns on the screens.
5. Method of Enhancing Brightness of a Stereoscopic Display System
Embodiments of the invention also encompass a method of cooling an electronic circuit consistent with the foregoing apparatus. The initial object is to form a hermetic cavity over the electronic circuit to be cooled and partially fill it with an appropriate non-conductive fluid. However, the use of the outer frame and flexure significantly improve the technique.
The method 400 may be further modified consistent with the various apparatus embodiments previously described. For example, the beam splitter device may include an optical coating to substantially balance the p-polarization transmittance with the s-polarization reflectance. Thus, the brightness of the stereoscopic image may be maximized. Further, in a typical embodiment the p-polarization transmittance and the s-polarization reflectance can each be at least 60%. The p-polarized display and the s-polarized display each may comprise an LCD display. In addition, the stereoscopic image can be viewed through one or more lenses disposed in the common viewing aperture. In one example, two plano-convex lenses can be employed in the common viewing aperture to increase the apparent size of the stereoscopic image to the viewer.
This concludes the description including the preferred embodiments of the present invention. The foregoing description including the preferred embodiment of the invention has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible within the scope of the foregoing teachings. Additional variations of the present invention may be devised without departing from the inventive concept as set forth in the following claims.
This application is related to the following co-pending U.S. Patent application which is incorporated by reference herein: U.S. patent application Ser. No. ______, filed on the same day herewith, by Hewitt et al. and entitled “EFFICIENT AND ACCURATE ALIGNMENT OF STEREOSCOPIC THREE-DIMENSIONAL DISPLAYS”.