The present invention relates to a three-dimensional (hereinafter 3-D) observation apparatus wherein individuals need not wear glasses in order to view 3-D images using the apparatus. A prior art example of such a 3-D observation apparatus is disclosed in Japanese Laid-Open Patent application S51-24116. As shown in
As in the 3-D observation apparatus described above, a large shift between the viewing points and the focal points spoils the stereoscopy observation. In this 3-D observation apparatus, the concave mirrors that produce distortion in images face each other. These two facing concave mirrors should be positioned so that their respective distortions cancel each other. Positioning errors of the concave mirrors determine the magnitude of image distortion and focal point shift. To avoid these problems, the two concave mirrors should have accurately formed surfaces that are precisely positioned. This results in a high cost for manufacturing and assembling the concave mirrors. Because the viewer faces the concave mirrors, a shift in the viewing position leads to a large image distortion, giving the viewer less freedom of viewing position and posture, which is inconvenient to the viewer. The exit pupils can be enlarged to improve freedom of movement during observation. However, larger concave mirrors are required in association with the enlarged exit pupil in the prior art observation apparatus discussed above. This will enlarge the entire 3-D observation apparatus.
U.S. Pat. No. 5,712,732 discusses, beginning at column 1, line 41, a prior art stereoscopic display wherein stereo pair images are projected, at slightly different angles, onto the back of a Fresnel lens so as to create a 3-D viewing experience for an observer without glasses. However, there is no suggestion that the Fresnel lens have its optical axis offset from the center of the Fresnel lens, as in the present invention.
U.S. Pat. No. 5,614,941 discloses a prior art stereoscopic display wherein stereo pair images are projected, at slightly different angles, onto a viewing screen that includes an array of cylinder lenses, a diffuser, and a Fresnel lens so as to create a 3-D viewing experience for an observer without glasses. Once again, however, there is no suggestion that the Fresnel lens have its optical axis offset from the center of the Fresnel lens, as in the present invention.
The objects of the present invention are to provide an individual 3-D observation apparatus and a 3-D observation system that do not require the observer to wear glasses and which provide bright images, more freedom of positioning of the viewer's head, and reduced aberrations due to misalignment of the viewer's pupils from the optical axes of the exit pupils. An additional object of the invention is to allow the viewer to assume one or more comfortable viewing postures during a 3-D observation.
The present invention will become more fully understood from the detailed description given below and the accompanying drawings, which are given by way of illustration only and thus are not limitative of the present invention, wherein:
FIGS. 1(a) and 1(b) are illustrations to explain the principle of the 3-D observation apparatus of the present invention, with
FIGS. 3(a) and 3(b) show an embodiment of the 3-D observation apparatus of the present invention, with
FIGS. 4(a) and 4(b) show another embodiment of the 3-D observation apparatus of the present invention, with
FIGS. 6(a), 6(b)) and 6(c) are side views to schematically illustrate three respective modifications to the embodiment illustrated in
FIGS. 7(a) and 7(b) are side views to schematically illustrate two additional embodiments of the 3-D observation apparatus of the present invention;
FIGS. 8(a) and 8(b) illustrate a reflection-type display panel applicable to the reflection-type 3-D observation apparatus of the present invention, with
FIGS. 9(a) and 9(b) are schematic illustrations of another example of a reflection-type display panel applicable to the reflection-type 3-D observation apparatus of the present invention, with
FIGS. 12(a)-12(c) show another example of a reflection-type display panel that is applicable to the reflection-type 3-D observation apparatus of the present invention, with
FIGS. 13(a)-13(c) show other examples of a reflection-type display panel that is applicable to the 3-D observation apparatus of the present invention, with
FIGS. 14(a) and 14(b)) show an arrangement of a reflection-type 3-D observation apparatus of the present invention having any of the strictures shown in the embodiments discussed above, with
FIGS. 27(a) and 27(b) show more details concerning the construction of the display panel 22 shown in
FIGS. 29(a) and 29(b) show another example of a display panel 22 construction wherein a diffusion plate, that provides a scattering effect to a luminous flux due to scattering when the luminous flux enters and exits, is combined with the Fresnel mirror in the display panel shown in
FIGS. 33(a) and 33(b) show the display panel 22 according to the embodiment shown in
FIGS. 34(a) and 34(b) show a Fresnel concave mirror, with
The 3-D observation apparatus of the present invention projects light beams that convey left and right stereo image data through respective apertures. The light beams converge to form overlapped images within a common region. Images for viewing are formed at the exit pupils of the 3-D observation apparatus by an imaging means that is formed of either a Fresnel lens or Fresnel mirror that is positioned substantially at the common region. In addition, a diffuser for enlarging the pupils is preferably provided substantially at the common region. The diffuser should not enlarge the projected images of the two apertures to the point that the two apertures overlap. In this way, light fluxes having parallax that are projected onto a display surface from the two apertures are imaged so that the exit pupils are enlarged but do not overlap. Thus, the exit pupils serve to display left and right images having different parallax, to the respective left and right eye of a viewer, thereby providing a 3-D viewing experience to a viewer without the need for the viewer to wear glasses in order to experience the 3-D effect.
With the structure of the 3-D observation apparatus of the present invention as described above, in which the left and right images are projected onto a common region, the convergence point for the light passing through the left and right pupils is made to be coincide with the image surface of the left and right images so that the left and right images overlap. With the left and right apertures enlarged and projected onto the viewing pupil positions, more freedom of pupil positions is obtained, thereby allowing the viewer to be in a more comfortable posture during observation. The diffuser enables the size of the pupils of the projectors to be reduced. This results in the image quality being improved, as well as enables the size of the projectors to be reduced. The diffuser is also used to reduce differences in aberrations in the projection optics, and it serves to make the light more uniform, which improves the 3-D viewing experience.
The imaging means for forming the left and right images, as well as the pupil enlarging effect provided at the left and right exit pupils, also reduces aberrations in the 3-D image. In the 3-D observation apparatus of the present invention, the imaging optical system for creating the exit pupils and the diffuser for enlarging the exit pupils can be provided as components on a display panel. The display panel can be planar, in which case it may be observed from a non-normal position to reduce image aberrations. Also, the display panel can be curved to further reduce image aberrations.
Various embodiments of the present invention will now be described in detail. FIGS. 1(a) and 1(b) show ray paths of two embodiments of a 3-D observation apparatus according to the present invention, with
The imaging optical system 3 is arranged to form the images from the two apertures 2R, 2L of the projection optical systems at the viewer's pupils 4R, 4L. The diffuser serves to enlarge the viewing pupils. The imaging optical system 3 and the diffuser are positioned at a common region, Such as a display surface. The display surface is positioned to coincide with the image plane of the images projected from the projection devices. The imaging optical system 3 is formed of a Fresnel lens in the case of a transmission-type 3-D observation apparatus, and of a Fresnel minor in the case of a reflection-type 3-D observation apparatus. The Fresnel mirror or Fresnel lens is arranged to form the images from the two apertures 2R, 2L at the viewer's pupils, respectively. Having the Fresnel surface positioned substantially at the image plane keeps the Fresnel surface from impairing the image quality. Further, unlike conventional concave mirrors, the Fresnel surface takes up much less space, since the overall form of such a mirror is similar to that of a flat surface.
FIGS. 3(a) and 3(b) illustrate an embodiment of the 3-D observation apparatus of the present invention, with
The transmission-type display panel of this example consists of a de-centered optical system. In other words, the Fresnel lens has an optical axis that is de-centered with respect to the center of the Fresnel lens surface. As is shown in
FIGS. 4(a) and 4(b) show another embodiment of the 3-D observation apparatus of the present invention, with
FIGS. 6(a)-6(c) are side views that show possible modifications to the embodiment shown in
FIGS. 7(a) and 7(b) are side views which schematically show the structure of another embodiment of the 3-D observation apparatus of the present invention. The 3-D observation apparatus of this embodiment is of the reflection-type. The 3-D observation apparatus in
Examples of the display panel used in the 3-D observation apparatus of the present invention will now be described in detail.
FIGS. 8(a) and 8(b) are illustrations to show an example of a reflection-type display panel that may be used in the reflection-type 3-D observation apparatus of the present invention, with
The display panel shown in FIGS. 8(a) and 8(b) has the structure of a de-centered, Fresnel back-surface mirror. However, the Fresnel mirror may instead be a front-surface mirror. The radius of curvature R of the Fresnel surface 3a of the front-surface or back-surface mirrors will now be discussed. If the Fresnel mirror is designed as a back-surface mirror, the radius of curvature R should equal 2n+f; however, when the Fresnel mirror is designed to be a front-surface minor, the radius of curvature R should equal 2f, where n is the refractive index and f is the focal length. Accordingly, by employing a Fresnel back-surface mirror as illustrated in FIGS. 8(a) and 8(b), the radius of curvature can be made larger, which is advantageous in that smaller aberrations are generated in the course of imaging the pupils. Furthermore, the display panel of this example uses an a spherical Fresnel surface 3a with its radius of curvature increased toward the periphery. With this structure, the a spherical Fresnel surface advantageously serves to further reduce aberrations generated in the course of imaging the pupils.
FIGS. 9(a) and 9(b) illustrate another example of a reflection-type display panel that is applicable to the reflection-type 3-D observation apparatus of the present invention, with
FIGS. 12(a)-12(c) are illustrations that show other examples of a reflection-type display panel applicable to the reflection-type 3-D observation apparatus of the present invention, with
FIGS. 13(a)-13(c) are illustrations to show other examples of a reflection-type display panel applicable to the reflection-type 3-D observation apparatus of the present invention, with
Polymerization is used to solidify liquid crystal. The present example uses this phenomenon. Polymerized liquid crystal 5e is birefringent and has an unstable orientation. When photo-polymerized, it is solidified with a random internal orientation as is shown in
FIGS. 14(a) and 14(b) are illustrations to show the arrangement of the reflection-type 3-D observation apparatus of the present invention having any of the structures shown in the examples above, with
The 3-D observation apparatus applications shown in FIGS. 16 to 19 may be used in various fields, such as surgical microscopy, endoscopy, medical 3-D data imaging, 3D CAD imaging, and so on, or even as a computer game machine. Furthermore, the structures used in reflection-type 3-D observation apparatuses of the embodiments above are also applicable to transmission-type 3-D observation apparatuses using a transmission-type display panel as shown in
The stereoscopic vision observation device according to the present invention projects images through two apertures onto the same image surface. A display panel that includes an optical element having positive optical power is arranged at, or in the vicinity of, the image surface. The two apertures are conjugated (i.e., imaged) at observation exit pupils by the optical element having positive optical power, and the optical element scatters the light incident on it so as to form enlarged observation exit pupils for easy viewing. The optical element having positive optical power may be formed of either a concave Fresnel mirror or a convex Fresnel lens. The optical axis of the optical element having positive optical power is constructed so as to be offset from the display panel (i.e., outside the display surface of the display panel) so as to avoid unwanted noise in the images and to prevent unnecessary interference between the image projectors and the observer as well as between the image projectors and other personnel in the vicinity of the observer.
Furthermore, the stereoscopic display unit according to the present invention is characterized by the following Condition (1) being satisfied:
Φ=10·Δproj Condition (1)
where
Φ is the diameter of the circle of confusion caused by the diffuser, which is determined by the thickness of the panel, as well as by the scattering angle, and
Δ proj is the pixel pitch (measured in linear units) of the image display surface when projected onto the display panel.
Further, the stereoscopic display unit according to the present invention is characterized by including:
(a) a projection means that projects images through two apertures onto the same image Surface;
(b) a display panel that includes an optical element having positive optical power positioned at or nearby the image surface and which conjugates the two apertures of the projection means so as to form observation exit pupils at which images may be observed; and,
(c) a diffuser, which scatters light incident thereon so as to thereby enlarge the observation exit pupils.
The optical element having positive optical power may include a Fresnel optical element. When this is the case, it is desirable that the optical axis of the Fresnel optical element is constructed so as to be offset from the display surface of the display panel. In addition, it is desirable that the following Condition (2) is satisfied:
P<10·Δeye Condition (2)
where
P is the groove pitch (in linear units) of the Fresnel optical element, and
Δ eye is the diameter of the circle of confusion for the human eye observing the display panel surface from the position of the observation exit pupils.
Because a human observer can discern two points as being separate points only when the angle the two points subtend from the eye equals one minute of arc or more, the diameter Δ eye of the circle of confusion at the surface of the display panel that results from such visual acuity of a human observer is substantially equal to the number of radians corresponding to one minute of arc times the distance that the observer's eyes are from the display panel.
Further, the stereoscopic vision observation device according to the present invention is characterized by the fact that it includes the stereoscopic display unit of the present invention and an image input device.
By satisfying the above Conditions (1) and (2), an image display unit and a stereoscopic vision observation device are provided having a high quality image. Furthermore, the image display unit and stereoscopic vision observation device are user-friendly with regard to enabling a three-dimensional observation to be observed with less fatigue experienced by the viewer and miniaturization of the image display unit and of the stereoscopic vision observation device can be realized.
Prior to explaining additional various embodiments of the invention in detail, the operation and efficacy of the present invention will be explained.
As described above, the stereoscopic display unit and the stereoscopic vision observation device according to the present invention are constructed by being equipped with a projection means that projects images via two apertures onto the same image surface, an optical element having positive optical power that is positioned at the image surface or nearby it and which conjugates (i.e., forms images of) these apertures at the respective observation exit pupil positions, and a diffuser which enlarges the observation exit pupils for observation beyond the magnification of the conjugated apertures produced by the optical element having positive optical power.
With the above-mentioned construction, an image that passes through each aperture is projected onto the image surface at or near the display panel, and images of the two apertures are formed at the observation exit pupils by the optical element having positive optical power. Further, the observation exit pupils are enlarged by the diffuser. The enlarging that occurs is such that none of the enlarged exit pupils for observation overlaps another enlarged exit pupil for observation. Consequently, a viewer can perceive stereoscopic images without having to wear special eyeglasses that would prevent the left-eye images from being seen by the right-eye, and vice-versa, within enlarged viewing areas.
According to the present invention, since the convergence position of a viewer's right and left eyes coincides with the in-focus position of the right and left projected images, an observer will not suffer from the undesirable feeling of disorientation that accompanies viewing images when the convergence position of the viewer's right and left eyes does not coincide with the in-focus position of the right and left projected images, respectively. Consequently, the viewer can comfortably perceive stereoscopic images of scenes without experiencing fatigue and/or a feeling of being disoriented, as often occurs when viewing stereo image pairs when the convergence position of the viewer's right and left eyes does not coincide with the in-focus positions of the right and left projected images, respectively. Further, because the images of the right and left apertures are enlarged at the positions of the enlarged exit pupils for observation, greater freedom in positioning the observer's eyes is provided. Thus, a viewer can view stereoscopic images while being able to change his viewing posture, which results in less fatigue.
Further, since a diffuser that accomplishes a scattering effect enlarges the observation exit pupils beyond that provided by the image magnification in forming the exit pupils for observation, the two apertures can be downsized, thereby improving image quality of the projected images as well as allowing the projector to be downsized.
Moreover, if the diffuser that accomplishes a scattering effect is positioned at or near the image surface, the distortion of the images due to aberrations of the optical system of the projectors can be eliminated. In other words, because the luminous flux can be made uniform on the display Surface due to the scattering effect of the diffuser, a viewer can observe an image which will not be distorted regardless of the positioning of the exit pupils for observation. Furthermore, even if a Fresnel optical element is used as the optical element having positive optical power so as to conjugate the apertures and thereby form observation exit pupils, no image quality deterioration will occur.
In addition, if a pupil enlargement function is provided by using a diffuser at the image surface to scatter the light, no image quality deterioration will occur as a result of the scattering. Therefore, in the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, the optical element having positive optical power and the diffuser that scatters light so as to enlarge the observation exit pupils are arranged as components of the same display panel and at coinciding positions or very near one another. Moreover, their location should be at or near the image surface. This reduces the deterioration of image quality when the display panel is viewed from near the periphery of the observation exit pupils.
In addition, with the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, the below-mentioned operation and effect can be obtained.
In the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, when the positive optical component includes a Fresnel optical element, namely, either a concave Fresnel mirror or a convex Fresnel lens, the optical axis of the Fresnel optical element should be offset from the display surface of the display panel. Having such an offset not only prevents interference of persons with equipment in the vicinity of the surgical site, but it also provides higher quality images, as will be explained below in the case where the Fresnel optical element is formed as a Fresnel mirror.
Where a Fresnel mirror forms the optical element having positive optical power, the cross-sectional configuration of the groove in the center region (the region that the optical axis passes through, shown in
On the other hand, in the present invention, a Fresnel optical element having positive optical power is constructed such that its optical axis is offset from the display surface of the display panel. Thus, the light that is reflected by the groove is reflected in a direction that is not towards the observer's eyes. Thus, the groove portion in this case will not appear too bright.
Further, grooves that form the Fresnel surface are formed at a predetermined pitch on the Fresnel optical element, as shown in FIGS. 36(a) and 36(b). If the pitch (in terms of linear units) is. large, the grooves become easily noticeable, and the quality of an image is thus deteriorated. The smaller the pitch becomes, the less noticeable the grooves. Further, the noticeability of the grooves is affected by the observation distance. Since the angular resolution of a human eye is about one minute of arc, as noted above, when the groove pitch (in linear units) of the Fresnel optical element is made smaller than a distance on the surface of the display panel that corresponds to one minute of arc, the groove lines will not be noticeable and the image will not be degraded. Furthermore, it is preferable that the groove pitch of the Fresnel optical element be made small relative to the diameter Φ of the circle of confusion (i.e., the amount of blur) of the projected image. The amount of blur is dependent on the diffuser that causes the scattering and the distance between the diffuser and the display surface. Once again, it is desirable that the grooves of the Fresnel surface not be noticeable to the viewer, as this will degrade the quality of an image. Satisfying the above Conditions (1) and (2) ensures that a high quality stereoscopic image is perceived without the Fresnel grooves being noticeable to a viewer.
In the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, it is preferable that what is termed herein as the ‘aperture ratio’ is 0.2 or more, with the aperture ratio being the summation of the areas of pixels that can be turned to a bright status divided by the display area, where the display area includes the areas that can be turned to a bright status as well as a portion around each pixel that forms a cell in an array of pixels that comprise the display, but excludes the border area of the display. If the aperture ratio becomes less than 0.2, boundary areas that surround each pixel appear as a grid pattern or as dot-shaped patterns when viewing the images become noticeable. Also, in the case where the difference between the groove pitch of the Fresnel optical element and the pixel pitch of the image display is small, a moir pattern will be generated. However, if the aperture ratio is designed to be 0.2 or more, the contrast of the moir pattern will be relatively weak.
In the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, if the diffuser is comprised of a hologram film which accomplishes both a scattering effect and a refraction effect, a high quality three-dimensional image can be obtained.
In addition, in the stereoscopic display unit and the stereoscopic vision observation device, it is necessary that the display panel be viewed from an appropriate distance and from an appropriate viewing angle as determined by the observation exit pupils, and that these observation exit pupils be designed properly. For example, if the observation distance is less than about 150 mm, an extended duration of observation will result in eye fatigue due to the muscles used to focus the eye lens as well as the muscles used to move the eyes becoming tired. Therefore, it is necessary to form the exit pupils for observation such that the distance from the display panel to the pupil positions for observation is greater than 150 mm.
The longer the viewing distance, the smaller the angle of convergence and the less refractive power required of an observer's eyes. However, as the observation exit pupils are made to be more remote from the display, the display panel itself must be larger for the images to be seen clearly, which results in an inconvenience and increases the likelihood that other equipment in the operating room will interfere with the placement of the display panel. Consequently, in the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, it is preferable that the distance from the display panel to the observation exit pupils is in the range of 150 mm-2000 mm.
In particular, in the case of performing an operation close at hand while a three-dimensional observation is conducted, it is preferable to have the display panel within a range of distance that provides a stereoscopic viewing sensation for direct viewing, thereby reducing the sense of incongruity that occurs where the observed images on the display panel are not at a distance that corresponds with the convergence angle of the displayed images. Therefore, from this point of view, it is desirable that the upper limit of the distance from the display panel to the observation exit pupil positions does not exceed 2000 mm.
Further, in the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, from the view point of ease in conducting an observation, it is better that the angle that the display panel subtends from the viewer in the horizontal direction be greater than the angle that the display panel subtends in the vertical direction. Also, it is desirable that the angle that the display panel subtends in the horizontal direction be in the range of 6 degrees through 60 degrees. The lower limit of 6 degrees provides a minimum picture angle to ensure that a sufficient amount of information concerning the object is being conveyed to a viewer; the upper limit is to prevent the size of the display panel from becoming too large. In particular, during an operation it is often necessary to observe the site of the operation while observing images on the display panel. Thus, it is necessary to not only be able to observe the display panel itself, but also to observe the surgical site directly. As an alternative, the information displayed on the display panel can be information for better understanding the circumstances, such as the image of the surgical site as viewed from a different point of view.
In the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, the display panel itself has a function that accomplishes the pupil enlargement effect by providing a scattering effect. Generally, such a scattering effect tends to degrade the resolution of the displayed images. However, in the present invention, degradation of the observed images is avoided by controlling the diameter Φ of the circle of confusion caused by the scattering. The diameter Φ of the circle of confusion depends on the scattering angle as well as on the thickness of the display panel. By keeping the diameter of the circle of confusion (i.e., the blur circle) small as compared with the amount of detail in the projected images, deterioration of image quality due to blur is maintained below the resolution limit of the eye.
If the projection means is miniaturized as much as possible by having the images of the apertures of the projection means magnified by the optical element having positive optical power when conjugating these apertures so as to from the observation exit pupils while at the same time enlarging the observation exit pupils using the diffuser, the diameter of the apertures in the projection means can be established smaller, thereby enabling the entire optical system to be miniaturized.
In the stereoscopic display unit and the stereoscopic vision observation device according to the present invention, it is preferable to construct the diameter of the exit pupils for observation in the range of 20 mm through 500 mm, from the point of view of securing a proper brightness. In addition, it is preferable to construct the diameter of the apertures in the projection means in the range of 5 mm through 50 mm, from the point of view of miniaturizing the size of the projection means.
The smaller the image display is, the smaller the optical construction of the projection means can become, under the circumstance of securing a given resolution. On the other hand, if the image display is constructed so that its area does not exceed 900 mm2, the projection means can be miniaturized. In order to additionally miniaturize the projection means, the image display means should be constructed so that its area does not exceed 400 mm2.
The image magnification in forming the observation exit pupils using the optical element having positive optical power should not be extremely reduced or enlarged. Moreover it is preferable to construct the image magnification in the range of 0.1 through 10. It is also preferable to construct the ratio of the area of the display panel surface at the image surface divided by the area of the projected image at the image surface so as to be in the range of 0.50 through 1.00, so as to avoid there being non-illuminated regions in the field of view.
The invention will now be discussed in general terms with reference to the drawings.
The image input device 1 may include: an endoscope 17a that can image a two-dimensional image or a three-dimensional stereoscopic image; a microscope 17b that can image a two-dimensional image or a three-dimensional stereoscopic microscope image; and /or a computer 17c that can process a tomographic image, such as a CT, an MRI, or a computer graphic image, such as a three-dimensional image that has been constructed based upon these tomographic images. An image source, such as a two-dimensional image or a three-dimensional image which has been imaged by a camera installed in the endoscope 17 or the microscope 11b, a tomographic image, such as a CT or an MRI that has been entered into the computer 11c, or a computer graphic image that has been constructed based upon these toniographic images is constructed so as to transmit the images to a projection device 21 in the stereoscopic display unit 2 via the image control devices 12a, 12b and 12c, respectively.
The stereoscopic display unit 2 may include a projection device 21 and a display panel 22. The stereoscopic display unit 2 shown in
The display panel 22 shown in FIGS. 27(a) and 33(a) each includes a Fresnel concave mirror 22a and a diffuser 22b, 22b′, respectively. FIGS. 27(a) and 33(a) are cross-sectional views that show different designs for the display panel 22 shown in
Referring to
As shown in
As shown in FIGS. 27(b) and 33(b), the Fresnel concave mirror 22a is formed so that its optical axis is positioned outside the display surface of the display panel 22. Further, the Fresnel concave mirror 22a is constructed so as to conjugate (i.e., form an image of) the aperture(s) 21c(21Rc and 21Lc) at observation exit pupils where the image(s) can be observed by the observer positioning his eyes at these locations and looking toward the display panel.
As described above, the display panel 22 is equipped with a diffuser 22b (or 22b′) which enlarges the exit pupils for observation to an appropriate size for ease of viewing while allowing the light to be efficiently directed in the direction of the enlarged exit pupils for observation so as to present bright images to a viewer. Further, the efficient direction of light toward the observation exit pupil positions also enables the brightness of the projection optical system 21b to be reduced (for example, a projection optical system having a large F-number can be used), so that it becomes possible to miniaturize the projection optical system 21b. More specifically, the reduction of the aperture diameter of the projection optical system 21b enables the miniaturization of the projection optical system 21b. This enables, as a light source for projection incorporated in the projection device 21, the use of a low-power light, such as an LED, instead of a mercury lamp or a halogen light source that has a relatively high power consumption.
The stereoscopic display unit for three-dimensional observation is constructed so as to arrange the projection devices 21R and 21L as two image projection means side-by-side, with the light from each passing through a respective aperture (21Rc, 21Lc). The two apertures are imaged as right and left observation exit pupils, respectively, and these are then enlarged so as to provide right and left enlarged exit pupils for observation, as discussed above. The positions and the diameters of the right and left observation exit pupils are established so as not to overlap each other.
Further, as shown in
Further, the optical element having positive optical power is positioned at the image formation position of the projection optical systems 21Rb and 21Lb. This optical element functions to image the apertures that function as exit pupils of the projectors to positions, herein termed the observation exit pupils, where a viewer may place his right and left eyes 24R, 24L. The optical element having positive optical power has no affect on the formation of the images that are projected via the projection devices 21R,21L. Consequently, even if the position of the optical element having positive optical power is mis-positioned or shifts somewhat from its intended position and/or orientation, no distortion of the observed images will result. Thus, stable, high-quality images can be observed using the present invention.
In addition, in order to provide a display unit and an observation device that are user-friendly by causing less eye fatigue, particularly when viewing stereoscopic image pairs that are perceived as three-dimensional images and, to enable miniaturization to be realized, it is preferable that the construction of the display panel, the projection means and the entire optical system be optimized as follows:
(a) when the optical element having positive optical power is formed of a concave Fresnel mirror, the optical axis of the Fresnel mirror should be positioned outside of the display surface of the display panel 22;
(b) concerning the entire optical system, the panel thickness and the scattering angle are constructed such that the above Condition (1) is satisfied;
(c) concerning the entire optical system, the above Condition (2) is satisfied;
(d) the projection means is constructed so that the aperture ratio is 0.20 or more;
(e) a diffuser that preferably is formed as a hologram film that has both a scattering effect and a refraction effect is used to enlarge the observation exit pupils;
(f) concerning the angles subtended from the enlarged observation exit pupils to both ends of the display panel in the horizontal and vertical directions, the angle subtended in the horizontal direction should be in the range of 6 degrees through 60 degrees and the angle subtended in the vertical direction should be in the range of 4 degrees through 50 degrees;
(g) concerning the observation distance, the observation exit pupils should be positioned in the range of 150 mm through 2000 mm from the display panel;
(h) concerning the images of the exit pupils of the projector that form the exit pupils for observation, the exit pupils for observation should have a diameter in the range of 20 mm through 500 mm;
(i) in the case that the pupils for observation are non-circular, the dimension of the shortest side should lie in the range of 20 mm through 500 mm;
(j) the ratio of the area of the display panel 22 to the display area of the projected images at the image surface should be in the range of 0.5-1;
(k) the magnification ratio of the optical element having positive optical power in imaging the exit pupils of the projectors should be in the range of 0.1-10;
(l) the diameter of the aperture(s) 21c (21Rc and 21Lc) that serve as the exit pupils of the projector(s) should be in the range of 5 mm-50 mm; and
(m) the area of the image display 21a should not exceed 900 mm2, and it is preferred that the area of the image display 21a′ does not exceed 400 mm2.
Items (a)-(d) above are for obtaining high quality images, item (e) above is for obtaining high quality, stereoscopic images, items (f)-(j) are for the purpose of realizing a user-friendly stereoscopic display unit, and items (k)-(m) are for the purpose of realizing miniaturization of the stereoscopic display unit.
Several more embodiments of the invention will now be described in detail with reference to the drawings.
The size of the exit pupils for observation is normally designed such that their diameter does not exceed 500 mm in order to ensure that the observed images will have sufficient brightness. Furthermore, the exit pupils of the projectors can be non-circular. In such a case, if the length of the shortest side of the exit pupil for observation does not exceed 500 mm, the observed images will have a sufficient brightness.
FIGS. 27(a) and 27(b) show more details concerning the construction of the display panel 22, with
As shown in
With the stereoscopic display unit constructed as above, since the pitch P of the Fresnel grooves is less than the distance subtended by one minute of arc, an observer is unable to resolve the fine patterns of the Fresnel surface, and the image is not degraded. Further, the degree of eccentricity of the Fresnel mirror and the display screen size of the display panel are established so as to not have the optical axis position of the Fresnel mirror 22a be situated within the display surface of the display panel 22. Thus, none of the grooves of the Fresnel surface will be visible nor will any irregular reflection of light that might otherwise occur at the optical axis of the Fresnel mirror surface degrade the image quality observed.
FIGS. 29(a) and 29(b) show another example of a display panel 22 construction wherein a diffusion plate, that serves as a diffuser due to scattering that occurs both when the luminous flux enters and exits, is combined with the rear-surface Fresnel mirror in the stereoscopic display unit shown in
The deterioration of the image in the case of using a diffusion plate wherein the scattering occurs twice will now be considered.
Initially, an image from the projection device is formed on the incident surface of the display panel 22. The amount of blur at this time is zero, and the scattering angle of the luminous flux coincides with the numerical aperture of the light beams exiting the projection optical system. 10 As is apparent from
If it is assumed that the intensity profile due to one scattering effect is a Gaussian distribution, then two scattering effects will cause the diffusion to have an intensity profile that is also a Gaussian distribution but the new scattering angle will be the square root of 2 (i.e., 1.414) times the initial scattering angle. Thus, the intensity profile due to two scattering effects is different than the intensity profile due to one scattering effect, and will vary depending upon the scattering distribution characteristic. It is reasonable to assume that the scattering characteristic when a luminous flux enters such a diffusion plate and when a luminous flux exits such a diffusion plate will have substantially the same characteristics. Thus, when the scattering angle is defined as the angle between the points on the scattering profile where the scattering intensity has fallen to one-tenth the peak intensity, when two scattering effects occur, the scattering angle will be enlarged by a factor of approximately 1.4 times the scattering angle for a single scattering effect. In computing the diameter of the blur circle that results from two scatterings, a thickness of two times the thickness d2 of the transparent layer that is adjacent the reflective surface of the Fresnel mirror must be used, since the light travels through this layer twice. Referring to
where
2ε is the full beam width scattering angle due to one scattering effect.
As noted above, since the full beam width scattering angle 2ε is enlarged by a factor of approximately 1.414 times (i.e., by the factor 21/2) due to two scattering effects, the full beam width scattering angle 2ε required for one scattering effect is approximately equal to 4.7 degrees.
Further, the blur circle has a diameter ▭ given by the following Equation (C):
Φ=(2·d2/n)·(sin{sin−1(10/600)+2ε}) Equation (C)
where
d2 is the thickness of tile transparent optical material adjacent the reflective Fresnel mirror surface,
n is the index of refraction of the transparent optical material adjacent the reflective Fresnel mirror surface,
ε is the half beam width scattering angle (i.e., the scattering angle as measured from the surface normal) due to a single scattering in air, and
Sin−1 (10/600) is the angle between the outer rays of the projected light beam due to the numerical aperture of the projection optical system.
As is apparent from Equation (C) above, the amount of blur (i.e., the diameter Φ of the circle of confusion) depends on the numerical aperture of the projection optical system, the full beam width scattering angle 2ε of the scattering surface, and the equivalent optical distance in air (2d2/ n) that the light rays propagate within the panel.
Referring to Equation (C) above, when 2ε equals 4.7 degrees, d2 is 1 mm, and n=1.5, the diameter Φ of the circle of confusion equals 0.13 mm. In other words, the amount of blur for a panel thickness d2 of 1 mm having a refractive index of 1.5 is about 0.13 mm.
Further, in the stereoscopic display unit shown in
In the case when an image is projected onto the entire surface of the display surface of the display panel 22 having the standard size ‘B5’, the pitch (measured in linear units) as measured in the horizontal direction H and in the vertical direction V for each of the display formats VGA, SVGA, XGA, SXGA is listed in Table 1 below:
Moreover, the following Conditions (3) and (4) are satisfied so as to obtain high image quality:
0.01<(Δproj/Δeye)<100 Condition (3)
0.01<(Φ/Δproj)<10 Condition (4)
where
Δ proj, Δ eye, and Φ are as defined for Conditions (1) and (2) above. Unless the diameter Φ of the circle of confusion (i.e., the amount of blur) is established as being less than or equal to 2 times Δ proj (when measured in linear units), high spatial frequency information (i.e., fine details) of the image may be lost. The value of Δ proj when using the various display formats listed in Table 1 for the display panel 22 of shown in
Even though fine details of an image will be lost, as a practical matter for most uses, it is acceptable if the diameter Φ of the circle of confusion is less than 10 times Δ proj (when measured in linear units).
In the stereoscopic display unit shown in
In this embodiment, the groove pitch P (measured in linear units) of the Fresnel surface is made to be approximately the same size as Δ eye. Furthermore, even if the groove pitch P (in linear units) is up to 10 times the value of Δ eye, the display surface will appear to be of acceptable quality in that the grooves of its Fresnel surface, for most observers, will be unnoticeable.
Furthermore, the value of Δ proj (i.e., the pixel pitch, measured in linear units, of the image display surface of this embodiment when projected onto the display panel) is 0.13 mm. Consequently, there is no loss of fine details due to the manner of displaying and viewing the images. Of course, the displayed image can be provided with finer details than can be resolved by a human at a given viewing distance (wherein Δ proj is smaller than the distance subtended by one minute of arc on the display surface as viewed from the exit pupil position(s)). However, there is no benefit to be gained by providing a higher image resolution than can be perceived by a human.
It is preferable that each of the image displays 21a, 21Ra and 21La, have an area, including the perimeter area of the image display, that does not exceed 900 mm2. In addition, it is more preferable that this area does not exceed 400 mm2. The smaller the projection optical system(s) 21b (21Rb and 21Lb), the more the entire projection device(s) 21 (21R and 21L) can be miniaturized. If the image displays 21a, 21Ra and 21La are large, the projection optical systems 21b, 21Rb and 21Lb and the projection devices 21, 21R and 21L will be large. Further, downsizing the size of the apertures of the projection device(s) allows the projection optical system(s) 21b (21Rb and 21Lb) to be made smaller. In addition, it is desirable that the diameter of the aperture(s) not exceed 50 mm, and more desirable that the diameter of the aperture(s) not exceed 20 mm.
Because the exit pupils are properly sized, the brightness of the images is excellent, without being too bright. For the light source incorporated in the projection device, either a xenon lamp, a halogen lamp, a mercury lamp or an LED can be used.
Further, an observation can be conducted without noticing a boundary between what is perceived as a three-dimensional image that is displayed on the display surface and the periphery of the display surface of the display panel 22. Therefore, when an operation is conducted with a three-dimensional image being displayed on the display panel so as to show the surgical site, for example, from a different viewpoint so that the surgeon can better understand the circumstances, user-friendliness is excellent.
In order to realize such a situation, it is necessary to employ a reflective-type stereoscopic display unit, and to simultaneously make the size of the image that is projected onto the display panel be larger than the display surface of the display panel 22. When projecting an image onto the display panel 22, care must be taken to ensure that the projected image does not become excessively large, so that the pixels in the image display(s) 21a (21Ra and 21La) are effectively utilized. Consequently, it is preferable that the ratio of the area of the display surface of the display panel 22 divided by the area of the projected display images at the image surface are within the range of about 0.5 -1.0.
Further, it is preferable that the aperture ratio(s) of the image display(s) 21a (21Ra and 21La) be as large as possible. As mentioned above, if the aperture ratio is too small, artifacts appear in the image in that the border area around each pixel will be noticeable, thereby degrading the image quality. In addition, a moir pattern may be noticeable in the displayed image if the difference between the pitch P of the Fresnel optical element having positive optical power versus the pitch of the image display elements of the image display is small. In this case, by designing the aperture ratio to be large, the artifacts of the border around the pixels and of the appearance of a moire pattern will be suppressed.
As shown in
Further, the separation between the centers of a viewer's pupils is normally within the range of 50 mm through 70 mm. For the purpose of being able to conduct an observation with both eyes, the diameter of the exit pupil for observation needs to be at least 60 mm. The larger the exit pupils for observation, the greater the freedom the viewer has in selecting observation positions and postures. On the other hand, the larger the exit pupils for observation, the less bright the displayed images will be. Therefore, it is preferred that the diameter of the exit pupils for observation not exceed 500 mm.
As mentioned above,
As shown in
As discussed above, if the distance between a viewer's eyes and the display panel 22 is insufficient, eye fatigue of the viewer will result. Thus, it is desirable that the distance from the viewer's eyes to the display panel 22 normally be 200 mm or more. Further, it is desirable that the distance from the viewer's eyes to the display panel 22 not exceed 2000 mm. When the distance to the display panel exceeds 2000 mm, the background of the display panel will enter into the field of view, and this will cause eye fatigue due to the generation of a sense of incongruity when stereo images are observed. Further, because the display panel 22 itself must be larger, a viewing distance that exceeds 2000 mm should be avoided.
Next, the affect of the size of the display panel 22 versus the angles of view ωh and ωv (with the latter angle being illustrated in
Table 2 below lists the size designator of the display panel, as well as the actual panel size in the horizontal H and vertical V dimensions when oriented in a ‘landscape mode’ view, as well as the angle of view in the horizontal direction ωH and the angle of view in the vertical direction ωV subtended by the opposite edges of the display panel.
The magnification of the optical element having positive optical power is 450/600=0.75.
Next, the affect that the size of the display panel 22 has on the the angles of view ωH and ωV for this embodiment of display panel 2 will be described.
Table 3 below lists the actual panel size in the horizontal H and vertical V dimensions when oriented in a ‘landscape mode’ view, as well as the angle of view ωH in the horizontal direction and the angle of view ωV in the vertical direction subtended by opposite edges of the display panel according to this embodiment.
Further, as shown in
In addition, on the concave Fresnel mirror 22a, a diffusion surface 22b′ that provides a scattering effect to an incident light beam is integrally formed on the light incidence surface of the concave Fresnel mirror 22a. More specifically, glass beads are sprayed onto a brass surface that has been polished, and a metal mold that has minute concave surfaces randomly arranged thereon is formed. The metal mold is then used to construct the light incident surface of a layer that is made of plastic material that forms part of the concave Fresnel mirror.
In this embodiment, the distance on the surface of the display panel that corresponds to the resolution of the human eye when viewed from a position 2000 mm distant is 2000 mm times tan (1°/60) equals 0.58 mm.
In the case when an image is projected onto the entire surface of the display surface of the display panel having a size in the horizontal direction of 1322 mm and a size in the vertical direction of 934 mm, the pitch (measured in linear units) as measured in the horizontal direction H and in the vertical direction V for each of the display formats VGA, SVGA, XGA, SXGA is listed in Table 4 below:
Further, in the case that an image is projected onto the entire surface of the display surface of the display panel having a size in the horizontal direction of 577 mm and a size in the vertical direction of 400 mm, the pitch (measured in linear units) in the horizontal direction H and in the vertical direction V for each of the display formats VGA, SVGA, XGA, SXGA is listed in Table 5 below:
Furthermore, the magnification of the exit pupil for observation is 2000/1450, which is nearly equal to 1.38.
The other construction, operation and effects of this embodiment are substantially the same as those of the previous embodiment.
The invention being thus described, it will be obvious that the same may be varied in many ways. For example, the Fresnel lens, Fresnel mirror, and/or diffuser may formed holographically, as is known in the art, or a single holographic optical element can serve as both a Fresnel lens and diffuser, or as a Fresnel mirror and diffuser. In addition, low cost copies of such holographic components may be manufactured, as is known in the art. Rather, the scope of the invention shall be defined as set forth in the following claims and their legal equivalents. All such modifications as would be obvious to one skilled in the art are intended to be included within the scope of the following claims.
Number | Date | Country | Kind |
---|---|---|---|
2003-274802 | Jul 2003 | JP | national |
2003-406275 | Dec 2003 | JP | national |
This is a continuation-in-part of applicants' co-pending U.S. patent application Ser. No. 10/270,641 entitled “Three-Dimensional Observation Apparatus” filed Oct. 16, 2002. In addition, this application claims benefit of priority under 35 U.S.C. 119 from Japanese Patent Application number 2003-274802 filed Jul. 15, 2003, and from Japanese Patent Application number 2003-406275 filed Dec. 4, 2003, both of which are hereby incorporated by reference.
Number | Date | Country | |
---|---|---|---|
Parent | 10270641 | Oct 2002 | US |
Child | 10891057 | Jul 2004 | US |