The Claimed Priority Patents and Applications disclose and claim a SYSTEM AND APPARATUS FOR THE RECORDING AND PROJECTION OF IMAGES IN SUBSTANTIALLY 3-DIMENSIONAL FORMAT. The invention described therein derives from the principles of holography and/or integral photography. The Claimed Priority Patents and Applications first disclose a basic principle of magnification and projection. This principle permits magnification and projection of 3-dimensional images uniformly in all directions, thereby overcoming drawbacks in the prior art. Based upon this principle, cameras are described, in their various embodiments, that photograph a scene and retain the 3-dimensional information therein. An editor is also described that would edit integral photographs and holograms containing the 3-dimensional information from the photographed scene. In addition, a theater is designed to project the magnified 3-dimensional scene that was photographed, upon a large screen to be viewed by an audience. Further, the projectors and screens are described in their various embodiments.
Within some of the embodiments of the camera and projector, specially prepared holograms are used as optical elements therein. Use of these holograms affords the advantage of being able to replace complex, bulky, difficult to manufacture, and expensive conventional optical elements needed to produce certain types of images during photography, magnification, and projection. In addition, some of the embodiments of the screen are themselves holograms. Unlike conventional projection screens used in current theaters, the screen described in the Claimed Priority Patents and Applications is an active optical element that, when combined with the projection optics, causes light waves to emanate from the screen into the theater that are the same as though the 3-dimensional scene were real. Therefore, the viewing audience should not be able to perform any visual test to determine whether or not the projected 3-dimensional scene truly exists. The use of a specially developed holographic screen affords the advantage of replacing more conventional optical components used in screen fabrication.
The three-dimensional images reconstructed from integral photographs are pseudoscopic. In other words, objects which should appear closer to a viewer actually appear further away, and vice versa. This would prove annoying to a viewing audience. Therefore it is an object of this invention to convert the reconstructed pseudoscopic image to an orthoscopic image (i.e., a three-dimensional image that would appear normal to a viewer).
The Present Invention is a method of forming a three-dimensional orthoscopic image from a pseudoscopic image comprising preparing an integral photograph representing the pseudoscopic image, and reconstructing a three-dimensional image from that integral photograph. Since the reconstruction of a three-dimensional image from an integral photograph is pseudoscopic, and the original subject of the integral photograph is itself pseudoscopic, the reconstruction will be orthoscopic (i.e., being the pseudoscopic transform from a pseudoscopic image).
The invention will be better understood by the Detailed Description of the Preferred and Alternate Embodiments with reference to the drawings, in which:
The present invention, in all its embodiments, is based upon a method that permits magnification of a 3-dimensional image produced from a photograph, hologram, optical system or other system or device, regardless of the medium or the method, in such a manner as to preserve the depth to height and width relationship of the image as it existed prior to magnification. This method requires the 3-dimensional image prior to magnification to be rendered as an array of 2-dimensional images by some form of matrix lens array, such as a fly's eye lens. Were this array of 2-dimensional images to be magnified by some magnification factor, and then viewed or projected through a new matrix lens array that has been scaled up from the lens array that produced the original array of 2-dimensional images, such that the scaling factor is equal to the magnification (i.e., the focal length and diameter of each lenslet must be multiplied by the same magnification factor), a new 3-dimensional image would be produced that would be magnified by the same magnification factor, and all image dimensions of the final 3-dimensional image would be proportional to the dimensions of the original image. The utility of magnifying 3-dimensional images using this method would be the ability to enlarge holograms or integral photographs or other media from which 3-dimensional images are produced, or to project still or moving 3-dimensional images before a large audience.
The magnification principle is illustrated in
Projection is merely another form of magnification. The only difference lies in the fact that no permanent record is produced as in photography. To illustrate the principle of projection, let us use as an example, the technique of rear projection shown in
The camera consists of an optical system that would produce the 2-dimensional array of 2-dimensional images on a plane, the plane and/or recording medium whereon the 2-dimensional array is produced, the mechanical apparatus (if any) associated with the image plane and/or recording medium, a means (if any) for adjusting the optical system for focus and/or special effects, and the housing (if any) that integrates the optical system, the mechanical system and the image plane and/or recording medium into a single unit. An example of the optical system is a matrix lens array such as a fly's eye lens arranged so as to produce a rectangular matrix array of rectangular 2-dimensional images. The image plane, for example would contain a film for recording the 2-dimensional images. Once developed, the matrix array photograph would be called an integral photograph. If the camera is a motion picture camera capable of capturing moving 3-dimensional images in the form of a sequential series of integral photographs, a film motion and film stabilization mechanism would be required. Finally, such a camera might require a housing to integrate the components and to provide a dark environment so as to not expose the film unnecessarily.
The projector consists of an optical system that would project a magnified image of the processed 2-dimensional integral photograph produced by the camera onto an image plane that would be converted by the screen into a magnified 3-dimensional image, the mechanical apparatus (if any) associated with the image plane and/or recording medium, a means (if any) for adjusting the optical system for focus and/or special effects, and the housing (if any) that integrates the optical system, the mechanical system and the image plane and/or recording medium into a single unit. If the projector is a motion picture projector capable of magnifying moving 3-dimensional images in the form of a sequential series of integral photographs, a film motion and film stabilization mechanism would be required. Finally, such a projector might require a housing to integrate the components and a projection lamp.
The screen consists of an active optical system configured as a matrix lens array comprised of a plurality of optical elements. The screen has the same number of active optical elements as the matrix lens array used in the camera and configured identically as in the camera. In the preferred embodiment of the system, the matrix lens array of the screen is larger than that of the camera such that the ratio of the diameter of the screen lenslets to the diameter of the camera lenslets is equal to the image magnification. However, the (F/#) of the lenslets in the screen matrix lens array must be equal to the (F/#) of the lenslets in the camera matrix lens array. Finally, the screen might consist of a mechanism to filter the color of certain portions of the projected image in order to produce a color rendition of a scene projected upon it in black-and-white.
The Claimed Priority Patents and Applications describe a number of methods for projecting the photographed scene residing on a 2-dimensional integral photograph or hologram onto a large screen thereby creating a magnified 3-dimensional image of the scene. Many of these utilize complex systems comprised of conventional optics. Conventional optical systems such as those described in the Claimed Priority Patents and Applications are expensive to manufacture, and the images produced therefrom are subject to aberration and distortion. By contrast, holographic imaging devices are inexpensive to manufacture, and images produced from them are generally aberration and distortion free. One method of accomplishing projection using a holographic imaging device is shown in
Holographic imaging devices can be used with more-or-less standard, inexpensive lenses to accomplish all projection functions.
Another task that can be performed by a holographic optical system is the conversion of the final 3-dimensional image from pseudoscopy to orthoscopy. A viewing audience expects to see an orthoscopic 3-dimensional image of a scene. Orthoscopy occurs normally where a first object that is supposed to be in front of a second object appears closer to the viewer. Pseudoscopy occurs where the second object appears closer to the viewer. This is an unnatural viewing condition that would be annoying to an audience. Unfortunately, the image produced using the basic principle of magnification and projection is pseudoscopic. Therefore, optics must be used to convert from pseudoscopy to orthoscopy.
In the Claimed Priority Patents and Applications, the most practical method and the preferred embodiment of unmultiplexing is with the use of a holographic imaging device. Not only can the entire image unmultiplexing process be accomplished in one step using such an element, but so also can both the inversion of the image from pseudoscopy to orthoscopy and the final projection (if these steps are desired to be performed using this method). The use of this method is shown in
This method of inverting a pseudoscopic image is to reconstruct the 3-dimensional image in the usual manner and then to re-photograph the reconstruction with a second camera. The reconstruction of this second film will produce a pseudoscopic image of the 3-dimensional image which was photographed. Since this image was originally pseudoscopic, the pseudoscopic reconstruction of this image would be orthoscopic. This method of image inversion is shown in
There is another basic method of producing orthoscopic images from pseudoscopic images which will not incur this resolution loss. This method was described in the Claimed Priority Patents and Applications. The basic principle is quite simple. Referring to
The method for image inversion discussed here concerns itself only with its performance in the projector. Any intermediate processing where another film must be prepared is discussed in the Claimed Priority Patents and Applications only. The proposed method is to perform this inversion during unmultiplexing when a holographic imaging device is used (refer to
Accordingly, any of the holographic optical elements described above can be fabricated in a manner so that when an integral photographic image is processed by it, the 3-dimensional image projected therefrom will be orthoscopic. This is done by optically reversing each elemental image of the integral photograph separately as shown in
Therefore, the schematic shown in
Now turning to the issue of image multiplexing, the Claimed Priority Patents and Applications describe one embodiment of the camera design that uses holographic optics to accomplish the image dissection and multiplexing. This is shown conceptually in
The preferred embodiment of the screen is an array of cylindrical zone plates with associated color filtration. Zone plates can be produced holographically. However, instead of being produced as transmission holograms, they are produced as reflection holograms. Reflection holograms are commonly manufactured by a process called Bragg-Angle Holography. In this instance, instead of the diffraction pattern being formed on the surface of the photographic emulsion which makes up the hologram, the diffraction pattern is formed in the volume of the emulsion itself. Such a holographic zone plate would have the following advantages:
(1) Since it is formed as a reflection hologram, this type of screen is applicable to front projection, the technique now in use in most theaters.
(2) A reflection holographic screen accepts white light emanating from a point source and reflects it into the audience at the wavelength with which the hologram was initially made. Since the zone plate screen consists of a mosaic of alternating zone plates, each one produced as a hologram by laser light having a different wavelength, it becomes obvious that a holographic screen of this type already has its own color plate “built-in.” Separate color filters are not required.
The screen is a Bragg Angle Reflection Hologram, which when illuminated from the front with a beam of white light having a spherical wavefront, the reconstruction will be a series of thin vertical lines, each line a different color, the colors alternating between red, green and blue, each line projected in front of the screen a distance f, and the vertical lines will be arranged horizontally across the width of the screen. A Bragg Angle Hologram is really a diffraction grating whose diffracting elements are distributed throughout the volume of the emulsion. A reconstruction can only be obtained by a reference beam of the same wavelength as was used to make the hologram. For this wavelength, the reconstruction efficiency is extremely high. If a white light reference beam should be used, only the appropriate color component will be selected to perform the reconstruction.
The screen need not be prepared as an extremely large hologram, as this would be impractical. Even in a very small theater, the screen size might be 20 feet wide×10 feet high. The mechanics of producing a hologram that large is formidable. Instead, smaller rectangular shaped tiles can be produced which are all identical. These tiles can then be assembled to produce a screen of any size.
Now we turn to the fabrication of high quality holographic imaging optics. With any ordinary optical system, when projecting a 2-dimensional image, the projected image is normally degraded with respect to the original image. This is true even at 1:1 magnification. The reason for this is that most optical systems exhibit inherent aberration and distortion. However, it is often required that a projected image have extremely high quality with minimum aberration and distortion. To accomplish this, special high quality optical systems must be used. Often such optics do not exist, and must be specially designed and fabricated. Obtaining such optics can be very expensive.
The Claimed Priority Patents and Applications disclose the requirement that projected images must be of extremely high quality, particularly during intermediate processing and intermediate projection. As special case of this intermediate projection is when it is performed at no magnification. This is very useful in certain of the final projection systems discussed in the Claimed Priority Patents and Applications. What is required is that an image be transferred from one image plane to another at 1:1 magnification with the resolution preserved, i.e., the total information must be transferred from one image to the other. Such an imaging system is typically used for a microprojector and semiconductor circuits. One such system was designed by PERKIN-ELMER several years ago. This optical system uses mirrors instead of lenses. It covers a field of two-inches. Resolution was one-micron or 500 line pairs/mm. Of course such an optical system could be constructed using lenses, but it would be more complex and very much more expensive.
Holographic optics can be used to accomplish this type of high quality image transfer or projection. Reflection holography should definitely be used since the diffraction efficiency is much higher than for transmission holography.
The discussion now proceeds to holography of a 2-dimensional integral photographic film. In this method a holographic movie film is used. However, the projected real image of the hologram is a 2-dimensional image which is projected onto a diffusing screen (or imaginary image plane). This image is the integral photograph to be projected. This process is illustrated in
In 1968, Dr. D. J. DeBitetto of Phillips Laboratories, Briarcliff Manor, N.Y., published several articles concerning holographic 3-dimensional movies with constant velocity film transport. In these articles, he described holograms produced which allowed bandwidth reduction by elimination of vertical parallax. This was accomplished by making the 3-dimensional holograms on a film strip using a horizontal slit as an aperture. The frames were formed by advancing the film each time by the width of the slit. Each frame was animated. After development, the film was illuminated as any hologram would be, and the filmstrip was moved at constant velocity. I have seen Dr. DeBitetto's holographic movies, and they are the best attempts to-date in the field of motion picture holography. The 3-dimensional pictures are of extremely high quality. However, vertical parallax was absent.
The same technique can be used in our projector. It can be used with direct holography as Dr. DeBitetto did or it can be used with holograms of integral photographs as shown in
Dr. DeBitetto takes his holograms as strip holograms in that both the holography and projection must be performed with the slit aperture. This requires the holography of a very large number of small strip frames, the animation of each frame showing only slight or miniscule motion with respect to the previous frame. This is contrasted with the method of taking holographic movies where each frame has a reasonable size both in height and in width (as would be expected in a standard format motion picture film). Obviously, Dr. DeBitetto's technique has the disadvantage of requiring an extremely large number of frames, thus making the process very arduous. However, this patent application submits that the frames be prepared in the standard motion picture format (as opposed to horizontal strip holograms), and that the frame be projected with a horizontal slit aperture. The film is used in the same way as in Dr. DeBitetto's process, and is projected at constant velocity. The image projected from the hologram onto the screen will only change in vertical parallax as the frame moves by the aperture. However, if the film format used is that previously described for holography of the original 2-dimensional integral photographic film, then the vertical parallax does not change as the frame moves by, because the projected image is 2-dimensional and has no vertical (nor horizontal) parallax. The image only changes, therefore, when a new frame comes into view. Therefore, the height of the frame required for the holographic film will depend upon the film velocity and the frame rate. This represents the preferred embodiment for the holographic projector.
Constant velocity is a tremendous advantage for projection of 3-dimensional movies. Since film registration must be held to extremely tight tolerances, not having to stop the film for each frame would provide much needed stability, and film registration would be far simpler. Without this constant velocity transport, each frame would have to be registered with the three-point registration system as described in the Claimed Priority Patents and Applications. Furthermore, constant velocity film transport reduces the probability of film breakage.
The discussion now turns to intermediate processing of the film. In the previous discussions of the formation of orthoscopic images from pseudoscopic images, image inversion was accomplished during the projection stage. It is considered more desirable to accomplish this operation during the projection stage because it can be done without the inherent loss in resolution (a factor of {square root}2) attached to a process in which a new integral photograph or hologram must be copied from the 3-dimensional projected image. Should it be desirable to make a film to be presented to motion picture theaters, which, in turn, when projected, would produce orthoscopic images, then the best method of making such films from the original would be by projection techniques previously discussed. These projection techniques can be used for film copying as well as for projection onto a screen. However, for the sake of completeness of this application, the methods for image inversion, by making a new integral photograph or hologram from the original reconstructed 3-dimensional pseudoscopic image, will be presented.
This non-provisional patent application is a division of U.S. patent application Ser. No. 09/853,790, filed May 11, 2001 and currently pending, which in turn is a continuation-in-part of U.S. Non-Provisional patent application Ser. No. 09/749,984, filed Dec. 27, 2000 (having matured into U.S. Pat. No. 6,593,958 which issued on Jul. 15, 2003), which in turn is a continuation of U.S. patent Non-Provisional application Ser. No. 09/111,990, filed Jul. 8, 1998 (having matured into U.S. Pat. No. 6,229,562 which issued on May 8, 2001), which in turn is the non-provisional counterpart of U.S. Provisional Patent Application No. 60/051,972, filed Jul. 8, 1977. The above mentioned US patents and applications will be hereinafter called the Claimed Priority Patents and Applications. This application claims priority to all the above mentioned Claimed Priority Patents and Applications. All of the above mentioned Claimed Priority Patents and Applications are incorporated by reference herein in their entirety thereto.
Number | Date | Country | |
---|---|---|---|
60051972 | Jul 1997 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09853790 | May 2001 | US |
Child | 10904920 | Dec 2004 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09111990 | Jul 1998 | US |
Child | 09749984 | Dec 2000 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09749984 | Dec 2000 | US |
Child | 09853790 | May 2001 | US |