Patent Application
20120008103
The present invention relates to a three-dimensional display system and method for using the same. More specifically, to a system and method for back-projection of coherent light images onto a three-dimensional surface defining a substantially-enclosed volume.
Humans generally find it useful or entertaining to view images or projections of visual representations of real or imaginary things. Therefore, technologies have been developed to enable us to place visual representations, such as still images and moving images, onto surfaces or screens so that we can enjoy or benefit from such visual displays.
One common depiction used for educational and recreational purposes is to depict the surface of planet Earth so that people can observe the various bodies of land and water thereon. Earth depictions can be in the form of photographs, illustrations, or other visual means. More realistic representations of Earth, the Moon, planets, anatomical structures, or other three-dimensional objects have been created by painting the image of the same onto a spherical or other three-dimensional shell or globe. The classic spinning globe atlas of Earth that can spin along a North-South axis is a standard feature in libraries, offices and homes. Medical institutions and instructional classrooms have benefited from drawn representations of anatomical features or organs (e.g., the brain) so that practitioners and students can get a clearer understanding of the structure of the organs. However, such representations usually are artists' drawn renditions, and may not have the desired or required level of detail. Also, such three-dimensional solid models lack a dynamic character that would allow the depiction of an image of an object in real time. In addition, it is difficult or impossible to selectively add or delete desired features or layers to such representations at will.
More realistic or dynamic representations of the surface of Earth have been used in products such as Google Earth from Google, Inc. of Mountain View, Calif. This product and others portray photographic images of the Earth onto computer monitor screens, giving the user the feeling of seeing the Earth from some height, either perpendicular to the terrain or at some angle thereto. However, the image is displayed on whatever display surface the user's computer monitor is using, which is generally flat or substantially two-dimensional. This is a general weakness in depicting naturally three-dimensional (e.g., spherical) objects onto flat, two-dimensional, projection surfaces.
Examples of visual projection display technologies include flat sheets of white or reflective material onto which an appropriate image is projected. These are commonly called “projection screens.” This technique for illuminating a screen can be carried out on a suitable blank wall as well, and is the basis for common cinema projection displays, home slide show displays, outdoor wall displays, etc. The principle of operation of such displays is directing a focused image (still or moving) onto the projection screen or surface. The image is then reflected off the screen or surface so that it can be seen by observers on the same side of the projection screen plan as the device projecting the image onto the screen. Some drawbacks to this technology include that the projector device (e.g. movie or slide projector) and the screen are two distinct (usually large) pieces of equipment that require focusing and aiming of the projector onto the surface of the screen. Also, in such systems, as the projector and the viewing audience are on the same (illuminated) side of the projection screen the audience may be disposed between the projector and the projection screen. This requires special care so that the projector is not illuminating its audience from behind, and casting a shadow onto the projection screen, resulting in the well-known “down, in front!” complaint from the rest of the audience trying to enjoy the image. In these systems, the image can be said to be frontally projected onto the screen because the incident light from the projector device is reflected off of the frontal face of the projection screen, and both the projector (light source) and the viewer are on the same (frontal) side of the projection screen.
Another example of visual projection display technologies includes television sets and computer monitors and similar devices. Here, an image is projected from the “back” face of the screen and instead of being reflected off the screen, is scattered by the screen material and travels through the screen to the eye of the beholder. Such screens are illuminated through “back projection” by a projector or source of light that is on the opposite side or face of the screen than the viewers looking at the image on the screen. Therefore, these systems do not suffer from the viewer him or herself interfering with the path of light projected from the projector onto the screen.
Present back-projection systems typically project computer-controlled colored light onto a screen capable of scattering the projected light to form the image on the screen. Present systems require focusing and are generally projected onto flat surfaces or nearly flat surfaces, such as computer monitors or television screens. Some prior art includes back projection onto a non-flat screen, however, these prior systems suffered from limited clarity and focusing problems because the light used by their projectors was not coherent. Also, these prior systems lacked a true range to cover a substantial three-dimensional projection screen because of the cumbersome mechanisms that had to be installed on the side of the screen facing the projector, thereby limiting the solid angle that could be displayed on the projection screens of traditional back projection systems. Also, prior systems were generally incapable of producing dynamic images and more complex and interesting or useful images, and in many case were only capable of providing static or quasi-static images on the screens. In addition, presently available coherent light projection systems generally only scan a coherent light source over the projection surface, and don't include appropriate modulation components for the applications discussed below. In addition, present systems can require excessive power and cooling mechanisms that are not practical, desirable, or possible in the applications as discussed below.
Some present systems purport to project images onto a convex mirror that is mounted inside of a projection screen, the mirror being in a predetermined position facing the projector. This approach fails to achieve a proper focus over the extended projection screen due to the varying image distance in relation to the screen and the convex mirror geometry. Also, in existing systems of this type, the size of the screen cannot be changed without adjusting the mirror and the optics, which is not possible and/or not practical or cost effective. Also, the solid angle that could be displayed on the projection screen is limited by the mirror, which casts a distracting shadow that detracts from the projected image.
Other present systems require the use of custom optics to achieve a variable focal distance to attempt to match the corresponding distance from the image projector to the three-dimensional screen. This method displays images in fair focus at closer range, eliminating the shadow. However, numerous limitations of this type of projection system have not been overcome. For example, it is not possible to substantially cover a spherical or other substantially enclosed three-dimensional screen with a clear true focused image using this system. Furthermore, when alterations are made to the screen size, distance, or shape, corresponding custom alterations would also be required to be made to the lens in order to function properly. Such custom lens design is not available and/or not practical or cost effective, therefore, these systems cannot satisfy a need for a variable-focal length projection coverage of a three-dimensional screen.
The systems described above typically employ a conventional non-coherent light source such as a UHP lamp. Conventional non-coherent projector systems require collocation of their incident light beams to form a clear, sharp, focused image onto the projection surface, and a focused image is generally formed in one plane at a given distance from the projector.
Other existing systems project light into an expensive and cumbersome inflatable balloon by means of a fiber optic tether, which carries light and power to a scanning deflector module and projection head. Limitations of this system include its undesirable size, cost, safety concerns, reliability, and efficiency. These systems use mixed gas lasers which deliver very high amounts of laser energy in the visible spectrum. As a result they require a very high electrical power input and a commensurate cooling capability to prevent overheating. These systems also require a three-phase power supply, 220 volt circuit running on a 45 A breaker per phase. This system also has a very high discharge current and is extremely costly to own and maintain.
The cost to own an ion laser is tens of thousands of dollars annually. Mixed gas lasers also emit a very large amount of heat requiring a continuous water supply for cooling. By combining water and high voltage together in the same unit, a mixed gas ion laser puts the user at great risk of electrical shock.
This system is also very bulky, needing roughly 9.5 cubic feet of space and weighing over 200 lbs. Ion Laser tubes contain Beryllium Oxide, which is carcinogenic if ingested or inhaled, so extreme care must be taken when handling this type of device.
These types of lasers are currently used in commercial laser light shows, and are the preferred laser types for such displays due to the high output. In a large scale multimedia display such as a stadium, great care must be taken to ensure the safety of the observers. The inner workings of the system must be off limits to people unless properly trained to handle such equipment.
There is a need for a three-dimensional back-projection display system that can overcome, inter alia, the limitations of the prior art by eliminating focal difficulties, cumbersome mirror assemblies, custom optics requirements, costly and impractical light source cooling, and distracting shadows cast onto the display surface. Some examples have been described by the present inventors and assignee in earlier related patent applications, referenced above. This application continues with further details of preferred embodiments and components to provide such features.
Various embodiments of the present invention are directed to an image projection system having a coherent light source configured to emit coherent light in a visible portion of the electromagnetic spectrum; a microdisplay array that receives the coherent light from said coherent light source and provides a controlled coherent light output representing an image; an optical lens assembly that operates on the coherent light output of said microdisplay array and delivers a corresponding coherent light output for projection onto a projection screen; a projection screen having a three-dimensional configuration substantially defining an enclosure volume through which the coherent light output from the optical lens assembly travels to be incident upon an inner surface of said screen; wherein said projection screen is constituted to have an inner surface, an outer surface, and a composition there-between; and wherein said projection screen and said composition are configured and arranged to receive the coherent light output from said optical lens assembly and to present a corresponding viewable image that is observable from outside the enclosure volume.
Other embodiments are directed to a method for projecting an image onto an interior surface of a projection screen, including the steps of generating coherent light in a visible portion of the electromagnetic spectrum from a coherent light source; providing said coherent light as an input to a microdisplay apparatus; controlling said microdisplay apparatus to achieve a coherent light representation of the image as an output of said microdisplay apparatus; providing said output of said microdisplay apparatus as a coherent light input to an optical lens assembly disposed substantially within an internal volume at least partially defined by said projection screen; and affecting the coherent light input of the optical lens assembly within the optical lens assembly so as to project a coherent light output from said optical lens assembly outward from the optical lens assembly and onto the interior surface of the projection screen to form a visible image viewable from outside the projection screen.
In some aspects, the present systems allow for projection onto substantially arbitrary three-dimensional surfaces like the interiors of curved or volumetric projection shells. This may be performed including if the projection surface or shell is replaced with other projection surfaces or shells of different configurations, geometries, shapes and sizes without needing to adjust or replace the optics within the system. The image will remain substantially visible, useful, sharp to the eyes of the user because of the use of coherent light rays to produce and cast the image onto the projection surface.
Also, ray crossing is minimized in the present systems, and in some cases eliminated as the rays are controlled by the optics of the system. In some embodiments there is no need for intermediate image planes or focusing of the rays of the image onto the projection surface. The overall resulting system is simple to make and use, and will cost less to produce than traditional systems.
Speckle reduction or elimination and noise filtering are possible herewith.
Optical components for controlling the path of the coherent light rays include positive (converging) lenses, negative (diverging) lenses, prisms, mirrors, or other elements as appreciated by those skilled in the art.
As discussed above, it can be useful to project onto or illuminate a three-dimension projection surface so that it displays a visual image that is either static or moving. Present systems are not able to effectively project such images to substantially cover a spherical projection surface due to focusing, distortion, interference, and other limitations.
The present disclosure describes novel projection systems and methods for operating the same that place coherent light from a rear projection source onto an interior surface of a substantially-enclosed three-dimensional non-opaque projection surface such as a sphere. The projection surface diffuses, scatters, or passes the light projected onto its interior surface so that a viewer observing the outer surface of the spherical projection screen may observe the projected images. The images may be projected from a projection apparatus coupled to an apparatus for processing and storing still or live images, or the images may be downloaded from another storage source or an image sensor such as a still or animated camera. The images may further be transmitted from a source to a destination over a network such as a LAN or a WAN or the Internet itself.
The systems described and claimed herein do not suffer from the problems associated with conventional three dimensional image projection systems in part because they employ a coherent light projection apparatus instead of a conventional non-coherent light projection apparatus (e.g., UHP, lamp, arc lamp, incandescent, light emitting diode “LED”). Conventional non-coherent projectors require collocation of their incident light beams to form a clear, sharp (focused) image onto the projection surface, and a focused image is generally only formed in one plane at a given distance from the projector. This fact limits conventional non-coherent projectors to projecting a focused image onto a substantially planar, or flat, projection surface. By contrast, coherent light sources form a sharp image that can remain clear and focused (while focusing is not required) at essentially any distance from the source of coherent light. Therefore, when combined with a wide angle lens greater than 90 degrees, coherent light projectors can form a clear and sharp image resulting in greater than hemispherical coverage on a substantially spherical substantially-enclosed projection screen. Coherent light projectors are also capable of providing a higher resolution image with greater color gamut, lower power consumption, and longer life expectancy than conventional non-coherent image projectors are capable of.
Some embodiments of the present invention use at least one vertical cavity surface emitting laser (VCSEL), or an optically or electrically pumped vertical extended cavity surface emitting diode laser (VECSEL) capable of emitting highly collimated coherent light, illuminating a microdisplay. Laser light is much more directional than non coherent light, providing more luminescence and less beam scatter than other types of light. Lasers are a common source of coherent light, and are typically XvYCC compliant, capable of displaying the substantial range of colors viewable by the human eye. By illuminating a microdisplay with a VCSEL or VECSEL laser light source, an ultra high definition, full color, coherent image is formed witch retains the properties of coherent light, having a great depth of focus. This allows for fewer and cheaper optical components in the display system than in a system that doesn't use coherent light sources. In some embodiments, low-power laser light sources are employed to generate the coherent light, with the low-power laser light sources being compact enough and consuming little enough energy so as not to require active cooling of the laser light sources. In some embodiments the low-power laser light sources require less than about 1 Watt (W) of energy during operation. In other embodiments, the low-power laser light sources require less than about 0.25 W of energy during operation.
The present system can include components for adjusting the coherence of the coherent light used. An in-line coherence adjustment element may be used to reduce speckle in the projected image in case of excessive speckle that may result from interference of coherent wavefronts that are subject to phase or intensity fluctuations. One example of such an element for controlling the diffusion of the coherent light is a diffusion filter that can be placed in-line with the light rays' path.
The optics are configured to project the image over a solid angle of roughly equal to or greater than 180 degrees to achieve substantially spherical coverage over the internal surface of the globe projection shell. It is possible in some embodiments to employ lenses that spread the incident coherent light out over a solid angle of almost 360 degrees by using the right lens. This proves very useful when projecting into certain asymmetrical shapes. By positioning the optics toward any side of a substantially closed projection shell facing inward, complete focused coverage minus the optics is achieved, filling any substantially closed projection shell, regardless of size or symmetry, without the use of custom optics and cumbersome mirrors. Efficiency and safety are substantially increased, while creating a truly modular screen system with no shadows.
The present systems are primarily intended to produce visible intelligible images representing real or abstract objects. The images may be of colored or monochromatic nature. Colored light produces corresponding color images with respective characteristic wavelength content. Light wavelengths are representative of oscillations in the electromagnetic energy which is known to run a range of wavelengths in “the electromagnetic spectrum.” Light of different colors generally includes characteristic wavelengths corresponding to the different colors, with violet and blue colors having shorter wavelengths (and higher electromagnetic field oscillation frequencies) than orange and red colors, which have longer characteristic wavelengths (and lower electromagnetic field oscillation frequencies). In that regard, the present system includes the ability to produce and project visible light. Visible light is light having characteristic wavelengths (and combinations thereof) in the visible portion of the electromagnetic spectrum, and includes light with wavelengths between about 380 nm and 780 nm, and even between about 400 nm and 700 nm.
A VCSEL is a type of semiconductor laser diode with a laser beam emission generally and substantially exiting the device perpendicular from the top surface. Work on VCSELs began in the late 1970s and VCSEL devices are used in optical fiber data transmission applications. A VECSEL is a small semiconductor laser similar to a VCSEL. Unlike a VCSEL, in which two highly-reflecting mirrors are incorporated into the laser structure to form the optical cavity. In a VECSEL, a partially reflective mirror is added outside of the chip, but still inside the pump-laser housing to further intensify the beam. VECSELs do not require external cooling and can run on 5 watts of power for two hours using 4AA cells. A ultra high performance (“UHP”) lamp requires an external fan and uses significantly more power than a comparable VECSEL source. In some embodiments, the present invention uses a VECSEL coherent light source to generate the coherent projected image.
VECSEL devices can provide almost 100% light output for 20,000 hours compared to a mixed gas ion laser which has a 2,000-5,000 hr tube life, and a UHP lamp which has roughly a 2,000 hour life span. So the replacement of these components is both frequent and costly. Replacement tubes for ion lasers cost about $8,000 to $10,000, and a replacement arc lamp costs about $500. VECSELs are also “instant on” sources, meaning when the laser is turned on, the light output is substantially instantly available at full power.
Additionally, VECSEL sources can be mass produced more easily than other types of sources, so they can be produced more economically than other sources. VECSELs are manufactured in a monolithic array format, allowing for low cost power scaling, speckle reduction and redundancy. All components are wafer produced and fully tested at wafer level, and they are line assembled with easy tolerances. Cost is much less than a mixed gas ion laser, and can be produced cheaper than UHP lamps at a rate of over one million laser array chips per year. A state of the art GaAs wafer fabrication facility can produce several million VECSEL array chips per year. A VESCEL array chip can emit very bright, highly collimated, polarized, coherent light providing very high contrast for diffractive, reflective or transmissive microdisplays such as Liquid Crystal On Silicon (“LCOS”), Liquid Crystal Display (“LCD”), Digital Light Processor (“DLP”), and grating light valve (“GLV”), while eliminating the need for costly polarizing filters.
While most present projection screens and surfaces are flat or substantially planar, it can be useful to project images onto spherical or other three dimensional projection screens. For example, there is potential educational, utilitarian, and entertainment value in having dynamic images projected from within onto a substantially spherical or other three dimensional projection screen through a wide angle lens. In one instance, images of the Earth's surface could be projected by the coherent source onto the interior surface of a spherical projection screen. The Earth, or other celestial bodies such as stars, planets, moons, or others are generally substantially spherical in shape. Therefore, projecting an image of the surface of these bodies onto the interior surface of a spherical screen in a way that allows a viewer looking at the exterior surface of the screen to see the image provides a more accurate view of the object being examined than if it was projected onto a flat surface.
A map projection of the earth designed so that a straight line from the central point of the map to any other point gives the shortest distance between the two points is generally referred to as an azimuthal equidistant projection. This enables a single flat map to represent distances and directions on the Earth's surface. This type of map projection is used in navigational and defense purposes.
In using a substantially spherical or three-dimensional projection surface for projecting an image of the Earth, the present “globe” projection surface allows layering of other visible data onto the Earth image. For example, the layered images can display and label various active forces such as global warming, plate tectonics, weather, demographic, political, economic, and other data. Historical data can also be displayed such as past and current country, state, and political boundaries, time zones, grid and vector data, and famous voyages. The system thereby can provide both temporal as well as spatially dynamic displays of information for educational, utilitarian, or entertainment purposes. The system can additionally be constructed to display color animated light shows to digital music and educational tutorials describing in more detail any science associated with the globe.
In some embodiments, lens 14 is a glass, quartz, or other optical material that is adapted to carry and light beams in the visible range of the electromagnetic spectrum (visible light). Lens 14 may be a single lens or a compound set of lenses designed to provide the effect of a wide angle lens that spreads incident light beams outward onto the interior surface of screen 16. Lens 14 may be equipped with coatings and imbued with optical or chemical additives to enhance its performance in spreading the incident light 12 and redirecting it as 18. A simple example lens 14 has a back (input, or incidence) side that receives as input an incident laser image 12 that is generated by a laser projector below the lens (not shown) or that arrives at the lens 14 by way of other lenses, mirrors, or optical components. The incident image 12 can be a static image or a dynamic moving image (e.g., a video stream). The convex shape of lens 14 causes the individual light beams therein to deflect from their original direction and are redirected according to the size of the lens 14, its shape, curvature, composition, and wavelength of the light in incident image 12. The fish-eye lens 14 can be a semi-spherical section or derivation thereof, including a 180-degree lens that can deliver light to substantially a 360-degree region of the interior surface 17 of spherical projection screen 16.
It is noted that projection screen 16 includes an inner portion along an interior thickness of the screen that has scattering elements to cause scattering of light incident of the interior surface 17 of screen 16. The scattering may result from the purposeful inclusion of scattering particles such as beads, bubbles, dust, glitter, shavings, fibers, and the like. The scattering may also be provided by a coating or other mechanical or chemical treatment of the interior surface 17 of projection screen 16. Frosting can also be used to scatter incident light beams from the interior surface 17 of screen 16 so that the beams are redirected in a plurality of directions. After passing through the scattering interior portion of projection screen 16, the light passes through the light-permissive exterior portion 19 of the screen 16. This can be accomplished by using common glass, acrylic, crystal, or other transparent or substantially transparent layers on the outside surface 19 of screen 16. It is possible to construct a projection screen 16 to suit the present inventions where the entire thickness of the screen includes frosted or scattering elements as described with regard to the interior surface 17 portion above. That is, the material of screen 16 does not necessarily need to be constructed from layered or graded material, but can also be constructed from uniform scattering material. Finally, the scattering material, treatment, frosting as discussed above may be disposed at or near the exterior surface 19 of projection screen 16.
In some embodiments, the screen is formed from a glass, polymer material, plastic, acrylic, or the like and is provided with micro-beads within the material. The micro-beads have optical properties such as a selected index of refraction, or range of indices of refraction, that causes the light rays incident on the screen's interior surface to diffuse within the screen before being sent out the screen's outer surface. In other embodiments, the interior surface of the screen is mechanically, chemically, or otherwise treated or coated to cause it to have a surface texture that diffuses the incident light. For example, the interior surface of the screen can be scratched, rubbed, knurled, dimpled, or have raised microscopic features that scatter and diffuse the incoming light for better viewing at a variety of angles. The interior projection surface can also be coated or laminated with a second or multiple layers that provide desired optical properties to the screen. The exterior surface of the screen 16 can be smooth, or coated or textured to reduce glare and enhance the viewing contrast and overall aesthetic experience.
Image distortion, sometimes referred to as the “barrel distortion” can occur with wide angle lenses in general, and is addressed by the present invention. A cause of the distortion is that, ordinarily, the incoming image 12 is typically formed for use with a flat projection screen like that of a television or a computer monitor instead of a curved, spherical or three-dimensional screen. When the image is spread out as shown by beams 18 of
According to embodiments of the present invention, the screen body is contoured into three dimensions rather than a conventional flat (generally two-dimensional) screen. In some examples, this provides substantial or extreme curvature of some or all portions of the projection screen such as to form a substantially spherical or similar highly curved surface onto which the internally back-projected image can be displayed. The formation of the screen can be done in several ways, including by molding, bending, blowing, forming, extruding, or otherwise processing sheet material to form the body of the screen 16. The screen 16 has an inner surface 17 that faces the projection source and an outer surface 19 that the viewer beholds when viewing the projected image. The screen is designed with optical properties that permit it to be back-lit (from the inside) so that light can pass from its inner surface 17 outward to its outer surface 19 and beyond. However, the screen is not completely transparent so that the viewer does not become distracted with the inner components of the projection system and so that the projected images are properly visible and diffused by the screen. Therefore, for viewing at a range of angles, the projection screen can be designed to scatter and diffuse the incident light arriving at its interior surface, which will send light corresponding to the incident light at any given spot on the screen into multiple directions, including substantially all directions, including especially substantially all directions outside projection screen 16.
In one exemplary embodiment, the present invention provides a fully interactive digital back-projection of the surface of a planet (e.g., Earth) on a globe-shaped projection surface, where the globe displays some or all aspects of movement (e.g., rotation) associated with the Earth. Other aspects such as Earth's atmosphere can also be depicted thereon. Azimuthal equidistant images of Earth are provided from a computer-readable source by way of a computer to a microdisplay which is illuminated by a coherent light source. The microdisplay and the computer can be directly or indirectly coupled to achieve the imaging desired at the microdisplay. The system creates a coherent visible signal or image to be sent through an optical element with roughly a 180 degree field of view (FOV). The optical element is mounted at an outer edge of a substantially spherical projection shell, as described above, and sending the coherent visible signal or image towards an internal surface of the projection shell which enables an observer looking at an outer surface of the projection shell to see the visible signal or image.
The three-dimensional projection screen or shell can be formed from glass, polymer material, plastic, acrylic, or the like. The interior surface of the shell can be mechanically, chemically, or otherwise treated or coated to cause it to have a surface texture that diffuses or scatters the coherent light. The shell can be scratched rubbed knurled dimpled or have light diffusing or scattering polymers that scatter and diffuse the incoming coherent light for better viewing at a variety of angles. The interior projection surface can also be coated or laminated with a second or multiple layers that provide desired optical properties to the shell. The exterior of the shell can be smooth, coated, or textured to reduce glare and enhance the viewing contrast. The shell can be custom tinted to enhance the overall viewing experience.
In some embodiments, the system also comprises a housing or case which acts as a decorative enclosure internally housing and protecting various optical and electrical components that provide computational functions or the output of audio and coherent visual data. The housing can further comprise a manifold for power distribution and electrical surge protection, and an air circulation system for the removal of excess heat generated by the various electrical components. The housing also provides a surface for mounting connections to streaming data, standard electrical service, a user interface, and the input and output of audio. This can be done in the form of an mp3 “dock.” In some instances, the housing supports the projection shell and completes the globe's physical dimensions.
Projection system 200 delivers coherent images 210 to for display on a three-dimensional projection surface that substantially encloses or defines an internal volume 211. The three-dimensional (e.g., partial sphere) projection surface is coupled to a housing 212 which houses and protects various electrical and mechanical components of the system 200 as well as the output of audio and coherent visual data. The housing 212 also provides a surface for mounting connections to streaming data 21, standard electrical service 22, a user interface connection 23, and an input and output of audio connection 24. The housing 212 further provides a surface for mounting a cooling fan 213, an air circulation vent 214, a battery 215 or other source of electrical power, and a manifold for power distribution 220.
Projection system 200 also includes one or more apparatus for processing electronic data, instructions, or signals. For example a processor 230 which receives power from another portion of the system and includes connections for electrical power, and cooling means. The processor 230 controls most or all logical operations of the present system, and is typically disposed on a printed circuit board or other type of suitable motherboard 232. The functions of processor 230 are myriad, some of which are described in greater detail elsewhere with respect to image processing and other numerical and logical operations used to properly project a coherent light image onto the present three-dimensional screens. The processor can perform operations on the information and data it receives and provides an output that corresponds to signals to be sent to form the projected image and/or sound from the system. One type of operation performed by processor 230 is the pre-distortion mentioned above to compensate for geometric (e.g., “pincushion”) distortion from the lens projecting onto the projection surface. Other processing operations known to those skilled in the art include for example format conversion, amplification, decompression, decoding, and other signal processing operations.
Other components coupled (directly or indirectly) to motherboard 232 include memory apparatus 240, network connection apparatus 241, and input apparatus 242. The memory apparatus 240 provide the processor 230 with access to instructions and data stored on memory apparatus 240. The memory apparatus 240 can be in the form of random access memory (RAM) 243 which takes the form of integrated circuits that allow the stored data to be accessed in essentially any (random) order without physical or mechanical movement of the storage medium. An optical drive 244 which can read and write data on optical disks. A hard drive 245, which is a permanent storage device used to hold data. Flash memory 246 which is a form of non-volatile computer memory held on memory cards that can be electrically erased and reprogrammed.
The network connection apparatus 241 is used to provide a link to a wide area network (“WAN”) via the Internet or satellite transmissions or other means of communicating with remote systems over a wired or wireless network. The present system 200 and the components thereof can use a variety of connectors and protocols for carrying data and signals thereover, including TCP/IP with Ethernet connectors, USB connections, Firewire IEEE connections, Wi-Fi 802.11, Bluetooth, and others being known or becoming available.
The input device 242 gives the user the ability to control the input and output of visual and audio data to the system 200. Examples of input devices 242 include, but are not limited to, integrated touch-screen, mouse, keyboard, track ball, track pad, joystick, click wheel, and remote control etc. Further examples of user interface devices are given elsewhere in this document and are known or will become known to those skilled in the art. In general, content is selected for display on the three-dimensional projection surface by a user through input device 242.
Processor 230 sends data received from the memory 240, with or without processing the data, to at least one optional audio speaker for generation of sound to accompany the coherent projected images. Output from processor 230 is a coherent light source 260, a microdisplay 270, an optical element such as a wide angle lens or array of lenses 280 as discussed elsewhere.
The coherent light source 260 directs colored light (e.g., red, green, and blue coherent light) 261 toward microdisplay 270. By illuminating the microdisplay 270 with coherent light, a full color high definition coherent image 210 is formed. The coherent image 210 is directed toward optical element or assembly 280, which consists of shaped pieces of transparent material with opposing surfaces that are contoured to allow the coherent image 210 to subtend an output projection angle. This angle can substantially cover the three-dimensional projection surface, and may be roughly equal to, equal to, or greater than 180 degrees to give almost or substantially 360-degree coverage in some embodiments. The three-dimensional projection surface can consist of any substantially enclosed three-dimensional space large enough to accept the optical lens element or assembly 280.
A coherent image which leaves the microdisplay 270 is directed towards an optical lens element 280. It is worth describing some basic types of lenses or lens components that can be used as part of lens element or assembly 280 in various present embodiments. The power of a lens is measured in millimeters and is known as the focal length. The focal length is the distance between the focal plane and the optical center of the lens. In addition, there are generally two types of wide angle lenses: short-focus lenses and retrofocus lenses, which can individually or in combination with other optical elements be used to construct an appropriate lens assembly 280 for the present purposes.
A fisheye lens is a type of lens that has a wide field of view, including some having a very wide field of view covering a broad solid angle. Fisheye lens angles of roughly 180 degrees can also produce what is known as “barrel distortion,” where the image magnification decreases with increasing distance from the optical axis. In the context of photography, fisheye lenses which can cover or capture substantially hemispherical views may produce this type of distortion as a result of a hemispherical scene being projected onto a two-dimensional photographic medium such as film. This tends to give the image of objects with straight lines that do not radiate out from the center point of the photograph a warped appearance, while leaving lines which do radiate out from the center straight or less distorted. In some or all embodiments of the present invention, this type of lens is suitable for projecting azimuthal equidistant images as is discussed in more detail elsewhere in this document. Note that equivalent optical apparatus, whether analog or digital, and whether electronic or mechanical, or combinations thereof, that accomplish the same or substantially the same function as lens assembly 280 are comprehended by the present disclosure and associated claims.
Microdisplay 270 is a display having compact physical proportions, as suitable for the application at hand. For the present applications, a microdisplay typically has a screen size less than about 5 diagonal inches, and even less than two diagonal inches, or even less than 1.5 diagonal inches, but these dimensions are not intended to be limiting of the present description or other embodiments that are and will be apparent to those skilled in the art. The precise action of the microdisplay 270 is to control the coherent light delivered to the lens element or assembly 280. This same or equivalent function is accomplished using “light valves” or “light modulators” as known to those skilled in the art. Three specific examples of types of microdisplays 270 suitable for some or all present embodiments include “reflective” microdisplays and “transmissive” microdisplays, and “diffractive” microdisplays, depending on the specific embodiment and application under consideration.
The use of a coherent light source in the present context allows for the system to operate with a small-sized microdisplay, which is able to be made smaller than what would be required if the light source was non-coherent (e.g., ARC lamp). The small microdisplay can be address electrically or optically to achieve its function.
In some embodiments of the present system, the coherent light source's output covers a cross-sectional area substantially equal to, slightly larger than, or slightly smaller than the area of the microdisplay.
In other embodiments, a lens system or an array or collection of specially-selected (e.g., magnification, de-magnification) lens components or optical elements is disposed between the optical source and the microdisplay so as to more evenly distribute the coherent light from the light source onto the surface of the microdisplay. In some specific embodiments, this may provide a substantially uniform light intensity across a substantial (e.g., one half or more) fraction of the microdisplay's surface area. In yet other embodiments, an optical element, such as a diffractive element, is placed in-line with the output of the light source so as to further concentrate or intensify the light incident upon the microdisplay.
Still other embodiments hereof employ a scanning apparatus disposed between the source of coherent light and the microdisplay so as to cause a scanning of the coherent light onto the surface of the microdisplay. In particular examples, the scanning is done in a raster or Cartesian or x-y grid pattern as determined by the scanning apparatus.
As mentioned above, the projection system 200 can be coupled to external sources of information over a network. Examples of such sources of information include image repositories (including still and moving images) or a live camera feed, or a national, local, regional or global weather system, economic market data sources, sensors, including environmental and biometric sensors, satellite camera sources, aerial camera sources, traffic systems, libraries, or other sources in order to receive information, for display on the contoured surface. The data can be controlled to display current (real time) information or historical information (past times) or predicted information (future times).
Processor 230 can be a part of a computer system, such as a personal computer (“PC”) or workstation, and may in fact be a PC or a modified PC as needed, and may be implemented in a central processing unit (“CPU”), graphics processor, or other processing unit suitable for this purpose. Processor 230 can also receive inputs in various embodiments from control devices, including a user interface control pad, which allows a user to control the system, including controlling the images projected onto the projection screen.
User interactivity can be accomplished locally or remotely by using at least one input device. Input devices are sometimes referred to as input or user interface peripherals. A peripheral is added to the terminal computer in order to expand its abilities. The term “peripheral” is sometimes applied to devices that are connected to the system externally, typically through some form of computer bus connection, or communicate with the host wirelessly. However, the user input device 242 can be physically mounted to the housing 212 and can be hardwired or integrated with the underlying computer. Examples include touch screens and multi touch screens and others as described herein.
In some embodiments, a user can use actuation controls on the control pad 510 to control the orientation of a projected image on the contoured projection surface. In one embodiment, the control pad 510 includes special hardware for use by the user. In another embodiment, the control pad includes software for controlling the system. In still other embodiments, control pad 510 includes both hardware and software for controlling the system. The control pad 510 can also be used by software designed with the system to correct or adjust the image by adjusting for distortion, contrast, brightness, color, sound volume, etc.
Control pad 510 can also be used to perform functions such as turning the system on and off. Also it can be used to control which data is selected for display on the projection screen and in what form. For example the interface is used for turning on or off various data layers shown with a display of the Earth (e.g. cloud cover).
A grid overlaid onto the globe may be included in the projected image or added thereto for example to represent the latitude and longitude lines on the surface of the Earth. The control pad 510 can also be used with software to pan (translate) the image or zoom (magnify) in or out of a selected location on the surface of the globe. The user can thereby navigate to a location on the globe and control the appearance of the image on the projection screen.
Referring to
Referring to
Numerous uses of the present system to illuminate and enhance the interior spaces of a home, theater, office, or other enclosure can be developed. For example, to experience something that a user cannot or does not want to experience in person is one possible type of application for the present system. Consider a person with a physical handicap who would like to experience the effect of walking through the woods, or a person who would like to simulate a car or bicycle race but isn't able to physically participate therein. The person may have previously-stored images (and optionally sounds) from the venue transmitted through the present projection systems onto the interior surfaces of a room the person is in so that the person can virtually enjoy the experience. Also, for scientific purposes, a person may experience the inside of a normally-inhospitable environment such as a cave or a volcano without being in physical danger. Cameras and optionally microphones may capture images and optionally sounds form an environment and bring that information to the projection system for presentation to a user. In some embodiments, the camera and optional microphone may be transmitting substantially real-time information from a remote location, such as the Tour de France bicycle race course, for example being mounted on one of the bicycles or vehicles at the race, and the user can experience that event almost in real-time. The same effect can be edited and time-delayed for broadcast in the way best suited for the application at hand.
As discussed earlier, the present invention is capable of providing focused coherent light images onto a variety of three-dimensional projection surfaces. In some instances these projection surfaces have substantial curvature, depth, or even angular facets. This is distinct from present back-projection systems that project onto a substantially two-dimensional or flat (e.g., television, computer monitor) screen, and is distinct from projection onto the back of a slightly curved but otherwise two-dimensional cathode ray tube (“CRT”) screen that has been in use for some time. These conventional (e.g., television, computer monitor) screens are not fully three-dimensional and cannot provide the same experiences as the presently-described projection surfaces. In the present invention, the highly-curved three-dimensional projection screens cover a spherical section with a substantial three-dimensional enclosed volume like a cup, dome, ball, and other such shells. Note that the shells are not necessarily hollow, but can in some embodiments include solid (filled) shapes that accomplish the same effect. In many present embodiments, the projection screen covers enough spherical section so as to provide greater than 180-degrees (hemispherical) solid angle projection. In yet some other embodiments, the coverage extends to at least 270-degree solid angle. In yet further embodiments, the coverage extends even to coverage exceeding about 300-degree solid angles.
Note that the microdisplay 1630 may be a reflective type, or it may be a pass-through type. A reflective element (e.g., a mirror or a prism) can redirect the path of the coherent light as needed, upstream or downstream of the microdisplay. A diffuser such as a rotary diffuser 1650 can be used to reduce speckle in projected image.
A diffusing filter 1770 is located at principal focus 1780 of converging lens 1720 (whether or not the rays take a straight or deflected path en route to focus 1780) and serves to reduce speckle interference in the projected image. Image data is modulated onto the light rays by microdisplay 1720 and travels to be incident on a first converging lens group 1740. Converging lens group 1740 provides positive optical power to the coherent light rays passing through lens group 1740 and providing a coherent light input to a diverging lens group 1760. Diverging lens group 1760 spreads light rays out to a solid angle of roughly 180 degrees or greater, in some aspects this spreading occurring substantially with no ray crossing in or beyond the diverging lens group 1760. In some aspects, the light output of diverging lens group 1760 corresponds to the light output of (transmissive or reflecting) microdisplay 1730.
Image data is modulated onto the light rays by microdisplay 1820 and travels to be incident on a first converging lens group 1840. Converging lens group 1840 provides positive optical power to the incident coherent light rays and provides an input to a diverging lens group 1850. Diverging lens group 1850 spreads light rays out to onto an internal surface of a projection screen as shown earlier. In some embodiments the diverging lens group 1850 may include a fish-eye lens. In other embodiments, the diverging lens group may include a fish-eye lens combined with other lens components. In some aspects this diverging lens group 1850 provides an output comprising a solid azimuthal angle of about or over 180 degrees and covering the entirety of the solid angle about the axis of symmetry of said lens group 1850 (towards the top of the page in the present example). The light output of diverging lens group 1850 therefore corresponds to or matches the output of microdisplay 1820.
Converging lens group 1920 focus light rays to a primary focus 1980 of light source 1900. An inline diffusing filter 1930 is disposed on primary focus 1980 and serves to reduce speckle interference in the projected image. Collimating lens assembly 1940 re-directs light rays to travel substantially parallel to the optical axis. A rotating diffuser 1950 is also optionally applied within parallel beam to further reduce speckle in the projected image. Parallel beam travels to be incident on a microdisplay 1960, where it is modulated with image data to form a coherent image, which travels to be incident on the input side of a diverging lens group 1970. Diverging lens group 1970 serves to spread the parallel beam outward to a solid angle of roughly 180 degrees or greater. As said before, the microdisplay 1960 may be of a reflecting type (shown) or an alternate, non-reflective or transmissive type. And as mentioned before, the diverging lens assembly 1970 provides ray casting features that allow projection of the images from such apparatuses substantially without ray crossing within said assembly or beyond in the light path towards the projection screen surface.
The diffusion filters may comprise hardware (optical elements) to reduce speckle noise and enhance coherence of the light passing through the present systems. In some aspects, said filters provide a balance between image quality and retention of details in the image due to its anisotropy. Additionally, image processing techniques can be used along with or to supplement the use of said diffusion filters.
In this example, light rays 2100 are incident upon a microdisplay at an undesired angle, throwing the image off axis thus creating a keystone effect common with image projectors. By tilting lens element 2120 slightly, light rays are directed to image plain 2130 with improved ray spacing and improvement in the overall projected image. By adding a first half silvered mirror (or prism) 2130 in-line, and re-directing the rays to a second mirror 2135, the incident light rays can be further manipulated to fall within a preferred optical axis for the projection system with all rays evenly spaced apart as they fall on image plane 2150 making them ideal for projection through diverging lens elements (not shown).
The present disclosure is not intended to be limited by its preferred embodiments, and other embodiments are also comprehended and within its scope. For example, embodiments where the contoured projection screen is not strictly spherical in shape, but rather cubical, rectangular, pyramidal, or otherwise shaped for utility or novelty purposes to support a projection image.
Numerous other embodiments, modifications and extensions to the present disclosure are intended to be covered by the scope of the present inventions as claimed below. This includes implementation details and features that would be apparent to those skilled in the art in the mechanical, logical or electronic implementation of the systems described herein. This also includes uses for such systems, whether for entertainment, education, commercial, military, astronomical, navigational, medical, or other purposes that the present systems are capable of being used in.
This application is a continuation in part and claims the priority and benefit of U.S. patent application Ser. No. 11/799,508 “Three-Dimensional Internal Back-Projection System and Method for Using the Same,” filed on May 2, 2007, which claims priority to provisional application No. 60/850,298 “System and Method for Displaying Computer Controlled Laser Driven Coherent Images Over a Substantially Spherical or Other Three Dimensional Surface,” filed on Oct. 6, 2006, and U.S. patent application Ser. No. 12/246,945 “Three-Dimensional Internal Projection System,” filed on Oct. 7, 2008, which is a continuation of the above '508 application. Each of the above is incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| 60850298 | Oct 2006 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11799508 | May 2007 | US |
| Child | 13238625 | US |
