The invention is system, method, and apparatus (collectively the “system”) for displaying an image. More specifically, the system is a virtual retinal display system that projects images onto the eyes of a viewer using a curved mirror and a partially transparent plate.
A virtual retinal display (VRD) is like shining an 80 inch television image directly on the viewer's eyes. In an era where large screen TVs keep getting larger and larger, and mobile media consumption continues to grow through the use of smart phones and tablet computers, VRDs avail themselves to the advantages of both worlds by combining a large screen TV experience with the mobility of a set of headphones.
VRDs can potentially open a large universe of much desired functionality to users. However, coordinating such different functions is no trivial task. Light is always a tricky resource to control. In a head mounted display such as a VRD, there isn't a lot of room in the device if one wants to have a device that is a sufficiently small for convenient mobile use.
There is a need for a “traffic cop” to manage the different light pathways that can be useful to manage the different light pathways in a VRD display or other forms of head mounted displays.
The invention is system, method, and apparatus (collectively the “system”) for displaying an image. More specifically, the system is a virtual retinal display system that projects images onto the eyes of a viewer using a curved mirror and a partially transparent plate.
The configuration of a curved mirror in conjunction with a partially reflective plate is an effective way to direct the desired image directly onto the retinas of the viewer. If desired, such a configuration can also be used to: (1) direct light to a tracking assembly for the purposes of monitoring the eye movement of the viewer; and (2) create a media experience that allows for augmented reality (i.e. media displays overlaying a view of the physical environment that is visible to the user).
Many features and inventive aspects of the system are illustrated in the various drawings described briefly below. All components illustrated in the drawings below and associated with element numbers are named and described in Table 1 provided in the Detailed Description section.
The invention is system, method, and apparatus (collectively the “system”) for displaying an image. More specifically, the system is a virtual retinal display system that projects images onto the eyes of a viewer using a curved mirror and a partially transparent plate.
A. Displaying an Image on the Eye of a Viewer
B. Tracking the Movement of an Eye
Some embodiments of the system 100 can include a tracking assembly. The tracking assembly allows for the system 100 to track the movement of the eyes 92 of the viewer 96 while the viewer 96 is viewing an image 880.
C. Augmented Reality
The system 100 can be potentially used in either an augmented reality mode (where the outside world and the displayed images are seen simultaneously by the viewer) or an immersion mode which blocks out exterior images.
D. Aggregate Functionality
The system 100 can be described in terms of assemblies of components that perform various functions in support of the operation of the system 100.
As illustrated in
A. Illumination Assembly
An illumination assembly 200 performs the function of supplying light 800 to the system 100 so that an image 880 can be displayed.
B. Imaging Assembly
An imaging assembly 300 performs the function of creating the image 880 from the light 800 supplied by the illumination assembly 200. A modulator 320 can transform the light 800 supplied by the illumination assembly 200 into the image 880 that is displayed by the system 100. The image 880 generated by the imaging assembly 300 can sometimes be referred to as an interim image 850 because the image 850 may be focused or otherwise modified to some degree before it is directed to the location where it can be experienced by one or more users 90.
Imaging assemblies 300 can vary significantly based on the type of technology used to create the image. Display technologies such as DLP (digital light processing), LCD (liquid-crystal display), LCOS (liquid crystal on silicon), and other methodologies can involve substantially different components in the imaging assembly 300.
A light modulator 320 is the device that modifies or alters the light 800, creating the image 880 that is to be displayed. Modulators 320 can operate using a variety of different attributes of the modulator 320. A reflection-based modulator 322 uses the reflective-attributes of the modulator 320 to fashion an image 880 from the supplied light 800. Examples of reflection-based modulators 322 include but are not limited to the DMD 324 of a DLP display and some LCOS (liquid crystal on silicon) panels 340. A transmissive-based modulator 321 uses the transmissive-attributes of the modulator 320 to fashion an image 880 from the supplied light 800. Examples of transmissive-based modulators 321 include but are not limited to the LCD (liquid crystal display) 330 of an LCD display and some LCOS panels 340. The imaging assembly 300 for an LCOS or LCD system 100 will typically have a combiner cube 350 or some similar device for integrating the different one-color images into a single image 880.
The imaging assembly 300 can also include a wide variety of supporting components 150.
C. Projection Assembly
The projection assembly 400 can perform the task of directing the image 880 to its final destination in the system 100 where it can be accessed by users 90. In many instances, the image 880 created by the imaging assembly 300 will be modified in at least some minor ways between the creation of the image 880 by the modulator 320 and the display of the image 880 to the user 90. Thus, the image 880 generated by the modulator 320 of the imaging assembly 400 may only be an interim image 850, not the final version of the image 880 that is actually displayed to the user 90.
D. Tracking/Sensing Assembly
As illustrated in
F. Augmentation Assembly
An augmentation assembly 600 provides the capability of viewing external environment images 650 simultaneously with the displayed images 880 generated from the media or streaming source. As illustrated in
G. Supporting Components
Light 800 can be a challenging resource to manage. Light 800 moves quickly and Cannot be Constrained in the Same Way that Most Inputs or Raw Materials can be.
H. Process Flow View
The system 100 can be described as the interconnected functionality of an illumination assembly 200, an imaging assembly 300, and a projection assembly 400. However, the system 100 can also be described in terms of a method 900 that includes an illumination process 910, an imaging process 920, and a projection process 930. Similarly, the functions of the tracking assembly 500 and the augmentation assembly 600 can also be described and characterized in terms of processes.
The system 100 can be implemented with respect to a wide variety of different display technologies, including but not limited to DLP and LCOS.
A. DLP Embodiments
As discussed above, the illumination assembly 200 includes a light source 210 for supplying light 800. The light 800 then passes to the imaging assembly 300. Two TIR prisms 311 direct the light 800 to the DMD 314, the DMD 314 creates an image 880 with that light 800, and the TIR prisms 311 then direct the light 800 embodying the image 880 to the configuration of the plate 430 and curved mirror 420 which together function to deliver the image 880 onto the eye 92 of the viewer 96.
B. LCD Embodiments
The illumination assembly 200 in an LCOS system 143 typically include a variety of dichroic mirrors 152 that separate light 800 into three component colors, typically red, green, and blue—the same colors on many color wheels 240 found in a DLP application.
The LCDs 330 form single color images which are combined into a multi-color image 880 by a dichroic combiner cube 320 or some similar device.
The system 100 can be implemented in a wide variety of different configurations and scales of operation. However, the original inspiration for the conception of the multiple diffuser concept occurred in the context of a VRD visor system 106 embodied as a VRD visor apparatus 116. A VRD visor apparatus 116 projects the image 880 directly onto the eyes of the user 90. The VRD visor apparatus 116 is a device that can be worn on the head of the user 90. In many embodiments, the VRD visor apparatus 116 can include sound as well as visual capabilities. Such embodiments can include multiple modes of operation, such as visual only, audio only, and audio-visual modes. When used in a non-visual mode, the VRD apparatus 116 can be configured to look like ordinary headphones.
A 3 LED light source 213 generates partially coherent light 803 that passes through a condensing lens 160 which directs the light 800 to a mirror 151 which reflects the light 800 to a shaping lens 160 prior to the entry of the light 800 into an imaging assembly 300 comprised of two TIR prisms 311 and a DMD 314. The interim image 850 from the imaging assembly 300 passes through two doublets 180 and another lens 160 that focuses the interim image 850 into a final image 880 that is viewable to the user 90 through the plate 430/mirror 420 configuration.
No patent application can expressly disclose in words or in drawings, all of the potential embodiments of an invention. Variations of known equivalents are implicitly included. In accordance with the provisions of the patent statutes, the principles, functions, and modes of operation of the systems 100, methods 900, and apparatuses 110 (collectively the “system” 100) are explained and illustrated in certain preferred embodiments. However, it must be understood that the inventive systems 100 may be practiced otherwise than is specifically explained and illustrated without departing from its spirit or scope.
The description of the system 100 provided above and below should be understood to include all novel and non-obvious alternative combinations of the elements described herein, and claims may be presented in this or a later application to any novel non-obvious combination of these elements. Moreover, the foregoing embodiments are illustrative, and no single feature or element is essential to all possible combinations that may be claimed in this or a later application.
The system 100 represents a substantial improvement over prior art display technologies. Just as there are a wide range of prior art display technologies, the system 100 can be similarly implemented in a wide range of different ways. The innovation of utilizing a tandem of a partially transparent plate 430 and curved mirror 420 can be implemented at a variety of different scales, utilizing a variety of different display technologies, in both immersive and augmenting contexts, and in both one-way (no sensor feedback from the user 90) and two-way (sensor feedback from the user 90) embodiments.
A. Variations of Scale
Display devices can be implemented in a wide variety of different scales. The monster scoreboard at EverBanks Field (home of the Jacksonville Jaguars) is a display system that is 60 feet high, 362 feet long, and comprised of 35.5 million LED bulbs. The scoreboard is intended to be viewed simultaneously by tens of thousands of people. At the other end of the spectrum, the GLYPH™ visor by Avegant Corporation is a device that is worn on the head of a user and projects visual images directly in the eyes of a single viewer. Between those edges of the continuum are a wide variety of different display systems. While the specification motivations for the system 100 are very much grounded in visor systems 105 and particularly VRD visor systems 106, that is not to say that the concepts have no utility outside those contexts.
The system 100 can be potentially implemented in a wide variety of different scales or for the structures to be used to serve different purposes.
1. Large Systems
A large system 101 is intended for use by more than one simultaneous user 90. Examples of large systems 101 include movie theater projectors, large screen TVs in a bar, restaurant, or household, and other similar displays. Large systems 101 include a subcategory of giant systems 102, such as stadium scoreboards 102a, the Time Square displays 102b, or other or the large outdoor displays such as billboards off the expressway.
2. Personal Systems
A personal system 103 is an embodiment of the system 100 that is designed to for viewing by a single user 90. Examples of personal systems 103 include desktop monitors 103a, portable TVs 103b, laptop monitors 103c, and other similar devices. The category of personal systems 103 also includes the subcategory of near-eye systems 104.
a. Near-Eye Systems
A near-eye system 104 is a subcategory of personal systems 103 where the eyes of the user 90 are within about 12 inches of the display. Near-eye systems 104 include tablet computers 104a, smart phones 104b, and eye-piece applications 104c such as cameras, microscopes, and other similar devices. The subcategory of near-eye systems 104 includes a subcategory of visor systems 105.
b. Visor Systems
A visor system 105 is a subcategory of near-eye systems 104 where the portion of the system 100 that displays the visual image 200 is actually worn on the head 94 of the user 90. Examples of such systems 105 include virtual reality visors, Google Glass, and other conventional head-mounted displays 105a. The category of visor systems 105 includes the subcategory of VRD visor systems 106.
c. VRD Visor Systems
A VRD visor system 106 is an implementation of a visor system 105 where visual images 200 are projected directly on the eyes of the user. The technology of projecting images directly on the eyes of the viewer is disclosed in a published patent application titled “IMAGE GENERATION SYSTEMS AND IMAGE GENERATING METHODS” (U.S. Ser. No. 13/367,261) that was filed on Feb. 6, 2012, the contents of which are hereby incorporated by reference. It is anticipated that a VRD visor system 106 is particularly well suited for the implementation of the multiple diffuser 140 approach for reducing the coherence of light 210.
3. Integrated Apparatus
Media components tend to become compartmentalized and commoditized over time. It is possible to envision display devices where an illumination assembly 120 is only temporarily connected to a particular imaging assembly 160. However, in most embodiments, the illumination assembly 120 and the imaging assembly 160 of the system 100 will be permanently (at least from the practical standpoint of users 90) into a single integrated apparatus 110.
B. Different Categories of Display Technology
The prior art includes a variety of different display technologies, including but not limited to DLP (digital light processing), LCD (liquid crystal displays), and LCOS (liquid crystal on silicon).
C. Immersion vs. Augmentation
Some embodiments of the system 100 can be configured to operate either in immersion mode or augmentation mode, at the discretion of the user 90. While other embodiments of the system 100 may possess only a single operating mode 120.
D. Display Only vs. Display/Detect/Track/Monitor
Some embodiments of the system 100 will be configured only for a one-way transmission of optical information. Other embodiments can provide for capturing information from the user 90 as visual images 880 and potentially other aspects of a media experience are made accessible to the user 90.
E. Media Players—Integrated vs. Separate
Display devices are sometimes integrated with a media player. In other instances, a media player is totally separate from the display device. By way of example, a laptop computer can include in a single integrated device, a screen for displaying a movie, speakers for projecting the sound that accompanies the video images, a DVD or BLU-RAY player for playing the source media off a disk. Such a device is also capable of streaming
F. Users—Viewers vs. Operators
G. Attributes of Media Content
As illustrated in
As illustrated in
Table 1 below sets forth a list of element numbers, names, and descriptions/definitions.
This utility patent application both (i) claims priority to and (ii) incorporates by reference in its entirety, the provisional patent application titled “NEAR-EYE DISPLAY APPARATUS AND METHOD” (Ser. No. 61/924,209) that was filed on Jan. 6, 2014.
Number | Date | Country | |
---|---|---|---|
20160195721 A1 | Jul 2016 | US |
Number | Date | Country | |
---|---|---|---|
61924209 | Jan 2014 | US |