The present invention relates to optics, and more particularly to extending light paths.
Providing multiple focal planes, or discrete steps of focus adjustment, is useful for a number of applications. It can be part of creating a more realistic three dimensional display, as well as the ability to capture three dimensional data. In the prior art, multiple focus capture utilized mechanical movement such as gears or liquid lenses. Such mechanisms are expensive, slow, and relatively fragile. Another prior art method of capturing multiple focal lengths uses multiple mirrors and lenses. This is like having multiple cameras; it is bulky and expensive. Because of the bulk and expense, it also limits the number of focal lengths that can be simultaneously captured. A large beam splitter has also been used in the prior art to create two light path lengths. However, this is also a bulky solution.
Such prior art solutions are some combination of large, expensive, and slow. Liquid lenses are expensive and slow, and large beam splitters are large. This makes them difficult to use, and not useful for size or cost constrained systems, particularly portable or worn devices.
The present invention is illustrated by way of example, and not by way of limitation, in the figures of the accompanying drawings and in which like reference numerals refer to similar elements and in which:
A digital light path length modulator is described. The digital light path length modulator includes an optical path length extender (OPLE) and a polarization modulator, and can be used to adjust the path length of light. In one embodiment, light with state 1 polarization travels through a longer path in the OPLE than light with state 2 polarization. This can be used to create two focal planes. In one embodiment, an OPLE is made up of a partially reflective coating, a quarter wave plate, and a wire grid polarizer. In one embodiment, the OPLE may be made up of one or more plates with a plurality of polarization sensitive reflective elements. A plurality of digital light path length modulators create a modulation stack.
In one embodiment, using a modulation stack the number of focal planes can be increased. This provides the capacity to build a system that can meet the physiological requirements of human vision, by creating display in which the 3D indicia of overlap, focus, and vergence match. This produces a better quality 3D display and can prevent the headaches associated with 3D displays.
This mechanism in one embodiment can also be used for image capture, and various other uses in which light waves or other waves in a similar spectrum are either projected or captured, including but not limited to cameras, binoculars, 3D printing, lithography, medical imaging, etc. Creating a simple, easy to manufacture digital light path length modulator is like the step from vacuum tubes to transistors; it enables more complex, cheaper, and much more dense digitally controlled elements, which can become building blocks for a wide range of uses.
The following detailed description of embodiments of the invention makes reference to the accompanying drawings in which like references indicate similar elements, showing by way of illustration specific embodiments of practicing the invention. Description of these embodiments is in sufficient detail to enable those skilled in the art to practice the invention. One skilled in the art understands that other embodiments may be utilized and that logical, mechanical, electrical, functional and other changes may be made without departing from the scope of the present invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is defined only by the appended claims.
In one embodiment, there may be a digital correction system 210, which adjusts the output of the light source to compensate for the predicted difference in the location of light of different polarizations coming out of the digital light path length modulator 230. By pre-adjusting the light, the resulting light regardless of its path length is properly positioned when it is displayed.
The digital correction system 210 in one embodiment changes the brightness of the light having a particular polarization through the digital light path length modulator 230, to correct for the loss of brightness due to the OPLE. The digital correction system 210 in one embodiment spatially shifts the image elements entering the digital light path length modulator 230 which may be shifted by the digital light path length modulator 230, to place them in the correct location upon exit from the digital light path length modulator 230.
The corrections from digital correction system 210 may include brightness, lateral shift, and correction for other artifacts of the system. Such pre-calculation of the output of a digital display system is known in the art. Digital correction systems 210 are utilized to correct for lens warping, color separation, and other issues. The digital correction system 210 creates an output which is in the “rendering state” such that the perceived image by the user is correct.
In one embodiment, the optical path length extender (OPLE) 240 may not produce any spatial shift between the light that travels the longer and the shorter path through the OPLE 240. In one embodiment, the OPLE 240 may produce a spatial shift or may be set to an intentional spatial shift.
In the embodiment of
The digital light path length modulator 230 includes a polarization modulator 235 and an OPLE 240. The polarization modulator 235, in one embodiment, is an electronically controlled element which can rotate the polarization of beams of light between two orthogonal states, state 1 and state 2, by selectively modulating the polarization of some or all of the light. In one embodiment, the orthogonal states are clockwise and counterclockwise circularly polarized light. In one embodiment, the two orthogonal states are S-polarized and P-polarized linearly polarized light. The polarization modulator 235 may also be a filter which selectively filters light.
In one embodiment, the polarization modulator 235 is an electronically controlled liquid crystal device (LCD). In another embodiment, the polarization modulator may be a Faraday modulator, a switchable birefringent crystal (i.e. LiNO3), or another modulator, which can selectively modulate a portion or all of the light impacting it. In one embodiment, the polarization modulator 235 may selectively polarize the light based on other factors, such as color, wavelength, etc.
The polarization modulator 235 may modulate a subset of the light that impacts it, in one embodiment. In another embodiment, the polarization modulator 235 may modulate all of the light, and switch modulation in time sequential slices. Time sequential slices means that light impacting at time T is not modulated, while light impacting at T+x is modulated. Because the image perceived by a human user is constructed of a series of time sequential slices of data, in one embodiment, these slices are perceived as components of a single image. This is referred to as “biological real time,” which is perceived as being concurrent by a human viewer, even though it is time sequential in processing.
The polarized or selectively polarized light impacts the OPLE 240. The OPLE 240 reflects light having a first polarization, and passes through light with a second polarization. The reflected light bounces, before exiting the OPLE 240. This increases the path length of the light having the first polarization, compared to the light having the second polarization which passes directly through the OPLE 240. In one embodiment, the light exits the OPLE 240 at the same angle that it entered the OPLE 240.
Use of this system alters the relative light path length of the light with the two polarizations, because the light with a first polarization travels through a longer path than the light with the second polarization.
Utilizing a plurality of digital light path length modulators 230 allows for a multitude of digitally selectable path lengths. Having the various selectable path lengths enables the creation of multiple focal lengths of light exiting the digital light path length modulator 230, since the light appears to be at different distances from the user, based on the length of the light path. In one embodiment, image elements formed by the light that has a longer light path appear further from a user.
In one embodiment, light exiting the OPLE 240 is not spatially shifted, or intentionally spatially shifted, regardless of polarization. The specific configurations of an OPLE 240, and its manufacture, is discussed in more detail below.
The OPLE 240 and polarization modulator 235 make up the digital light path length modulator 230. A digital light path length modulator 230 creates two or more light path lengths. Although only a single digital light path length modulator 230 is shown in
The output of the digital light path length modulator 230 is displayed via display element 245, or through some other means. The display element 245 may provide a component for a three-dimensional display, with image elements displayed in different focal planes.
The polarized light is then selectively modulated by polarization modulator 260, and passed through OPLE 265. As noted above, within the OPLE 265, the differently polarized light has different path lengths. In one embodiment, a portion of light may be polarized so that a portion of an image embodied in the light goes through a longer light path than another portion. In one embodiment, all of the light may have the same polarization, and the changes in polarization and thus focal length may be varied in time sequential slices. In one embodiment, the system may combine concurrent and time-based light path adjustment.
Imager 275 captures or displays the image. The imager 275 may be an electronic image sensor, such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) sensor. The imager 275 may be another capture element, such as film, binoculars, scope, or any mechanism to capture or display an image. In one embodiment, a digital correction system 280 may be used to correct the captured or displayed image to account for differences in brightness/light level or spatial shift between the light beams, because of the path they took.
The OPLE 265 and polarization modulator 260 together form a digital light path length modulator 270. In one embodiment, although only a single digital light path length modulator 270 is shown, the system may include a modulation stack with a plurality of digital light path length modulators 270.
OPLE 325 reflects state 1 polarized light, while passing through state 2 polarized light. Here, state 2 polarized light is transmitted straight through (having the shorter light path.) The output in one embodiment is transmitted to near eye display (NED) projection optics 330. Of course, though it is not shown, additional optical elements may be included in this system, including lenses, correction systems, etc.
A comparison of
For light with polarization type two, here C1 (circular polarization type 1), the light passes through the partially reflective coating 420, passes through the quarter wave plate 430, and exits through wire grid polarizer 440. The quarter wave plate 430 alters the C1 polarization to an L1 polarization, so the exiting light is L1 polarized. This may be input to another digital light path length modulator.
The partially reflective coating 420 reflects a portion of the light, as C1 polarized light, and permits the rest of the light to pass through, as C2 polarized light. The now C1 polarized light passes through the quarter wave plate one more time, before exiting through the wire grid polarizer. Thus, the path of the light entering with the C2 polarization is three times the length of the path of light entering with the C1 polarization, since it reflects back up through the OPLE, and down through the OPLE a second time, before exiting. However, there is no lateral shift of the virtual source during this process.
The partially reflective coating 525 is applied to a first layer 520. The partial reflective coating 525 is one embodiment a thin layer of a reflective metal or dielectric, in the 50-100 angstrom thickness. In one embodiment, material is aluminum or silver. In one embodiment, partially reflective coating 525 is applied to a bottom of the first layer 520. In one embodiment, the middle layer 530 is entirely made of quarter wave plate 535, or may have a quarter wave plate portion. The quarter wave plate may be mica, or a polymer plastic. There is no limitation on a size of the quarter wave. The bottom layer includes a wire grid polarizer 545, which may be applied to the top of the third layer. Each of the layers is made of a material clear to the type of light that is used with the OPLE. The material may be a glass, plastic, sapphire, or other material. The thickness of the OPLE is selected to optimize the value of the light path lengthening. In one embodiment, the reflective elements may be shaped, rather than flat.
At block 650, it is determined whether the light of polarization L1 will be reflected by the wire grid polarizer. If the L1 polarized light is not reflected, at block 660 the L1 polarized light is passed through the wire grid polarizer, and exits the longitudinal OPLE.
If the L1 polarization is reflected, as determined at block 650, at block 670 the light is reflected back through the OPLE. At block 675, the reflected light passes through the quarter wave plate again, changing the polarization from the L1 to C1.
At block 680, the partially reflective coating reflects back a portion of the light. The reflected portion of the light changes polarization to C2. The twice reflected light passes through the quarter wave plate again, changing the polarization from C2 to L2.
At block 695, the L2 polarized light passes out of the longitudinal OPLE. The process then ends.
In various embodiments, one or more of the following variations may be made: the effective thickness of the OPLEs may vary, as may the angles of the polarization sensitive reflective elements, and the OPLE may include one, two, or more plates. The effective thickness of the OPLE is defined as the cumulative thickness of the plates which are parts of the OPLE. Thus the effective thickness of OPLE 720 is different than the thickness of OPLE 740, even though the individual plates in the two OPLEs 720, 740 are identical.
With the shown set of four different OPLEs, the system can create up to sixteen, 24 focal lengths by selectively modulating the polarization, as follows:
In one embodiment, because the light exits from both sides of a longitudinal OPLE, the longitudinal OPLE 710 is preferentially a first OPLE in a modulation stack 700 that includes longitudinal OPLEs. In one embodiment, the number of longitudinal OPLEs 710 is limited by the level of light loss for each longitudinal OPLE.
At block 820, two optically transparent sheets of material are used. In one embodiment, the sheet is made of glass. Alternatively, another material that is optically clear to the wavelengths of the system, such as plastic, transparent ceramic, silicon, sapphire, or other materials, may be used.
At block 830, a partially reflective coating is applied to the first surface of the first sheet. In one embodiment, this first surface is the “top” surface of the sheet, which will form the entry surface of the OPLE.
At block 840, the second surface of the first sheet is attached to the quarter wave plate. In one embodiment the adhesive used is optically clear glue. In one embodiment, the substrates may be attached via spacers, in which the substrates are spaced apart using a support structure, rather than adhered or otherwise directly attached. Other methods of securing substrates together may be used. The quarter wave plate is made of a birefringent material, for which the index of refraction is different for different orientations of light passing through it. The quarter wave plate may be a bulk material, such as mica, quartz, calcite, or plastic. The quarter wave plate may be a film applied to an optically clear material. The quarter wave plate converts circularly polarized light into linear polarized light, and vice versa.
At block 850, the second sheet is attached to the other side of the quarter wave plate. The quarter wave plate is now sandwiched between the two transparent sheets of material. The attachment may be via adhesive, spacers, or other methods.
At block 860, the wire grid polarizer is applied to the second surface of the second sheet. This is the exit surface, in one embodiment.
At block 870, the resulting material is cut into appropriately sized longitudinal OPLEs. The process then ends.
Although this is illustrated as a flowchart, one of skill in the art would understand that the steps need not be taken in the order shown. For example, the wire grid polarizer may be applied to the optically transparent material at any time, before or after the second sheet is integrated into the OPLE structure. Similarly, the partially reflective coating may be applied at any time.
The process shown produces consistent longitudinal OPLEs. These longitudinal OPLEs can be used to lengthen the light path, which may be controlled by digitally modulating the polarization of the light impacting the OPLE. The OPLE and the digital light path length modulator is easily and consistently manufactured, and takes up very little space.
In the foregoing specification, the invention has been described with reference to specific exemplary embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the appended claims. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
The present application is a continuation of U.S. application Ser. No. 16/559,121, filed Sep. 3, 2019, issuing as U.S. Pat. No. 11,016,307 on May 25, 2021, which is a continuation of U.S. application Ser. No. 15/358,040, filed Nov. 21, 2016, issued as U.S. Pat. No. 10,401,639 on Sep. 3, 2019, which claims priority to U.S. patent application Ser. No. 15/236,101, filed on Aug. 12, 2016, issued as U.S. Pat. No. 10,809,546 on Oct. 20, 2020. All applications are incorporated herein in their entirety.
Number | Name | Date | Kind |
---|---|---|---|
3586416 | De Bitetto | Jun 1971 | A |
3856407 | Takeda et al. | Dec 1974 | A |
4253723 | Kojima et al. | Mar 1981 | A |
4670744 | Buzak | Jun 1987 | A |
5610765 | Colucci | Mar 1997 | A |
5751243 | Turpin | May 1998 | A |
6134031 | Nishi et al. | Oct 2000 | A |
6515801 | Shimizu | Feb 2003 | B1 |
6580078 | O'Callaghan et al. | Jun 2003 | B1 |
7023548 | Pallingen | Apr 2006 | B2 |
7360899 | McGuire et al. | Apr 2008 | B2 |
7798648 | Ijzerman et al. | Sep 2010 | B2 |
7905600 | Facius et al. | Mar 2011 | B2 |
8262234 | Watanabe | Sep 2012 | B2 |
8755113 | Gardner et al. | Jun 2014 | B2 |
9025067 | Gray et al. | May 2015 | B2 |
9304319 | Bar-Zeev et al. | Apr 2016 | B2 |
9494805 | Ward et al. | Nov 2016 | B2 |
9588270 | Merrill et al. | Mar 2017 | B2 |
9606354 | Spitzer | Mar 2017 | B2 |
10057488 | Evans et al. | Aug 2018 | B2 |
10185153 | Eash et al. | Jan 2019 | B2 |
10187634 | Eash et al. | Jan 2019 | B2 |
10379388 | Eash et al. | Aug 2019 | B2 |
10401639 | Evans et al. | Sep 2019 | B2 |
11016307 | Evans | May 2021 | B2 |
20010027125 | Kiyomatsu et al. | Oct 2001 | A1 |
20020191300 | Neil | Dec 2002 | A1 |
20030020925 | Patel et al. | Jan 2003 | A1 |
20040156134 | Furuki et al. | Aug 2004 | A1 |
20040263806 | Silverstein et al. | Dec 2004 | A1 |
20050141076 | Bausenwein et al. | Jun 2005 | A1 |
20060119951 | McGuire, Jr. | Jun 2006 | A1 |
20070030456 | Duncan et al. | Feb 2007 | A1 |
20070030543 | Javidi et al. | Feb 2007 | A1 |
20070139760 | Baker et al. | Jun 2007 | A1 |
20070146638 | Ma et al. | Jun 2007 | A1 |
20080130887 | Harvey et al. | Jun 2008 | A1 |
20080174741 | Yanagisawa et al. | Jul 2008 | A1 |
20080205244 | Kitabayashi | Aug 2008 | A1 |
20090021824 | Ijzerman et al. | Jan 2009 | A1 |
20090046262 | Okazaki et al. | Feb 2009 | A1 |
20090052838 | McDowall et al. | Feb 2009 | A1 |
20090061505 | Hong et al. | Mar 2009 | A1 |
20090061526 | Hong et al. | Mar 2009 | A1 |
20090225420 | Yao et al. | Sep 2009 | A1 |
20090237785 | Bloom | Sep 2009 | A1 |
20090244355 | Horie | Oct 2009 | A1 |
20110032436 | Shimizu et al. | Feb 2011 | A1 |
20110075257 | Hua et al. | Mar 2011 | A1 |
20110149245 | Barth et al. | Jun 2011 | A1 |
20120069413 | Schultz | Mar 2012 | A1 |
20120075588 | Suga | Mar 2012 | A1 |
20120113092 | Bar-Zeev et al. | May 2012 | A1 |
20130010360 | Ouderkirk et al. | Jan 2013 | A1 |
20130070338 | Gupta et al. | Mar 2013 | A1 |
20130100376 | Sawado | Apr 2013 | A1 |
20130222770 | Tomiyama | Aug 2013 | A1 |
20130344445 | Clube et al. | Dec 2013 | A1 |
20140168035 | Luebke et al. | Jun 2014 | A1 |
20140176818 | Watson et al. | Jun 2014 | A1 |
20140340588 | Akiyama | Nov 2014 | A1 |
20150061976 | Ferri | Mar 2015 | A1 |
20150153572 | Miao et al. | Jun 2015 | A1 |
20150205126 | Schowengerdt | Jul 2015 | A1 |
20150319342 | Schowengerdt | Nov 2015 | A1 |
20160041390 | Poon et al. | Feb 2016 | A1 |
20160041401 | Suga | Feb 2016 | A1 |
20160077338 | Robbins et al. | Mar 2016 | A1 |
20160131920 | Cook | May 2016 | A1 |
20160195718 | Evans | Jul 2016 | A1 |
20160225337 | Ek et al. | Aug 2016 | A1 |
20160227195 | Venkataraman et al. | Aug 2016 | A1 |
20160306168 | Singh et al. | Oct 2016 | A1 |
20160381352 | Palmer | Dec 2016 | A1 |
20170038579 | Yeoh et al. | Feb 2017 | A1 |
20170068103 | Huang et al. | Mar 2017 | A1 |
20170075126 | Carls et al. | Mar 2017 | A1 |
20170097507 | Yeoh et al. | Apr 2017 | A1 |
20170146803 | Kishigami et al. | May 2017 | A1 |
20170160518 | Lanman et al. | Jun 2017 | A1 |
20170227770 | Carollo et al. | Aug 2017 | A1 |
20170269369 | Qin | Sep 2017 | A1 |
20180045973 | Evans et al. | Feb 2018 | A1 |
20180045974 | Eash et al. | Feb 2018 | A1 |
20180045984 | Evans et al. | Feb 2018 | A1 |
20180048814 | Evans et al. | Feb 2018 | A1 |
20180149862 | Kessler et al. | May 2018 | A1 |
20180283969 | Wang et al. | Oct 2018 | A1 |
20190007610 | Evans et al. | Jan 2019 | A1 |
20190086675 | Carollo et al. | Mar 2019 | A1 |
20190155045 | Eash et al. | May 2019 | A1 |
20190174124 | Eash et al. | Jun 2019 | A1 |
Number | Date | Country |
---|---|---|
1910499 | Feb 2007 | CN |
102566049 | Jul 2012 | CN |
103765294 | Apr 2014 | CN |
105739093 | Jul 2016 | CN |
109997357 | Jul 2019 | CN |
0195584 | Sep 1986 | EP |
06-258673 | Sep 1994 | JP |
3384149 | Mar 2003 | JP |
2012104839 | Aug 2012 | WO |
2012175939 | Dec 2012 | WO |
2015190157 | Dec 2015 | WO |
2016087393 | Jun 2016 | WO |
Entry |
---|
Hu et al., “High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics,” Optics Express, vol. 22, No. 11, Jun. 2014, pp. 13896-13903. |
Hui, Wang, “Optical Science and Applications Series: Digital holographic three-dimensional display and detection”, Shanghai Jiaotong University Press, Nov. 1, 2013, 4 pages. |
Jun et al., “Industry Patent Analysis Report (vol. 32)—New Display”, ISBN: 7513033447, Intellectual Property Publishing House Co., Ltd, Jun. 2015, 4 pages. |
Lee et al., “Switchable Lens for 3D Display, Augmented Reality and Virtual Reality”, Society for Information Display (SID), International Symposium Digest of Technical Papers, vol. 47, Issue 1, May 25, 2016, 4 pages. |
Matjasec et al., “All-optical thermos-optical path length modulation based on vanadium-doped fibers”, Optical Society of America, vol. 21, No. 10, May 2013, pp. 1-14. |
Pate, Michael, “Polarization Conversion Systems for Digital Projectors”, Web Publication, Apr. 21, 2006, Downloaded from <http://www.zemax.com/os/resources/learn/knowledgebase/polarization-conver-sion-systems-for-digital-projectors> on Jun. 17, 2016, 8 pages. |
Polatechno Co., Ltd., “LCD Projector Components”, Available Online at <http://www.polatechno.co.jp/english/products/projector.html>, downloaded on Jun. 17, 2016, 2 pages. |
Sandner et al., “Translatory MEMS actuators for optical path length modulation in miniaturized Fourier-transform infrared spectrometers”, MEMS MOEMS, vol. 7, No. 2, Apr.-Jun. 2008, pp. 1-11. |
Number | Date | Country | |
---|---|---|---|
20210278685 A1 | Sep 2021 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16559121 | Sep 2019 | US |
Child | 17303226 | US | |
Parent | 15358040 | Nov 2016 | US |
Child | 16559121 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15236101 | Aug 2016 | US |
Child | 15358040 | US |