Embodiments relate to optical combiner apparatus and components thereof. More particularly but not exclusively, embodiments relate to augmented reality image combiners. Additionally, some embodiments relate to head mounted displays including optical combiners.
An optical see through combiner is a fundamental component in an augmented reality display system. The optical combiner enables the real world and an artificially generated scene created by a computer and created by a projector to be optically superimposed.
There are a number of optical systems that have been proposed and adopted with one of the main requirements is to take the projection system away from the eye so it does not obscure the natural view of the world. However, high performance optical combiner systems are complex and difficult to fabricate.
There is a need to provide improved optical combiners that are easier to manufacture and have better performance than current optical systems.
According to a first aspect, there is provided an optical combiner. The optical combiner may comprise an optically transparent substrate and a patterned region included in the optically transparent substrate and disposed along a wave propagation axis of the substrate. The patterned region may be partially optically reflective and partially optically transparent. The patterned region may comprise a plurality of optically transparent regions of the optically transparent substrate and a plurality of optically reflective regions inclined relative to the optical transparent substrate wave propagation axis.
By including in the optical substrate a patterned region which is partially optically reflective and partially optically transparent, improved optical combiners are provided that are easier to manufacture and have better performance.
According to another aspect, an augmented reality optical combiner is provided. The optical combiner may comprise a transparent optical waveguide substrate for receiving an optical image and viewing there through a distant real world scene and a plurality of reflective elements arranged within the transparent optical waveguide for reflecting the received optical image. The plurality of reflective elements may be arranged in such a way that, when the optical combiner is in use, the received optical image is reflected and superimposed on the real world scene view so as to allow viewing of the distant real world scene while simultaneously viewing the optical image superimposed on the real world scene.
According to yet another aspect, an augmented reality optical apparatus is provided. The augmented reality optical apparatus may comprise a head mounted display and at least one of the aforementioned optical combiners supported on the head mounted display.
According to yet other aspects, methods of combining optical rays are provided. In one aspect, a method of combining optical rays comprises propagating first optical image rays along a length of an optical transparent waveguide substrate towards a pattern region included in said optical transparent substrate; transmitting second optical image rays through a width of the optical waveguide substrate; and selectively reflecting out of said optical substrate said first optical image rays at different points along said substrate from reflective regions of said pattern region; said reflected first optical image rays superimposing on said second optical image rays transmitted out of said optical transparent substrate.
The first optical image rays may be computer generated rays. The second optical image rays may be from a distant real world scene. The pattern region may be a pattern region as set forth hereinbefore.
In order that the present invention may be more readily understood, reference will now be made to the accompanying drawings, in which:
In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular embodiments, procedures, techniques, etc. in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that the present invention may be practiced in other embodiments that depart from these specific details.
Referring now to the accompanying drawings,
Substrate 105 is a see-through substrate made from optical waveguide substrate material such as but not limited to glass or plastic. Optical rays 150 entering the substrate rear face pass through the substrate material and exit from the substrate front face. An observer located on one side of the substrate and looking through the front face of the substrate can see through the substrate material and observe objects, scenes etc. located on the other side of the substrate.
A patterned region 107 is included in a volume of the optically transparent substrate. Patterned region 107 is partially optically reflective and partially optically transparent. Patterned region 107 comprises a plurality of optically transparent regions 109 of optically transparent substrate 105 and a plurality of optically reflective regions 108 inclined relative to optical transparent substrate wave propagation axis 106. For sake of clarity, not all reflective regions are shown and not all shown reflective regions 108 and transparent regions 109 have been labeled with reference numerals. Optical image rays 140, which are captured in an end of the substrate, propagate along propagation axis 106, pass into patterned region 107, and are selectively reflected at different points along substrate 105 by inclined optical reflective regions 108. The reflected optical image rays 142 exit the front face of substrate 105.
For ease of illustration, rays 140 are shown only as straight through rays. There are countless other rays that bounce along the waveguide rather than passing straight through which are not shown (examples are given in
The patterned region can take various forms. In some embodiments, optically reflective regions 108 of pattern region 107 are a plurality of optically reflective elements distributed in optically transparent substrate 105, for example as shown in
In the optical combiner of
In some embodiments, each of at least some of the reflective dots or other elements are fully reflective. In some other embodiments, each of at least some of the reflective dots or other reflective elements is partially reflective. For example, at least some of the reflective dots each have reflectivities between 5-100%. In some embodiments, the reflectivites of at least some of the reflective elements are the same. In some embodiments, the reflectivities of at least some of the reflective elements are different.
Optical reflective dots are each made of a reflective material such as but not limited to a single reflective metal layer or multiple layers of reflective oxides or other materials. The reflective dot material may deposited by known deposition techniques. In some embodiments, injection forming with over-molded reflective layers and optical 3D printing, may be used to form the optical substrate including the pattern region. In the embodiment of
Additionally, in some embodiments, reflective dots 108 are distributed in a volume section of the substrate that extends beyond each distinct plane 115, 120, 125, 130. By way of example,
In any event, irrespective of how reflective elements are exactly distributed in the different embodiments, the reflective elements can form groups that are spaced along a length of substrate 105. For example, in
Each group of reflective dots distributed about a distinct plane and/or a distinct volume section together with optical transparent substrate gaps therebetween collectively operate as a partially reflective individual reflector.
Optical combiner 100 is an extremely simple structure made up of reflective elements rather than reflectors which have a complex set of reflective layers coated over the entire area of each reflector.
Operation of the optical combiner as an optical image combiner is very simple, when the rays that form the image travel along the waveguide substrate some of them hit reflective dots of the first reflector and are re-directed towards the eye. The majority of the rays miss the dots as they only occupy a small area of the first reflector. If for example the dots occupy 5% of the overall area then overall reflectivity is about 5% too and 95% of the image energy passes through to the next reflector and so on. The reflective dots reflect optical rays 140 that have propagated straight through into the substrate but also the other rays 140 that arrive via a wide “bounce” and hit the reflective dots at a glancing angle (see for example the optical combiners shown in
In some embodiments, the first reflector (group of dots 101) has a relatively low reflectivity (small area of dots) and subsequent ones have greater reflectivity (bigger area of dots) increasing reflectivity the further along the waveguide substrate. The dot area to optical transparent gap ratio is varied to obtain chosen reflectivity for each reflector.
In yet some other embodiments, all reflective dots 108 are distributed throughout a substrate volume extending along a length of the waveguide rather than occupy distinct planes and/or distinct volume sections. In such embodiments, reflective dots 108 and optically transparent gaps or regions therebetween effectively form one continuous partially reflective reflector extending through the substrate volume.
In yet some other embodiments of the optical combiner, the optical substrate is a non see-through substrate.
Sparse aperture surface reflectors 215-230 comprise a plurality of reflective dots (such as dots 108), or other reflective elements, that are formed on a surface and can have many different configurations. In some embodiments, the reflective dots or other elements are arbitrary shapes and are arranged in a matrix on the surface in randomized positions. Reflective dots may be positioned about the surface in a deterministic manner or according to a random function.
In
One such sparse aperture reflector surface is shown in more detail in
In some embodiments of the optical combiners described herein, at least some of the reflective elements 108, etc. in the optical substrate are tilted at different angles from one another and/or at least some of the reflective elements are tilted in parallel with one another. Also, in some further embodiments, some of the reflective elements are individually tilted relative to the planes occupied by the reflective elements. By way of example
The optical combiners of the described embodiments have many advantages over known waveguide reflectors. The optical combiners of embodiments are insensitive to input polarization unlike known combiners that require careful polarization control on transit through the reflectors. The optical combiners of embodiments have inherently broadband optical bandwidth unlike known combiners that require careful design to make sure reflectivity is maintained over a wide range of incidence angles. The optical combiners of embodiments are less complex because patterns of reflective dots or other elements can be fabricated using a single layer of reflective material. In contrast, in known combiners each reflector array will require 20 to 30 separate carefully deposited layers to make one reflecting surface. The optical combiners are easily fabricated and robust compared to known combiners which are difficult to manufacture due to the highly complex multiple layers of reflective films and the fragile nature of the multilayers.
In some aspects, the optical combiners can be used for combining augmented reality images and a real world scenes. As indicated by
In order to more adequately illustrate how the images are combined in an augmented reality image combiner, reference is made to
In some aspects, one or more of the optical combiners are incorporated in head mounted displays. In some embodiments, a pair of the optical combiners are included in glasses or Goggle form factor augmented reality head mounted displays.
In some embodiments, the formed images are for monocular view and only one of the optical combiner and projection systems 710, 715 is included in the head mounted display.
In some embodiments, the head mounted display in which one or more of the optical combiners is incorporated is a helmet form factor augmented reality head mounted display.
In some embodiments, the formed images are for monocular view and only one of the optical combiner and projection systems 815, 820 is included in the head mounted display.
It will be appreciated that various of the above-disclosed and other features and functions, or alternatives thereof, may be desirably combined into many other different systems or applications such as head up type displays. Various presently unforeseen or unanticipated alternatives, modifications, variations, or improvements therein may be subsequently made by those skilled in the art which are also intended to be encompassed by the following claims. For example, the head mounted display sets may be visors, goggles or headband structures and are not limited to the particular types shown in the Figures. Likewise the shape of the optical combiner substrates may be any shape that is capable of guiding and combining images in the manner described hereinbefore.
The description of the present disclosure has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the present disclosure in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the present disclosure. Exemplary embodiments were chosen and described in order to best explain the principles of the present disclosure and its practical application, and to enable others of ordinary skill in the art to understand the present disclosure for various embodiments with various modifications as are suited to the particular use contemplated.
While various embodiments have been described above, it should be understood that they have been presented by way of example only, and not limitation. The descriptions are not intended to limit the scope of the technology to the particular forms set forth herein. Thus, the breadth and scope of a preferred embodiment should not be limited by any of the above-described exemplary embodiments. It should be understood that the above description is illustrative and not restrictive. To the contrary, the present descriptions are intended to cover such alternatives, modifications, and equivalents as may be included within the spirit and scope of the technology as defined by the appended claims and otherwise appreciated by one of ordinary skill in the art. The scope of the technology should, therefore, be determined not with reference to the above description, but instead should be determined with reference to the appended claims along with their full scope of equivalents.
This application is a divisional of U.S. Non-Provisional patent application Ser. No. 15/206,111, filed Jul. 8 2016, entitled “Optical Combiner Apparatus” in the name of DAQRI LLC, the entire disclosure of which is incorporated herein by reference as if fully set forth herein.
Number | Name | Date | Kind |
---|---|---|---|
3121992 | Fritz et al. | Feb 1964 | A |
4220400 | Vizenor | Sep 1980 | A |
4232943 | Rogers | Nov 1980 | A |
4545646 | Chern et al. | Oct 1985 | A |
4767186 | Bradley, Jr. et al. | Aug 1988 | A |
4968117 | Chern et al. | Nov 1990 | A |
5050946 | Hathaway et al. | Sep 1991 | A |
5076664 | Migozzi | Dec 1991 | A |
5202950 | Arego et al. | Apr 1993 | A |
5253637 | Maiden | Oct 1993 | A |
5535025 | Hegg | Jul 1996 | A |
5848119 | Miyake et al. | Dec 1998 | A |
5886822 | Spitzer | Mar 1999 | A |
5896438 | Miyake et al. | Apr 1999 | A |
5959726 | Riley et al. | Sep 1999 | A |
5991085 | Rallison et al. | Nov 1999 | A |
6057966 | Carroll et al. | May 2000 | A |
6157291 | Kuenster et al. | Dec 2000 | A |
6204974 | Spitzer | Mar 2001 | B1 |
6222677 | Budd et al. | Apr 2001 | B1 |
6236511 | Brown | May 2001 | B1 |
6262019 | Keller et al. | Jul 2001 | B1 |
6288846 | Stoner, Jr. | Sep 2001 | B1 |
6353503 | Spitzer et al. | Mar 2002 | B1 |
6563648 | Gleckman et al. | May 2003 | B2 |
6577311 | Crosby et al. | Jun 2003 | B1 |
6607286 | West et al. | Aug 2003 | B2 |
6671100 | McRuer | Dec 2003 | B1 |
6714174 | Suyama et al. | Mar 2004 | B2 |
6829095 | Amitai | Dec 2004 | B2 |
6926420 | Sung | Aug 2005 | B2 |
7059728 | Alasaarela | Jun 2006 | B2 |
7079318 | Shikama et al. | Jul 2006 | B2 |
7209097 | Suyama et al. | Apr 2007 | B2 |
7336244 | Suyama et al. | Feb 2008 | B2 |
7418202 | Biernath et al. | Aug 2008 | B2 |
7446943 | Takagi et al. | Nov 2008 | B2 |
7506987 | Nilsen | Mar 2009 | B2 |
7513674 | Donahue | Apr 2009 | B1 |
7576916 | Amitai | Aug 2009 | B2 |
7639208 | Ha et al. | Dec 2009 | B1 |
7656585 | Powell et al. | Feb 2010 | B1 |
7686497 | Kropac et al. | Mar 2010 | B2 |
7688347 | Dolgoff | Mar 2010 | B2 |
7703931 | Nilsen | Apr 2010 | B2 |
7710655 | Freeman et al. | May 2010 | B2 |
7876489 | Gandhi et al. | Jan 2011 | B2 |
7936519 | Mukawa et al. | May 2011 | B2 |
7944616 | Mukawa | May 2011 | B2 |
7991257 | Coleman | Aug 2011 | B1 |
8384999 | Crosby et al. | Feb 2013 | B1 |
8964292 | Marason et al. | Feb 2015 | B1 |
8988463 | Stone Perez et al. | Mar 2015 | B2 |
9252015 | Wu et al. | Feb 2016 | B2 |
9720232 | Hua et al. | Aug 2017 | B2 |
10007115 | Greenhalgh et al. | Jun 2018 | B2 |
10191993 | Ross et al. | Jan 2019 | B2 |
10481678 | Crispin | Nov 2019 | B2 |
10488666 | Leighton et al. | Nov 2019 | B2 |
10623722 | Markovsky et al. | Apr 2020 | B2 |
10649209 | Leighton et al. | May 2020 | B2 |
10795434 | Crispin | Oct 2020 | B2 |
10962786 | Leighton et al. | Mar 2021 | B2 |
20010021239 | Itoga | Sep 2001 | A1 |
20010033440 | Togino | Oct 2001 | A1 |
20020021461 | Ono et al. | Feb 2002 | A1 |
20020070904 | Okuyama | Jun 2002 | A1 |
20030169397 | Reichow | Sep 2003 | A1 |
20030184868 | Geist | Oct 2003 | A1 |
20050094292 | Cahall | May 2005 | A1 |
20060119794 | Hillis et al. | Jun 2006 | A1 |
20060132914 | Weiss et al. | Jun 2006 | A1 |
20070008624 | Hirayama | Jan 2007 | A1 |
20070177275 | McGuire, Jr. | Aug 2007 | A1 |
20090051879 | Vitale et al. | Feb 2009 | A1 |
20090167651 | Minano et al. | Jul 2009 | A1 |
20100103078 | Mukawa et al. | Apr 2010 | A1 |
20100149073 | Chaum | Jun 2010 | A1 |
20100278480 | Vasylyev | Nov 2010 | A1 |
20100290127 | Kessler et al. | Nov 2010 | A1 |
20100321409 | Komori et al. | Dec 2010 | A1 |
20110007277 | Solomon | Jan 2011 | A1 |
20110050655 | Mukawa | Mar 2011 | A1 |
20110083741 | Munro | Apr 2011 | A1 |
20110083742 | Munro | Apr 2011 | A1 |
20110155331 | Lopin | Jun 2011 | A1 |
20110157600 | Lyon | Jun 2011 | A1 |
20110213664 | Osterhout et al. | Sep 2011 | A1 |
20110221656 | Haddick et al. | Sep 2011 | A1 |
20110226332 | Ford et al. | Sep 2011 | A1 |
20110227813 | Haddick et al. | Sep 2011 | A1 |
20110255303 | Nichol et al. | Oct 2011 | A1 |
20110286222 | Coleman | Nov 2011 | A1 |
20120002294 | Dobschal | Jan 2012 | A1 |
20120002295 | Dobschal et al. | Jan 2012 | A1 |
20130147686 | Clavin | Jun 2013 | A1 |
20130235191 | Miao | Sep 2013 | A1 |
20130242392 | Amirparviz et al. | Sep 2013 | A1 |
20140153102 | Chang | Jun 2014 | A1 |
20150205126 | Schowengerdt | Jul 2015 | A1 |
20160109708 | Schowengerdt | Apr 2016 | A1 |
20160154244 | Border et al. | Jun 2016 | A1 |
20160270656 | Samec et al. | Sep 2016 | A1 |
20190250405 | Leighton et al. | Aug 2019 | A1 |
20200042082 | Crispin | Feb 2020 | A1 |
20200049998 | Leighton | Feb 2020 | A1 |
20200183152 | Stannard | Jun 2020 | A1 |
20200183174 | Noui et al. | Jun 2020 | A1 |
20200225400 | Stannard | Jul 2020 | A1 |
20200278553 | Leighton et al. | Sep 2020 | A1 |
20210055788 | Crispin | Feb 2021 | A1 |
Number | Date | Country |
---|---|---|
107272199 | Oct 2017 | CN |
0785457 | Jul 1997 | EP |
1798592 | Jun 2007 | EP |
1736812 | Apr 2010 | EP |
3355315 | Aug 2018 | EP |
2069835 | Nov 1996 | RU |
271580 | Jan 2007 | TW |
2002099509 | Dec 2002 | WO |
2007014371 | Feb 2007 | WO |
2007019138 | Feb 2007 | WO |
2007062098 | May 2007 | WO |
2008109420 | Sep 2008 | WO |
2008110942 | Sep 2008 | WO |
2010033859 | Mar 2010 | WO |
2010062481 | Jun 2010 | WO |
2010106248 | Sep 2010 | WO |
2010112393 | Oct 2010 | WO |
2010123934 | Oct 2010 | WO |
2011113071 | Sep 2011 | WO |
2011124897 | Oct 2011 | WO |
2011130715 | Oct 2011 | WO |
2017027139 | Feb 2017 | WO |
2018009885 | Jan 2018 | WO |
2020123561 | Jun 2020 | WO |
2020146683 | Jul 2020 | WO |
Entry |
---|
Aye T M, “Miniature Guided Light Array Sequential Scanning Display for Head Mounted Displays,” Final Repod to US Army CECOM, May 15, 1998. Retrieved on-line from http://handle.dtic.mi1/100.2/ADA350745, 35 pages. |
Corresponding GB Patent Application GB 1200321.6 specification and drawings, filed Jan. 9, 2011, at UK Intellectual Property Office, to Cerr Limited, Inventors: Crosby, David Nicholas et al., 46 pages. |
UK Intellectual Property Office, Combined Search and Examination Report under Sections 17 and 18(3) of UK Patents Act 1977, dated May 8, 2012, issued on corresponding GB Patent Application GB1200312.6,to Cerr Limited, Inventors: Crosby, David Nicholas et al., 3 pages. |
International Search Report and Written Opinion dated Nov. 2, 2017 on International Patent Application PCTUS1741228, filed in Jul. 17, 2017 in the name of Daqri, LLC, 21 pages. |
International Search Report and Written Opinion dated Feb. 21, 2020 issued on International Patent Application PCT/US2019/065551, filed Dec. 10, 2019, in the name of Daqri LLC, 18 pages. |
International Filing Receipt Dec. 10, 2019, issued on International Patent Application PCT/US2019/065551, filed Dec. 10, 2018, in the name of Daqri LLC, 4 pages. |
International Search Report dated Jan. 9, 2020, issued on International Patent Application PCT/US19/55198, filed Oct. 8, 2019 in the name of Daqri, LLC. |
International Search Report and Written Opinion dated May 19, 2020 on International Patent Application PCT/US2020/012995, filed Jan. 9, 2020 in the name of Daqri, LLC, 40 pages. |
Office Action dated Aug. 27, 2020 issued on U.S. Appl. No. 16/739,103, filed Jan. 9, 2020, 2 pages. |
Notice of allowance and fee(s) due dated Apr. 22, 2021 issued on U.S. Appl. No. 16/214,142, filed Dec. 10, 2018, 17 pages. |
Office Action dated Apr. 6, 2021 issued on U.S. Appl. No. 16/709,787, filed Dec. 10, 2019, 24 pages. |
Office Action dated May 19, 2020 issued on U.S. Appl. No. 16/877,490, 1 page. |
Notice of allowance and fee(s) due dated Feb. 2, 2021 issued on U.S. Appl. No. 16/658,078, filed Oct. 19, 2019, 57 pages. |
Office Action dated Apr. 24, 2020, issued on U.S. Appl. No. 16/658,078, filed Oct. 19, 2019, 54 pages. |
Office Action dated Feb. 19, 2021 issued on U.S. Appl. No. 17/168,140, filed Feb. 4, 2021, 4 pages. |
Notice of allowance and fee(s) due dated Aug. 28, 2020, issued on U.S. Appl. No. 16/596,648, filed Oct. 8, 2019, 48 pages. |
Office Action dated Feb. 3, 2020 issued on U.S. Appl. No. 16/596,648, filed Oct. 8, 2019, 36 pages. |
U.S. Appl. No. 17/168,140, filed Feb. 4, 2021. |
Co-Pending U.S. Appl. No. 14/825,148, filed Aug. 12, 2015, 68 Pages. |
Co-Pending U.S. Appl. No. 16/214,142, filed Dec. 10, 2018, 163 Pages. |
Final Office Action dated Aug. 8, 2019 for U.S. Appl. No. 15/893,599, filed Feb. 10, 2018, 24 Pages. |
Final Office Action dated Aug. 31, 2016 for U.S. Appl. No. 14/825,148, filed Aug. 12, 2015, 14 Pages. |
Final Office Action dated Jan. 31, 2019 for U.S. Appl. No. 15/893,599, filed Feb. 10, 2018, 30 Pages. |
International Preliminary Report on Patentability for International Application No. PCT/US2017/041228, dated Jan. 17, 2019, 11 Pages. |
International Search Report and Written Opinion for International Application No. PCT/US2016/041588, dated Oct. 24, 2016, 32 Pages. |
Non-Final Office Action dated May 3, 2012 for U.S. Appl. No. 13/345,769, filed Jan. 9, 2012, 18 Pages. |
Non-Final Office Action dated Aug. 10, 2017 for U.S. Appl. No. 14/825,148, filed Aug. 12, 2015, 36 Pages. |
Non-Final Office Action dated May 17, 2016 for U.S. Appl. No. 14/825,148, filed Aug. 12, 2015, 16 Pages. |
Number | Date | Country | |
---|---|---|---|
20200233218 A1 | Jul 2020 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15206111 | Jul 2016 | US |
Child | 16845018 | US |