A major trend in wearable devices is not only providing data to a user, but also sensing important information from a user. The user's eyes can provide critical information to help the user navigate through screens, monitor the health and alertness of the user, and provide feedback on reactions of the user to different sources of information. Eye monitoring commonly requires illumination sources, typically infrared lights, to be positioned in front of the eye. This front illumination adds devices and electrical connections to a highly visible part of eyewear, often limiting design aesthetics. Furthermore, the electrical connections can often pass through the hinge of the eyewear, and can result in the hinge becoming stiffer, reducing the reliability of the electrical connection, or both. There is a need for eye monitoring illumination systems to be positioned elsewhere on the eyewear.
The present disclosure provides for an optical element useful in an optical device for illuminating the pupil of an eye, particularly for use with a head mountable display that can include eye-tracking. The optical device includes a light source and an optical element that transmits light, where light emitted from the light source is directed by the optical element toward the pupil of the eye, and attributes of the eye can then be detected by an optical sensor such as a camera. The light source can emit infrared light that is not visible to the human eye, so that world view images and/or combined digital images of the head-mountable display are not compromised.
In one aspect, the present disclosure provides an optical element that includes a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the reflective polarizer and the embedded reflector, the retarder having a fast axis aligned at a retarder angle to the first polarization direction.
In another aspect, the present disclosure provides a head-mountable display that includes a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction. The head-mountable display further includes an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device.
In yet another aspect, the present disclosure provides a head-mountable tracking device that includes a lens having a concave first major surface and an opposing second major surface; a partial reflector disposed adjacent to the concave first major surface; an illuminator positioned to project a light beam toward the partial reflector, a portion of the light beam reflected by the partial reflector and capable of illuminating an eye positioned adjacent the illuminator; and an image receiving device positioned adjacent the illuminator and capable of receiving an image of the illuminated eye reflected from the partial reflector.
In yet another aspect, the present disclosure provides a tracking head-mountable display that includes a lens having a concave first major surface, an opposing second major surface, and an embedded reflector; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction. The tracking head-mountable display further includes an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device; an illuminator positioned adjacent the image forming device, capable of projecting an illuminator light beam toward the reflective polarizer; and an image receiving device positioned adjacent the illuminator; wherein the reflective polarizer, the retarder, and the embedded reflector together are capable of illuminating the eye positioned adjacent the illuminator, the image receiving device being capable of receiving an image of the illuminated eye.
The above summary is not intended to describe each disclosed embodiment or every implementation of the present disclosure. The figures and the detailed description below more particularly exemplify illustrative embodiments.
Throughout the specification reference is made to the appended drawings, where like reference numerals designate like elements, and wherein:
The figures are not necessarily to scale. Like numbers used in the figures refer to like components. However, it will be understood that the use of a number to refer to a component in a given figure is not intended to limit the component in another figure labeled with the same number.
The present disclosure provides for an optical element useful in an optical device for illuminating the pupil of an eye, particularly for use with a head mountable display that can include eye-tracking. The optical device includes a light source and an optical element that transmits light, where light emitted from the light source is directed by the optical element toward the pupil of the eye, and attributes of the eye can then be detected by an optical sensor such as a camera. The light source can emit infrared light that is not visible to the human eye, so that world view images and/or combined digital images of the head-mountable display are not compromised.
In the following description, reference is made to the accompanying drawings that forms a part hereof and in which are shown by way of illustration. It is to be understood that other embodiments are contemplated and may be made without departing from the scope or spirit of the present disclosure. The following detailed description, therefore, is not to be taken in a limiting sense.
All scientific and technical terms used herein have meanings commonly used in the art unless otherwise specified. The definitions provided herein are to facilitate understanding of certain terms used frequently herein and are not meant to limit the scope of the present disclosure.
Unless otherwise indicated, all numbers expressing feature sizes, amounts, and physical properties used in the specification and claims are to be understood as being modified in all instances by the term “about.” Accordingly, unless indicated to the contrary, the numerical parameters set forth in the foregoing specification and attached claims are approximations that can vary depending upon the desired properties sought to be obtained by those skilled in the art utilizing the teachings disclosed herein.
As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” encompass embodiments having plural referents, unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.
Spatially related terms, including but not limited to, “lower,” “upper,” “beneath,” “below,” “above,” and “on top,” if used herein, are utilized for ease of description to describe spatial relationships of an element(s) to another. Such spatially related terms encompass different orientations of the device in use or operation in addition to the particular orientations depicted in the figures and described herein. For example, if an object depicted in the figures is turned over or flipped over, portions previously described as below or beneath other elements would then be above those other elements.
As used herein, when an element, component or layer for example is described as forming a “coincident interface” with, or being “on” “connected to,” “coupled with” or “in contact with” another element, component or layer, it can be directly on, directly connected to, directly coupled with, in direct contact with, or intervening elements, components or layers may be on, connected, coupled or in contact with the particular element, component or layer, for example. When an element, component or layer for example is referred to as being “directly on,” “directly connected to,” “directly coupled with,” or “directly in contact with” another element, there are no intervening elements, components or layers for example.
As used herein, “have”, “having”, “include”, “including”, “comprise”, “comprising” or the like are used in their open ended sense, and generally mean “including, but not limited to.” It will be understood that the terms “consisting of” and “consisting essentially of” are subsumed in the term “comprising,” and the like.
Combining or “combiner” near-eye displays generally rely on the use of optics to both transmit the real world view to the user, and also project a secondary (e.g., digital) image to the eye. One type of combiner display may use a partial mirror, such as a 50% visible light transmission (VLT) mirror, which can transmit part of the world view and also reflect part of the secondary image. Another type of combiner display may use a reflective or weakly reflective polarizer which can nearly fully transmit one polarization state of the world view to the user and also nearly fully (or at least partially) reflect a polarized secondary image to the user. Another type of combiner display may use a dichroic, “notch”, or “comb” type reflector which can reflect a band of wavelengths of light (e.g., a first wavelength range of light) to a certain extent but also transmit other bands of wavelengths (e.g., second or more wavelength range of light) or partially transmit the reflection band of wavelengths.
A head-mountable display as provided herein is capable of transmitting a view of the real world to the user's eye(s) while also reflecting or transmitting a secondary image, such as one produced via a digital display. In one particular embodiment, an optical element such as a lens includes a coating or film that has a dichroic, “notched”, or “comb” type transmission and reflection profile. In one particular embodiment, the optical element includes a reflective polarizer that reflects one polarization state (e.g., a first polarization direction) and passes another polarization state (e.g., a second polarization direction orthogonal to the first polarization direction) to varying degrees. In some cases, the optical element may also include retarding layer such as a quarter-wave retarder. In some cases, the shape of the optical element can provide for a magnification of either of the secondary images, the real world view image, or both.
This transmission/reflection profile of the optical element (whether polarization dependent, wavelength dependent, or independent) enables the user to see, simultaneously, a view of the real world “combined” with the second image based on the wavelengths and/or polarization states of the real world and second image. The optical element itself or in combination with another refractive element and/or film and/or coating may provide image magnification based on refraction through and/or reflection from curved surfaces.
The optical device for illuminating the pupil of an eye, and the image sensor (e.g., camera) for gathering attributes of the eye, can be used as a stand-alone eye monitoring device, or it can be used in tandem with the head mounted display. Further descriptions of head mounted displays useful with the present invention include, for example, co-pending U.S. Provisional Patent Application Ser. No. 61/954,690, filed Mar. 18, 2014 entitled “Low Profile Image Combiner for Near-Eye Displays” and also U.S. Provisional Patent Application Ser. No. 61/977,166, filed Apr. 9, 2014, entitled “Near Eye Display System.” In one particular embodiment, the optical device for illuminating the pupil can be positioned adjacent the digital display for producing the secondary image in the head-mountable display that combines the real-world and secondary image. In some cases, the digital display and the image sensor can be positioned in the same imaging device, further reducing the electronics for use with a head mountable display that can include eye-tracking. It is to be understood that any of the eye illumination and sensing devices described herein can be used with a head-mounted display capable of providing a combined world-view and digital image.
A first polarization direction of the chief ray is transmitted by the linear reflective polarizer 107, and the linearly polarized light is converted to circularly polarized light ray 115 which is reflected by an embedded reflector 111 disposed within the base lens 113, between the first surface 114 and an opposing second surface. The reflected light ray 119 has the opposite circular polarization of circularly polarized light ray 115. Reflected light ray 119 is transmitted through the quarter-wave retarder 109, becomes linearly polarized in the second polarization direction orthogonal to the first polarization direction, is reflected by the linear reflective polarizer 107, and is transmitted again through quarter-wave retarder 109, becoming circularly polarized in the opposite direction than reflected light ray 119. The resulting ray 121 is reflected by reflector 111 becoming ray 125, again switching direction of circular polarization. Ray 125 is transmitted through the quarter-wave retarder 109 and passes through reflective polarizer 107 becoming digital image ray 127 having the first polarization direction. Digital image ray 127 is then visible to an eye 129. The reflector 111 may be a partial reflector, and form partially transmitted rays 117 and 123. A partial reflector allows the user to see a world-view in combination with the display image, as described elsewhere.
Quarter-wave retarder 109 is a well known optical device that converts linearly polarized light to circularly polarized light, and circularly polarized light to linearly polarized light. Examples of suitable material include ZeonorFilm® ZM16-138, available from Zeon Corp, Japan. The film is preferably oriented such that the stretch axis of the film is at a 45 degree angle from the block polarization axis of the linear reflective polarizer. In some cases, the retarder can be disposed immediately adjacent the reflective polarizer 107; however, in some cases, the retarder can instead be disposed immediately adjacent the reflector 111.
The partial reflector can be a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light, or the partial reflector can be a broadband partial mirror. In some cases, the embedded reflector 111 can be a curved reflector or a planar reflector.
These attributes of the eye 229 that can be detected may include one or more of the following: the viewing direction of the eye, diameter and changes in the diameter of the pupil, blinking of the eyelids, the eye tracking objects, and saccade movement. Eye tracking parameters may include velocity of the eye rotation and lag or phase between movement of an object and movement of the eye. Saccade movement may include duration, velocity, and pattern of the movement.
The partial reflector 207 may be made from a dichroic coating composed of one or more layers of an optically transparent material, using refractive index differences between the layers and adjacent layers to create reflection. The partial reflector may also be made of a thin metallic coating such as aluminum or silver. In some cases, the partial reflector may be made from a reflective polarizer. The partial reflector may be curved in one or more directions, or may be flat. Suitable optically transparent materials include silicon monoxide, silicon dioxide, magnesium fluoride, aluminum oxide, hafnium oxide, zirconium oxide, silicon nitride, titanium dioxide, polymer layers, other organic or inorganic materials, and combinations thereof.
The light source 202 may emit unpolarized light, polarized light, visible light, ultraviolet light, infrared light, or a combination thereof. All or a portion of the light may be linearly or circularly polarized. Using polarized light can change the illumination pattern on the eye (for example allowing either the lighting path shown in
It is to be understood that any of the eye-monitoring systems described herein can be combined with near-eye display systems having pellicle reflective elements, such as those described in co-pending U.S. Patent Application entitled “Near-Eye Display”, filed on an even date herewith. The eye monitoring attributes that can be detected may include one or more of the following: the viewing direction of the eye, diameter and changes in the diameter of the pupil, blinking of the eyelids, the eye tracking objects, and saccade movement. Eye tracking parameters may include velocity of the eye rotation and lag or phase between movement of an object and movement of the eye. Saccade movement may include duration, velocity, and pattern of the movement. The described pellicles may be useful for providing the reflective surface for the pupil illuminator and image receiving optics, as well as for providing a reflective surface for the near-eye display, as can be readily understood to those having ordinary skill in the art.
Following are a list of embodiments of the present disclosure.
Item 1 is an optical element, comprising: a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; and a retarder between the reflective polarizer and the embedded reflector, the retarder having a fast axis aligned at a retarder angle to the first polarization direction.
Item 2 is the optical element of item 1, wherein the retarder is disposed immediately adjacent the reflective polarizer.
Item 3 is the optical element of item 1 or item 2, wherein the retarder is disposed immediately adjacent the embedded reflector.
Item 4 is the optical element of item 1 to item 3, wherein the retarder is a quarter-wave retarder, and the retarder angle is about 45 degrees.
Item 5 is the optical element of item 1 to item 4, wherein the embedded reflector comprises a partial reflector.
Item 6 is the optical element of item 5, wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
Item 7 is the optical element of item 5, wherein the partial reflector comprises a broadband partial mirror.
Item 8 is the optical element of item 1 to item 7, wherein the embedded reflector is a planar reflector.
Item 9 is the optical element of item 1 to item 8, wherein the embedded reflector is a curved reflector capable of collimating an incident light beam.
Item 10 is a head-mountable display, comprising: a lens having a concave first major surface, an opposing second major surface, and an embedded reflector disposed therebetween; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction; and an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device.
Item 11 is the head-mountable display of item 10, wherein the retarder is disposed immediately adjacent the reflective polarizer.
Item 12 is the head-mountable display of item 10 or item 11, wherein the retarder is disposed immediately adjacent the embedded reflector.
Item 13 is the head-mountable display of item 10 to item 12, wherein the retarder is a quarter-wave retarder and the retarder angle is about 45 degrees.
Item 14 is the head-mountable display of item 10 to item 13, wherein the embedded reflector comprises a partial reflector.
Item 15 is the head-mountable display of item 14, wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
Item 16 is the head-mountable display of item 14, wherein the partial reflector comprises a broadband partial mirror.
Item 17 is the head-mountable display of item 10 to item 16, wherein the embedded reflector is a planar reflector.
Item 18 is the head-mountable display of item 10 to item 17, wherein the embedded reflector is a curved reflector capable of collimating an incident light beam.
Item 19 is the head-mountable display of item 10 to item 18, further comprising a tracking device disposed to detect a viewing direction of the eye, a diameter of the eye pupil, changes in a diameter of the eye pupil, a blinking of an eyelid, a tracking object of the eye, a saccade eye movement, or combination thereof.
Item 20 is the head-mountable display of item 19, wherein the tracking device comprises: an illuminator positioned to project a light beam toward the embedded reflector, a portion of the light beam reflected to illuminate the eye positioned adjacent the illuminator; an image receiving device positioned adjacent the illuminator and capable of receiving an image of the illuminated eye.
Item 21 is a head-mountable tracking device, comprising: a lens having a concave first major surface and an opposing second major surface; a partial reflector disposed adjacent to the concave first major surface; an illuminator positioned to project a light beam toward the partial reflector, a portion of the light beam reflected by the partial reflector and capable of illuminating an eye positioned adjacent the illuminator; and an image receiving device positioned adjacent the illuminator and capable of receiving an image of the illuminated eye reflected from the partial reflector.
Item 22 is the head-mountable tracking device of item 21, wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
Item 23 is the head-mountable tracking device of item 21 or item 22, wherein the partial reflector comprises a broadband partial mirror.
Item 24 is the head-mountable tracking device of item 21 to item 23, wherein the partial reflector comprises a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface.
Item 25 is the head-mountable tracking device of item 21 to item 24, wherein the image receiving device is capable of detecting a viewing direction of the eye, a diameter of the eye pupil, changes in a diameter of the eye pupil, a blinking of an eyelid, a tracking object of the eye, a saccade eye movement, or combination thereof.
Item 26 is a tracking head-mountable display, comprising: a lens having a concave first major surface, an opposing second major surface, and an embedded reflector; a reflective polarizer aligned to a first polarization direction and disposed adjacent the concave first major surface; a retarder between the concave first major surface and the reflective polarizer, the retarder having a fast axis aligned at a retarder angle to the first polarization direction; an image forming device positioned to project an image light beam toward the concave first major surface, the image light beam comprising light polarized in the first polarization direction, wherein at least a portion of the image light beam is capable of being directed toward an eye disposed adjacent the image forming device; an illuminator positioned adjacent the image forming device, capable of projecting an illuminator light beam toward the reflective polarizer; and an image receiving device positioned adjacent the illuminator; wherein the reflective polarizer, the retarder, and the embedded reflector together are capable of illuminating the eye positioned adjacent the illuminator, the image receiving device being capable of receiving an image of the illuminated eye.
Item 27 is the tracking head-mountable display of item 26, wherein the retarder is disposed immediately adjacent the reflective polarizer.
Item 28 is the tracking head-mountable display of item 26 or item 27, wherein the retarder is disposed immediately adjacent the embedded reflector.
Item 29 is the tracking head-mountable display of item 26 to item 28, wherein the retarder is a quarter-wave retarder and the retarder angle is about 45 degrees.
Item 30 is the tracking head-mountable display of item 26 to item 29, wherein the embedded reflector comprises a partial reflector.
Item 31 is the tracking head-mountable display of item 30, wherein the partial reflector comprises a dichroic reflector capable of reflecting at least a first wavelength range of light and transmitting other wavelength ranges of light.
Item 32 is the tracking head-mountable display of item 30, wherein the partial reflector comprises a broadband partial mirror.
Item 33 is the tracking head-mountable display of item 26 to item 32, wherein the embedded reflector is a planar reflector.
Item 34 is the tracking head-mountable display of item 26 to item 33, wherein the embedded reflector is a curved reflector capable of collimating an incident light beam.
Item 35 is the tracking head-mountable display of item 26 to item 34, wherein the illuminator light beam comprises a polarized light beam aligned to the first polarization direction.
Item 36 is the tracking head-mountable display of item 26 to item 35, wherein image of the illuminated eye comprises a viewing direction of the eye, a diameter of the eye pupil, changes in a diameter of the eye pupil, a blinking of an eyelid, a tracking object of the eye, a saccade eye movement, and combination thereof.
Unless otherwise indicated, all numbers expressing feature sizes, amounts, and physical properties used in the specification and claims are to be understood as being modified by the term “about.” Accordingly, unless indicated to the contrary, the numerical parameters set forth in the foregoing specification and attached claims are approximations that can vary depending upon the desired properties sought to be obtained by those skilled in the art utilizing the teachings disclosed herein.
All references and publications cited herein are expressly incorporated herein by reference in their entirety into this disclosure, except to the extent they may directly contradict this disclosure. Although specific embodiments have been illustrated and described herein, it will be appreciated by those of ordinary skill in the art that a variety of alternate and/or equivalent implementations can be substituted for the specific embodiments shown and described without departing from the scope of the present disclosure. This application is intended to cover any adaptations or variations of the specific embodiments discussed herein. Therefore, it is intended that this disclosure be limited only by the claims and the equivalents thereof.
This application is a continuation of U.S. application Ser. No. 15/127,040, filed Sep. 19, 2016, now published, which is a National Stage entry of International Application No. PCT/US2015/023000, filed Mar. 27, 2015, which claims the benefit of U.S. Provisional Application No. 61/977,171, filed Apr. 9, 2014, the disclosure of which is incorporated by reference in their entirety herein.
Number | Name | Date | Kind |
---|---|---|---|
5654827 | Reichert | Aug 1997 | A |
5715023 | Hoppe | Feb 1998 | A |
5801885 | Togino | Sep 1998 | A |
6075651 | Hoppe | Jun 2000 | A |
6384982 | Spitzer | May 2002 | B1 |
6421183 | Ophey | Jul 2002 | B1 |
8576484 | Okamoto | Nov 2013 | B2 |
8743298 | Inoue | Jun 2014 | B2 |
20070273970 | Hoppe et al. | Nov 2007 | A1 |
20080051135 | Destain et al. | Feb 2008 | A1 |
20080278812 | Amitai | Nov 2008 | A1 |
20100202048 | Amitai et al. | Aug 2010 | A1 |
20120019645 | Maltz | Jan 2012 | A1 |
20120056897 | Okamoto | Mar 2012 | A1 |
20120062990 | Okamoto | Mar 2012 | A1 |
20120086907 | Coleman et al. | Apr 2012 | A1 |
20120147465 | Ruhle et al. | Jun 2012 | A1 |
20130222384 | Futterer | Aug 2013 | A1 |
20130265227 | Julian | Oct 2013 | A1 |
20130265231 | Cleveland et al. | Oct 2013 | A1 |
20140240843 | Kollin | Aug 2014 | A1 |
20150287048 | Nortrup | Oct 2015 | A1 |
20160209656 | Urey | Jul 2016 | A1 |
Number | Date | Country |
---|---|---|
102005062847 | Jul 2007 | DE |
2007286317 | Nov 2007 | JP |
2009-157634 | Jul 2009 | JP |
10-2014-0017735 | Feb 2014 | KR |
WO 9936826 | Jul 1999 | WO |
WO 2008082703 | Jul 2008 | WO |
WO 2008129539 | Oct 2008 | WO |
WO 2013066634 | May 2013 | WO |
WO 2013070788 | May 2013 | WO |
WO 2013103443 | Jul 2013 | WO |
WO 2013112705 | Aug 2013 | WO |
WO 2013122711 | Aug 2013 | WO |
WO 2015142654 | Sep 2015 | WO |
WO 2015157482 | Oct 2015 | WO |
Entry |
---|
International Search Report for PCT International Application No. PCT/US2015/023000, dated Jul. 8, 2015, 4 pages. |
Number | Date | Country | |
---|---|---|---|
20200150439 A1 | May 2020 | US |
Number | Date | Country | |
---|---|---|---|
61977171 | Apr 2014 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15127040 | US | |
Child | 16745415 | US |