Patent Application
20180149776
Head mounted display devices used for example in augmented reality environments often have multiple cameras used for mapping and tracking purposes. Some of these cameras are active, in that they include their own illumination source, such as a laser or LED, to actively illuminate the scene. Active cameras include a depth camera for mapping the scene and recognizing gestures. Other cameras are passive, having no illumination source. Passive cameras include head tracking cameras for estimating head pose.
One problem with conventional head mounted display devices is that the high-powered light from active cameras, together with the tight spacing of the cameras behind the visor, may result in optical crosstalk between infrared light emitters and sensors that interferes with both the active and passive camera images. This may occur two ways. First, some portion of the light from an illumination source may be reflected by the visor directly back into optical sensors of the active and/or passive cameras according to Fresnel's equations. Second, light from the illumination source may couple into the visor, traveling through the visor and into optical sensors of the active and/or passive cameras. This phenomena, referred to as waveguiding, may be worsened as a result of smudges, contamination, fingerprints, and scratches on the visor surface.
Embodiments of the present technology relate to a system and method for preventing optical cross talk between one or more light sources and one or more optical sensors by reflection off of a visor and/or waveguiding within the visor. In embodiments, the system may be incorporated into a device, such as a head mounted display device, including one or more active and passive cameras mounted behind a visor. The one or more active cameras may include a depth camera including one or more IR light sources and an optical sensor which together operate to sense the depth of objects within the field of view of the depth camera. The one or more passive cameras may include head tracking cameras for estimating head pose, and video cameras for capturing video of a scene.
The system includes a number of light blocking components for preventing optical cross talk between light sources and sensors within a device such as a head mounted display device. The light blocking components may include a shroud mounted around the light source(s) of the one or more active cameras. The shroud may be optically opaque to the wavelengths of light emitted by the one or more light sources. The light blocking components may further include a gasket between the visor and the shroud creating a seal between the shroud and the visor.
The light blocking components may further include one or more features formed in or on the visor for disrupting waveguided light in the visor from reaching optical sensors of the cameras. The waveguide obstructing features may for example be one or more grooves formed in the visor. The grooves may be coated or filled with a material that is optically opaque to the wavelengths of light emitted by the one or more light sources. The grooves and opaque material block light from the one or more light sources that may otherwise enter the optical sensor via waveguiding.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
Embodiments of the present technology will now be described with reference to the figures, which in general relate to system of light blocking components for reducing optical cross talk within and between active and passive cameras mounted behind an optical shield such as a visor. In one embodiment explained below, one or more of the light blocking components may be implemented in the light sources and/or sensors of a head mounted display device (HMD) for presenting an augmented reality experience.
It is further understood that one or more of the light blocking components according to the present technology may be used in a wide variety of imaging devices other than those used in an HMD. The present technology may be used in any of various devices including cameras behind a shield, where light from at least one of the cameras interferes with the camera images as a result of the light reflecting off the shield and/or waveguiding within the shield.
As shown in
The HMD 2 may further include a variety of active and passive cameras mounted behind and adjacent to the visor 104. The active cameras may include for example a depth camera 110 having a pair of light sources 112 and an optical sensor 114 which may be an image sensor. The light sources 112 may be semiconductor devices such as for example laser diodes emitting for example pulsed light in the IR wavelengths. Other types of light sources are contemplated, such as light emitting diodes. The optical sensor 114 may be configured to capture a depth image of an area in the field of view of the sensor 114. The depth image may include a two-dimensional (2-D) pixel array of the captured area where each pixel in the 2-D pixel array may calculate a distance of an object in the captured area from the depth sensor 114. The depth image may capture depth values of the area via any suitable technique including, for example, gated and phase modulated time-of-flight, structured light, stereo image, or the like.
The active cameras may further include a pair of eye tracking cameras 116, one for each eye of a user, for sensing a gaze direction of the user. The eye tracking cameras may include a plurality of IR light sources 118 (four shown for each camera 116) which emit IR light toward the left and/or right eyes. Light reflected off of the left and/or right eyes is received back within optical sensors 120 which may be image sensors. Based on the amount of light received back in the respective sensors, the direction of the user's gaze may be determined. There may be a single eye tracking camera 116, and each eye tracking camera may have fewer or greater numbers of light sources 118, in further embodiments.
The passive cameras shown in
The passive cameras shown in
As noted, some or all of the depth camera 110, eye tracking camera 116, head tracking cameras 122 and video camera 124 may be adjacent to the visor 104. In embodiments, being adjacent means that the one or more light sources and/or optical sensors of the camera are behind the visor (when worn by a user) and slightly spaced from, or directly affixed to, a surface of the visor 104. Slightly spaced may include being spaced from the visor by up to 2 mm, but slightly spaced may include spacings that are larger than 2 mm in further embodiments.
The visor 104 may for example be formed of injection-molded polycarbonate, though it may be formed of other plastics or glass in further embodiments. The visor 104 may have coatings with different indicies of refraction than the air on either side of the visor to make an antireflection coating, and are designed to have very low reflectivity at the wavelength band of interest. Referring to the front view of
The visor 104 may further include an anti-reflective coating 128 applied to one or both surfaces of the visor 104. It is understood that one or more of the coated layers 126, 128 may be omitted in further embodiments, and the visor 104 may have additional or alternative coatings in further embodiments. The light blocking components described below may be used with shields other than a visor 104, such as for example shields that are not head-worn.
In accordance with aspects of the present technology, HMD 2 may include light blocking components for preventing light from the depth sensor light sources 112 from entering any of the adjacent optical sensors 114, 120, 122 and 124 of the active and/or passive components as a result of reflecting off the visor or waveguiding within the visor. Embodiments of the light blocking components are now described with reference to
Each shroud 130 may include angled sidewalls 132 adjacent the light sources 112 to define a generally cone-shaped structure having an opening at one end around each light source 112, and an opening at the opposite end adjacent the visor 104. The sidewalls 132 may be curved or straight. In embodiments, the angle θ of the sidewalls may be selected so as to be large enough to encompass at least the field of view of the depth sensor 110. In embodiments, the angle θ is also small enough to prevent light from striking the visor 104 at an angle which would result in total internal reflectance or Fresnel reflection of the incident light, instead of the desired propagation of the light through the visor 104. In embodiments, the angle θ of the sidewalls 132 may be 30° at a point adjacent the light source 112, but the angle θ may be larger or smaller than that in further embodiments.
The shroud 130 may be affixed to the visor 104, for example against one of the antireflective coatings 128. As shown in
Each gasket 140 may completely encircle the shroud 130 and light source 112, and may be formed of a gasket material of low reflectivity to absorb/block any light that impinges upon it. In the embodiment shown, the shrouds 130 and gaskets 140 have a generally rectangular shape, but the shrouds 130 and gaskets 140 may have other shapes in further embodiments, including for example square, oval and circular. The gaskets 140 may also be provided with an adhesive on opposed surfaces so that the gaskets 140 affix the shrouds 130 to the visor 104.
In addition to the shrouds 130 and gaskets 140, the light blocking components of the present technology may further include a pattern of grooves and/or an opaque material, individually or collectively referred to herein as light disrupting features. These light disrupting features are omitted from
In general, the light disrupting features may be one or more features which scatter the light through mechanical features in or on the visor 104, out-couple the light through anti-guiding (using for example high index materials), and/or absorb the light with optically absorbing materials. In examples explained below, the light disrupting features may include grooves or abrasions in a surface of the visor and/or an optically opaque material within the grooves/abrasions or on a surface of the visor. The pattern of grooves and/or opaque material may be formed in one or both surfaces of the visor 104 completely encircling the light sources 112.
The grooves 150 may be formed of a ring pattern of three separate grooves partially through the thickness of the visor 104. It is understood that there may be one, two or greater than three grooves 150 in a pattern of grooves in further embodiments. The grooves may be formed from a side of the visor 104 including the light source 112. However, as explained below, the grooves 150 may be formed into either surface of visor 104 or both surfaces of visor 104 in further embodiments.
In embodiments, the visor 104 may have a thickness of 1.5 mm, and the grooves 150 may be formed to a depth of 25 microns (μm) to 300 μm, and further for example 200 μm, through the thickness of the visor 104. It is understood that the depth of the grooves 150 may be less than 100 μm or greater than 300 μm in further embodiments. The grooves 150 may have a width, transverse to their depth, of 200 μm to 500 μm and further for example 400 μm. It is understood that the width of the grooves 150 may be less than 200μ greater than 500μ in further embodiments.
The pattern of grooves 150 may for example be defined during the injection molding process in which the visor 104 is formed. For example, the mold defining the shape and dimensions of visor 104 may include raised walls in the shape and dimensions of the grooves 150. In further embodiments, the grooves 150 may be machined into the visor 104 after it is fabricated, for example by a water jet cutting process. In a further embodiment, the grooves 150 may be formed using a laser.
The light disrupting features may further include an opaque material 152. For example, after the grooves 150 are formed, they may be filled with a material 152 opaque to the wavelengths of the one or more light sources 112 and having a higher index of refraction than the material of visor 104. The opaque material 152 may for example be black paint or epoxy which is painted on or printed into the grooves 150. As shown in
Light may be waveguided into the visor due to the disparate indexes of refraction of the visor 104 and surrounding ambient environment. Alternatively or additionally, contamination such as finger prints and/or impurities in one or more surfaces of the visor may allow light to get trapped within the visor and transmitted through the visor by waveguiding. Light (136a) may be waveguided solely within the visor 104 alone. In further embodiments, light (136b) may be waveguided within the visor 104 and one or more of the coatings 126, 128. The pattern of grooves 150 and material 152 are provided to absorb waveguided light in both instances as shown in
The pattern of grooves 150 in the embodiment of
In the embodiments of
While some examples of light disrupting features such as grooves, abrasions and optically opaque materials have been described, it is understood that other light disrupting features may be provided which prevent light, waveguided within the visor, from leaving the one or more optical sensors of the active cameras. Other patterned structures may be formed on or in a surface of visor 104, other mechanical features may be molded or stamped into or on the visor 104, and other dielectric or other materials may be used for anti-guiding the waveguided light to prevent it from leaving the light source(s) 112.
Embodiments described above may be effective at providing at least 20 decibels of isolation with regard to the amount light from the one or more light sources 112 that is reflected or waveguided directly into the optical sensors of the active and passive cameras.
In addition to or instead of the above-described light blocking components around the light sources 112, one or more of the light blocking components (the shroud 130, gasket 140, grooves 150 and/or opaque material 152) may be applied around one or more of the optical sensors of the active and/or passive cameras.
In summary, in one example, the present technology relates to a system for reducing an amount of light transmitted from a light source of an imaging device to an optical sensor of the imaging device by a shield, the optical sensor being adjacent to the shield, the system comprising: light blocking components, the light blocking components comprising one or more of: a shroud formed around the light source and extending from the light source toward the shield, the shroud being opaque to wavelengths emitted by the light source, a gasket formed around an edge of the shroud and connecting the shroud to the shield, the gasket absorbing wavelengths of light emitted by the light source, and light disrupting features formed in or on a surface of the shield, the light disrupting feature blocking light waveguided within the shield.
In another example, the present technology relates to a system for reducing an amount of light transmitted from a light source of an imaging device to an optical sensor of the imaging device by a visor, the light source and optical sensor being adjacent to the visor, the system comprising: a shroud formed around the light source and extending from the light source toward the shield, the shroud being opaque to wavelengths emitted by the light source; a gasket formed around an edge of the shroud and connecting the shroud to the shield, the gasket absorbing wavelengths of light emitted by the light source; and light disrupting features formed in or on a surface of the visor for preventing light from waveguiding within the visor.
In a further example, the present technology relates to a method of forming an imaging device for a head mounted display device, the head mounted display device comprising a visor, and the display device comprising a light source and optical sensor positioned behind the visor when worn by a user, the method comprising: (a) forming a shroud around the light source, extending from the light source toward the visor; and (b) forming light disrupting features on or in a surface of the visor at least partially encircling an area of the visor adjacent to the light source.
Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims. It is intended that the scope of the invention be defined by the claims appended hereto.
