Non-telecentric emissive micro-pixel array light modulators and methods for making the same

Information

  • Patent Grant
  • 11598954
  • Patent Number
    11,598,954
  • Date Filed
    Wednesday, January 29, 2020
    4 years ago
  • Date Issued
    Tuesday, March 7, 2023
    a year ago
  • CPC
  • Field of Search
    • CPC
    • G02B27/0075
    • G02B27/0018
    • G02B30/10
    • G02B30/50
    • G02B6/003
    • G02B6/0046
    • G02B6/0058
    • G02B26/08
    • G02B30/33
    • G02B2027/0178
    • G02B26/0875
    • G02B26/125
    • G02B26/127
    • G02B27/0172
    • G02B27/0176
    • G02B27/10
    • G02B27/283
    • G02B3/00
    • G02B3/0056
    • G02B3/0062
    • G02B3/0068
    • G02B30/00
    • G02B2005/1804
    • G02B30/27
    • H04N13/398
    • H04N13/30
    • H04N13/32
    • H04N1/047
    • H04N1/1135
    • H04N1/12
    • H04N1/195
    • H04N13/307
    • H04N13/324
    • H04N13/359
    • H04N2201/0082
    • H04N2201/03158
    • H04N2201/0471
    • H04N2201/04729
    • H04N2201/04731
    • H04N2201/04734
    • H04N2201/04744
    • H04N2201/04767
    • H04N2201/04789
    • H04N2201/04791
    • H04N13/218
    • H04N13/239
    • H04N13/286
    • H04N13/305
    • H04N13/31
    • H04N13/312
    • H04N13/315
    • H04N13/351
    • H04N13/363
    • H04N13/373
    • H04N13/376
    • H04N13/38
    • H04N2201/001
    • H04N2213/001
    • H04N9/3182
  • International Classifications
    • H04N13/30
    • G02B27/00
    • H04N13/398
    • G02B30/10
    • Term Extension
      418
Abstract
Emissive micro-pixel spatial light modulators with non-telecentric emission are introduced. The individual light emission from each multi-color micro-scale emissive pixel is directionally modulated in a unique direction to enable application-specific non-telecentric emission pattern from the micro-pixel array of the emissive spatial light modulator. Design methods for directionally modulating the light emission of the individual micro-pixels using micro-pixel level optics are described. Monolithic wafer level optics methods for fabricating the micro-pixel level optics are also described. An emissive multi-color micro-pixel spatial light modulator with non-telecentric emission is used to exemplify the methods and possible applications of the present invention: ultra-compact image projector, minimal cross-talk 3D light field display, multi-view 2D display, and directionally modulated waveguide optics for see-through near-eye displays.
Description
BACKGROUND OF THE INVENTION
1. Field of the Invention

Non-telecentric emission spatial light modulators, emissive micro-pixel displays, ultra-compact image projectors, directional light modulators, multi-view 2D displays, 3D displays, near-eye displays, head-up displays.


2. Prior Art

Spatial light modulators (SLMs) are a class of optoelectronic devices having a planar array of micro-scale pixels that are typically used as an image source in display systems. Such light modulators typically fall in one of three distinctive categories: reflective, transmissive or emissive. Examples of reflective SLMs include micro mirror array devices and liquid crystal on silicon (LCoS) devices. Examples of transmissive SLMs include high temperature poly-silicon liquid crystal (HTPS) devices. Examples of emissive SLMs include emissive micro-pixel array devices. One example of an emissive micro-pixel array device may be based on the Quantum Photonic Imager or QPI® imager described in U.S. Pat. Nos. 7,623,560, 7,767,479, 7,829,902, 8,049,231, 8,243,770 and 8,567,960 and organic light emitting diode (OLED) micro-pixel array devices. Both reflective and transmissive SLMs typically require an external light source to modulate images while an emissive SLM generates its own light. In general, all current categories of SLMs modulate telecentric light; meaning the modulated light bundles have their chief rays perpendicular to the plane of the light modulator pixel array. In the case of reflective and transmissive SLMs, telecentric light modulation is dictated by the design limitations of their external light source. Telecentric light emission is the only option available for emissive SLMs with a Lambertian emission profile such as OLED based SLMs.


Example micro-emissive solid state light-emitting display elements suitable for use with the embodiments herein include, without limitation, those described in U.S. Pat. Nos. 7,623,560, 7,767,479, 7,829,902, 8,049,231, 8,243,770 and 8,567,960. These SSL imagers feature high brightness, in a multi-color emissive micro-pixel spatial array with all of its needed drive circuitry in a single device. Within the context of this disclosure the term “SSL imager” is henceforth intended to mean an optoelectronics device that comprises an array of emissive micro-scale solid state light (SSL) emitting pixels. The SSL light emitting pixels of such an imager, hereinafter referred to as simply SSL imagers, are typically either a light emitting diode (LED) or laser diode (LD) whose on-off state is controlled by the drive circuitry contained within a CMOS device upon which the emissive micro-scale pixel array is formed or bonded. The pixels within the emissive micro-scale pixel array of an SSL imager are individually addressable through its drive circuitry, such as CMOS or the comparable, enabling an SSL imager to emit light that is modulated spatially, chromatically and temporally. The multiple colors emitted by an SSL imager share the same pixel optical aperture. In an SSL imager best suited for use with the embodiments herein, each SSL imager pixel emits at least partially collimated (or non-Lambertian) light, in the case of a QPI SSL imager, with an angle of divergence ranging, by design, from ±5° to ±45°. The size of the pixels comprising the emissive array of an SSL imager would typically be in the range of approximately 5-20 microns with the typical emissive surface area of the device being in the range of approximately 15-150 square millimeter. An SSL imager preferably can be designed with minimal gap between its emissive pixel array area and the device physical edge, allowing a multiplicity of SSL imagers, including QPI imagers, to be tiled to create any arbitrary size emissive display area.


Although all current categories of SLMs preferably modulate telecentric light, there is much to be gained from a non-telecentric light emission SLM. Since reflective and transmissive SLM's non-telecentric light modulation capability is limited by their external light source, and an emissive OLED-based SLM cannot achieve non-telecentric light emission by virtue of its Lambertian light emission profile, the SSL imager with its emissive multi-color micro-pixels that emits collimated (or non-Lambertian) light is uniquely qualified to achieve non-telecentric light modulation. It is therefore an objective of this invention to extend the design and manufacturing methods of an SSL imager to include the capability of non-telecentric light emission for the numerous possible applications that stand to benefit from such capability, some few of which are described herein by way of non-limiting examples only.



FIG. 1A illustrates the prior art design concept of a projection display that uses a telecentric light emission SLM. As illustrated in FIG. 1A, the divergence pattern of the light bundles 105 emitted from the telecentric emission SLM 110 dictates the use of a large diameter projection optics 115 which typically dictates the large optical track length 120, which in turn makes the overall design of a projection system that uses the telecentric emission SLM 110 overly bulky. It is therefore one of the objectives of this invention to introduce non-telecentric emission SLM methods that enable smaller diameter projection optics, and consequently achieve shorter optical track lengths and a substantially more compact overall projection system.



FIG. 1B illustrates the prior art designs of a 3D light field display that uses a telecentric light emission SLM, for example U.S. Pat. Nos. 8,928,969, 8,854,724 and 9,195,053. In these types of displays, an array of lenses (130-132) are used whereby each of these lenses (130 for example) directionally modulates the light emitted from the sub-array of the SLM micro pixels 115 to subtend into a unique set of directions depending on the spatial position of each pixel within the sub-array of pixels. As illustrated in FIG. 1B, the divergence pattern of the telecentric light bundles 135 emitted from the pixels at the boundaries of each lens (130 for example) corresponding pixel sub-array would partially illuminate the adjacent lenses (131 and 132 for example). This effect, which is often referred to as “cross-talk”, causes undesirable “ghost” distortions in the directionally modulated 3D image. It is therefore another objective of this invention to introduce non-telecentric emission SLM methods that enable a 3D light field display exhibiting minimal cross-talk image distortion.


In the design of 3D displays, directional modulation of the emitted light is necessary to create the 3D viewing perception. In a typical 3D display, a backlight with uniform illumination in multiple illumination directions is required to display images of the same scene from different directions by utilizing some combination of spatial multiplexing and temporal multiplexing in the SLM. In these 3D displays, the light that typically comes from the directional backlight is usually processed by a directionally selective filter (such as diffractive plate or a holographic optical plate for example FIG. 1D, U.S. Pat. No. 7,952,809) before it reaches the spatial light modulator pixels that modulate the light color and intensity while keeping its directionality.


Currently, prior art directional light modulators are a combination of an illumination unit comprising multiple light sources and a directional modulation unit that directs the light emitted by the light sources to a designated direction (see FIGS. 1D, 1E & 1F). As illustrated in FIGS. 1A, 1B & 1C which depict several variants of the prior art, an illumination unit is usually combined with an electro-mechanical movement device such as scanning mirrors, a rotating barriers (see U.S. Pat. Nos. 6,151,167, 6,433,907, 6,795,221, 6,803,561, 6,924,476, 6,937,221, 7,061,450, 7,071,594, 7,190,329, 7,193,758, 7,209,271, 7,232,071, 7,482,730, 7,486,255, 7,580,007, 7,724,210, 7,791,810 and U.S. Patent Application Publication Nos. 2010/0026960 and 2010/0245957, or electro-optically such as liquid lenses or polarization switching (see U.S. Pat. Nos. 5,986,811, 6,999,238, 7,106,519, 7,215,475, 7,369,321, 7,619,807, 7,952,809 and FIGS. 1A, 1B & 1C).


In addition to being slow, bulky and optically lossy, the prior art directional backlight units typically need to have narrow spectral bandwidth, high collimation and individual controllability for being combined with a directionally selective filter for 3D display purposes. Achieving narrow spectral bandwidth and high collimation requires device level innovations and optical light conditioning, increasing the cost and the volumetric aspects of the overall display system. Achieving individual controllability requires additional circuitry and multiple light sources, increasing the system complexity, bulk and cost. It is therefore an objective of this invention to introduce directional light modulators that overcome the limitation of the prior art, thus making it feasible to create distortion free 3D and multi-view 2D displays that provide the volumetric advantages plus a viewing experience over a wide viewing angle.


Additional objectives and advantages of this invention will become apparent from the following detailed description of preferred embodiments thereof that proceeds with reference to the accompanying drawings.





BRIEF DESCRIPTION OF THE DRAWINGS

The invention is illustrated by way of example, and not by way of limitation, in the Figs. of the accompanying drawings in which like reference numerals refer to similar elements.



FIG. 1A illustrates prior art light projection that uses a telecentric spatial light modulator.



FIG. 1B illustrates a prior art directional light modulator that uses a telecentric spatial light modulator.



FIG. 1C illustrates a prior art directional light modulator that uses a liquid lens.



FIG. 1D illustrates a prior art directional light modulator that uses scanning mirrors.



FIG. 1E illustrates a prior art directionally modulated backlight.



FIG. 1F illustrates a prior art directional display using a directionally modulated backlight.



FIG. 2A illustrates a cross sectional view of a generalized non-telecentric emissive micro pixel light modulator (SSL imager) in accordance with this invention.



FIGS. 2B-1 AND 2B-2 illustrate top views of the light coupling topside of the photonic layer of the non-telecentric emissive micro pixel light modulator of this invention.



FIGS. 2C-1 AND 2C-2 illustrate the directional light modulation aspects of the non-telecentric emissive micro pixel directional light modulator of this invention.



FIGS. 2D-1, 2D-2 AND 2D-3 illustrate the geometrical aspects of the directional light modulation pixel groups of the non-telecentric emissive micro pixel directional light modulator of this invention.



FIG. 3A illustrates a schematic cross section of an embodiment of this invention in which the array pixel level micro optical elements are realized as de-centered refractive optical elements (ROE).



FIG. 3B illustrates a face view of the directional modulation layer of an embodiment of this invention in which the array pixel level micro optical elements are realized as de-centered refractive optical elements (ROE).



FIG. 4A illustrates a schematic cross section of an embodiment of this invention in which the array pixel level micro optical elements are realized as tilted refractive optical elements (ROE).



FIG. 4B illustrates a face view of the directional modulation layer of an embodiment of this invention in which the array pixel level micro optical elements are realized as tilted refractive optical elements (ROE).



FIG. 5A illustrates a schematic cross section of a waveguide exit of an embodiment of this invention in which the array pixel level micro optical elements are realized as spatially modulated refractive optical elements (ROE).



FIG. 5B illustrates a top view of the waveguide exit of an embodiment of the invention in which the array pixel level micro optical elements are realized as spatially modulated refractive optical elements (ROE).



FIG. 6A illustrates an embodiment of this invention in which the array pixel level micro optical elements are realized as diffractive optical elements (DOE).



FIG. 6B illustrates an example in which the SSL imager pixels' diffractive optical elements are realized using multiple dielectric layers that form a blazed grating.



FIG. 6C illustrates an example of the case when multi-level gratings are used to realize the desired diffraction angle across the multiple wavelengths light emission bandwidth of the SSL imager pixels.



FIG. 7A illustrates a wafer level optics (WLO) fabrication process of the pixel level micro optical elements of the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 7B illustrates a lithographic mask set used in the wafer level optics (WLO) fabrication process of the pixel level micro optical elements of the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 7C illustrates a wafer level optics (WLO) fabrication process of a de-centered pixel level micro optical elements of the non-telecentric emissive micro pixel light modulator of this invention.



FIGS. 7D-7M illustrate a wafer level optics (WLO) fabrication process sequence of the pixel level micro optical elements of the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 8A illustrates a design method of an ultra compact display projector enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 8B illustrates the superior optical efficiency and uniformity of the ultra compact display projector of FIG. 8A enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 8C illustrates the superior volumetric efficiency of the ultra compact display projector of FIG. 8A enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 9 illustrates a design method of a minimum cross-talk light field modulator enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 10A illustrates a top view of a multi-view 2D display enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 10B illustrates a side view of a multi-view 2D display enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 11A illustrates a side view of a waveguide light modulator enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 11B illustrates a top view of a waveguide light modulator enabled by the non-telecentric emissive micro pixel light modulator of this invention.



FIG. 11C illustrates a side view of a tapered waveguide light modulator enabled by the non-telecentric emissive micro pixel light modulator of this invention.





DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

References in the following detailed description of the present invention to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in this detailed description are not necessarily all referring to the same embodiment.


In the description to follow, references are made to the word groups, such as in a directional modulation groups of micro pixels and similar references. When a non-telecentric emissive micro-pixel array light modulator in accordance with the present invention is to display a light field, reference to a group of pixels or to the corresponding micro optical elements is a reference to the pixels or micro optical elements associated with a single hogel. When the present invention is to display one or more two dimensional scenes at the same time, reference to a group of pixels or to the corresponding micro optical elements is a reference to all pixels of the non-telecentric emissive micro-pixel array light modulator or to one of the groups of pixels associated with a respective two dimensional scene.


The embodiments herein combine the emissive micro pixel array capabilities of an SSL imager with a monolithically fabricated pixel level micro optical element (referred to in the claims as a directional modulation layer) to create a non-telecentric spatial light modulator that performs the combined functionalities of color and brightness as well as directional modulation of the light emitted from each of its emissive micro pixels. Pixel level micro optical elements are a class of wafer level optics (WLO) which, in accordance with the present invention, are fabricated monolithically on an SSL imager wafer from semiconductor dielectric materials, such silicon oxide or silicon nitride, or alternatively with a UV curable polymer using ultra violet (UV) imprint lithography. As used herein, wafer level or wafer means a device or matrix of devices having a diameter of at least 2 inches, and more preferably 4 inches or more. Among the primary advantages of WLO are the ability to fabricate small feature micro-scale optical elements and the ability to precisely align multiple layers of WLO optical elements with the optoelectronics elements of devices such as the SSL imager or a CMOS sensor, for example. The alignment precision that can be achieved by typical WLO fabrication techniques can be much less than one micron. The combination of the individual pixel addressability of the emissive micro pixel array of the SSL imager and a precisely aligned micro pixel level optical elements, herein referred to collectively as the “non-telecentric SSL imager”, creates the first non-telecentric emissive SLM which enables the numerous applications highlighted in the previous discussion and detailed henceforth.


In the embodiments herein, pixels' color, brightness and directional light modulation is achieved by the combination of the SSL imager emissive pixels and light bending achieved by their associated micro pixel level optics that collectively comprise the non-telecentric emission SSL imager.



FIG. 2A illustrates a general cross sectional view of an exemplary non-telecentric emissive micro pixel (spatial) light modulator (SSL imager) 200 that may be used with the invention. As illustrated in FIG. 2A, the overall structure of the exemplary SSL imager 200 is a stack of multiple layers comprising the photonic micro pixels array layer 205 with the control layer 225 bonded to its non-emissive backside 233 and the directional modulation layer 245 and the cover glass layer 235 (optional in some embodiments) bonded to its emissive topside 230. The photonic layer 205 comprises the array of emissive multi-color micro pixels 210 with each micro pixel being a photonic cavity defined by its reflective sidewalls 220 and its reflective top and back side contacts that form the topside 230 and backside 233 of the photonic layer 205; respectively. The photonic layer 205 is a stack of multiple color emission III/V semiconductor sub-layers 215 which, when pixelated (i.e., formed into a micro pixel array using semiconductor lithography, etch and deposition techniques), form a multi-color stack of heterojunction diodes within the photonic cavity of each of the micro pixels 210 comprising the micro pixel array 200. Each of the micro pixels 210 is electrically coupled to the control layer 225 with multiple contact metal micro vias through the backside 233 and sidewalls 220 to control the on-off state of each pixel color emission sub-layer 215. The control layer 225 is a complementary metal oxide semiconductor (CMOS) comprising multiple digital logic sub-layers designed to convert (or process) the SSL imager digital input, coupled through the CMOS contact vias, into electrical signals that are coupled to each pixel to modulate their emitted light color and brightness. Depending on the geometry of the CMOS technology process used to fabricate the control layer 225, for example 180-nm CMOS versus 65-nm or smaller geometry CMOS, the control layer 225 can be used to implement either merely the micro pixel driving circuitry or to further implement the complex digital image processing of the digital image input that would lead to generating the micro pixel's electrical drive signal.



FIGS. 2B-1 and 2B-2 illustrate top views of the light coupling top side 230 of the photonic layer 205 of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 according to embodiments herein. As illustrated in FIGS. 2B-1 and 2B-2, the light coupling topside 230 of each micro pixel 210 is comprised of a multiplicity of waveguides 260, which are formed on the topside sub-layer 230 using semiconductor lithography, etch and deposition techniques. As shown in FIGS. 2B-1 and 2B-2, the waveguides 260 may be located at various positions with respect to the light coupling top side 230 of the photonic layer 205. Depending on the waveguides 260 diameter, depth spacing pattern, and the dielectric semiconductor material used, the angle of divergence of the collimated light emission from micro pixels 210 can be tailored within an angle of divergence ranging from ±5° to ±45°. Referring back to FIG. 2A, the at least partially collimated light emitted from each of the micro pixels 210 is coupled onto their corresponding micro pixel level optical elements 250 comprising the directional modulation layer 245.



FIGS. 2C-1 and 2C-2 illustrates the functional aspects of the directional modulation layer 245 of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein. As illustrated in the multiple panels of FIGS. 2C-1 and 2C-2, the micro optical element 250 associated with each of the micro pixels 210 may be designed to direct (or directionally modulate) the light coupled onto it from its corresponding micro pixels 210 to a unique direction relative to its perpendicular axis. The multiple panels of FIGS. 2C-1 and 2C-2 illustrate two possible examples of the directional modulation patterns that can be realized by the directional modulation layer 245 of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein. The first panel of FIG. 2C-1 illustrates an example in which the directional modulation layer 245 is designed to realize a convergent directional modulation pattern with the light emitted from the directional modulation group 270 of micro pixels 210 directionally converge systematically toward the perpendicular axis from the peripheral edges of the directional modulation group 270 toward its center. The second panel of FIG. 2C-2 illustrates an example in which the directional modulation layer 245 is designed to realize a divergent directional modulation pattern with the light emitted from the directional modulation group 270 of micro pixels 210 directionally diverge systematically away from the perpendicular axis from the center of the directional modulation group 270 toward its peripheral edges. In FIGS. 2C-1 and 2C-2, the arrows placed at the center of each of the micro pixels 210 are meant to indicate the direction of the chief ray of the light bundle emitted from each of the micro pixels 210 as represented by the angle of each respective arrow in the (x,y) plane and the length of each respective arrow representing or suggestive of its angle from the perpendicular axis.



FIGS. 2D-1, 2D-2 and 2D-3 illustrate the geometrical aspects of the directional modulation pixel groups 270 of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein. As illustrated in the multiple panels of FIGS. 2D-1, 2D-2 and 2D-3, the geometrical shape of the directional modulation pixel groups 270, in terms of the number of pixels representing its dimensions in the (x,y) plane of the micro pixel array, can possibly be a square (see FIG. 2D-1), rectangle (see FIG. 2D-3) or hexagonal (see FIG. 2D-2) among many possible shapes depending on the intended application. The size, in micro pixels, of the directional pixel group 270 can extend to include either a sub-region of the SSL imager micro pixel array or the entire micro pixel array of the SSL imager. In the case when the directional pixel group 270 extends over a sub-region of the SSL imager micro pixel array, it could be a repeated directional modulation pattern or in some cases it could be a unique directional modulation pattern for each directional modulation pixel group 270 depending on the application.


The pixel level micro optical elements 250 of the directional modulation layer 245 would have the same planar dimensions in the (x,y) plane as their respective emissive micro pixel 210. The pixel level micro optical elements 250 could be realized as either a refractive optical element (ROE) or a diffractive optical element (DOE). In either of these cases, the optical design parameters of each of the pixel level micro optical elements 250 would be selected to realize the selected directional modulation pattern across the modulation pixel group 270 as explained earlier. The pixel level micro optical elements 250 would be fabricated monolithically on the SSL imager wafer from either semiconductor dielectric materials, such silicon oxide or silicon nitride, or from polymer using ultra violet (UV) imprint lithography. In one embodiment, the fabrication of the pixel level micro optical elements 250 would be accomplished as a sequence of lithography, etch and deposition steps directly on the topside (the light emissive side) of the SSL imager wafer that already incorporates on its topside the photonic layer 205, which incorporates the array of micro pixels 230, and on its backside the CMOS control layer 225. In another embodiment of this invention, the fabrication of the pixel level micro optical elements 250 would be accomplished as a sequence of lithography, etch and deposition steps on one side of a wafer size cover glass layer 235, then the micro optical elements 250 side of the cover glass wafer is aligned and bonded directly on the top side (the light emissive side) of the SSL imager wafer that already incorporates the photonic layer 205 and the CMOS control layer 225. In yet another embodiment of this invention, the fabrication of the pixel level micro optical elements 250 would be accomplished as a sequence of lithography, etch and deposition steps on one side of the cover glass layer 235, then the micro optical elements 250 side of the glass cover wafer is used as a substrate to which the multiple sub-layers constituting the photonic layer 205, upon which the array of micro pixels 230 are formed, and the CMOS control layer 225 would be bonded sequentially to fabricate the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein.


In another embodiment, the fabrication of the pixel level micro optical elements 250 would be accomplished using WLO techniques in which the micro optical elements 250 would be formed by embossing a UV curable polycarbonate polymer on one side of the cover glass layer 235, then the formed micro optical elements 250 side of the wafer is aligned and bonded directly on the top side (the light emissive side) of the SSL imager wafer that already incorporates the photonic layer 205 and the CMOS control layer 225. In this method, the layer of pixel level micro optical elements 250 would be fabricated using a master mold of the array of micro optical elements 250 that is first fabricated using micro machining or laser ablation techniques, then copied on a UV transparent mold that would be used to emboss the UV curable polycarbonate polymer on one side of a wafer-size cover glass 235. The embossing of the array of micro optical elements 250 would also incorporate the embossing of alignment marks that would be used to align the micro optical elements 250 to their respective micro pixels 230 during the bonding process with the SSL imager wafer that already incorporates the photonic layer 205 and the CMOS control layer 225. In this case, the bonding of the glass cover wafer 235 with the embossed micro optical elements 250 to the of the SSL imager wafer, that already incorporates the photonic layer 205 and the CMOS control layer 225, would be accomplished using UV curable optical glue that would be spread or sprayed on the bonding surface of either or both wafers, then the wafers are brought into alignment using alignment marks previously incorporated onto the surface of each wafer, then the aligned wafer pair is scanned with a UV laser beam or illuminated by a UV flood light to cure the optical glue bonding layer placed on the bonding surfaces of the two wafers.


“De-Centered” Refractive Micro Optical Element (ROE)—



FIG. 3A illustrates one instantiation of the embodiment of this invention in which the array pixel level micro optical elements 250 are realized as refractive optical elements (ROE). In this embodiment the pixel level refractive micro optical elements 250 directional modulation aspects are realized using de-centered micro lenses 250-1 formed by successive layers of dielectric materials 310 and 320 with different indexes of refraction. FIGS. 3A and 3B are side and top views; respectively, of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein when realized as de-centered refractive micro optical elements 250-1. In this embodiment, the array of pixel level micro optical elements 250-1 would be fabricated monolithically at the wafer level as multiple layers of semiconductor dielectric materials, such silicon oxide for the low index layer 310 and silicon nitride for the high index layer 320, using semiconductor lithography, etch and deposition techniques. As illustrated in FIG. 3A, the array pixel level micro optical elements 250-1 are realized using multiple layers, the dielectric materials 310 and 320 with different indexes of refraction successively (sequentially) deposited to form the refractive surfaces of the pixel level micro optical elements 250-1. The top view panel of FIG. 3B illustrates the de-centered micro lenses method when used to realize an exemplary directional modulation group 270 whereby the de-centeration in the (x,y) plane of the refractive micro optical elements 250-1 would be proportional to the directional modulation to be realized by each of the refractive micro optical elements 250-1. As illustrated in FIG. 3B, in order to realize the desired directional modulation pattern across the intended directional modulation pixel group 270, the center of the refractive micro optical elements 250-1 associated with the micro pixel 230 at the center of the directional modulation group 270 would be aligned with the center of its respective pixel 230 but the center of the refractive micro optical elements 250-1 away from the center of directional modulation pixel group 270 would have their centers offset from the center of their respective pixels 230 with such an offset gradually increasing for micro optical elements 250-1 further away from the center of the directional modulation pixel group 270. The de-centeration offset of the refractive micro optical elements 250-1 would converge toward or diverge away from the center of the directional modulation pixel group 270 when the directional modulation pattern converges toward or diverges away from the center of the directional modulation pixel group 270, respectively. The angular separation δθ between the directional modulation realized by the individual de-centeration of the refractive micro optical elements 250-1 would be made proportional to the desired directional modulation of the angular extent Θ. For example, for an N×N pixels modulation group 270 having the angular extent Θ, the angular separation δθ between the directional modulation realized by the individual de-centeration of the refractive micro optical elements 250-1 would be equal to Θ/N.


“Tilted” Refractive Micro Optical Element (ROE)—



FIG. 4A illustrates yet another instantiation of the embodiment of this invention in which the array of pixel level micro optical elements 250 are realized as refractive optical elements (ROE). In this embodiment, the pixel level refractive micro optical elements 250 directional modulation aspects are realized using tilted micro lenses 250-2 formed by successive layers of dielectric materials 410 and 420 with different indexes of refraction. FIGS. 4A and 4B are side and top views; respectively, of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein when realized using tilted refractive micro optical elements 250-2. In this embodiment, the array of pixel level micro optical elements 250-2 would be fabricated monolithically at the wafer level as multiple layers of semiconductor dielectric materials, such as silicon oxide for the low index layer 410 and silicon nitride for the high index layer 420, using semiconductor lithography, etch and deposition techniques. As illustrated in FIG. 4A the array pixel level micro optical elements 250-2 are realized using multiple layers dielectric materials 410 and 420 with different indexes of refraction successively (sequentially) deposited to form the refractive surfaces of the pixel level micro optical elements 250-2. The top view panel of FIG. 4A illustrates the tilted micro lenses method when used to realize an exemplary directional modulation group 270 whereby the tilting of optical axis of the refractive micro optical elements 250-2 would be proportional to the directional modulation to be realized by each of the refractive micro optical elements 250-2. As illustrated in FIG. 4A, in order to realize the desired directional modulation pattern across the intended directional modulation pixel group 270, the optical axis of the refractive micro optical elements 250-2 associated with the micro pixel 230 at the center of the directional modulation group 270 would be aligned with the axis perpendicular to the (x,y) plane of the refractive micro optical elements 250-2 but the optical axis of the refractive micro optical elements 250-2 away from the center of directional modulation pixel group 270 would have their optical axis inclined from the axis perpendicular to the (x,y) plane with such an inclination gradually increasing for micro optical elements 250-2 further away from the center of the directional modulation pixel group 270. The tilting of the optical axis of the refractive micro optical elements 250-1 would converge toward or diverge away from the axis perpendicular to the (x,y) plane when the directional modulation pattern converges toward or diverges away from the center of the directional modulation pixel group 270, respectively. The angular separation δθ between the directional modulation realized by the individual optical axis tilting of the refractive micro optical elements 250-2 would be made proportional to the desired directional modulation of the angular extent Θ. For example, for an N×N pixels modulation group 270 having the angular extent Θ, the angular separation δθ between the directional modulation realized by the individual de-centeration of the refractive micro optical elements 250-2 would be equal to Θ/N.


Spatially Modulated Refractive Micro Optical Element (ROE)—



FIG. 5A illustrates yet another embodiment of this invention in which the array of pixel level micro optical elements 250 are realized as refractive optical elements (ROE). In this embodiment, the pixel level refractive micro optical elements 250 directional modulation aspects are realized using spatially modulated micro lenses 250-3 formed by successive layers of dielectric materials 510 and 520 with different indexes of refraction. FIGS. 5A and 5B are side view and top view illustrations; respectively, of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein when realized using the spatially modulated refractive micro optical elements 250-3. As illustrated in FIG. 5A and FIG. 5B, in this embodiment the centers of the pixel level refractive micro optical elements 250-3 are aligned with their respective emissive micro pixels 205 and their optical axes are also aligned perpendicular to the (x,y) plane but in the case of this embodiment, the directional modulation is realized by using Fourier (or field) lens micro optical elements 250-3 combined with an emissive micro pixel 205 having a single waveguide 260 that is spatially modulated, or appropriately positioned in the (x,y) plane, within the pixel's optical aperture. In FIG. 5B, the single waveguide is illustrated by the solid circle at the center of the pixel illustrated, with the limits of its possible spatial modulation in the x and y directions being illustrated by the dashed circles 265. In this embodiment, the Fourier lens' aspects of the micro optical elements 250-3 may cause its chief ray to be either aligned with, or inclined from, the perpendicular to the (x,y) plane when the single waveguide 260 of its respective emissive micro pixel 205 is positioned at the center or offset from its optical aperture; respectively, with the inclination of chief ray of the micro optical elements 250-3 from the perpendicular to the (x,y) plane being in the direction of the axis extended from the center of waveguide 260 to the center of the pixel's micro optical element 250-3 and with angular inclination that is proportional to the spatial offset of single waveguide 260 from the center of its respective emissive micro pixel 205. FIG. 5B illustrates the micro pixel's single waveguide spatial offset method of this embodiment when used to realize an example directional modulation group 270 whereby the micro pixel's 230 single waveguide 260 spatial offset from the center of its optical aperture in the (x,y) plane would be proportional to the directional modulation to be realized by each of the refractive micro optical elements 250-3. As illustrated in FIG. 5A, in order to realize the desired directional modulation pattern across the intended directional modulation pixel group 270, the micro optical elements 250-3 at the center of the directional modulation group 270 would have the single waveguide 260 of its associated emissive micro pixel 205 aligned with the center of its optical aperture but the micro optical elements 250-3 away from the center of directional modulation pixel group 270 would have their associated emissive micro pixels 205 having their single waveguide 260 spatial offset from the centers of their optical apertures gradually increasing for the emissive micro pixel 205 and micro optical element 250-3 pairs further away from the center of the directional modulation pixel group 270. The spatial offset of single waveguide 260 of the emissive pixels 230 and their respective refractive micro optical elements 250-3 would converge toward or diverge away from the center of the emissive micro pixels 205 of the directional modulation pixel group 270 when the directional modulation pattern diverges away from or converges toward the center of the directional modulation pixel group 270, respectively. The angular separation δθ between the directional modulation realized by the individual single waveguide 260 spatial offset associated with the refractive micro optical elements 250-3 would be made proportional to the desired directional modulation the angular extent Θ. For example, for an N×N pixels modulation group 270 having the angular extent Θ, the angular separation δθ between the directional modulation realized the refractive micro optical elements 250-3 single waveguide 260 spatial offset would be equal to Θ/N.


In other applications, the spatially modulated refractive micro optical element (ROE) of the directional modulation layer described above need not have the micro optical element 250-3 at the center of the directional modulation group or have the single waveguide 260 of its associated emissive micro pixel 205 aligned with the center of its optical aperture. Further, the directional modulation layer 245 of the embodiment of FIGS. 5A and 5B might be geometrically, but not physically, intentionally shifted in an x,y plane relative to the emissive micro pixels 205. The result would be that all the micro optical elements 250-3 so shifted would have less truncation on one end and a greater truncation on the other end. This would create a directional bias in the emission which would then be controllable by the intentional positioning of each single waveguide in the group, or pixel array, creating the bias while preserving the range of directional modulation available by selective positioning of the single waveguides.


“Diffractive” Micro Optical Element (DOE)—



FIG. 6A illustrates an embodiment of this invention in which the array pixel level micro optical elements 250 are realized as diffractive optical elements (DOE). In this embodiment the pixel level micro optical elements 250 directional modulation aspects are realized using micro grating 250-4 formed by successive layers of either metal rails or dielectric materials with different indexes of refraction. FIGS. 6A and 6B are side view and top view illustrations; respectively, of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein when realized using micro grating diffractive optical elements 250-4. In this embodiment the array of pixel level micro grating elements 250-4 would be fabricated monolithically at the wafer level as multiple layers of semiconductor dielectric materials, such silicon oxide for the low index layer 610 and silicon nitride for the high index layer 620, or metal rails using semiconductor lithography, etch and deposition techniques. As illustrated in FIG. 6A the array pixel level micro grating elements 250-4 are realized using multiple layers of dielectric material with different indexes of refraction successively (sequentially) deposited to form the diffractive surfaces of the pixel level micro optical elements 250-4 (FIG. 6B). The top view of FIG. 6A illustrates the micro DOE method when used to realize an exemplary directional modulation group 270 whereby the micro grating optical element 250-4 diffraction angle (measured from the normal axis) and axial orientation of the micro grating diffractive optical elements 250-4 in the (x,y) plane would be proportional to the directional modulation to be realized by each of the diffractive micro optical elements 250-4.


As illustrated in FIG. 6A, a convergent (or divergent depending on the selected design parameters of the diffractive optical elements 250-4) directional modulation pattern would be realized across the intended directional modulation pixel group 270 by having the axial orientation of the diffractive micro optical elements 250-4 associated with each of the emissive micro pixels 205 be aligned with radial axis of the directional modulation group 270 and having their diffraction angle be proportional to their radial distance from the center of the modulation group 270. The angular separation δθ between the directional modulation realized by the individual diffractive micro optical elements 250-4 would be proportional to the desired directional modulation angular extent or field of view (FOV) Θ of the directional modulation pixel group 270. For example in the case of the illustration of FIG. 6A that shows a modulation group 270 comprised of 8×8 of the micro pixels 205, when the directional modulation angular extent or field of view (FOV) Θ equals 45 degrees, the angular separation δθ between the directional modulation realized by the individual diffractive micro optical elements 250-4 would be 5.625 degrees.


The SSL imager 200 pixels' diffractive optical elements 250-4 can be realized using transmission grating such as blazed grating or rail grating, for example. The illustration of FIG. 6B shows an example in which the SSL imager 200 pixels' diffractive micro optical elements 250-4 are realized using multiple dielectric layers 610 and 620 having different indexes that form a blazed grating, for example using high index silicon nitride for layer 610 and lower index silicon oxide for layer 620. In the illustration of FIG. 6B the slant angle and pitch of the blazed grating would be selected to realize the desired diffraction angle of each diffractive micro optical elements 250-4 and consequently the directional modulation of their associated emissive micro pixels 205 of the SSL imager 200. In the example of FIG. 6B, the index of the layer 610 would preferably be selected to match the index of the pixel's photonic layer 215, thus for example, using the higher index silicon nitride for layer 610. The index difference between the high index layer 610 and the low index layer 620 of the pixels' diffractive micro optical elements 250-4 would govern the maximum diffraction angle of the pixels' diffractive optical elements 250-4 and consequently the index difference between the two dielectric layers 610 and 620 would be a design parameter that would affect the total angular extent or field of view (FOV) realizable by the directional modulation groups 270 of the SSL imager 200 of this embodiment. For example although FIG. 6A shows a lower index dielectric material 620 capping the high index layer 610, it would be possible to have the high index layer 610 be the top layer of the SSL imager 200 pixels in order to maximize the pixel's diffraction angular extent and consequently the realizable field of view (FOV) of the SSL imager 200 directional modulation groups 270. In order to maximize the index difference between the two layers 610 and 620 of the pixels' diffractive micro optical elements 250-4, it would be beneficial in this case for the top layer 620 to be an air gap. In this case, the cover glass layer 235 would be bonded on top side of the SSL imager 200 with the addition of spacers that would allow a thin air gap layer 620 between the high index layer 610 and the glass cover 235. In order to further maximize the field of view (FOV) realizable by the SSL imager 200 directional modulation groups 270 of this embodiment, it would also be possible to etch the diffractive micro optical elements' 250-4 lower layer 610 surface directly into the top side 230 of the photonic layer 215 of the SSL imager 200 pixels since, as explained earlier, the photonic layer 215 is fabricated from III/V semiconductor material, such as gallium nitride (GaN) for example, which typically has high index of refraction. Similar to the previous case of this embodiment, in this case it would also be beneficial to maximize the realizable FOV even further by having the top layer 620 of the diffractive micro optical elements 250-4 be an air gap layer. In this case also, the cover glass layer 235 would be bonded on top side of the SSL imager 200 with the addition of spacers that would allow a thin air gap layer between the high index layer 610 and the glass cover 235.


As explained earlier, the SSL imager 200 pixels can emit light with multiple wavelengths from each pixel aperture. In the case when the SSL imager 200 pixels emit light with multiple wavelengths, the diffractive optical elements 250-2 would be realized using wideband transmission gratings or multi-level gratings designed to achieve the desired diffraction angle across the light emission bandwidth of the SSL imager 200 pixels. In the case when wideband transmission gratings are used, the SSL imager 200 pixels diffractive optical elements 250-2 could be realized using a multiplicity of layers of dielectric materials with alternating high and low indexes for each such layer index. The index of such layers together with the formed grating slant angle and pitch would be selected to realize the desired pixel's diffractive angle within each sub-band of the SSL imager 200 pixels' light emission bandwidth. FIG. 6C illustrates an example of the case when multi-level gratings are used to realize the desired diffraction angle across the multiple wavelengths light emission bandwidth of the SSL imager 200 pixels. In this example case, two dielectric layers 630 and 640 with differing indexes are used to form a multi-level grating with a different grating pitch within each layer whereby the grating pitch of each layer being designed to dominantly diffract light within a given sub-band of the SSL imager 200 pixels light emission bandwidth. The pitch and index of each of the two layers 630 and 640 would be selected through an iterative design process that would take into account the collective diffractive action of the grating multi-level across the entire multiple wavelength emission bandwidth of the SSL imager 200 pixels. In the example of FIG. 6C, the index of the layer 630 would preferably be selected to match the index of the pixel's photonic layer 205. In addition, it would be possible to have the high index layer 630 be the top layer of the SSL imager 200 pixels in order to maximize the pixel's diffraction angular extent and consequently the realizable field of view (FOV) of the SSL imager 200 directional modulation groups 270. In this embodiment, the cover glass layer 235 would be bonded on top side of the SSL imager 200 with the addition of spacers that would allow a thin air gap layer between the high index layer 630 and the glass cover 235.


Directional Modulation Layer 245 Fabrication Method—


As explained earlier, the pixel level micro optical elements 250 of the previous embodiments would be used to directionally modulate, collect and/or collimate the light emitted from their corresponding emissive micro pixels 205 and as such would have optical apertures which are equal to and precisely aligned, within at least less than 10% accuracy, with their corresponding micro pixels 230 of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of this invention. The pixel level micro optical elements 250 of the previous embodiments can be fabricated using a variety of nano-imprint lithographic techniques such as patterning using Phase, Grayscale, entire domain or sub domain masks, additive lithographic sculpting that use binary masks as well as various direct write techniques. Photo resist (heat) reflow and molding could also be employed for fabrication of the micro optical elements 250 to increase the smoothness of the formed surfaces. Additive Lithography using a sub domain binary mask set will be used herein as an example to illustrate a typical method for the fabrication of exemplary ROE pixel level micro optical elements 250 of the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of this invention.


Wafer Level Optics Mask Set—


The fabrication process sequence of the pixel level micro optical elements 250 begins with the fabrication of a set of lithography sub domain masks that captures the binary shape specifications of the micro optical elements 250. The fabrication process of the sub domain masks involves identifying the symmetry within the specified features of the pixel level micro optical elements 250 to be fabricated and breaking down the identified symmetry to an orthogonal or non orthogonal set of basis. FIG. 7A illustrates the orthogonal and non orthogonal basis set for an exemplary rotationally symmetric pixel level refractive micro optical elements 250 generated by this process. The specified binary surface shape of the micro optical elements 250 will be achieved later during the fabrication process by controlling the exposure dose of each element of the orthogonal or non orthogonal basis set during lithography as illustrated in FIG. 7B.


As illustrated in FIG. 7A, the rotationally symmetric refractive micro optical elements 250 would be represented by the two dimensional basis set of orthogonal (rings) or non orthogonal (circles) elements. For realizing the pixel level micro optical elements 250 as a de-centered ROC of the previous embodiment, at each micro pixel 230 position, the required de-centering shift is applied to the generated basis set and then truncated accordingly after each of the basis is aligned with the micro pixel 230 aperture specified by the design. FIG. 7C illustrates two example cases, one where the micro optical elements 250 axis lies at the center of the aperture of the micro pixel 230 and a second case where the micro optical elements 250 axis is shifted from the center of the aperture of the micro pixel 230. This process is then repeated across the entire array of micro pixels 230 mask alignment reference coordinates to create a multilayer mask set for the full aperture of the emissive micro pixel light modulator (SSL imager) 200 device. Equivalent orthogonal and non-orthogonal basis elements are then aligned with the array of emissive micro pixel 230 mask alignment reference coordinates across the SSL imager 200 aperture to form separate mask layers. These mask layers can then be separated and placed on well known locations on a single reticle or on multiple reticles to be used in the wafer level micro optics lithography fabrication process of the micro optical elements 250. This entire process of masking layers formation can be accomplished using a standard mask editing software such as LEdit typically used in the creation of semiconductors lithography masks. It should be noted that this mask formation process would be repeated for every optical surface comprising the pixel level micro optical elements 250 to create a full mask set for the wafer level optic fabrication of the non-telecentric emissive micro pixel light modulator (SSL imager) 200.


Although the preceding discussion outlined the process of forming the lithography mask set for the case when the pixel level micro optical elements 250 are realized in accordance with the embodiment described earlier as a de-centered ROE, a person skilled in the art will readily know how to apply the described lithography mask set formation process in the cases of other described embodiments when the micro optical elements 250 are realized as tilted ROE or as a DOE.


Wafer Level Optics Fabrication Sequence—



FIGS. 7D-7M illustrate the fabrication process sequence of the pixel level micro optical elements 250. After the wafer level optics mask set is formed in accordance with the preceding discussion, a substrate of choice is coated with a thin layer, preferably few microns, of a dielectric material, herein referred to as dielectric-1 (FIG. 7D), using semiconductor material deposition tools such as plasma enhanced chemical vapor deposition (PECVD). The deposited dielectric-1 layer could be amorphous but needs to be sufficiently transparent within the target optical spectrum, for example within the visible light 400 nm to 650 nm spectrum and specifically selected to introduce minimal stresses on the substrate wafer. The deposited dielectric-1 layer would typically be the low index material surrounding other high index material layers that would comprise the pixel level micro optical elements 250. Alignment marks are then patterned onto the topside of the deposited dielectric-1 layer to be used for aligning subsequent layers of the pixel level micro optical elements 250.


A photoresist appropriately chosen and characterized is then coated on top of dielectric-1 layer and Additive Lithography is performed using the fabricated mask set to create a negative of that surface of the pixel level micro optical elements 250 (FIG. 7E). In the Additive Lithography process, the negative surface would be created on the photoresist layer by the successive alignment and exposure using the various masks of the set with an alignment tolerance of less than 100 nm or preferably in the range of 50 nm (FIG. 7F). The created shape of the photoresist surface would be optimized by adjusting the exposure and focus offset parameters for each of the lithographical steps for the various masks of the set as illustrated in FIG. 7B. This step is followed by the appropriate metrology measurements to confirm that the created photoresist negative surface is compliant with the surface design specification (or optical prescription) of the 1st surface of the pixel level micro optical elements 250.


Once the specification compliance of the photoresist negative surface is confirmed, the micro optical elements 250 would be etched using the appropriate chemistry on a reactive ion etching (RIE) tool that can provide 1:1 selectivity between the photoresist and the dielectric-1 layers (FIG. 7G). Etching time needs to be adjusted based on pre-characterized etch rate in order to avoid over-etching into the dielectric-1 layer and to ensure that the shape on the photoresist is faithfully transferred on the dielectric-1 layer with minimal defects formed during the etching step. A metrology measure following this step is used to confirm the dielectric-1 layer etched surface is compliant with the surface design specification (or optical prescription) of the micro optical elements 250. After the etch and metrology steps, the wafer dielectric-1 layer surface is thoroughly cleaned to ensure removal of all polymer residues and other contaminants from the fabricated surface of the wafer. At the end of this step, the first surface of the micro optical elements 250 would be created on the dielectric-1 layer in accurate alignment with the micro pixels 230 across the entire wafer surface with the created optical surface.


After the dielectric-1 layer surface is fabricated, the wafer is coated with a relatively thick conformal layer of a high index dielectric-2 layer (FIG. 7H). The thickness of dielectric-2 layer should be sufficient to accommodate the optical features of the micro optical elements 250 while being highly transparent with minimal stress. The deposited surface of the dielectric-2 layer then undergoes a planarization process using chemical mechanical polishing (CMP) tool to obtain a nearly flat surface across the wafer with minimal total thickness variation (TTV) (FIG. 7I). The dielectric-2 layer wafer surface is then coated with photoresist then processed, in similar steps as described for dielectric-1 layer, using Additive Lithography followed by etching to create the 2nd surface of the pixel level micro optical elements 250 on the dielectric-2 layer surface (FIG. 7J-L).


After the fabrication of the 1st and 2nd surfaces of the pixel level micro optical elements 250 as shown in FIGS. 7K and 7L, a third layer of dielectric material, designated as dielectric-3 layer, is deposited on the top of the wafer surface and planarized to the required thickness and TTV specifications (FIG. 7M). The dielectric constant and index of refraction of the dielectric layers dielectric-1, dielectric-2 and dielectric-3 would be selected based on the optical prescription of the pixel level micro optical elements 250 and typically in most applications dielectric-1 and dielectric-3 would have the same index of refraction value that lower than dielectric-2 index of refraction value.


The described WLO fabrication steps would be repeated on the top of dielectric-3 layer wafer surface if a second optical element is to be added in accordance with the optical prescription of the pixel level micro optical elements 250.


After all the optical elements of the pixel level micro optical elements 250 are fabricated on top of the substrate wafer, the wafer surface is coated with a bonding intermediary layer, polished to the appropriate bonding specification then aligned bonded, using the alignment marks added earlier in the process, to the top photonic layer 205 surface.


In one embodiment of this invention, the WLO fabrication process described in the preceding paragraphs is used to fabricate the pixel level micro optical elements 250 on the top of the cover glass wafer 235 as a substrate then the fabricated wafer is used as a substrate upon which the pixelated photonic layers stack 205 would be bonded and formed sequentially. At the end of that fabrication sequence, the formed wafer would be aligned bonded to the topside of the CMOS control layer 225.


In another embodiment of this invention, the WLO fabrication process described in the preceding paragraphs is used to fabricate the pixel level micro optical elements 250 on top of the cover glass wafer 235 as a substrate then the fabricated wafer is aligned bonded to the photonic layer 205 top surface of the wafer formed separately that comprises the photonic layer stack 205 bonded sequentially to the topside of the CMOS control layer 225.


In yet another embodiment of this invention, the WLO fabrication process described in the preceding paragraphs is used to fabricate the pixel level micro optical elements 250 on top of the wafer formed separately that comprises the photonic layer stack 205 bonded sequentially to the topside of the CMOS control layer 225, then the cover glass wafer is bonded on the top of the fabricated pixel level micro optical elements 250. In the WLO fabrication process for this case, the 2nd surface of the pixel level micro optical elements 250 will be fabricated first on top of the pixelated photonic layers stack 205, then the 1st surface of the pixel level micro optical elements 250 would be fabricated on top. In still other embodiments, particularly using other fabrication processes described herein for the directional modulation layers and using this fabrication process, the glass cover layer 235 would be bonded on the top side of the SSL imager 200 with the addition of spacers that would allow a thin air gap layer 620 between the high index layer 610 and the glass cover 235. Each of the aforementioned embodiments would have its advantages depending on the intended application.



FIGS. 7D-7M illustrate the WLO fabrication process described in the preceding paragraphs to fabricate the pixel level micro optical elements 250 on the on top of the cover glass wafer 235 as a substrate. Although FIGS. 7D-7M illustrate the described the WLO fabrication process in the case of the pixel level micro optical elements 250 being a ROE fabricated on top the glass cover wafer 235 as a substrate, the described fabrication sequence equally applies in the case of the numerous embodiments described including the case when the pixel level micro optical elements 250 being a DOE fabricated within the context of any of the WLO fabrication process embodiments of the previous paragraphs.


Ultra Compact Projector—



FIG. 8A illustrates a design method of an ultra compact display projector enabled by the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein. In this embodiment, the directional modulation layer 245 of the SSL imager 200 is designed to realize a convergent directional modulation pattern causing the light emitted from the directional modulation group 270 of micro pixels 210 to directionally converge systematically toward the perpendicular axis from the peripheral edges of the directional modulation group 270 toward its center. In this case, the directional modulation group 270 extends across the entire emissive optical aperture of the SSL imager 200. As illustrated in FIG. 8A, the pixel level micro optical elements 250 would directionally modulate the light emitted from SSL imager 200 micro pixels to achieve maximum fill factor of the optical aperture of the first optical element L-1 of the projection optics 810 which in turn is designed to further redirect the light rays toward the second optical element L-2 optical aperture while maintaining the fill factor at a maximum. Optical elements L3 and L4 are used for magnification of the projected image. The projector design of this embodiment achieves less than an 8 mm optical track length with a 3.6×6.4 mm SSL imager emissive aperture size while achieving a fairly uniform optical efficiency. The actual projector has cross-sectional dimensions of 5.82 mm×8.05 mm, with a height of 7.86 mm. Besides its volumetric efficiency, the ultra compact display projector of FIG. 8A would enable the attainment of high optical efficiency and brightness uniformity. As shown in FIG. 8B, the projector design of this embodiment achieves almost 83% optical efficiency with less than 15% center to corner roll off compared to 22.8% optical efficiency for a design that does not use the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of the embodiments herein. With the minimal optical track length it achieves, the projector design of this embodiment was used to fabricate the ultra compact, full color projector pictured in FIG. 8C having a total volume of less than 0.3 cc. To the best of the inventors' knowledge, this is volumetrically the smallest HD projector ever designed and fabricated, which makes it ideal for mobile display applications such as embedded and attached mobile projectors as well as near-eye head mounted displays (HMD).


Minimum Cross-Talk Light Field Modulator—



FIG. 9 illustrates a design method of a minimum cross-talk light field modulator enabled by the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of this invention. In this embodiment the “cross-talk” between holographic elements (hogels) and the undesirable 3D image “ghost” distortions it causes would be substantially reduced or eliminated altogether by making the SSL imager 200 emission non-telecentric across the optical apertures of each of the hogel lenses 930-932 as illustrated in FIG. 9. That is to say in this embodiment, the directional modulation layer 245 of the SSL imager 200 would be designed to realize a convergent directional modulation pattern causing the light emitted from the directional modulation group 270 of micro pixels 210 to directionally converge systematically toward the perpendicular axis from the peripheral edges of the directional modulation group 270 toward its center. In the case of this embodiment, the directional modulation group 270 would extend across the sub-array of SSL imager 200 emissive micro pixels corresponding to (or associated with) the optical aperture of each of the hogel lenses 930-932 of FIG. 9. With the design method of this embodiment the pixel level micro optical elements 250 of the SSL imager 200 sub-array of micro pixels 210 associated with each of the hogel lenses 930-932 would be designed such that the light emission from the sub-array of micro pixels 210 would remain substantially confined within the optical apertures of their associated hogel lenses 930-932 apertures, thus minimizing the light leakage or cross-talk between adjacent the hogel lenses 930-932. With that being achieved, the light leakage between light field views modulated by the SSL imager 200 would be minimized, making the views from different directions having no ghost interference from other directions.


In this embodiment, the light emitted from each of the SSL imager 200 micro pixels 210 would be sufficiently collimated and directionally modulated (or directed) by the pixel's micro optical elements 250 to efficiently fill in their associated hogel lens with minimal or substantially no light leakage into adjacent hogel lenses. Thus in addition to minimizing the cross-talk between directionally modulated views, the directional light modulator of FIG. 9 enabled by the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of this invention would also achieve higher optical efficiency and uniformity across its field of view (FOV).


Multi-View Display—



FIG. 10A and FIG. 10B illustrate a top view and side view, respectively, of a multi-view 2D display design method enabled by the non-telecentric emissive micro pixel light modulator (SSL imager) 200 of this invention. In this embodiment, the SSL imager 200 emissive pixels 210 array and their associated micro optical elements 250 of the directional modulation layer 245 would be spatially partitioned into directional modulation sub-arrays or directional modulation groups 270. As illustrated in FIG. 10B the directional modulation layer 245 of the SSL imager 200 of this embodiment may be designed to realize a divergent directional modulation pattern that would cause the light emitted from the directional modulation group 270 of micro pixels 210 to directionally diverge systematically into a unique set of directions away from the perpendicular axis of the directional modulation group 270. In this embodiment, the size of the directional modulation group 270 in terms of the number of emissive pixels 210 will determine the number of views that can supported by the multi-view display. For example, a 64-view multi-view display can be realized using an 8×8 directional modulation group 270 of FIG. 10A with each of the pixels in each of the modulation groups across the display aperture being designed to emit light in a unique direction that is uniformly and angularly spaced within the targeted field of view (FOV) of the multi-view display. In this embodiment, the light emitted from each of the SSL imager 200 micro pixels 210 would be sufficiently collimated and directionally modulated to a specific unique direction by the pixel's micro optical elements 250.


Waveguide Light Modulator—



FIG. 11A illustrates a design method of a Waveguide Light Modulator enabled by the non-telecentric emissive micro pixel light modulator of this invention. As illustrated in FIG. 11A, the Waveguide Light Modulator of this embodiment would be comprised of the SSL imager 200 with its directional modulation layer coupled onto the optical input aperture 1120 of the waveguide 1110 which has the reflective optics layer 1130 coated to one of its sides to define its optical output aperture 1140. In this embodiment the SSL imager 200 emissive pixels 210 array and their associated micro optical elements 250 of the directional modulation layer 245 would direct the light emitted from each of the SSL imager 200 pixels in a unique direction within the waveguide angular range of the waveguide 1110. In the case of a total internal reflection (TIR) waveguide 1110, such as that illustrated in the FIG. 11A, the light emitted from each of the SSL imager 200 pixels would be directionally modulated by the pixel's associated micro optical elements 250 in a unique direction within the tangential (lateral) and vectorial (elevation) planes that will set forth the wave guiding angle of the light emitted from that pixel as well as the lateral divergence from the pixel's (x,y) coordinates. The directional modulation of the light emitted by the SSL imager 200 pixels in lateral plane would serve to determine the total expansion (or magnification) of the image being modulated by the SSL imager 200 pixel array as the light emitted from its pixel array propagate through the waveguide. In effect the directional modulation of the light emitted by the SSL imager 200 pixels in lateral plane would serve to determine the x-axis magnification factor of the image being modulated by the SSL imager 200 pixel array and coupled into the waveguide. The directional modulation of the light emitted by the SSL imager 200 pixels in vectorial plane would serve to determine the angle at which the light emitted (and modulated) from each of the SSL imager 200 pixels would propagate through the waveguide. With the waveguide reflective optics layer 1130 typically being designed to break the TIR condition for light rays being guided through the waveguide at progressively lower angle further away from the waveguide input optical aperture 1120 into which the SSL imager 200 is optically coupled, the light emitted by the SSL imager 200 pixels and directionally modulated by its micro optical elements 250 in vectorial plane at a progressively smaller angles within the waveguide TIR angular range would propagate further away from waveguide input optical aperture 1120 before its TIR guiding condition is broken (collapsed) by the waveguide reflective optics layer 1130 directing the light more directly toward the output aperture 1140 of the waveguide 1110. In effect the directional modulation of the light emitted by the SSL imager 200 pixels in vectorial plane would serve to determine the y-axis magnification factor of the image being modulated by the SSL imager 200 pixel array and coupled into the waveguide. When the directional modulation of the light emitted by the SSL imager 200 pixels in the tangential (lateral) and vectorial planes are properly selected for each of its pixels, the directional modulation of the light emitted by the SSL imager 200 of this invention would enable the magnification and relay of the image it is modulating and coupling into the waveguide input optical aperture 1120 to the waveguide output optical aperture 1140. As an alternative, the output aperture may itself include transmissive optics to break the TIR condition at the output aperture 1140.


The directional modulation design method of this embodiment is further illustrated in FIG. 11B which shows a top view of the SSL imager 200 enabled Waveguide Light Modulator of this invention. In FIG. 11B the SSL imager 200 pixels' coordinates within the waveguide input optical aperture 1120 are designated as (x,y) coordinates while the Waveguide Light Modulator pixels' coordinates within the waveguide output optical aperture 1140 are designated as (X, Y) coordinates. As illustrated in FIG. 11B, the SSL imager 200 pixels directional modulation angles in the lateral and vectorial planes cause the light emitted from each of the SSL imager 200 pixels and coupled into the waveguide at a given (x,y) coordinates within the waveguide input optical aperture 1120 to be uniquely mapped to given (X, Y) coordinates within the waveguide output optical aperture 1140. In effect the SSL imager 200 pixels' directional modulation method of this embodiment together with an appropriately designed waveguide reflective optics layer 1130 would enable the synthesis of a given optical transfer function that realizes both magnification and relay between the waveguide input and output optical apertures 1120 and 1140; respectively. It should be added that in this embodiment, the collimation angle of the light bundles emitted by the SSL imager 200 pixels would be selected to be outside the TIR angular range of the waveguide 1110 for proper functioning of the output aperture 1140 without special provisions for the emission.


Tapered Waveguide Light Modulator—


In an alternative embodiment, illustrated in FIG. 11C, the SSL imager 200 based Waveguide Light Modulator may be realized using the tapered waveguide 1150 whereby the tapering angle (or slope) of one surface of the waveguide 1150 is selected to break the TIR condition for light rays being guided through the waveguide 1150 at a progressively lower angle (closer to a line perpendicular to the local waveguide surface) further away from the waveguide input optical aperture 1160 into which the SSL imager 200 is optically coupled. The tapering of one surface of the waveguide 1150 in this embodiment performs the equivalent optical function of the diffractive optics layer 1130 of the previous embodiment. In this embodiment, the SSL imager 200 emissive pixels 210 array and their associated micro optical elements 250 of the directional modulation layer 245 would direct the light emitted from each of the SSL imager 200 pixels in a unique direction within the waveguide angular range of the tapered waveguide 1150. As illustrated in the FIG. 11C, the light emitted from each of the SSL imager 200 pixels would be directionally modulated by the pixel's associated micro optical elements 250 in a unique direction within the tangential (lateral) and vectorial (elevation) planes that will set forth the wave guiding angle of the light emitted from that pixel as well as the lateral divergence from the pixel's (x,y) coordinates. The directional modulation of the light emitted by the SSL imager 200 pixels in the lateral plane would serve to determine the total expansion of the image being modulated by the SSL imager 200 pixel array as the light emitted from its pixel array propagates through the tapered waveguide 1150. In effect, the directional modulation of the light emitted by the SSL imager 200 pixels in lateral plane would serve to determine the x-axis magnification factor of the image being modulated by the SSL imager 200 pixel array and coupled into the waveguide. The directional modulation of the light emitted by the SSL imager 200 pixels in vectorial plane would serve to determine the angle at which the light emitted (and modulated) from each of the SSL imager 200 pixels would propagate through the waveguide. With the tapered surfaces of the waveguide 1150 being designed to break the TIR condition for light rays being guided through the waveguide at progressively lower angle (closer to a perpendicular to the local surface of the tapered waive guide 1150) further away from the waveguide input optical aperture 1160 into which the SSL imager 200 is optically coupled, the light emitted by the SSL imager 200 pixels and directionally modulated by its micro optical elements 250 in the vectorial plane at a progressively lower angles within the waveguide TIR angular range would propagate further away from waveguide input optical aperture 1160 before it's TIR guiding condition is broken (collapsed) by the tapered surface of the waveguide 1160. In effect, the directional modulation of the light emitted by the SSL imager 200 pixels in the vectorial plane would serve to determine the y-axis magnification factor of the image being modulated by the SSL imager 200 pixel array and coupled into the tapered waveguide 1160. When the directional modulation of the light emitted by the SSL imager 200 pixels in the tangential (lateral) and vectorial planes are properly selected for each of its pixels, the directional modulation of the light emitted by the SSL imager 200 of the embodiments herein would enable the magnification and relay of the image it is modulating and coupling into the tapered waveguide 1160 input optical aperture 1120 to the waveguide output optical aperture 1140. In effect the SSL imager 200 pixels directional modulation method of this embodiment together with an appropriately designed tapered waveguide 1150 would enable the synthesis of a given optical transfer function that realizes both magnification and relay between the tapered waveguide 1150 input and output optical apertures 1160 and 1170; respectively. It should be added that in this embodiment, the collimation angle of the light bundles emitted the SSL imager 200 pixels would be selected to be within the TIR angular range of the tapered waveguide 1150. As an alternate, certain surfaces of the tapered waveguide such as part of the lower surface of the tapered waveguide may be coated with a reflective coating, if desired, to allow a last reflection when the TIR condition has already been broken.


It should be noted that the two previous embodiments of the SSL imager 200 based Waveguide Light Modulator can be used to create optical see-through (OST) near-eye or head-mounted display (HMD). In each of these embodiments, as alternate embodiments, the SSL imager may instead have its output coupled into an input aperture at the end or edge of the waveguide 1110 and achieve the same of similar results. Also the waveguides themselves may have other shapes, and are not limited to rectangular shapes as shown.


Thus, using the wafer level fabrication techniques for the wafer level optics, the entire non-telecentric emissive micro-pixel array light modulator may be fabricated at the wafer level and then the wafer level assembly diced to obtain the final products.


Also, while FIG. 2C-1 illustrates an embodiment wherein the light converges from the center of the pixel group or the entire array, and FIG. 2C-2 illustrates an embodiment wherein the light diverges from the center of the pixel group or the entire array, neither are a limitation of the invention, as in some applications, light from all pixels in a group or the entire array may be directed in the same general direction, though normally in different angles to present the full image or images for viewing in an undistorted form. This may require a counter distortion at the directional modulator layer to achieve the undistorted image for viewing. Further, the directional modulation layer may include two or more distinct pixel groups, one for presenting a first image at one location or depth, and one or more other images at one or more additional location or locations or depths.


In the foregoing description and in the claims, reference is made to a directional modulation layer. It is to be understood that the word layer is used in a general sense to identify the layer or multiple layers that determine the spatial modulation of the non-telecentric emissive micro-pixel array light modulator. Also it should be understood that while certain fabrication techniques for the directional modulation layer have been described herein, each with respect to a respective embodiment, such techniques are also applicable to use in other embodiments using the same form of directional modulation layer and/or fabrication sequence. Thus by way of example, the use of UV curable polycarbonate polymer or the embossing to form a specific embodiment is exemplary, and such techniques and the sequence of operations for forming the resulting ROE are exemplary only, and the use of UV curable polycarbonate polymer or embossing may be used to form any ROE based directional modulation layer and to fabricate the non-telecentric emissive micro-pixel array light modulator of the present invention in any sequence of fabrication operations. Further, unless the context dictates otherwise, references to a pixel group or pixel groups includes a reference to a group that encompasses the entire SSL imager emitter area


Thus those skilled in the art will readily appreciate that various modifications and changes can be applied to the embodiments of the invention without departing from its scope defined in and by the appended claims. It should be appreciated that the foregoing examples of the invention are illustrative only, and that the invention can be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The disclosed embodiments, therefore, should not be considered to be restrictive in any sense. The scope of the invention is indicated by the appended claims, rather than the preceding description, and all variations which fall within the meaning and range of equivalents thereof are intended to be embraced therein.

Claims
  • 1. An emissive directional light modulator comprising: a control layer;a solid state light (SSL) emitting display layer, comprising an array of light emitting pixels, positioned above and controllable from the control layer to emit light; and a directional modulation layer comprising pixel level refractive optical elements in the form of de-centered, or tilted, or spatially modulated, lenses comprising layers of dielectric materials with different indexes of refraction positioned above the SSL emitting display layer, each pixel level refractive optical element to directionally modulate light coupled to it from a corresponding light emitting pixel in a respective direction.
  • 2. The emissive directional light modulator of claim 1, wherein the solid state light emitting display layer comprising the array of light emitting pixels comprise a plurality of pixelated III/IV semiconductor layers to emit at least partially collimated, pixelated light.
  • 3. The emissive directional light modulator of claim 1, wherein each pixel level refractive optical element to directionally modulate light coupled to it from the corresponding light emitting pixel in a respective direction comprises each pixel level refractive optical element to directionally modulate light coupled to it from a corresponding light emitting pixel in a pre-selected respective direction.
  • 4. The emissive directional light modulator of claim 1, wherein the de-centered, or tilted, or spatially modulated, lenses comprising layers of dielectric materials with different indexes of refraction comprise de-centered, or tilted, or spatially modulated, micro-lenses comprising layers of dielectric materials with different indexes of refraction.
  • 5. The emissive directional light modulator of claim 1 wherein the array of light emitting pixels are divided into groups, each comprising a plurality of pixels.
  • 6. The emissive directional light modulator of claim 5 wherein each group of pixels is organized into a square, rectangle or hexagonal pattern.
  • 7. The emissive directional light modulator of claim 1 wherein the directional modulation layer comprises patterns, each directional modulation layer pattern corresponding to a respective pixel pattern, each directional modulation layer having the same directional modulation pattern.
  • 8. The emissive directional light modulator of claim 1 wherein the directional modulation layer comprises patterns, each directional modulation layer pattern corresponding to a respective pixel pattern, each directional modulation layer having a unique directional modulation pattern.
  • 9. The emissive directional light modulator of claim 5 wherein a group of light emitting pixels in the array of light emitting pixels in the solid state light (SSL) emitting display layer directionally modulates light coupled onto it to a respective converging pattern.
  • 10. The emissive directional light modulator of claim 5 wherein a group of light emitting pixels in the array of light emitting pixels in the solid state light (SSL) emitting display layer directionally modulates light coupled onto it to a respective diverging pattern.
  • 11. An emissive directional light modulator comprising: a control layer;a solid state light emitting display layer, comprising an array of light emitting pixels, positioned above and controllable from the control layer to emit light; anda directional modulation layer comprising pixel level diffractive optical elements in the form of a micro-grating comprising layers of metal rails or dielectric materials with different indexes of refraction positioned above the SSL emitting display layer, each pixel level diffractive optical element to directionally modulate light coupled to it from a corresponding light emitting pixel in a respective direction.
  • 12. The emissive directional light modulator of claim 11, wherein the pixel level diffractive optical elements in the form of a micro-grating comprise pixel level diffractive optical elements in the form of a transmission grating selected from one of a blazed grating or a rail grating.
  • 13. The emissive directional light modulator of claim 11, wherein the solid state light emitting display layer comprising the array of light emitting pixels comprise a plurality of pixelated III/IV semiconductor layers to emit at least partially collimated, pixelated light.
  • 14. The emissive directional light modulator of claim 11, wherein each pixel level diffractive optical element to directionally modulate light coupled to it from the corresponding light emitting pixel in a respective direction comprises each pixel level diffractive optical element to directionally modulate light coupled to it from a corresponding light emitting pixel in a pre-selected respective direction.
  • 15. An emissive pixel array light modulator comprising: a control layer;pixelated III/V semiconductor layers stacked above the control layer and controllable from the control layer to emit at least partially collimated, pixelated light; anda directional modulation layer comprising pixel level refractive optical elements in the form of de-centered, or tilted, or spatially modulated, lenses comprising layers of dielectric materials with different indexes of refraction positioned above the pixelated III/V semiconductor layers, each pixel level refractive optical element to directionally modulate light coupled onto it from a corresponding pixel to a respective direction relative to an axis perpendicular to the pixelated III/V semiconductor layers.
  • 16. The emissive pixel array light modulator of claim 15, wherein the pixelated III/V semiconductor layers to emit at least partially collimated, pixelated light that is modulated temporally.
CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional application and claims the benefit of U.S. Non-Provisional patent application Ser. No. 15/391,583, filed Dec. 27, 2016, now allowed, which in turn claims the benefit of U.S. Provisional Patent Application No. 62/271,637, filed Dec. 28, 2015, the entirety of each of which is incorporated herein by reference.

US Referenced Citations (272)
Number Name Date Kind
4427912 Bui et al. Jan 1984 A
4987410 Berman et al. Jan 1991 A
5162828 Furness et al. Nov 1992 A
5368042 O'neal et al. Nov 1994 A
5619373 Meyerhofer et al. Apr 1997 A
5696521 Robinson et al. Dec 1997 A
5818359 Beach Oct 1998 A
5886822 Spitzer Mar 1999 A
5986811 Wohlstadter Nov 1999 A
6128003 Smith et al. Oct 2000 A
6147807 Droessler et al. Nov 2000 A
6151167 Melville Nov 2000 A
6353503 Spitzer et al. Mar 2002 B1
6433907 Lippert et al. Aug 2002 B1
6456438 Lee et al. Sep 2002 B1
6522794 Bischel et al. Feb 2003 B1
6529331 Massof et al. Mar 2003 B2
6666825 Smith et al. Dec 2003 B2
6710902 Takeyama Mar 2004 B2
6719693 Richard Apr 2004 B2
6795221 Urey Sep 2004 B1
6803561 Dunfield Oct 2004 B2
6804066 Ha et al. Oct 2004 B1
6829095 Amitai Dec 2004 B2
6924476 Wine et al. Aug 2005 B2
6937221 Lippert et al. Aug 2005 B2
6984208 Zheng Jan 2006 B2
6999238 Glebov et al. Feb 2006 B2
7061450 Bright et al. Jun 2006 B2
7071594 Yan et al. Jul 2006 B1
7106519 Aizenberg et al. Sep 2006 B2
7190329 Lewis et al. Mar 2007 B2
7193758 Wiklof et al. Mar 2007 B2
7209271 Lewis et al. Apr 2007 B2
7215475 Woodgate et al. May 2007 B2
7232071 Lewis et al. Jun 2007 B2
7369321 Ren et al. May 2008 B1
7482730 Davis et al. Jan 2009 B2
7486255 Brown et al. Feb 2009 B2
7545571 Garoutte et al. Jun 2009 B2
7580007 Brown et al. Aug 2009 B2
7619807 Baek et al. Nov 2009 B2
7623560 El-Ghoroury et al. Nov 2009 B2
7724210 Sprague et al. May 2010 B2
7747301 Cheng et al. Jun 2010 B2
7767479 El-Ghoroury et al. Aug 2010 B2
7791810 Powell Sep 2010 B2
7829902 El-Ghoroury et al. Nov 2010 B2
7952809 Takai May 2011 B2
8049231 El-Ghoroury et al. Nov 2011 B2
8098265 El-Ghoroury et al. Jan 2012 B2
8243770 El-Ghoroury et al. Aug 2012 B2
8279716 Gossweiler et al. Oct 2012 B1
8292833 Son et al. Oct 2012 B2
8405618 Colgate et al. Mar 2013 B2
8471967 Miao et al. Jun 2013 B2
8477425 Border et al. Jul 2013 B2
8482859 Border et al. Jul 2013 B2
8508830 Wang Aug 2013 B1
8508851 Miao et al. Aug 2013 B2
8510244 Carson et al. Aug 2013 B2
8553910 Dong et al. Oct 2013 B1
8567960 El-Ghoroury et al. Oct 2013 B2
8619049 Harrison et al. Dec 2013 B2
8725842 Al-Nasser May 2014 B1
8743145 Price Jun 2014 B1
8773599 Saeedi et al. Jul 2014 B2
8854724 El-Ghoroury et al. Oct 2014 B2
8928969 Alpaslan et al. Jan 2015 B2
8975713 Sako et al. Mar 2015 B2
9097890 Miller et al. Aug 2015 B2
9110504 Lewis et al. Aug 2015 B2
9134535 Dobschal et al. Sep 2015 B2
9179126 El-Ghoroury et al. Nov 2015 B2
9195053 El-Ghoroury et al. Nov 2015 B2
9239453 Cheng et al. Jan 2016 B2
9244277 Cheng et al. Jan 2016 B2
9244539 Venable et al. Jan 2016 B2
9274608 Katz et al. Mar 2016 B2
9286730 Bar-Zeev et al. Mar 2016 B2
9529191 Sverdrup et al. Dec 2016 B2
9538182 Mishourovsky et al. Jan 2017 B2
9681069 El-Ghoroury et al. Jun 2017 B2
9712764 El-Ghoroury et al. Jul 2017 B2
9774800 El-Ghoroury et al. Sep 2017 B2
9779515 El-Ghoroury et al. Oct 2017 B2
9965982 Lapstun May 2018 B2
20020008854 Travis Jan 2002 A1
20020017567 Connolly et al. Feb 2002 A1
20020024495 Lippert et al. Feb 2002 A1
20020075232 Daum et al. Jun 2002 A1
20020083164 Katayama et al. Jun 2002 A1
20020141026 Wiklof et al. Oct 2002 A1
20020158814 Bright et al. Oct 2002 A1
20020181115 Massof et al. Dec 2002 A1
20020194005 Lahr Dec 2002 A1
20030032884 Smith et al. Feb 2003 A1
20030086135 Takeyama May 2003 A1
20030122066 Dunfield Jul 2003 A1
20030138130 Cohen et al. Jul 2003 A1
20030184575 Reho et al. Oct 2003 A1
20030187357 Richard Oct 2003 A1
20040004585 Brown et al. Jan 2004 A1
20040024312 Zheng Feb 2004 A1
20040051392 Badarneh Mar 2004 A1
20040080807 Chen et al. Apr 2004 A1
20040080938 Holman et al. Apr 2004 A1
20040085261 Lewis et al. May 2004 A1
20040119004 Wine et al. Jun 2004 A1
20040125076 Green Jul 2004 A1
20040138935 Johnson et al. Jul 2004 A1
20040179254 Lewis et al. Sep 2004 A1
20040240064 Dutta Dec 2004 A1
20050002074 Douglas et al. Jan 2005 A1
20050024730 Aizenberg et al. Feb 2005 A1
20050053192 Sukovic et al. Mar 2005 A1
20050116038 Lewis et al. Jun 2005 A1
20050117195 Glebov et al. Jun 2005 A1
20050168700 Berg et al. Aug 2005 A1
20050179976 Davis et al. Aug 2005 A1
20050264502 Sprague et al. Dec 2005 A1
20060017655 Brown et al. Jan 2006 A1
20060132383 Gally et al. Jun 2006 A1
20060152812 Woodgate et al. Jul 2006 A1
20060253007 Cheng et al. Nov 2006 A1
20060285192 Yang Dec 2006 A1
20060290663 Mitchell et al. Dec 2006 A1
20070052694 Holmes Mar 2007 A1
20070083120 Cain et al. Apr 2007 A1
20070236450 Colgate et al. Oct 2007 A1
20070269432 Nakamura et al. Nov 2007 A1
20070276658 Douglass Nov 2007 A1
20080002262 Chirieleison et al. Jan 2008 A1
20080049291 Baek et al. Feb 2008 A1
20080130069 Cernasov Jun 2008 A1
20080141316 Igoe et al. Jun 2008 A1
20080239452 Xu et al. Oct 2008 A1
20090073559 Woodgate et al. Mar 2009 A1
20090086170 El-Ghoroury et al. Apr 2009 A1
20090096746 Kruse et al. Apr 2009 A1
20090161191 Powell Jun 2009 A1
20090199900 Bita et al. Aug 2009 A1
20090222113 Fuller et al. Sep 2009 A1
20090256287 Fu et al. Oct 2009 A1
20090268303 Takai Oct 2009 A1
20090278998 El-Ghoroury et al. Nov 2009 A1
20090327171 Tan et al. Dec 2009 A1
20100003777 El-Ghoroury et al. Jan 2010 A1
20100026960 Sprague Feb 2010 A1
20100046070 Mukawa Feb 2010 A1
20100053164 Imai et al. Mar 2010 A1
20100066921 El-Ghoroury et al. Mar 2010 A1
20100091050 El-Ghoroury et al. Apr 2010 A1
20100156676 Mooring et al. Jun 2010 A1
20100171922 Sessner et al. Jul 2010 A1
20100199232 Mistry et al. Aug 2010 A1
20100220042 El-Ghoroury et al. Sep 2010 A1
20100241601 Carson et al. Sep 2010 A1
20100245957 Hudman et al. Sep 2010 A1
20100259472 Radivojevic et al. Oct 2010 A1
20100267449 Gagner et al. Oct 2010 A1
20110054360 Son et al. Mar 2011 A1
20110115887 Yoo et al. May 2011 A1
20110221659 King et al. Sep 2011 A1
20110285666 Poupyrev et al. Nov 2011 A1
20110285667 Poupyrev et al. Nov 2011 A1
20120033113 El-Ghoroury et al. Feb 2012 A1
20120075173 Ashbrook et al. Mar 2012 A1
20120075196 Ashbrook et al. Mar 2012 A1
20120105310 Sverdrup et al. May 2012 A1
20120113097 Nam et al. May 2012 A1
20120120498 Harrison et al. May 2012 A1
20120143358 Adams et al. Jun 2012 A1
20120154441 Kim Jun 2012 A1
20120157203 Latta et al. Jun 2012 A1
20120195461 Ashok Aug 2012 A1
20120212398 Border et al. Aug 2012 A1
20120212399 Border et al. Aug 2012 A1
20120218301 Miller Aug 2012 A1
20120236201 Larsen et al. Sep 2012 A1
20120249409 Toney et al. Oct 2012 A1
20120249741 Maciocci et al. Oct 2012 A1
20120288995 El-Ghoroury et al. Nov 2012 A1
20120290943 Toney et al. Nov 2012 A1
20120293402 Harrison et al. Nov 2012 A1
20120299962 White et al. Nov 2012 A1
20120319940 Bress et al. Dec 2012 A1
20120320092 Shin et al. Dec 2012 A1
20130016292 Miao et al. Jan 2013 A1
20130021545 Song et al. Jan 2013 A1
20130021658 Miao et al. Jan 2013 A1
20130027341 Mastandrea Jan 2013 A1
20130041477 Sikdar et al. Feb 2013 A1
20130050260 Reitan Feb 2013 A1
20130080890 Krishnamurthi et al. Mar 2013 A1
20130083303 Hoover et al. Apr 2013 A1
20130100362 Saeedi et al. Apr 2013 A1
20130141895 Alpaslan et al. Jun 2013 A1
20130162505 Crocco et al. Jun 2013 A1
20130169536 Wexler et al. Jul 2013 A1
20130176622 Abrahamsson et al. Jul 2013 A1
20130187836 Cheng et al. Jul 2013 A1
20130196757 Latta et al. Aug 2013 A1
20130215516 Dobschal et al. Aug 2013 A1
20130225999 Banjanin et al. Aug 2013 A1
20130258451 El-Ghoroury Oct 2013 A1
20130271679 Sakamoto et al. Oct 2013 A1
20130285174 Sako et al. Oct 2013 A1
20130286053 Fleck et al. Oct 2013 A1
20130286178 Lewis et al. Oct 2013 A1
20130321581 El-Ghoroury et al. Dec 2013 A1
20140009845 Cheng et al. Jan 2014 A1
20140024132 Jia et al. Jan 2014 A1
20140049417 Abdurrahman et al. Feb 2014 A1
20140049983 Nichol et al. Feb 2014 A1
20140055352 Davis et al. Feb 2014 A1
20140055692 Kroll et al. Feb 2014 A1
20140085177 Lyons et al. Mar 2014 A1
20140091984 Ashbrook et al. Apr 2014 A1
20140098018 Kim et al. Apr 2014 A1
20140098067 Yang et al. Apr 2014 A1
20140118252 Kim et al. May 2014 A1
20140129207 Bailey et al. May 2014 A1
20140139454 Mistry et al. May 2014 A1
20140139576 Costa et al. May 2014 A1
20140147035 Ding et al. May 2014 A1
20140168062 Katz et al. Jun 2014 A1
20140176417 Young et al. Jun 2014 A1
20140185142 Gupta et al. Jul 2014 A1
20140200496 Hyde et al. Jul 2014 A1
20140232651 Kress et al. Aug 2014 A1
20140292620 Lapstun et al. Oct 2014 A1
20140300869 Hirsch et al. Oct 2014 A1
20140301662 Justice et al. Oct 2014 A1
20140304646 Rossmann Oct 2014 A1
20140340304 Dewan et al. Nov 2014 A1
20150001987 Masaki et al. Jan 2015 A1
20150033539 El-Ghoroury et al. Feb 2015 A1
20150035832 Sugden et al. Feb 2015 A1
20150054729 Minnen et al. Feb 2015 A1
20150058102 Christensen et al. Feb 2015 A1
20150125109 Robbins et al. May 2015 A1
20150138086 Underkoffler et al. May 2015 A1
20150148886 Rao et al. May 2015 A1
20150193984 Bar-Zeev et al. Jul 2015 A1
20150205126 Schowengerdt et al. Jul 2015 A1
20150220109 Von Badinski et al. Aug 2015 A1
20150235467 Schowengerdt et al. Aug 2015 A1
20150277126 Hirano et al. Oct 2015 A1
20150301256 Takiguchi et al. Oct 2015 A1
20150301383 Kimura Oct 2015 A1
20150323990 Maltz et al. Nov 2015 A1
20150323998 Kudekar et al. Nov 2015 A1
20150326842 Huai et al. Nov 2015 A1
20150331297 Han et al. Nov 2015 A1
20150381782 Park et al. Dec 2015 A1
20160018948 Parvarandeh et al. Jan 2016 A1
20160026059 Chung et al. Jan 2016 A1
20160028935 El-Ghoroury et al. Jan 2016 A1
20160116738 Osterhout et al. Apr 2016 A1
20160182782 El-Ghoroury et al. Jun 2016 A1
20160191765 El-Ghoroury et al. Jun 2016 A1
20160191823 El-Ghoroury et al. Jun 2016 A1
20160220232 Takada et al. Aug 2016 A1
20160342151 Dey et al. Nov 2016 A1
20170065872 Kelley et al. Mar 2017 A1
20170069134 Shapira et al. Mar 2017 A1
20170116897 Ahn et al. Apr 2017 A1
20170184776 El-Ghoroury et al. Jun 2017 A1
20170236295 El-Ghoroury et al. Aug 2017 A1
20170261388 Ma et al. Sep 2017 A1
20170310956 Perdices-Gonzalez et al. Oct 2017 A1
Foreign Referenced Citations (13)
Number Date Country
103298410 Sep 2013 CN
103546181 Jan 2014 CN
103558918 Feb 2014 CN
104460992 Mar 2015 CN
108701437 Oct 2018 CN
0431488 Jun 1991 EP
2014075486 Apr 2014 JP
2015501951 Jan 2015 JP
2019508725 Mar 2019 JP
201001368 Jan 2010 TW
201531738 Aug 2015 TW
201734527 Oct 2017 TW
2014124173 Aug 2014 WO
Non-Patent Literature Citations (54)
Entry
Ahumada, Jr., Albert J. et al., “Spatio-temporal discrimination model predicts temporal masking functions”, Proceedings of SPIE—the International Society for Optical Engineering, Human vision and electronic imaging III, vol. 3299, 1998, 6 pp. total.
Beulen, Bart W. et al., “Toward Noninvasive Blood Pressure Assessment in Arteries by Using Ultrasound ”, Ultrasound in Medicine & Biology, vol. 37, No. 5, 2011, pp. 788-797.
Bickel, Bernd et al., “Capture and Modeling of Non-Linear Heterogeneous Soft Tissue ”, ACM Transactions on Graphics (TOG)—Proceedings of ACM SIGGRAPH 2009, vol. 28, Issue 3, Article No. 89, Aug. 2009, 9 pp. total.
Castellini, Claudio et al., “Using Ultrasound Images of the Forearm to Predict Finger Positions”, IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 20, No. 6, Nov. 2012, pp. 788-797.
Cobbold, Richard S., “Foundations of Biomedical Ultrasound”, Oxford University Press, 2007, pp. 3-95.
Fattal, David et al., “A multi-directional backlight for a wide-angle, glasses-free three-dimensional display”, Nature, vol. 495, Mar. 21, 2013, pp. 348-351.
Final Office Action for U.S. Appl. No. 15/391,583, dated Jun. 11, 2019, 13 pages.
First Examination Report for India Patent Application No. 201847028193, dated Jan. 27, 2021, 5 pages.
Grossberg, Stephen et al., “Neural dynamics of saccadic and smooth pursuit eye movement coordination during visual tracking of unpredictably moving targets”, Neural Networks, vol. 27, 2012, pp. 1-20.
Guo, Jing-Yi et al., “Dynamic monitoring of forearm muscles using one-dimensional sonomyography system”, Journal of Rehabilitation Research & Development, vol. 45, No. 1, 2008, pp. 187-195.
Harrison, Chris et al., “Skinput: Appropriating the Body as an Input Surface”, CHI '10 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2010, pp. 453-462.
Hsiao, Tzu-Yu et al., “Noninvasive Assessment of Laryngeal Phonation Function Using Color Doppler Ultrasound Imaging”, Ultrasound in Med & Biol., vol. 27, No. 8, 2001, pp. 1035-1040.
Hua, Hong et al., “A 3D integral imaging optical see-through head-mounted display”, Optics Express, vol. 22, No. 11, May 28, 2014, pp. 13484-13491.
International Preliminary Report on Patentability for International Patent Application No. PCT/US2016/069042, dated Jul. 12, 2018, 12 pages.
International Search Report and Written Opinion for International Patent Application No. PCT/US2016/069042, dated Apr. 19, 2017, 21 pages.
International Search Report and Written Opinion of the International Searching Authority dated Jun. 29, 2017 International Application No. PCT/US2017/026238, mailed Jun. 29, 2017, 24 pages.
Keir, Peter J. et al., “Changes in geometry of the finger flexor tendons in the carpal tunnel with wrist posture and tendon load: an MRI study on normal wrists”, Clinical Biomechanics, vol. 14, 1999, pp. 635-645.
Khuri-Yakub, Butrus T. et al., “Capacitive micromachined ultrasonic transducers for medical imaging and therapy”, J. Micromech. Microeng., vol. 21, No. 5, May 2011, pp. 054004-054014.
Koutsouridis, G. G. et al., “Towards a Non-lnvasive Ultrasound Pressure Assessment in Large Arteries”, Technische Universiteit Eindhoven, University of Technology, Mate Poster Award 2010 : 15th Annual Poster Contest, 2010, 1 page total.
Lanman, Douglas et al., “Near-Eye Light Field Displays”, ACM Transactions on Graphics (TOC), vol. 32, Issue 6, Article 220, Nov. 2013, 27 pp. total.
Legros, M. et al., “Piezocomposite and CMUT Arrays Assessment Through In Vitro Imaging Performances”, 2008 IEEE Ultrasonics Symposium, Nov. 2-5, 2008, pp. 1142-1145.
Martin, Joel R. et al., “Changes in the flexor digitorum profundus tendon geometry in the carpal tunnel due to force production and posture of metacarpophalangeal joint of the index finger: An MRI study”, Clinical Biomechanics, vol. 28, 2013, pp. 157-163.
Martin, Joel R. et al., “Effects of the index finger position and force production on the flexor digitorum superficialis moment arms at the metacarpophalangeal joints—a magnetic resonance imaging study”, Clinical Biomechanics, vol. 27, 2012, pp. 453-459.
Marwah, Kshitij et al., “Compressive Light Field Photography using Overcomplete Dictionaries and Optimized Projections”, Proc. of SIGGRAPH 2013 (ACM Transactions on Graphics, 32, 4), 2013, 12 pp. total.
Mujibiya, Adiyan et al., “The Sound of Touch: On-body Touch and Gesture Sensing Based on Transdermal Ultrasound Propagation”, ITS '13 Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces, Oct. 6-9, 2013, pp. 189-198.
Notice of Allowance for Taiwan Patent Application No. 105143728, dated Dec. 1, 2020, 3 pages.
Notice of Allowance for U.S. Appl. No. 15/391,583, dated Nov. 12, 2019, 8 pages.
Notice of Reasons for Rejection for Japan Patent Application 2018-533893, dated Nov. 10, 2020, 6 pages.
Office Action for Taiwan Patent Application No. 105143728, dated Feb. 17, 2020, 7 pages.
Office Action for U.S. Appl. No. 15/391,583, dated Aug. 31, 2018, 15 pages.
Paclet, Florent et al., “Motor control theories improve biomechanical model of the hand for finger pressing tasks”, Journal of Biomechanics, vol. 45, 2012, pp. 1246-1251.
Pinton, Gianmarco F. et al., “A Heterogeneous Nonlinear Attenuating Full-Wave Model of Ultrasound”, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, vol. 56, No. 3, Mar. 2009, pp. 474-488.
Restriction Requirement for U.S. Appl. No. 15/391,583, dated Mar. 5, 2018, 9 pages.
Richard, William D. et al., “A scalable architecture for real-time synthetic-focus imaging”, Ultrasonic Imaging, vol. 25, 2003, pp. 151-161.
Rolland, Jannick P. et al., “Dynamic focusing in head-mounted displays”, Part of the IS&T/SPIE Conference on the Engineering Reality of Virtual Reality, SPIE vol. 3639, Jan. 1999, pp. 463-470.
Shi, Jun et al., “Feasibility of controlling prosthetic hand using sonomyography signal in real time: Preliminary study”, Journal of Rehabilitation Research & Development, vol. 47, No. 2, 2010, pp. 87-97.
Sikdar, Siddhartha et al., “Novel Method for Predicting Dexterous Individual Finger Movements by Imaging Muscle Activity Using a Wearable Ultrasonic System”, IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 22, No. 1, Jan. 2014, pp. 69-76.
Sueda, Shinjiro et al., “Musculotendon Simulation for Hand Animation”, ACM Transactions on Graphics (TOG)—Proceedings of ACM SIGGRAPH 2008, vol. 27 Issue 3, Article No. 83, vol. 27 Issue 3, Aug. 2008, 8 pp. total.
Szabo, Thomas L., “Diagnostic Ultrasound Imaging: Inside Out, Second Edition”, Elsevier Inc., 2013, 829 pp. total.
Van Den Branden Lambrecht, Christian J., “A Working Spatio-Temporal Model of the Human Visual System for Image Restoration and Quality Assessment Applications”, ICASSP-96, Conference Proceedings of the 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing, May 1996, 4 pp. total.
Watson, Andrew B., “The search for optimal visual stimuli”, Vision Research, vol. 38, 1998, pp. 1619-1621.
Watson, Andrew B., “The Spatial Standard Observer: A Human Visual Model for Display Inspection”, Society for Information Display, SID 06 Digest, Jun. 2006, pp. 1312-1315.
Watson, Andrew B., “Visual detection of spatial contrast patterns: Evaluation of five simple models”, Optics Express, vol. 6, No. 1, Jan. 3, 2000, pp. 12-33.
Watson, Andrew B. et al., “Model of human visual-motion sensing”, Journal of the Optical Society of America A, vol. 2, No. 2, Feb. 1985, pp. 322-342.
Natson, Andrew B. et al., “Model of visual contrast gain control and pattern masking”, Journal of the Optical Society of America A, vol. 14, No. 9, Sep. 1997, pp. 2379-2391.
Wikipedia, “List of refractive indices”, https://en.wikipedia.org/wiki/List_of_refractive_indices, Dec. 7, 2003, 5 pp. total.
Williams III, T. W., “Progress on stabilizing and controlling powered upper-limb prostheses”, Journal of Rehabilitation Research & Development, Guest Editorial, vol. 48, No. 6, 2011, pp. ix-xix.
Willis, Kari D. et al., “MotionBeam: A Metaphor for Character Interaction with Handheld Projectors”, CHI '11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, May 7-12, 2011, pp. 1031-1040.
Yun, Xiaoping et al., “Design, Implementation, and Experimental Results of a Quaternion-Based Kalman Filter for Human Body Motion Tracking”, IEEE Transactions on Robotics, vol. 22, No. 6, Dec. 2006, pp. 1216-1227.
Zhang, Cha et al., “Maximum Likelihood Sound Source Localization and Beamforming for Directional Microphone Arrays in Distributed Meetings”, IEEE Transactions on Multimedia, vol. 10, No. 3, Apr. 2008, pp. 538-548.
Final Office Action for Taiwan Patent Application No. 110107404, dated Apr. 8, 2022, 3 pages.
First Office Action for China Patent Application No. 201680082778.9, dated Mar. 5, 2021, 16 pages.
Notice of Allowance for Chinese Patent Application No. 201680082778.9, dated Jan. 7, 2022, 2 pages.
Office Action for Taiwan Patent Application No. 110107404, dated Sep. 1, 2021, 4 pages.
Related Publications (1)
Number Date Country
20200209646 A1 Jul 2020 US
Provisional Applications (1)
Number Date Country
62271637 Dec 2015 US
Divisions (1)
Number Date Country
Parent 15391583 Dec 2016 US
Child 16775878 US