This disclosure relates to systems and methods for optimizing fabrication of optical devices.
Optical devices such as metasurfaces may benefit from optimization. Metasurfaces are wavefront shaping devices with subwavelength-scale structures which have been demonstrated for a broad range of applications in sensing, imaging, and information processing. Inverse design using topology optimization has proven to be highly effective for designing metasurfaces with optimized performance, which uses adjoint based gradient computations to iteratively update the dielectric distribution of the device to achieve better performance. A challenge in the inverse design of metasurfaces is to not only optimize device performance but also guarantee device fabricability, for example, enforcing control on the minimum feature size of the pattern so that the fabrication requirement will not go beyond the ability of lithography and etching. Although existing strategies to restrict the minimum feature size such as applying filters and employing analytical penalty functions are able to tackle the problem to some extent, they all lack the ability to strictly avoid the existence of tiny features.
Various embodiments are directed to a method for optimization of photonic devices. The method receives a set of unconstrained latent variables, maps the set of unconstrained latent variables to a constrained space to generate a constrained device, and calculates the permittivity across each element of the constrained device. The method further determines a permittivity-constrained variable gradient based at least partially on the permittivity across each element and optimizes the set of unconstrained latent variables by at least partially using the permittivity-constrained variable gradient.
In various other embodiments, mapping the unconstrained space to a constrained space includes reparameterization of the unconstrained latent variables.
In still various other embodiments, the reparameterization of the unconstrained latent variables includes solving for a set of constrained width space {wi} through the following equations:
where the set of unconstrained latent variables are {ui} and wherein wmin is a minimum width of each feature of the constrained width space, M is the total number of features, and Σi=1M wi=L.
In still various other embodiments, calculating the permittivity across each element of the constrained device includes performing a gray-space relaxation of the set of constrained width space to determine a function of refractive index across each element in the set of constrained width space.
In still various other embodiments, the gray-space relaxation comprises solving for
where x is the position across the width of a certain element, where x=0 is at the middle of the element, and T controls the binarization of the pattern.
In still various other embodiments, the method further includes determining an efficiency-constrained variable gradient of the constrained device based on the permittivity-constrained variable gradient.
In still various other embodiments, the efficiency-constrained variable gradient is further based on an efficiency-permittivity gradient.
In still various other embodiments, the efficiency-constrained variable gradient is calculated using the following equation:
where
is the permittivity-constrained width gradient and
is the efficiency-permittivity gradient.
In still various other embodiments, an efficiency-latent variable gradient is calculated at least partially using a latent variable gradient of the latent unconstrained variables in relation to constrained device calculated using the following equations:
where the set of unconstrained latent variables are {ui} and wherein wmin is a minimum width of each feature of the constrained width space, M is the total number of features, and Σi=1M wi=L.
In still various other embodiments, the efficiency grating in relation to the unconstrained latent variables is calculated at least partially using the following equation:
where
is the constrained width-latent variables gradient and
is the efficiency-constrained width gradient.
In still various other embodiments, the efficiency-permittivity gradient is calculated using an adjoint variable method.
In still various other embodiments, the adjoint variable method includes forward and adjoint simulation.
In still various other embodiments, the method of further includes using a generator to generate the set of unconstrained latent variables; and iteratively updating the generator at least partially based on the permittivity-constrained variable gradient.
In still various other embodiments, the unconstrained latent variables comprise unconstrained latent widths and mapping the set of unconstrained latent variables comprises mapping the unconstrained latent widths to the constrained space to generate constrained widths. The method further includes receiving a set of unconstrained latent permittivities and mapping the set of unconstrained latent permittivities to a constrained space to generate constrained average permittivities of the constrained device. Calculating the permittivity profile across each element of the constrained device is further based on the constrained widths and the constrained average permittivities of the constrained device.
In still various other embodiments, the method further includes determining a permittivity-constrained average permittivity gradient of the constrained device and optimizing the set of unconstrained latent permittivities at least partially based on the permittivity-constrained average permittivity gradient of the constrained device.
In still various other embodiments, the method further includes binarizing the permittivity across each element of the constrained device, where determining a permittivity-constrained variable gradient is based on the binarized permittivity across each element.
Various embodiments are directed to a method for optimization of photonic devices, the method including receiving a set of variables including a set of refractive indices including a set of corresponding thicknesses, calculating a reflection gradient with respect to the set of refractive indices and their set of corresponding thicknesses, and optimizing the set of variables at least partially using the reflection gradient to obtain an optimized device including a set of optimized refractive indices with corresponding optimized thicknesses.
In various other embodiments, the method further includes calculating the reflection spectrum of the set of variables, where calculating the reflection gradient includes calculating a partial differential of the reflection spectrum.
In still various other embodiments, calculating the reflection spectrum comprises using a transfer matrix method.
In still various other embodiments, the method further includes: using a generator to generate the set of variables; using the set of variables to calculate a corresponding reflection gradient; and iteratively updating the generator at least partially using the reflection gradient.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
The description will be more fully understood with reference to the following figures and data graphs, which are presented as various embodiment of the disclosure and should not be construed as a complete recitation of the scope of the disclosure.
Nanophotonic devices may be capable of manipulating and guiding electromagnetic waves propagating in free space and on chip, and they have a broad range of applications in imaging, sensing, and optical communications. Among the most effective methods to design these devices is gradient-based topology optimization, which has been used to realize metagratings, metalenses, and on-chip photonic devices that utilize complex electromagnetic wave dynamics to achieve exceptional performance. Topology optimization is performed by discretizing the device structure into small voxels, initializing each voxel with grayscale dielectric permittivity values c, and then iteratively modifying these permittivity values in a manner that improves a figure of merit (FoM). These modifications are based on gradient terms
that can be computed for each pixel using the adjoint variables method or autodifferentiation. Topology optimization can be performed in the context of local optimization, in which local gradients are directly used to perform gradient descent on grayscale device structures, or global optimization with global topology optimization networks (GLOnets), in which local gradient calculations are combined with generative neural network training to perform global population-based optimization.
A critical concern in the inverse deign methods for optical devices may be guaranteeing device fabricability, making it desirable to incorporate practical experimental constraints such as the minimum feature size or robustness to fabrication imperfections. Existing techniques such as applying threshold filters and adding penalties to the figure of merit may be able to push the output devices towards the desired constrained design space. However, they may lack the ability to enforce hard constraints such as avoiding the appearance of tiny features smaller than the minimum specified feature size.
Further, a critical issue concerning topology-optimized devices is the practical implementation of hard geometric constraints imposed by experimental considerations. A particularly important geometric constraint is minimum feature size (MFS), which arises due to limitations in lithography patterning resolution and etching aspect ratio. The imposition of MFS constraints also enables proper base patterns to be defined and used in algorithms that enforce fabrication robustness, in which base patterns are codesigned with their geometrically eroded and dilated forms. Without these constraints, topology-optimized devices often possess complex geometric shapes with very small feature sizes, making them difficult if not impossible to experimentally fabricate in a reliable manner.
Current methods to impose MFS constraints fall in one of three classes. The first is to set the device voxel dimensions or spacing between features to match the desired MFS. While this method works, it adds significant granularity to the device design space, limiting the final device performance. The second method is to use regularization terms that penalize the FoM when the MFS constraint is violated. While this technique will generally push devices toward regions of the design space that satisfy the desired constraints, it does not guarantee their enforcement. A third method is to optimize the device in an unconstrained manner and then use threshold filters to incorporate constraints. This method can be applied during the iterative optimization process or after unconstrained optimization is performed, and while it has the potential to work well, it only works when optimized devices in the unconstrained space locally map onto high performance optima in the constrained space.
Various embodiments of this disclosure relate enforcing strict geometric constraints within an inverse optimizer, while maintaining the fine pixel-level granularity of the physical design space, by reparameterizing the physical design space itself.
Further, various embodiments of this disclosure relate to a method that accurately imposes constraints through reparametrization. In some embodiments, the method may impose hard constraints in the optimization process through reparametrizing the problem. The pixelated device pattern is reparametrized by a new set of parameters where the constraints in the old design space are naturally eliminated, and optimization is performed in this new design space instead. This method may be used to design metasurfaces such as metagratings including silicon nanoridges with strict restrictions on minimum feature size.
In some embodiments, via a sequence of mathematical transformations, the method uses variables in an unconstrained latent space to reparametrize the original constrained device space such that the constraints are naturally imposed through the reparameterization process. Adjoint based optimization may then be performed with this newly introduced unconstrained variable space where performance gradients are first calculated regarding the original constrained device space and then backpropagated to the unconstrained latent space.
Photonic devices including metasurfaces such as high efficiency metagratings including silicon nanoridges may be fabricated with accurate control on the minimum feature size are designed. Silicon nanoridges may deflect normally incident light to the +1 diffraction order.
At all stages of optimization, an individual metagrating period may be defined by a permittivity profile ε=ε(X), which denotes the material distribution at each voxel located at x within an individual grating period. ε(x) is normalized so that 0 represents air and 1 represents silicon. The metagrating period has a width L that is subdivided into N=256 voxels, so that both x and E are vectors with dimension N. Our FoM is deflection efficiency, which is defined as the electromagnetic power deflected into the +1 diffraction order normalized to the total incident beam power. The deflection efficiency is denoted as Eff=Eff(ε) and calculated with a rigorous coupled-wave analysis (RCWA) electromagnetic solver such as Reticolo.
The objective is to find a permittivity profile that maximizes the deflection efficiency, which can be cast as the following optimization:
To define feature size constraints on the pixelized pattern ε(x), the pixelized pattern may be transformed to a vector of discrete width values, w, with which MFS constraints can be readily defined and incorporated. For devices of fixed topology, each element in w represents ridge widths and air gap values which may generalize to devices of varying topology. By reframing the pixelized patterns to a vector of geometric values, the original optimization problem may be reformulated for devices of fixed topology to be:
wmin denotes the MFS, wi denotes the width of each structural feature, which can be a silicon ridge or air gap, and M denotes the total number of silicon and air features. The total device width should be equal to the grating period L.
By first transforming the pixelated pattern into a pattern represented by the ridge width and ridge separation values, the minimum feature size can be described as wi≥wmin with i=1, 2, . . . , M where wmin denotes the minimum feature size, wi denotes the width of each bar (silicon ridge or air gap), and M denotes the total number of bars.
Processes Including Reparameterization
The reparametrized inverse design process may be used to design high efficiency metagratings with accurate control on the minimum feature size.
The reparameterization process of mapping {ui} into n(x) is elaborated in the lower panel of
As illustrated in the leftmost box on the lower panel of
The transformation of u to w may be defined as w=ƒ(u, wmin). In this manner, MFS constraints on the metagrating pattern, have been imposed onto the width vector w.
Through the transformations described in the leftmost box on the lower panel of
With a physical device in hand,
may be evaluated using the adjoint variables method, in which forward and adjoint simulations are performed using the RCWA simulator. This gradient term may be then used to calculate
using back-propagation, which may be based on the chain rule. Backpropagation can be used in the algorithm because the entire reparameterization process can be described as a continuous and differentiable computation graph. In practice, backpropagation may be performed by programming the algorithm in PyTorch and using built-in autodifferentiation packages. Finally, u may be updated using the adaptive moment estimation (Adam) algorithm, which may be a variant of gradient descent, and the entire process is iteratively repeated.
A metagrating may be designed that deflects normally incident TM-polarized light at a wavelength of 850 nm to 65 degrees.
In some embodiments, the method may be used to enforce fabrication constraints through reparameterization. In the new reparameterized design space, those constraints may be naturally eliminated, and fabrication optimization may be achieved. The device designed by the method may be able to achieve extremely high performance and strictly satisfy fabrication constraints. Implementations of this design scheme may include variations in the topology, enrichment in constraints, and diversification of structural geometries.
Reparameterized local optimization may be used to design metagratings that deflect normally incident transversemagnetic-polarized light at a wavelength of 850 nm to 65 degrees. In one example, the MFS constraint may be set to 60 nm, the topology is fixed to contain three silicon ridges (M=6), and the device thickness is 335 nm. The refractive index of silicon may be used and only the real part of the index may be used to simplify the design problem. Complex refractive indices can be readily incorporated into the optimization procedure without loss of generality. For the disclosed system, the role of the imaginary part of the index may be small, and its inclusion results in a less than 2% drop in the total deflection efficiency for all of the optimized devices.
spans many voxels, which translate to large
upon backpropagation. These gradients allow relatively large changes to the device layout to be made each iteration in the early stages of optimization, while the algorithm is broadly searching for a local optimum. It is noted that the initial magnitude of T cannot be too large and must be judiciously chosen because the grayscale and binary design spaces are different, and these differences become more substantial as T increases. Sufficient correlation between these two design spaces is required for gradients within the grayscale design space to reliably improve the device over the course of binarization. As the local optimizer evolves, T is gradually reduced and the device becomes more binarized. At this stage,
becomes more localized to the air-silicon interfaces and the gradients provide fine-tuning of the device layout, in a manner akin to conventional boundary optimization. Upon the completion of optimization, T is decreased to zero, and the device is fully binarized and contains only silicon and air material.
Reparameterization not only is able to enforce robust physical constraints, it also reduces the computational cost for the optimization process because it serves to reduce the dimensionality of the physical design space itself. Through reparameterization, N dimensional (N=256) pixelized device patterns are reduced to a M−1-dimensional latent vector representations, leading to over an order of magnitude reduction in the dimensionality of the design parameters. This results in a physical design space that is dramatically smaller with fewer local optima, yielding a simplified optimization problem that requires less computational cost for both local and global optimization algorithms.
In some embodiments, reparameterization may be applied to GLOnets to enable population-based global optimization of fixed-topology devices with hard geometric constraints.
Gϕ:UM-1(−1,1)→Pϕ(u) (5)
where Pϕ(u) denotes the probability of generating u in the latent device space. The reparameterization process then follows, which maps u to the physical device pattern ε using the same formalism specified for the reparameterized local optimizer.
The next step is the evaluation of the loss function using metrics calculated from the generated devices. The loss function is engineered so that minimizing the loss function maximizes the probability that the neural network generates the optimal latent vector u*, which maps onto the globally optimized device ε*. For reparameterized GLOnets, the loss function is defined to be:
The efficiencies, Eff, and efficiency gradients,
of the physical devices are calculated with forward and adjoint electromagnetic simulations. K is the batch size, and σ is a hyperparameter that biases network training toward devices possessing relatively high efficiencies and large gradients. To minimize the loss function, backpropagation is performed to modify network weights ϕ in the generator. As the mapping functions that link the noise vector, latent vector, and physical device pattern profile are continuous and differentiable, backpropagation is performed via the chain rule in a straightforward manner. Upon the completion of network training, the network generates latent vectors that map to physical devices clustered around the global optimum.
Reparameterized GLOnets are used to optimize metagratings with the same specifications as those designed by local optimization which are discussed in connection with
Over the course of network training, the best generated device and the overall device distribution shift toward higher efficiency regimes (top panel,
The evolution of the device distribution over the course of network training is examined in more detail in
Fabrication Imperfections Enforced with Reparameterization
Devices that satisfy MFS constraints still may not guarantee good experimental performance as the device could be sensitive to other types of fabrication imperfections. Robustness to fabrication imperfections can be readily incorporated into reparameterized GLOnets. In some embodiments robustness may be incorporated in fixed-topology reparameterized GLOnets. In some embodiments, robustness may be incorporated in variable-topology reparameterized GLOnets. Robustness criteria are practically important due to geometric imperfections arising from all experimental fabrication processes. In some cases, geometrically eroded and dilated versions of the devices in the FoM may be used to account for fabrication imperfections.
Effavg=0.5×Efforiginal+0.25×Efferoded+0.25×Effdilated (7)
Effavg=0.5×Eff(w)+0.25×Eff(we)+0.25×Eff(wd) (11)
Fixed-topology reparameterized GLOnets with robustness may be used to globally optimize a metagrating with a MFS constraint of 30 nm and δw=10 nm. The device may operate with a wavelength of 850 nm and deflection angle of 65 deg, and the topology may be fixed to contain three silicon ridges.
Given that the final pixelized pattern ε(x) may be generated from the width space {wi}, fabrication imperfections may be defined in terms of pattern erosion (width of Si ridge decreases and width of air gap increases) and dilation (width of Si ridge increases and width of air gap decreases). In some embodiments, an averaged deflection efficiency may be defined as the figure of merit to reflect fabrication robustness where during each iteration the efficiency of multiple devices (e.g. three devices) may be averaged. The multiple devices may include:
In this way, robustness to fabrication imperfections may be introduced to the design space constrained with minimum feature size.
Optimization of Photonics Thin Film Stacks
In some embodiments, the optimization techniques may be used to optimize optical devices such as photonic thin film stacks. Thin film stacks have been used in many optical systems.
{n*,t*}=arg min{n,t}Σλ,θ,pol((n,t|λ,θ,pol)−*(λ,θ,pol))2 (5)
The desired reflection spectrum is denoted as *(λ,θ,pol). The objective may be described to determine Equation 6:
O(n,t)=Σλ,θ,pol((n,t|λ,θ,pol)−*(λ,θ,pol))2 (6)
To determine the optimization, a global optimization algorithm may be used. In some embodiments the optimization algorithm may be a transfer matrix method (TMM).
In some embodiments, a generative neural network may be used to determine a distribution of thin film stack configurations.
The gradient of the loss function with respect to the neuron weights may be calculated by propagation, and the generator may then be optimized by gradient descent. After optimization, the distribution of thin film stack configurations may converge to a delta function located at the global optimum.
In practice, the refractive indices of thin film layers may not take arbitrary values and may be chosen from a material database and thus n may be a categorical variable. However, the gradients may not be calculated for categorical variables. To overcome this issue, a new scheme to generate refractive indices is illustrated in
α is a hyperparameter to tune the sharpness of the Softmax function 910. The ith row of probability matrix P 912 is a 1×M vector, which represents the probability distribution over the material database for the ith layer. Then the expected refractive index of each layer given by this probability distribution is calculated by ni(λ)=Σj=1M mj(λ)·Pij, which is a continuous variable with the valid gradient. As such, the gradient with respect to the refractive index ni may be backpropagated to the probability matrix P 912 and then the neurons. In addition, to ensure the material probability distribution of each layer converges to only one material, the hyperparameter a may increase over the course of optimization.
Since the desired reflection spectra usually cover a wide range of wavelengths and incident angles, finding the proper thin film configuration may be complex and challenging. A deep neural network may be beneficial to produce complex distributions in the design space in the early stage of optimization, while the ability to express a relatively simple distribution is also important for smooth convergence at the end.
A 3-layer thin film stack forming a three-layer AR coating for Si was designed to minimize average reflection from silicon over the incident angle range between 0° and 60° and the wavelength range between 400 nm and 1100 nm. The refractive index was between 1.09 and 2.60 and the thicknesses were between 0 nm and 200 nm of each layer.
P0 is the input power and V(λ) denotes the eye's sensitivity spectrum. The generative neural network optimized device achieved χ of 18.0 compared with a genetic algorithm optimized device which achieved χ of 14.8. The generative neural network improved the performance by 22%.
A global optimizer may benefit from the ability to search for the proper device topology as well as the detailed layout for that topology. Optimizers for fixed-topology devices can perform this task by parametrically sweeping across a wide range of topologies, as performed in
with its function defined as:
The right half is defined in a similar way on {tilde over (x)}(i)∈
from the center location to the interface between the ith and the i+1th section:
Thus, a continuous and differentiable mapping function ĥ is defined to transform from the piecewise vectors (w,{circumflex over (ε)}) to the device's permittivity profile ε, such that the gradient can be backpropagated during the optimization process. In some embodiments, a gradient based on the width vector (wi) and the center permittivity vector ({circumflex over (ε)}i) may be solved for. A process such as gradient descent may be used to optimize each of these vectors in order to optimize the device. In some embodiments, these width and permittivity may be solved for simultaneously. In some embodiments, the optimum width of the elements may be solved for followed by the optimum permittivity or vice versa.
γ is a tunable hyperparameter that controls the binarization of the permittivity vector {circumflex over (ε)} and is analogous to the hyperparameter T used to control the binarization of the device widths. As with T, γ is initially set to produce grayscale refractive index values and is manually increased in a gradual manner so that the final device possesses binary refractive index values of silicon or air. {circumflex over (M)} specifies the total number of sections and sets the upper limit in the topological complexity of generated devices. For example, if {circumflex over (M)}=10, physical devices with up to five nanoridges can be generated. In some embodiments, the physical device may include less than
nanoridges. For example, it {circumflex over (M)}=10, the physical device may have 4 nanoridges.
The ability for variable-topology reparameterized GLOnets to search across different device topologies is demonstrated for metagratings with the same operating parameters specified in
Variable-topology reparameterized GLOnets were benchmarked with two other methods. The first is local adjoint based optimization, where 200 unconstrained topology optimization iterations are first performed to produce binary devices from random grayscale devices, followed by 50 boundary optimization iterations to refine the binary device layouts and incorporate MFS constraints. The second is the original GLOnets, where a Gaussian filter is used at the network output in an attempt to impose a MFS constraint. The device designs are benchmarked by two criteria, deflection efficiency and the MFS in the physical device.
In the version of reparameterization discussed above in connection with
In some embodiment, the binary devices may be obtained and evaluated at each step during the iterative optimization. Unlike the reparameterization process described in connection with
the grayscale pattern may be binarized.
of the binary pattern may be simulated with an EM solver. Lastly, the gradient evaluated using the binary device may be directly applied onto the grayscale pattern to update the grayscale pattern, and eventually backpropagate onto the latent vector. The gradient may be used to optimize the latent vector through processes such as gradient descent. In some embodiments, the gradient on the binary device
may be directly applied to the grayscale device because the grayscale device is close enough to the binary device under a small T. In this manner, the EM simulation at each step may be performed for the binary device. The hyperparameter T can be set as a constant value throughout the optimization as long as the binary device is similar enough to its corresponding grayscale version.
For purposes of this discussion, cloud services are one or more applications that are executed by one or more server systems to provide data and/or executable applications to devices over a network. The server systems 3210, 3240, and 3270 are shown each having three servers in the internal network. However, the server systems 3210, 3240 and 3270 may include any number of servers and any additional number of server systems may be connected to the network 3260 to provide cloud services. In accordance with various embodiments of this invention, the optimization system that uses systems and methods that optimizes photonic devices while enforcing fabrication constraints in accordance with an embodiment of the invention may be provided by a process being executed on a single server system and/or a group of server systems communicating over network 3260.
Users may use personal devices 3280 and 3220 that connect to the network 3260 to perform processes that optimizes photonic devices while enforcing fabrication constraints in accordance with various embodiments of the invention. In the shown embodiment, the personal devices 3280 are shown as desktop computers that are connected via a conventional “wired” connection to the network 3260. However, the personal device 3280 may be a desktop computer, a laptop computer, a smart television, an entertainment gaming console, or any other device that connects to the network 3260 via a “wired” connection. The mobile device 3220 connects to network 3260 using a wireless connection. A wireless connection is a connection that uses Radio Frequency (RF) signals, Infrared signals, or any other form of wireless signaling to connect to the network 3260. In the example of this figure, the mobile device 3220 is a mobile telephone. However, mobile device 3220 may be a mobile phone, Personal Digital Assistant (PDA), a tablet, a smartphone, or any other type of device that connects to network 3260 via wireless connection without departing from this invention.
As can readily be appreciated the specific computing system used to optimizes photonic devices while enforcing fabrication constraints is largely dependent upon the requirements of a given application and should not be considered as limited to any specific computing system(s) implementation.
The processor 3305 can include (but is not limited to) a processor, microprocessor, controller, or a combination of processors, microprocessor, and/or controllers that performs instructions stored in the memory 3320 to manipulate data stored in the memory. Processor instructions can configure the processor 3305 to perform processes in accordance with certain embodiments of the invention.
Peripherals 3310 can include any of a variety of components for capturing data, such as (but not limited to) cameras, displays, and/or sensors. In a variety of embodiments, peripherals can be used to gather inputs and/or provide outputs. The optimizer element 3300 can utilize network interface 3315 to transmit and receive data over a network based upon the instructions performed by processor 3305. Peripherals and/or network interfaces in accordance with many embodiments of the invention can be used to gather inputs that can be used to optimize photonic devices while enforcing fabrication constraints.
Memory 3320 includes an optimization application 3325 and generator 3330. The optimization application 3325 and the generator 3330 in accordance with several embodiments of the invention can be used to optimize photonic devices while enforcing fabrication constraints.
The optimization application 3325 and generator 3330 may be used to perform the methods described above and the methods described below in
In some embodiments, mapping the unconstrained space to a constrained space may include reparameterization of the unconstrained latent variables.
In some embodiments, calculating the permittivity across each element of the constrained device may include performing a gray-space relaxation of the set of constrained width space to determine a function of refractive index across each element in the set of constrained width space.
In some embodiments, the optimization application 3325 may further determine an efficiency-constrained width gradient of the constrained device based on the permittivity-constrained width gradient. The efficiency-constrained width gradient is further based on an efficiency-permittivity efficiency gradient.
In some embodiments, the generator 3330 may generate the set of unconstrained latent variables; and the generator 3330 may be iteratively updated at least partially based on the permittivity-constrained width gradient.
In various embodiments, the optimization application 3325 may receive a set of variables including a set of refractive indices including a set of corresponding thicknesses; calculate a reflection gradient with respect to the set of refractive indices and their set of corresponding thicknesses; optimize the set of variables at least partially using the reflection gradient to obtain an optimized device including a set of optimized refractive indices with corresponding optimized thicknesses.
In some embodiments, the optimization application 3325 may further calculate the reflection spectrum of the set of variables, where calculating the reflection gradient comprises calculating a partial differential of the reflection spectrum. Calculating the reflection spectrum may include using a transfer matrix method.
In some embodiments, the generator 3330 may be used to generate the set of variables; the set of variables may be used to calculate a corresponding reflection gradient; and the generator 3330 may be iteratively update at least partially using the reflection gradient.
Although a specific example of element 3300 is illustrated in this figure, any of a variety of optimizer elements can be utilized to perform processes optimize photonic devices while enforcing fabrication constraints similar to those described herein as appropriate to the requirements of specific applications in accordance with embodiments of the invention.
The optimization method 3400 may further include mapping (3404) the set of unconstrained latent variables to a constrained space to generate a constrained device. The mapping may include reparameterization of the unconstrained latent variables. the reparameterization of the unconstrained latent variables may include solving for a set of constrained width space {wi} through the following equations:
where the set of unconstrained latent variables are {ui} and wherein wmin is a minimum width of each feature of the constrained width space, M is the total number of features, and Σi=1M wi=L.
The optimization method 3400 may further include calculating (3406) the permittivity across each element of the constrained device. Calculating the permittivity across each element of the constrained device may include performing a gray-space relaxation of the set of constrained width space to determine a function of refractive index across each element in the set of constrained width space. The gray-space relaxation may include solving for:
where x is the position across the width of a certain element, where x=0 is at the middle of the element, and T controls the binarization of the pattern.
The optimization method 3400 may further include determining (3408) a permittivity-constrained width gradient based at least partially on the permittivity across each element. The optimization method 3400 may further include optimizing (3410) the set of unconstrained latent variables at least partially using the permittivity-constrained width gradient. The permittivity-constrained width gradient may be at least partially used to calculate the efficiency-constrained width gradient.
In embodiments where a generator is used to generate the set of unconstrained latent variables, the generator may be iteratively updated at least partially based on the permittivity-constrained width gradient. The generator may be used to generate another set of unconstrained latent variables which may be used to update the constrained device.
While the above description contains many specific embodiments of the invention, these should not be construed as limitations on the scope of the invention, but rather as an example of one embodiment thereof. It is therefore to be understood that the present invention may be practiced in ways other than specifically described, without departing from the scope and spirit of the present invention. Thus, embodiments of the present invention should be considered in all respects as illustrative and not restrictive. Accordingly, the scope of the invention should be determined not by the embodiments illustrated, but by the appended claims and their equivalents.
This application claims the benefit of and priority under 35 U.S.C. § 119(e) to U.S. Provisional Patent Application Ser. No. 63/023,766 entitled “Multi-objective, Robust Constraints Enforced Global Topology Optimizer for Photonic Devices,” filed May 12, 2020, which is incorporated herein by reference in its entirety for all purposes.
This invention was made with government support under Contract No. DE-AR0001212 awarded by the Department of Energy. The Government has certain rights in the invention.
Number | Name | Date | Kind |
---|---|---|---|
5051938 | Hyduke | Sep 1991 | A |
6374385 | Hamalainen et al. | Apr 2002 | B1 |
10268232 | Harris et al. | Apr 2019 | B2 |
11460753 | Hughes et al. | Oct 2022 | B2 |
20040107172 | Wang | Jun 2004 | A1 |
20070047966 | Hironishi et al. | Mar 2007 | A1 |
20080050124 | Tsuchida et al. | Feb 2008 | A1 |
20080154815 | Martinez | Jun 2008 | A1 |
20100039649 | Digonnet | Feb 2010 | A1 |
20110188800 | Futami | Aug 2011 | A1 |
20120070151 | Shin et al. | Mar 2012 | A1 |
20130294782 | Liboiron-ladouceur et al. | Nov 2013 | A1 |
20150078754 | Aflatouni et al. | Mar 2015 | A1 |
20150261058 | Silverstone et al. | Sep 2015 | A1 |
20160162798 | Marandi et al. | Jun 2016 | A1 |
20170148433 | Catanzaro et al. | May 2017 | A1 |
20170200526 | Guo | Jul 2017 | A1 |
20170351293 | Carolan et al. | Dec 2017 | A1 |
20170351952 | Zhang et al. | Dec 2017 | A1 |
20180045953 | Fan | Feb 2018 | A1 |
20180089558 | Wittenberg et al. | Mar 2018 | A1 |
20200144437 | Gosciniak | May 2020 | A1 |
20200257751 | Engheta | Aug 2020 | A1 |
20200401920 | Killoran | Dec 2020 | A1 |
20210116781 | Hughes et al. | Apr 2021 | A1 |
20210192342 | Hughes et al. | Jun 2021 | A1 |
20210390396 | Fan et al. | Dec 2021 | A1 |
Number | Date | Country |
---|---|---|
0502943 | Feb 1999 | EP |
1255157 | Nov 2002 | EP |
3791229 | Mar 2021 | EP |
3791332 | Mar 2021 | EP |
2021523410 | Sep 2021 | JP |
2021523461 | Sep 2021 | JP |
10-2021-0005273 | Jan 2021 | KR |
10-2021-0006962 | Jan 2021 | KR |
2017210550 | Dec 2017 | WO |
2017214729 | Dec 2017 | WO |
2019217835 | Nov 2019 | WO |
2019217836 | Nov 2019 | WO |
2020014490 | Jan 2020 | WO |
Entry |
---|
Sell et al., “Ultra-High-Efficiency Anomalous Refraction with Dielectric Metasurfaces”, ACS Photonics, vol. 5, No. 6, Mar. 15, 2018, pp. 2402-2407, https://doi.org/10.1021/acsphotonics.8b00183. |
Sell et al., “Visible Light Metasurfaces Based on Single-Crystal Silicon”, ACS Photonics, vol. 3, No. 10, Sep. 27, 2016, pp. 1919-1925, DOI: 10.1021/acsphotonics.6b00436. |
Shen et al., “An integrated-nanophotonics polarization beamsplitter with 2.4×2.4 μm2 footprint”, Nature Photonics, vol. 9, Jun. 2015, first published May 18, 2015, pp. 378-382, https://doi.org/10.1038/nphoton.2015.80. |
Shen et al., “Deep learning with coherent nanophotonic circuits”, Nature Photon, 2017, vol. 11, pp. 441-446, https://doi.org/10.1038/nphoton.2017.93. |
Shi et al., “Optimization of Multilayer Optical Films with a Memetic Algorithm and Mixed Integer Programming”, ACS Photonics, ACS Photonics, Just Accepted Manuscript, published online Dec. 15, 2017, 24 pgs., https://doi.org/10.1021/acsphotonics.7b01136. |
Silva et al., “Performing Mathematical Operations with Metamaterials”, Science, vol. 343, No. 6167, Jan. 10, 2014, pp. 160-163, DOI: 10.1126/science.1242818. |
Singh et al., “Ultrasensitive terahertz sensing with high-Q Fano resonances in metasurfaces”, Applied Physics Letters, vol. 105, No. 17, Oct. 27, 2014, pp. 171101-1-171101-5, DOI: 10.1063/1.4895595. |
Srivastava et al., “Dropout: A Simple Way to Prevent Neural Networks from Overfitting”, Journal of Machine Learning Research, vol. 15, No. 1, Jun. 1, 2014, pp. 1929-1958. |
Su et al., “Fully-automated optimization of grating couplers”, Optics Express, vol. 26, No. 4, Feb. 4, 2018, pp. 4023-4034, https://doi.org/10.1364/OE.26.004023. |
Tait et al., “Demonstration of a silicon photonic neural network”, 2016 IEEE Photonics Society Summer Topical Meeting Series (SUM), 2016, pp. 72-73. |
Tittl et al., “Imaging-based molecular barcoding with pixelated dielectric metasurfaces”, Science, vol. 360, No. 6393, Jun. 8, 2018, 5 pgs. |
Vercruysse et al., “Analytical level set fabrication constraints for inverse design”, Scientific Reports, vol. 9, No. 8999, 2019, published online Jun. 21, 2019, 7 pgs., https://doi.org/10.1038/s41598-019-45026-0. |
Vieu et al., “Electron beam lithography: resolution limits and applications”, Applied Surface Science, Sep. 1, 2000, vol. 164, Issues 1-4, pp. 111-117, https://doi.org/10.1016/S0169-4332(00)00352-4. |
Wang et al., “Robust design of topology-optimized metasurfaces”, Optical Materials Express, vol. 9, No. 2, Feb. 1, 2019, published online Jan. 10, 2019, pp. 469-482, https://doi.org/10.1364/OME.9.000469. |
Wang et al., “Robust topology optimization of photonic crystal waveguides with tailored dispersion properties”, Journal of the Optical Society of America B, vol. 28, No. 3, Mar. 2011, pp. 387-397, DOI:10.1364/JOSAB.28.000387. |
Wen et al., “Robust Freeform Metasurface Design Based on Progressively Growing Generative Networks”, ACS Photonics, vol. 7, No. 8, Jun. 19, 2020, pp. 2098-2104. https://doi.org/10.1021/acsphotonics.0c00539. |
Williamson et al., “Reprogrammable Electro-Optic Nonlinear Activation Functions for Optical Neural Networks”, IEEE Journal of Selected Topics in Quantum Electronics, vol. 26, No. 1, Jan.-Feb. 2020, pp. 1-12, DOI:10.1109/.JSTQE.2019.2930455. |
Williamson et al., “Tunable Nonlinear Activation Functions for Optical Neural Networks”, 2020 Conference on Lasers and Electro-Optics (CLEO), 2020, pp. 1-2. |
Wills, “Doing Neural Nets with Photons”, The Optical Society, Jun. 19, 2017, 4 pgs. |
Woods et al., “Photonic Neural Networks”, Optical Computing, vol. 8, Apr. 2012, pp. 257-259. |
Wu et al., “Beam Synthesis with Low-Bit Reflective Coding Metamaterial Antenna: Theoretical and Experimental Results”, International Journal of Antennas and Propagation, vol. 2018, Article ID 5058789, Mar. 26, 2018, 10 pages, https://doi.org/10.1155/2018/5058789. |
Xiao et al., “Diffractive Spectral-Splitting Optical Element Designed by Adjoint-Based Electromagnetic Optimization and Fabricated by Femtosecond 3D Direct Laser Writing”, ACS Photonics, vol. 3, No. 5, Apr. 25, 2016, pp. 886-894, DOI: 10.1021/acsphotonics.6b00066. |
Yablonovitch et al., “Optical projection lithography at half the Rayleigh resolution limit by two photon exposure”, Opt. Eng., 1998, Materials, fundamentalsand Applications Topical Meeting, 1998, pp. 126-128. |
Yang et al., “Analysis of material selection on dielectric metasurface performance”, Optics Express, vol. 25, No. 20, Oct. 2, 2017, pp. 23899-23909, https://doi.org/10.1364/OE.25.023899. |
Yang et al., “Freeform Metagratings Based on Complex Light Scattering Dynamics for Extreme, High Efficiency Beam Steering”, Annalen der Physik, vol. 530, No. 1, Jan. 2018, 1700302,19 pgs. |
Yang et al., “Topology-optimized metasurfaces: impact of initial geometric layout”, Optics Letters, vol. 42, No. 16, Aug. 15, 2017, pp. 3161-3164, https://doi.org/10.1364/OE.25.023899. |
Yeom et al., “Maximum achievable aspect ratio in deep reactive ion etching of silicon due to aspect ratio dependent transport and the microloading effect”, Journal of Vacuum Science and Technology, vol. 23, Nov./Dec. 2005, pp. 2319-2329, DOI:10.1116/1.2101678. |
Yin et al., “Ultra Wideband Polarization-Selective Conversions of Electromagnetic Waves by Metasurface under Large-Range Incident Angles”, Scientific Reports, vol. 5, No. 12476, Jul. 23, 2015, 10 pgs., DOI:10.1038/srep 12476. |
Yu et al., “Flat optics with designer metasurfaces”, Nature Materials, vol. 13, Feb. 2014, published online Jan. 23, 2014, pp. 139-150, DOI:10.1038/NMAT3839. |
Yu et al., “Light Propagation with Phase Discontinuities: Generalized Laws of Reflection and Refraction”, Science, vol. 334, No. 6054, Oct. 21, 2011, pp. 333-337, doi: 10.1126/science.1210713. |
Zheng et al., “Metasurface holograms reaching 80% efficiency”, Advanced Online Publication, published online Feb. 23, 2015, pp. 1-6, DOI:10.1038/NNANO.2015.2. |
Zhou et al., “Minimum length scale in topology optimization by geometric constraints”, Computer Methods in Applied Mechanics and Engineering, vol. 293, Aug. 15, 2015, pp. 266-282, DOI:10.1016/j.cma.2015.05.003. |
Gulrajani et al., “Improved Training of Wasserstein GANs”, in Advances in Neural Information Processing Systems, 2017, 11 pgs. |
Harris, “Programmable nanophotonics for quantum information processing and artificial intelligence”, Thesis, Massachusetts Institute of Technology, 2017, 126 pgs. |
Hermans et al, “Towards trainable media: Using waves for neural network-style training”, arXiv preprint arXiv:1510.03776, Sep. 30, 2015, 20 pgs. |
Huang et al., “Implementation of on-chip multi-channel focusing wavelength demultiplexer with regularized digital metamaterials”, Nanophotonics, vol. 9. No. 1, 2020, published online Nov. 19, 2019, pp. 159-166, https://doi.org/10.1515/nanoph-2019-0368. |
Hughes et al, “Training of photonic neural networks through in situ backpropagation and gradient measurement”, Optica, vol. 5, No. 7, Jul. 2018, first published Jul. 19, 2018, pp. 864-871, https://doi.org/10.1364/OPTICA.5.000864. |
Hughes et al., “Adjoint Method and Inverse Design for Nonlinear Nanophotonic Devices”, ACS Photonics, vol. 5, No. 12, Dec. 3, 2018, pp. 4781-4787, DOI: 10.1021/acsphotonics.8b01522. |
Hughes et al., “Forward-Mode Differentiation of Maxwell's Equations”, ACS Photonics, Oct. 21, 2019, vol. 6, pp. 3010-3016, DOI: 10.1021/acsphotonics.9b01238. |
Hugonin et al., “Reticolo software for grating analysis”, Institut d'Optique, Orsay, France. (2005), 57 pgs. |
Inampudi et al., “Neural network based design of metagratings”, Applied Physics Letters, vol. 112, Jun. 13, 2018, pp. 241102-1-241102-5, https://doi.org/10.1063/1.5033327. |
Jafar-Zanjani et al., “Adaptive Genetic Algorithm for Optical Metasurfaces Design”, Scientific Reports, vol. 8, No. 11040, Jul. 23, 2018, 16 pgs., DOI:10.1038/s41598-018-29275-z. |
Jensen et al., “Topology optimization for nano-photonics”, Laser & Photonics Reviews, vol. 5, No. 2, Mar. 2011, pp. 308-321, DOI: 10.1002/lpor.201000014. |
Jensen et al., “Topology optimization of photonic crystal structures: a high-bandwidth low-loss T-junction waveguide”, Journal of the Optical Society of America B, vol. 22, Issue 6, Jun. 2005, pp. 1191-1198, https://doi.org/10.1364/JOSAB.22.001191. |
Jiang et al., “Data-driven metasurface discovery”, arXiv:1811.12436, Nov. 29, 2018, 14 pgs. |
Jiang et al., “Deep neural networks for the evaluation and design of photonic devices”, arXiv:2007.00084v1 [eess.IV] Jun. 30, 2020, 29 pgs. |
Jiang et al., “Free-Form Diffractive Metagrating Design Based on Generative Adversarial Networks”, ACS Nano, Jul. 17, 2019, vol. 13, 7 pgs., DOI: 10.1021/acsnano.9b02371. |
Jiang et al., “Global Optimization of Dielectric Metasurfaces Using a Physics-Driven Neural Network”, Nano Letters, Jul. 11, 2019, vol. 19, No. 8, pp. 5366-5372, https://doi.org/10.1021/acs.nanolett.9b01857. |
Jiang et al., “Simulator-based training of generative neural networks for the inverse design of metasurfaces”, Nanophotonics, vol. 9, Issue 5, 2019, published online Nov. 19, 2019, 11 pgs., DOI: https://doi.org/10.1515/nanoph-2019-0330. |
Joy, “The spatial resolution limit of electron lithography”, Microelectronic Engineering, vol. 1, Issue 2, Oct. 1983, pp. 103-119, https://doi.org/10.1016/0167-9317(83)90024-2. |
Khoram et al., “Controlling the minimal feature sizes in adjoint optimization of nanophotonic devices using b-spline surfaces”, Optics Express, vol. 28, Issue 5, 2020, pp. 7060-7069, https://doi.org/10.1364/OE.384438. |
Khorasaninejad et al., “Metalenses at Visible Wavelengths: Diffraction-Limited Focusing and Subwavelength Resolution Imaging”, Science, vol. 352, No. 6290, Jun. 3, 2016, pp. 1190-1194, doi: 10.1126/science.aaf6644. |
Khorasaninejad et al., “Metalenses: Versatile multifunctional photonic components”, Science, vol. 358, Dec. 1, 2017, 10 pgs., DOI: 10.1126/science.aam8100. |
Kildishev et al., “Planar Photonics with Metasurfaces”, Science, vol. 339, No. 6125, Mar. 15, 2013, pp. 1232009-1-1232009-6, DOI: 10.1126.science.1232009. |
Kim et al., “Highly tunable refractive index visible-light metasurface from block copolymer self-assembly”, Nature Communications, vol. 7, No. 12911, Sep. 29, 2016, 9 pgs., DOI: 10.1038/ncomms12911. |
Kingma et al., “Adam: A Method for Stochastic Optimization”, arXiv.org, Retrieved from: https://arxiv.org/abs/1412.6980v1 [cs.LG], Dec. 22, 2014, 9 pgs. |
Kuznetsov et al., “Optically resonant dielectric nanostructures”, Science, vol. 354, No. 6314, Nov. 18, 2016, 11 pgs., DOI: 10.1126/science.aag2472. |
Lalau-Keraly et al., “Adjoint shape optimization applied to electromagnetic design”, Optics Express, vol. 21, No. 18, Sep. 9, 2013, first published Sep. 6, 2013, pp. 21693-21701, DOI: 10.1364/OE.21.021693. |
Leelar et al., “Learning with Deep Photonic Neural Networks”, 2017 IEEE Workshop on Recent Advances in Photonics (WRAP), 2017, pp. 1-7. |
Liebmann et al., “TCAD development for lithography resolution enhancement”, IBM Journal of Research and Development, vol. 45, No. 5, Sep. 2001, pp. 651-665, DOI: 10.1147/rd.455.0651. |
Lin et al., “Topology-Optimized Multilayered Metaoptics”, arXiv:1706.06715v1 [physics.optics] Jun. 21, 2017, 9 pgs. |
Liu et al., “Training Deep Neural Networks for the Inverse Design of Nanophotonic Structures”, ACS Photonics, vol. 5, No. 4, Feb. 25, 2018, pp. 1365-1369. |
Ma et al., “Deep-Learning-Enabled On-Demand Design of Chiral Metamaterials”, ACS Nano, vol. 12, No. 6, Jun. 1, 2018, pp. 6326-6334, DOI: 10.1021/acsnano.8b03569. |
Malkiel et al., “Plasmonic nanostructure design and characterization via Deep Learning”, Light: Science & Applications, vol. 7, No. 60, Sep. 5, 2018, 8 pgs., DOI 10.1038/s41377-018-0060-7. |
Marty et al., “Advanced etching of silicon based on deep reactive ion etching for silicon high aspect ratio microstructures and three-dimensional micro- and nanostructures”, Microelectronics Journal, vol. 36, Issue 7, Jul. 2005, pp. 673-677, https://doi.org/10.1016/j.mejo.2005.04.039. |
Minkov et al., “Inverse Design of Photonic Crystals through Automatic Differentiation”, ACS Photonics, vol. 7, 2020, pp. 1729-1741, https://dx.doi.org/10.1021/acsphotonics.0c00327. |
Mirza et al., “Conditional Generative Adversarial Nets”, arXiv:1411.1784v1 [cs.LG], Nov. 6, 2014, 7 pgs. |
Molesky et al., “Outlook for inverse design in nanophotonics”, Nature Photonics, vol. 12, Oct. 26, 2018, pp. 659-670, DOI: https://doi.org/10.1038/s41566-018-0246-9. |
Ng et al., “Ultra-High Aspect Ratio Trenches in a Single crystal silicon with epatixial gap tuning”, 2013 Transducers and Eurosensors XXVII: The 17th International Conference on Solid-State Sensors, pp. 182-185. |
Paszke et al., “PyTorch: An Imperative Style, High-Performance Deep Learning Library”, 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), Vancouver, Canada, 12 pgs. |
Pendry et al., “Transformation Optics and Subwavelength Control of Light”, Science, vol. 337, No. 6094, Aug. 3, 2012, pp. 549-552, DOI: 10.1126/science.1220600. |
Peurifoy et al., “Nanophotonic particle simulation and inverse design using artificial neural networks”, Science Advances, vol. 4, No. 6, Jun. 1, 2018, eaar4206, 8 pgs., DOI: 10.1126/sciadv.aar4206. |
Phan et al., “High-efficiency, large-area, topology-optimized metasurfaces”, Light: Science & Applications, vol. 8, No. 48, 2019, published online May 29, 2019, pp. 1-9, https://doi.org/10.1038/s41377-019-0159-5. |
Piggott et al., “Inverse design and demonstration of a compact and broadband on-chip wavelength demultiplexer”, Nature Photonics, Advance Online Publication May 11, 2015, 5 pgs., DOI: 10.1038/NPHOTON.2015.69. |
Rogers et al., “A super-oscillatory lens optical microscope for subwavelength imaging”, Nature Materials, vol. 11, Advance Online Publication Mar. 25, 2012, pp. 432-435, DOI: 10.1038/nmat3280. |
Schevenels et al., “Robust topology optimization accounting for spatially varying manufacturing errors”, Computer Methods in Applied Mechanics and Engineering, vol. 200, Issues 49-52, Dec. 1, 2011, published online Aug. 26, 2011, pp. 3613-3627, https://doi.org/10.1016/j.cma.2011.08.006. |
Sell et al., “Large-Angle, Multifunctional Metagratings Based on Freeform Multimode Geometries”, Nano Letters, vol. 17, No. 6, May 1, 2017, pp. 3752-3757, DOI: 10.1021/acs.nanolett.7b01082. |
Sell et al., “Periodic Dielectric Metasurfaces with High-Efficiency, Multiwavelength Functionalities”, Advanced Optical Materials, vol. 5, No. 23, Dec. 1, 2017, 7 pgs., DOI: 10.1002/adom.201700645. |
Extended European Search Report for European Application No. 19799849.5, Search completed Nov. 30, 2021, dated Dec. 16, 2021, 11 Pgs. |
Extended European Search Report for European Application No. 19799982.4, Search completed Jan. 18, 2022, dated Feb. 3, 2022, 12 Pgs. |
International Preliminary Report on Patentability for International Application PCT/US2019/041414, Report dated Jan. 12, 2021, dated Jan. 21, 2021, 6 Pgs. |
International Preliminary Report on Patentability for International Application PCT/US2019/031747, Report dated Nov. 10, 2020, dated Nov. 19, 2020, 4 Pgs. |
International Preliminary Report on Patentability for International Application PCT/US2019/031748, Report dated Nov. 10, 2020, dated Nov. 19, 2020, 4 Pgs. |
International Search Report and Written Opinion for International Application No. PCT/US2019/031747, Search completed Jul. 10, 2019, dated Jul. 24, 2019, 9 Pgs. |
International Search Report and Written Opinion for International Application No. PCT/US2019/031748, Search completed Jul. 12, 2019, dated Jul. 29, 2019, 9 Pgs. |
International Search Report and Written Opinion for International Application No. PCT/US2019/041414, Search completed Sep. 13, 2019, dated Oct. 8, 2019, 15 Pgs. |
Arjovsky et al., “Wasserstein Generative Adversarial Networks”, Proceedings of the 34th International Conference on Machine Learning, 2017, pp. 214-223. |
Arbabi et al., “Dielectric Metasurfaces for Complete Control of Phase and Polarization with Subwavelength Spatial Resolution and High Transmission”, Nature Nanotechnology, Aug. 31, 2015, 27 pgs., doi:10.1038/nnano.2015.186. |
Arbabi et al., “Full-Stokes Imaging Polarimetry Using Dielectric Metasurfaces”, ACS Photonics, vol. 5, No. 8, Jul. 16, 2018, pp. 3132-3140. |
Azunre et al., “Guaranteed global optimization of thin-film optical systems”, New Journal of Physics, Jul. 24, 2019, vol. 21, 073050, 19 pgs., https://doi.org/10.1088/1367-2630-ab2e19. |
Bayati et al., “Inverse Designed Metalenses with Extended Depth of Focus”, ACS Photonics, vol. 7, Mar. 25, 2020, pp. 873-878, https://dx.doi.org/10.1021/acsphotonics.9b01703. |
Campbell et al., “Review of numerical optimization techniques for meta-device design [Invited]”, Optical Materials Express, vol. 9, No. 4, Apr. 2019, pp. 1842-1863, https://doi.org/10.1364/OME.9.001842. |
Carolan et al., “Universal linear optics”, Science, vol. 349, Issue 6249, Aug. 14, 2015, pp. 711-716, DOI: 10.1126/science.aab3642. |
Chen et al., “Geometric phase coded metasurface: from polarization dependent directive electromagnetic wave scattering to diffusion-like scattering”, Scientific Reports, vol. 6, 35968, Oct. 24, 2016, 10 pgs., DOI: 10.1038/srep35968. |
Chung et al., “High-NA achromatic metalenses by inverse design”, Optics Express, vol. 28, No. 5, Mar. 2, 2020, first published Feb. 24, 2020, pp. 6945-6965, DOI: https://doi.org/10.1364/OE.385440. |
Colburn et al., “Metasurface optics for full-color computational imaging”, Science Advances, vol. 4, No. 2, Feb. 9, 2018, 7 pgs., DOI: 10.1126/sciadv.aar2114. |
De Marinis et al., “Photonic Neural Networks: A Survey”, in IEEE Access, vol. 7, Dec. 2, 2019, date of current version Dec. 19, 2019, pp. 175827-175841, DOI: 10.1109/ACCESS.2019.2957245. |
Decker et al., “High-Efficiency Dielectric Huygens' Surfaces”, Advanced Optical Materials, vol. 3, No. 6, Jun. 2015, pp. 813-820. |
Devlin et al., “Arbitrary spin-to-orbital angular momentum conversion of light”, Science, vol. 358, Nov. 17, 2017, published online Nov. 2, 2017, pp. 896-901, DOI: 10.1126/science.aao5392. |
Egorov et al., “Genetically optimized all-dielectric metasurfaces”, Optics Express, vol. 25, No. 3, Feb. 7, 2017, first published Feb. 1, 2017, pp. 2583-2593, https://doi.org/10.1364/OE.25.002583. |
Estakhri et al., “Inverse-designed metastructures that solve equations”, Science, vol. 363, No. 6433, Mar. 22, 2019, pp. 1333-1338, DOI: 10.1126/science.aaw2498. |
Fan, “Freeform metasurface design based on topology optimization”, MRS Bulletin, vol. 45, Mar. 2020, pp. 196-201, doi:10.1557/mrs.2020.62. |
Filipovich et al., “Training Deep Neural Networks in Situ with Neuromorphic Photonics”, 2020 IEEE Photonics Conference (IPC), 2020, pp. 1-2. |
Frei et al., “Geometry projection method for optimizing photonic nanostructures”, Optics Letters, vol. 32, Issue 1, Jan. 1, 2007, first published Dec. 13, 2006, pp. 77-79, https://doi.org/10.1364/OL.32.000077. |
Goodfellow et al., “Deep Learning”, The MIT Press, Cambridge, Massachusetts, 2016, 26 pgs. |
Goodfellow et al., “Generative Adversarial Nets”, 2014. Generative adversarial nets. In Advances in Neural Information Processing Systems, pp. 2672-2680, arXiv:1406.2661v1 [stat.ML] Jun. 10, 2014. |
Green, “Self-consistent optical parameters of intrinsic silicon at 300 K including temperature coefficients”, Solar Energy Materials and Solar Cells, vol. 92, No. 11, Nov. 2008, pp. 1305-1310, doi:10.1016/j.solmat.2008.05.0009. |
“Artificial Intelligence Funding Trends”, Retrieved from https://venturescanner.medium.com/artificial-intelligence-funding-trends-q3-2017-4e8a9b80fe53, published online on Sep. 2, 2017, 3 pages. |
Abu-Mostafa et al., “Optical Neural Computers”, Scientific American, vol. 256, No. 3, Mar. 1987, pp. 88-95, https://www.jstor.org/stable/24979343. |
Ahmed et al., “A 100 GB/s transimpedance amplifier in 65 nm CMOS technology for optical communications”, 2014 IEEE International Symposium on Circuits and Systems (ICAS), Jun. 1-5, 2014, pp. 1885-1888, DOI: 10.1109/ISCAS.2014.6865527. |
Alibart et al., “Pattern classification by memristive crossbar circuits using ex situ and in situ training”, Nature Communications, vol. 4, Issue 2072. Jun. 25, 2013, 7 pgs., https://doi.org/10.1038/ncomms3072. |
Annoni et al., “Unscrambling light—automatically undoing strong mixing between modes”, Light: Science & Applications, vol. 6, e17110, Dec. 1, 2017, article preview online Jun. 30, 2017, 10 pgs., doi:10.1038/lsa.2017.110. |
Bao et al., “Monolayer Graphene as a Saturable Absorber in a Mode-Locked Laser”, Nano Research, vol. 4, No. 3, 2011, pp. 297-307, DOI 10.1007/s12274-010-0082-9. |
Brunner et al., “Parallel photonic information processing at gigabyte per second data rates using transient states”, Nature Communications, vol. 4, Jan. 15, 2013, pp. 1364-1367, https://doi.org/10.1038/ncomms2368. |
Capmany et al., “Microwave photonics combines two worlds”, Nature Photonics, vol. 1, Jun. 1, 2007, pp. 319-330, DOI:10.1038/nphoton.2007.89. |
Clements et al., “Optimal design for universal multiport interferometers”, Optica vol. 3, Issue 12, Dec. 2016, pp. 1460-1465, https://doi.org/10.1364/OPTICA.3.001460. |
Crespi et al., “Anderson localization of entangled photons in an integrated quantum walk”, Nature Photonics, vol. 7, Apr. 2013, first published Mar. 3, 2013, pp. 322-328, https://doi.org/10.1038/nphoton.2013.26. |
Crespi et al., “Integrated multimode interferometers with arbitrary designs for photonic boson sampling”, Nature Photonics, vol. 7, Jul. 2013, first published May 26, 2013, pp. 545-549, https://doi.org/10.1038/nphoton.2013.112. |
Depuy et al., “59-dBOmega 68-GHz Variable Gain-Bandwidth Differential Linear TIA in 0.7-μm InP DHBT for 400-GB/s Optical Communication Systems”, 2015 IEEE Compound Semiconductor Integrated Circuit Symposium (CSICS), Oct. 11-14, 2015, 4 pgs., DOI: 10.1109/CSICS.2015.7314463. |
Duport et al., “Fully analogue photonic reservoir computer”, Scientific Reports, 2016, vol. 6, No. 22381, 12 pgs., DOI: 10.1038/srep22381. |
Georgieva et al., “Feasible adjoint sensitivity technique for EM design optimization”, IEEE Transactions on Microwave Theory and Techniques, vol. 50, Issue 12, Dec. 2002, pp. 2751-2758, DOI: 10.1109/TMTT.2002.805131. |
Ghelfi et al., “A fully photonics-based coherent radar system”, Nature, vol. 507, Mar. 20, 2014, first published Mar. 19, 2014, pp. 341-345, https://doi.org/10.1038/nature13078. |
Graves et al., “Hybrid computing using a neural network with dynamic external memory”, Nature, vol. 538, Oct. 27, 2016, first published Oct. 12, 2016, pp. 471-476, https://doi.org/10.1038/nature20101. |
Graves et al., “Neural Turing Machines”, arXiv:1410.5401v2 [cs.NE], Dec. 10, 10, 2014, 26 pgs. |
Harris et al., “Quantum transport simulations in a programmable nanophotonic processor”, Nature Photonics, vol. 11, 2017, pp. 447-452, https://doi.org/10.1038/nphoton.2017.95. |
Hermans et al., “Photonic Delay Systems as Machine Learning Implementation”, Journal of Machine Learning Research, vol. 16, 2015, pp. 2081-2097. |
Hermans et al., “Trainable hardware for dynamical computing using error backpropagation through physical media”, Nature Communications, vol. 6, Issue. 6729, Mar. 24, 2015, 8 pgs., DOI: https://doi.org/10.1038/ncomms7729. |
Hughes et al., “Method for computationally efficient design of dielectric laser accelerator structures”, Optics Express, vol. 25, Issue 13, Jun. 26, 2017, pp. 15414-15427, https://doi.org/10.1364/OE.25.015414. |
Hughes et al., “On-Chip Laser Power Delivery System for Dielectric Laser Accelerators”, arXiv:1709.04441v1 [physics.optics], Sep. 13, 2017, 14 pgs. |
Jiang et al., “Low-dimensional nanomaterial saturable absorbers for ultrashort-pulsed waveguide lasers”, Optical Materials Express, vol. 8, Issue 10, Oct. 1, 2018, first published Sep. 10, 2018, pp. 3055-3071, https://doi.org/10.1364/OME.8.003055. |
Jiao et al., “A 70 dBohm 2.3 GHz low noise transimpedance amplifier”, 2013 IEEE Third International Conference on Consumer Electronics ¿ Berlin (ICCE-Berlin), Sep. 9-11, 2013, pp. 322-325, DOI: 10.1109/ICCE-Berlin.2013.6697985. |
Jutamulia et al., “Overview of hybrid optical neural networks”, Science, vol. 28, 1996, pp. 59-72. |
Koos et al., “Nonlinear silicon-on-insulator waveguides for all-optical signal processing”, Optics Express, vol. 15, No. 10, May 14, 2007, first published May 1, 2007, pp. 5976-5990, doi: 10.1364/oe.15.005976. |
Larger et al., “Photonic information processing beyond Turing: an optoelectronic implementation of reservoir computing”, Optic Express, vol. 20, No. 3, Jan. 30, 2012 first published Jan. 27, 2012, pp. 3241-3249. |
Lecun et al., “Deep learning”, Nature, May 27, 2015, vol. 521, No. 7553, pp. 436-444, doi: 10.1038/nature14539. |
Lecun et al., “Gradient-Based Learning Applied to Document Recognition”, Proceedings of the IEEE, Nov. 1998, vol. 86, No. 11, pp. 2278-2324. |
Li et al., “Reconfigurable controlled two-qubit operation on a quantum photonic chip”, New Journal of Physics, vol. 13, 115009, Nov. 2011, 8 pgs., doi:10.1088/1367-2630/13/11/11/115009. |
Marpaung et al., “Integrated microwave photonics”, Laser & Photonic Reviews, vol. 7, Issue 4, Jul. 2013, pp. 506-538, first published Jan. 16, 2013, https://doi.org/10.1002/lpor.201200032. |
Merolla et al., “A million spiking-neuron integrated circuit with a scalable communication network and interface”, Science, Aug. 8, 2014, vol. 345, No. 6197, pp. 668-673, doi: 10.1126/science.1254642. |
Metcalf et al., “Multiphoton quantum interference in a multiport integrated photonic device”, Nature Communications, vol. 1, No. 1356, Jan. 15, 2013, pp. 1-7, DOI:10.1038/ncomms2349. |
Miller, “Arbitrary and Reconfigurable Optics—New Opportunities for Integrated Photonics”, Frontiers in Optics 2017, OSA Technical Digest (online) (Optica Publishing Group, 2017), paper FTu4A.1, 1 pg., https://doi.org/10.1364/FIO.2017.FTu4A.1. |
Miller, “Attojoule Optoelectronics for Low-Energy Information Processing and Communications”, Journal of Lightwave Technology, vol. 35, Issue 3, Feb. 1, 2017, pp. 346-396, DOI: 10.1109/JLT.2017.2647779. |
Miller, “Perfect optics with imperfect components”, Optica, vol. 2, Issue 8, 2015, pp. 747-750, https://doi.org/10.1364/OPTICA.2.000747. |
Miller, “Self-aligning universal beam coupler”, Optics Express vol. 21, Issue 5, Mar. 11, 2013, first published Mar. 6, 2013, pp. 6360-6370, https://doi.org/10.1364/OE.21.006360. |
Miller, “Setting up meshes of interferometers—reversed local light interference method”, Optics Express, vol. 25, Issue 23, Nov. 13, 2017, pp. 29233-29248, https://doi.org/10.1364/OE.25.029233. |
Miller et al., “Self-configuring universal linear optical component [Invited]”, Photonics Research. vol. 1, Issue 1, Jun. 2013, pp. 1-15, https://doi.org/10.1364/PRJ.1.000001. |
Nozaki et al., “Amplifier-Free Bias-Free Receiver Based on Low-Capacitance Nanophotodetector”, IEEE Journal of Selected Topics in Quantum Electronics, vol. 24, Issue: 2, Mar.-Apr. 2018, first published Dec. 20, 2017, 11 pgs., DOI: 10.1109/JSTQE.2017.2777105. |
Pai et al., “Matrix optimization on universal unitary photonic devices”, arXiv:1808.00458v3 [eess.SP] May 22, 2019, 18 pgs. |
Pallipuram et al., “A comparative study of GPU programming models and architectures using neural networks”, The Journal of Supercomputing, vol. 61, Sep. 2012, first published May 31, 2011, pp. 673-718, https://doi.org/10.1007/s11227-011-0631-3. |
Park et al., “Monolayer graphene saturable absorbers with strongly enhanced evanescent-field interaction for ultrafast fiber laser mode-locking”, Optics Express vol. 23, Issue 15, Jul. 27, 2015, first published Jul. 22, 2015, pp. 19806-19812, https://doi.org/10.1364/OE.23.019806. |
Peng et al., “Neuromorphic Photonic Integrated Circuits”, IEEE Journal of Selected Topics in Quantum Electronics , vol. 24, Issue: 6, Nov.-Dec. 2018, 15 pgs., DOI: 10.1109/JSTQE.2018.2840448. |
Prezioso et al., “Training and operation of an integrated neuromorphic network based on metal-oxide memristors”, Nature, vol. 521, May 7, 2015, pp. 61-64, includes supplementary info, doi: 10.1038/nature14441. |
Psaltis et al., “Adaptive optical networks using photorefractive crystals”, Applied Optics, vol. 27, No. 9. May 1, 2019, pp. 1752-1759. |
Psaltis et al., “Holography in artificial neural networks”, Nature, vol. 343, Jan. 25, 1990, pp. 325-330. |
Reck et al., “Experimental realization of any discrete unitary operator”, Physical Review Letters, vol. 73, No. 1, Jul. 1, 1994, pp. 58-61, doi:10.1103/PhysRevLett.73.58. |
Rosenbluth et al., “A high performance photonic pulse processing device”, Optics Express, vol. 17, Issue 25, Dec. 2009, first published Nov. 30, 2009, pp. 22767-22772, https://doi.org/10.1364/OE.17.022767. |
Settaluri et al., “First Principles Optimization of Opto-Electronic Communication Links”, IEEE Transactions on Circuits and Systems-I: Regular Papers, vol. 64, No. 5, May 2017, pp. 1270-1283, 10.1109/TCSI.2016.2633942. |
Shadbolt et al., “Generating, manipulating and measuring entanglement and mixture with a reconfigurable photonic circuit”, Nature Photonics, vol. 6, Jan. 2012, first published Dec. 11, 2011, pp. 45-49. https://doi.org/10.1038/nphoton.2011.283. |
Shainline et al., “Superconducting Optoelectronic Circuits for Neuromorphic Computing”, Phys. Rev. Applied vol. 7, No. 3, 034013, Mar. 23, 2017, 35 pgs., arXiv:1610.00053 [cs.NE] Nov. 10, 2016. |
Shastri et al., “Spike processing with a graphene excitable laser”, Scientific Reports, vol. 6, No. 19126, 2016, 12 pages. |
Shin et al., “Choice ofthe perfectly matched layer boundary condition for frequency-domain Maxwell's equations solvers”, Journal of Computational Physics, vol. 231, Issue 8, Apr. 20, 2012, pp. 3406-3431, https://doi.org/10.1016/j.jcp.2012.01.013. |
Spring et al., “Boson Sampling on a Photonic Chip”, Science, vol. 339, Issue 6121, Dec. 20, 2012, pp. 798-801, DOI: 10.1126/science.1231692. |
Sun et al., “Large-scale nanophotonic phased array”, Nature, vol. 493, Jan. 10, 2013, first published Jan. 9, 2013, pp. 195-199, https://doi.org/10.1038/nature11727. |
Tait et al., “A silicon photonic modulator neuron”, arXiv:1812.11898v1 [physics.app-ph] Dec. 9, 2018, 16 pgs. |
Tait et al., “Broadcast and Weight: An Integrated Network for Scalable Photonic Spike Processing”, Journal of Lightwave Technology, vol. 32, 2014, pp. 4029-4041. |
Tait et al., “Neuromorphic photonic networks using silicon photonic weight banks”, Scientific Reports, vol. 7, No. 7430, Aug. 7, 2017, 19 pgs., DOI:10.1038/s41598-017-07754-z. |
Tait et al., “The Dream: An Integrated Photonic Thresholder”, Journal of Lightwave Technology IEEE USA, vol. 31. No. 8, Apr. 15, 2013, pp. 1263-1272, DOI: 10.1109/JLT.2013.2246544. |
Trabelsi et al., “Deep Complex Networks”, arXiv:1705.09792v4 [cs.NE] Feb. 25, 2018, 19 pgs. |
Trentin, “Networks with trainable amplitude of activation functions”, Neural Networks, vol. 14, Issues 4-5, May 2001, pp. 471-493, https://doi.org/10.1016/S0893-6080(01)00028-4. |
Vandoorne et al., “Experimental demonstration of reservoir computing on a silicon photonics chip”, Nature Communications, vol. 5, No. 3541, Mar. 24, 2014, 6 pgs., https://doi.org/10.1038/ncomms4541. |
Veronis et al., “Method for sensitivity analysis of photonic crystal devices”, Optics Letters vol. 29, Issue 19, Oct. 1, 2004, pp. 2288-2290, https://doi.org/10.1364/OL.29.002288. |
Wagner et al., “Multilayer optical learning networks”, Applied Optics, vol. 26, Issue 23, 1987, pp. 5061-5076, https://doi.org/10.1364/AO.26.005061. |
Wu et al., “High aspect ratio silicon etch: A review”, Journal of Applied Physics, 2010, vol. 108, pp. 051101-1-051101-20.https://doi.org/10.1063/1.3474652. |
Yu et al., “A low-noise high-gain transimpedance amplifier with high dynamic range in 0.13im CMOS”, IEEE International Symposium on Radio-Frequency Integration Technology (RFIT), Nov. 2012, pp. 37-40, DOI:10.1109/RFIT.2012.6401606. |
Yu et al., “Design of AGC amplifier for CMOS Image Sensor”, 2012 IEEE International Symposium on Radio-Frequency Integration Technology (RFIT), Nov. 21-23, 2012, pp. 34-36, DOI: 10.1109/RFIT.2012.6401605. |
Number | Date | Country | |
---|---|---|---|
20210356738 A1 | Nov 2021 | US |
Number | Date | Country | |
---|---|---|---|
63023766 | May 2020 | US |