The present disclosure details novel LiDAR systems and methods. More specifically, this disclosure is directed to imaging LiDARs with separate transmit (Tx) and receive (Rx) optical antennas fed by different optical waveguides.
Light detection and ranging (LiDAR) is widely used in autonomous vehicles and portable devices such as smartphones and tablets. Solid state LiDARs are particularly attractive because they are conducive to miniaturization and mass production. US Patent Pub. No. 2021/0116778 teaches a beamsteering system consisting of a programmable array of vertical couplers (also called optical antennas) located at the focal plane of an imaging lens. Optical signal can be delivered to any selected optical antenna through a programmable optical network consisting of MEMS (micro-electro-mechanical system)-actuated waveguide switches. Compared with conventional thermo-optic or electro-optic switches, the MEMS switches offer lower insertion loss, lower crosstalk, broadband operation, and digital actuation. High density arrays of programmable optical antennas can be integrated on single chips for high resolution imaging LiDARs, thanks to their small footprint.
Previous work used the same optical antenna to transmit the interrogating optical beam and receive the optical signal reflected from the target. A drawback of this architecture is that any residue reflections from the optical antenna and the shared optical path will be mixed with the received optical signals. The spurious reflections degrade the signal-to-noise ratio and could saturate the amplifiers in the receiver, preventing the LiDAR from seeing far-away targets or targets with low reflectivity.
A pseudo-monostatic imaging LiDAR system is provided, comprising a lens, at least one light emitter, at least one light detector, a plurality of paired optical antennas each comprising a transmit optical antenna and a receive optical antenna, and a programmable optical network configured to provide a first light path from the at least one light emitter to a selected transmit optical antenna, the programmable optical network being further configured to provide a separate second light path from a receive optical antenna paired to the selected transmit optical antenna to the at least one light detector, wherein the plurality of paired optical antennas are positioned at or around a focal plane of the lens.
In some embodiments, the plurality of paired optical antennas and the programmable optical network are integrated on a photonic integrated circuit
In one implementation, the at least one light emitter is a frequency-modulated continuous-wave laser, and the at least one light detector is a coherent optical receiver comprising balanced photodetectors or in-phase/quadrature double balanced photodetectors, wherein a fraction of the at least one light emitter is tapped off by a 1×2 coupler to produce a local oscillator of the coherent receiver.
In one example, the at least one light detector is integrated into a pixel, the pixel comprising a 1×2 optical switching unit, a 1×2 coupler to split a fraction an output of the at least one light emitter to produce a local oscillator, a transmit optical antenna, a paired receive optical antenna, and a coherent receiver configured to receive optical signals from at least one receive optical antenna and the local oscillator.
In some embodiments, the at least one light detector is shared by a plurality of pixels, each pixel comprising the selected transmit optical antenna, the receive optical antenna paired to the selected transmit optical antenna, a dual-channel 1×2 optical switch comprising two parallel switches connecting an optical bus waveguide to the selected transmit optical antenna and a second optical bus waveguide connected to the receive optical antenna paired to the selected transmit optical antenna, wherein the programmable optical network is programmed to provide a light path from at least one light emitter to the selected transmit optical antenna and a physically separate light path from the receive optical antenna paired to the selected transmit optical antenna to the at least one light detector.
In some examples, optical energy from the at least one light emitter is delivered to multiple selected pixels through an optical splitter or optical amplifier.
In one embodiment, a separate light emitter is used for each group of pixels.
In some examples, the at least one light emitter or the at least one light detector, or both, are integrated on the photonic integrated circuit.
In one embodiment, the at least one light emitter or the at least one light detector, or both, are integrated on a separate second photonic integrated circuit and coupled to the photonic integrated circuit.
In some embodiments, the at least one light emitter or the at least one light detector, or both, are connected to the photonic integrated circuit by optical fibers, polymer waveguides, other type of waveguides, or coupled through free-space with optical elements such as lenses or grating couplers.
In other embodiments, the transmit optical antenna and the receive optical antenna of the plurality of paired optical antennas are side by side in the same optical layer.
In one embodiment, the transmit optical antenna and the receive optical antenna of the plurality of paired optical antennas are integrated vertically on separate optical layers.
In some examples, the transmit optical antenna and the receive optical antenna of the plurality of paired optical antennas have orthogonal polarizations, and wherein the system further comprises a quarter-wave plate disposed before or after the optical lens.
In other embodiments, each receive optical antenna of the plurality of paired optical antennas comprise two antennas with orthogonal polarizations and are configured to detect reflected optical signals in both of the orthogonal polarizations.
In some implementations, the programmable optical network is controlled by one or more micro-electro-mechanical system (MEMS) actuators, or Mach-Zehnder interferometers with electro-optic or thermo-optic phase modulators, or microring resonators with electro-optic or thermo-optic phase modulators.
A method of performing LiDAR imaging is provided, comprising the steps of controlling a programmable optical network to provide a first light path from at least one light emitter to a selected transmit optical antenna of a paired optical antenna of the optical network, controlling the programmable optical network to provide a separate second light path from a receive optical antenna paired to the selected transmit optical antenna to at least one light detector.
In some examples, controlling the programmable optical network comprises actuating one or more MEMS switches.
In another example, actuating the one or more MEMS switches further comprises energizing one or more electrodes disposed within the one or more MEMS switches.
In some embodiments, the method further comprises delivering optical energy from the at least one light emitter to multiple selected pixels through an optical splitter.
In one embodiment, three-dimensional images are acquired by combining the range measurements of multiple pixels.
The novel features of the invention are set forth with particularity in the claims that follow. A better understanding of the features and advantages of the present invention will be obtained by reference to the following detailed description that sets forth illustrative embodiments, in which the principles of the invention are utilized, and the accompanying drawings of which:
The present disclosure is directed to imaging LiDARs with separate transmit (Tx) and receive (Rx) optical antennas fed by different optical waveguides. In some embodiments, the optical antennas can be grating couplers, photonic crystals, resonant couplers, 45-degree (or other angle) mirrors, prism couplers, or tilted waveguides. This pair of optical antennas can be activated at the same time through a dual-channel optical switch network, with the Tx antenna connected to a laser source and the Rx antenna connected to a receiver. The Tx and Rx antennas can be positioned adjacent to each other, so they point to approximately the same far-field angle. No optical alignment between the Tx and Rx is necessary. This LiDAR configuration, referred to herein as pseudo-monostatic LiDAR, eliminates spurious reflections and increases the dynamic range of the LiDAR.
One example schematic of a monostatic imaging LiDAR 100 is shown in
The schematic of a pseudo-monostatic imaging LiDAR 200 is shown in
A programmable optical switch network can connect the selected Tx antenna to the laser and the Rx antenna in the same pair to the receiver. Suitable programmable optical switch networks for connecting the monostatic antenna arrays have been described by US Pub. No. US2021/0116778 which is incorporated herein by reference.
Sometimes the strongest reflections occur at the shared input/output coupler. In one embodiment, this reflection can be removed by using a separate input port 412 and output port 414 connected by a 2×1 coupler 416, as shown in the embodiment of
One embodiment of a coherent detector or receiver 528 is shown in detail in
In another embodiment shown in
Though coherent LiDAR is used in this example, the same architecture can also be used for pulsed LiDAR. In that case, the LO part is not required, and the coherent receiver can be replaced by a photodiode or avalanche photodiode (APD) followed by amplifiers.
Multiple lasers and detectors can be used to speed up the operation of the imaging LiDAR. In
In another embodiment, a row/column addressing circuit can be used to read the detected signal from the active pixel. The detector addressing circuit can be synchronized with the programmable optical network to select the same pixel. In all cases, it might be advantageous to integrate a pre-amplifier in the pixel or for a sub-group of pixels to improve the signal-to-noise ratios and increase the operation speed.
Alternatively, instead of having a coherent receiver at each pixel, the coherent receiver 628 and 1×2 coupler 640 can be shared by a block of pixels, as illustrated in
Optical amplifiers 639 can be inserted between the optical splitter and the pixels as shown in the embodiment of
Alternatively, instead of using a splitter as shown in the embodiment of
The optical antennas and the programmable optical network can be integrated on a single photonic integrated circuit, for example, using silicon photonics technology or other PIC platforms based on silicon nitride, silica, or III-V materials. The lasers and the detectors can be either integrated on the same PIC 701 (
As described above, the transmit optical antenna and the receive optical antenna for each pixel can be offset either in the X/Y direction (side by side) or the Z direction (vertically stacked) to minimize the crosstalk between the Tx and Rx signals. The Tx antenna 604a and Rx antenna 604b can be either integrated side by side (
One embodiment of the vertically stacked antennas is shown in
One embodiment of the imaging LiDAR employs a quarter-wave plate 1046 between the antennas (e.g., Tx antennas 1004a and Rx antennas 1004b) and the targets, as shown in
Yet another embodiment of the imaging LiDAR uses polarization-diversity receivers. Sometimes the light reflected from target is depolarized. A polarization-diversity receiver will be able to capture reflected light in both polarizations. In this embodiment, light emits in one polarization, but the Rx has two antennas, one with polarization parallel to that of the emitted light and the other with orthogonal polarization. The output of each antenna is mixed with an LO tapped off from the laser and detected by its own coherent receiver.
The systems and methods described herein can be used, for example, to perform range (distance) measurement in multiple directions. Additionally, the systems and methods described herein can be used to perform measurement of 3D point clouds. In some embodiments, the frame rate or speed of 3D point cloud measurement can be increased by turning on multiple pixels at the same time. In some examples, these multiple pixels can be powered by the same laser through an optical splitter. In other embodiments, the multiple pixels can be powered by separate lasers.
As for additional details pertinent to the present invention, materials and manufacturing techniques may be employed as within the level of those with skill in the relevant art. The same may hold true with respect to method-based aspects of the invention in terms of additional acts commonly or logically employed. Also, it is contemplated that any optional feature of the inventive variations described may be set forth and claimed independently, or in combination with any one or more of the features described herein. Likewise, reference to a singular item, includes the possibility that there are plural of the same items present. More specifically, as used herein and in the appended claims, the singular forms “a,” “and,” “said,” and “the” include plural referents unless the context clearly dictates otherwise. It is further noted that the claims may be drafted to exclude any optional element. As such, this statement is intended to serve as antecedent basis for use of such exclusive terminology as “solely,” “only” and the like in connection with the recitation of claim elements, or use of a “negative” limitation. Unless defined otherwise herein, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The breadth of the present invention is not to be limited by the subject specification, but rather only by the plain meaning of the claim terms employed.
This patent application claims priority to U.S. Provisional Patent Application No. 63/186,748 filed May 10, 2021, and titled “PSEUDO MONOSTATIC LIDAR WITH TWO-DIMENSIONAL SILICON PHOTONIC MEMS SWITCH ARRAY,” herein incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5543805 | Thaniyavarn | Aug 1996 | A |
5761352 | Kitajima et al. | Jun 1998 | A |
6028973 | Schienle et al. | Feb 2000 | A |
6160927 | Leclerc et al. | Dec 2000 | A |
6218667 | Nonaka et al. | Apr 2001 | B1 |
6522427 | Bhattacharjya et al. | Feb 2003 | B1 |
6777767 | Badehi | Aug 2004 | B2 |
6842563 | Zhang et al. | Jan 2005 | B2 |
6944361 | Xue et al. | Sep 2005 | B2 |
6970619 | Baumann et al. | Nov 2005 | B2 |
7116856 | Iio et al. | Oct 2006 | B2 |
8891914 | Ticknor et al. | Nov 2014 | B2 |
8938142 | Shastri et al. | Jan 2015 | B2 |
9013790 | Kazmierski et al. | Apr 2015 | B1 |
9405066 | Mahgerefteh et al. | Aug 2016 | B2 |
9800332 | Chalfant et al. | Oct 2017 | B2 |
10061085 | Wu et al. | Aug 2018 | B2 |
10466423 | Spector et al. | Nov 2019 | B2 |
10473862 | Spector et al. | Nov 2019 | B2 |
10715887 | Seok et al. | Jul 2020 | B2 |
10761272 | Hosseini et al. | Sep 2020 | B2 |
10823913 | Moebius et al. | Nov 2020 | B1 |
11061234 | Zhu et al. | Jul 2021 | B1 |
20020034372 | Alibert et al. | Mar 2002 | A1 |
20020186918 | Burroughs | Dec 2002 | A1 |
20020186919 | Pepper | Dec 2002 | A1 |
20030010827 | Hilton et al. | Jan 2003 | A1 |
20030107793 | Capps | Jun 2003 | A1 |
20030108274 | Haronian | Jun 2003 | A1 |
20030108290 | Zhang et al. | Jun 2003 | A1 |
20030174934 | Ishii et al. | Sep 2003 | A1 |
20030198259 | Zhang et al. | Oct 2003 | A1 |
20030231821 | Clarke et al. | Dec 2003 | A1 |
20060061753 | Harris et al. | Mar 2006 | A1 |
20070030570 | Jacobowitz et al. | Feb 2007 | A1 |
20070258681 | Takabayashi et al. | Nov 2007 | A1 |
20090220228 | Popovic | Sep 2009 | A1 |
20120105944 | Wang et al. | May 2012 | A1 |
20120170111 | Doerr et al. | Jul 2012 | A1 |
20120314037 | Nehmadi et al. | Dec 2012 | A1 |
20130336664 | Mack et al. | Dec 2013 | A1 |
20140192394 | Sun | Jul 2014 | A1 |
20140212104 | Cho et al. | Jul 2014 | A1 |
20140347733 | Stewart et al. | Nov 2014 | A1 |
20140354856 | Zhou et al. | Dec 2014 | A1 |
20150346340 | Yaacobi et al. | Dec 2015 | A1 |
20160170287 | Bitauld et al. | Jun 2016 | A1 |
20160359568 | De Dobbelaere et al. | Dec 2016 | A1 |
20170186166 | Grunnet-Jepsen et al. | Jun 2017 | A1 |
20170242161 | Zhang et al. | Aug 2017 | A1 |
20170374244 | Swaminathan et al. | Dec 2017 | A1 |
20180088255 | Sakai et al. | Mar 2018 | A1 |
20180088439 | Inoue | Mar 2018 | A1 |
20180224709 | Inada et al. | Aug 2018 | A1 |
20180267250 | Hosseini | Sep 2018 | A1 |
20190170937 | Menezo et al. | Jan 2019 | A1 |
20200150241 | Byrnes | May 2020 | A1 |
20200209361 | Maier et al. | Jul 2020 | A1 |
20200284883 | Ferreira et al. | Sep 2020 | A1 |
20200303896 | Ohta et al. | Sep 2020 | A1 |
20200333131 | Guo et al. | Oct 2020 | A1 |
20210116655 | Grieco | Apr 2021 | A1 |
20210116778 | Zhang et al. | Apr 2021 | A1 |
20210181310 | Lu | Jun 2021 | A1 |
20210191046 | Seok et al. | Jun 2021 | A1 |
20210316756 | Davydenko | Oct 2021 | A1 |
20210359396 | Mattheijssen | Nov 2021 | A1 |
20210382142 | Rogers et al. | Dec 2021 | A1 |
20220003842 | Wang | Jan 2022 | A1 |
20220075044 | Michaels | Mar 2022 | A1 |
20220214503 | Waldren et al. | Jul 2022 | A1 |
20220236384 | Sutton et al. | Jul 2022 | A1 |
20220291461 | Elsinger et al. | Sep 2022 | A1 |
Number | Date | Country |
---|---|---|
1656721 | Aug 2005 | CN |
102576130 | Jul 2012 | CN |
102018221875 | Jun 2020 | DE |
3635460 | Apr 2020 | EP |
2020017021228 | Aug 2020 | IN |
S56-48603 | May 1981 | JP |
09-005799 | Jan 1997 | JP |
2018049223 | Mar 2018 | JP |
10-20140138107 | Dec 2014 | KR |
10-20180056783 | May 2018 | KR |
WO-0052763 | Sep 2000 | WO |
WO2014089454 | Jun 2014 | WO |
WO2017065971 | Apr 2017 | WO |
WO2017132568 | Aug 2017 | WO |
WO2018111316 | Jun 2018 | WO |
WO-2018160729 | Sep 2018 | WO |
WO-2020205450 | Oct 2020 | WO |
WO2022011701 | Jan 2022 | WO |
Entry |
---|
English version of DE-102018221875-A1 (Year: 2020). |
Akihama et al.; Single and multiple optical switches that use freestanding silicon nanowire waveguide couplers; Light Science and Applications; 1(6); e16; DOI:10.1038/ISA_2012.16; 8 pages: ; Jun. 2012. |
Binkert et al.; Optical high radix switch design; Micro IEEE; 32(3); pp. 100-109; Apr. 2012. |
Celo et al.; 32X32 silicon photonic switch; IEEE In 2016 21st OptoElectronics and Communication Conference (OECC); pp. 1-3; Jul. 2016. |
Chen et al.; Compact, low-loss and low-power 8x8 broadband silicon optical switch; Optics Express; 20(17); pp. 18977-18985; 9 pages; Aug. 2012. |
Farrington et al.; Helios: a hybrid eiectrical/optical switch architecture for modular data centers; Proceedings of the ACM SIGCOMM 2010 Conference; 41(4); pp. 339-350; Aug. 2010. |
Han et al.; 50x50 polarization-insensitive silicon photonic MEMS switches: design and experiment: In ECOC 2016 Post Deadline Paper, 42nd European Conference on Optical Communication; pp. 1-3; Sep. 2016. |
Han et al.; Large-scale silicon photonic switches with movable directional couplers; Optica; 2(4); pp. 370-375; Apr. 2015. |
Han et al.; Monolithic 50x50 MEMS silicon photonic switches with microsecond response time; Optical Fiber Communication Conference, Optical Society of America; pp. M2K-2, 3 pages; Mar. 2014. |
Inoue et al.; An optical scanner based on beam switching method fabricated on silicon photonics circuit; Proceedings of SPIE; Laser radar Technology and Application XXIII; Event SPIE Defense + Security, Orlando, Florida; vol. 10636; doi 10.117/12.2309304; 7 pages; May 2018. |
Khope et al.; Elastic WDM crossbar switch for data centers; IEEE Optical Interconnects Conference (OI); pp. 48-49; May 2016. |
Kim et al.; 1100x1100 port MEMS-based optical crossconneect with 4-dB maximum loss; IEEE Photonics Technolgy Letters Leters; 15(11); pp. 1537-1539; Oct. 2003. |
Kwon et al.; 128x128 silicon photonic MEMS switch with scalable row/column addressing; CLEO Sciecnce and Innovations, Optical Society of America; pp. SF1A-4; 2 pages; May 2018. |
Lee et al.; Monolithic silicon integration of scaled photonic switch fabrics, CMOS logic, and device driver circuits; journal of Lightwave Technology; 32(4); pp. 743-751; Aug. 2013. |
Liu et al.; Circuit switching under the radar with REACToR; in 11th USENIX Symposium on network Systems Design and Implementation (NSDI 14); pp. 1-15; (the year of publication is sufficiently earlier than the effective U.S filing date and any foreign priority date so that the particular month of publication is not in issue) 2014. |
Nakamura et al.; High extinction ratio optical switching independently of temperature with silicon photonic 1x8 switch; Optical Fiber Communication Conference, Optical Society of America; pp. OTu2I-3); 3 pages; Mar. 2012. |
Porter et al.; Integrating microsecond circuit switching into the data center; in ACM SIGCOMM Computer Commuinication Review; 43(4); pp. 447-458; Aug. 2013. |
Rumley et al.; Impact of photonic switch radix on realizing optical interconnection networks for exascale systems; In IEEE Optical Interconnects Conference; pp. 98-99; May 2014. |
Seok; Large scale broadband digital silicon photonic switches with vertical adiabatic couplers; Optica; 3(1); pp. 64-70; Jan. 2016. |
Sun et al.; Large scale silicon photonic circuits for optical phased arrays; IEEE Journal of Selected Topics In Quantum Electronics; 20(4); pp. 264-278; 15 pages; Nov. 2013. |
Suzuki et al.; Ultra-compact 8x8 strictly-non-blocking si-wire PILOSS switch; Optics Express; 22(4); pp. 3887-3894; 8 pages; Feb. 2014. |
Tanizawa et al.; 32x32 Strictly non-blocking si-wire optical switch on ultra-small die of 11x25mm92; Optical Fiber Communication Conference; pp. M2B-5; 3 pages; Mar. 2015. |
Tanizawa et al.; 4x4 Si-wire optical path switch with off-chip polarization diversity; IEEE Opto-Electronics and Communications Conference (OECC); pp. 1-3; Jun. 2015. |
Tanizawa et al.; Non-duplicate polarization-diversity 8x8 si-wire PILOSS switch integrated with polarization splitter-rotators; Optics Express; 25(10); pp. 10885-10892; May 2017. |
Tanizawa et al.; Novel polarization diversity without switch duplication of a Si-wire Piloss optical switch; Optiics Express; 24(7); pp. 6861-6868; DOI:10.1364/OE.24.006861, 8 pages; Apr. 2016. |
Tanizawa et al.; Silicon photonic 32x32 strictly-non-blocking blade switch and its full path characterization; IEEE 21st OptoElectronics and Communications Conference (OECC); pp. 1-3; Jul. 2016. |
Vahdat et al.; The emerging optical data center; Optical Fiber Communication Conference; Optical Society of America; p. OTuH2; 3 pages; Mar. 2011. |
Yun et al.; 2x2 adiabatic 3-dB coupler on silicon-on-insulator rib waveguides; Photonics North, SPIE; vol. 8915; pp. 251-256; 6 pages; Oct. 2013. |
Zhang et al; A 20x20 focal plane switch array for optical beam steering; IEEE 2020 Conference on Lasers and Electro-Optics (CLEO); 2 pages; May 2020. |
Glaser et al.; Multiple lenslet array imagers and correlators; In 10th Meeting on Optical Engineering in Israel; SPIE; vol. 3110; pp. 706-720; Sep. 22, 1997. |
Edmund Optics; Lens spacers, shims, and focal extenders; retrieved from the internet (https://www.edmundoptics.com/knowledge-center/application-notes/imaging/lens-spacers-shims-and-focal-length-extenders/) 3 pages; on Sep. 28. 2022. |
Number | Date | Country | |
---|---|---|---|
20220357429 A1 | Nov 2022 | US |
Number | Date | Country | |
---|---|---|---|
63186748 | May 2021 | US |