The present disclosure generally relates to a light detection and ranging (LiDAR) and, more specifically, to a technique for encoding and decoding a LiDAR system.
LiDAR system can be used to measure the distance between an object and the system. Specifically, the system can transmit a signal (e.g., using a light source), record a returned signal (e.g., using light detectors), and determine the distance by calculating the delay between the returned signal and the transmitted signal.
The following presents a simplified summary of one or more examples in order to provide a basic understanding of the disclosure. This summary is not an extensive overview of all contemplated examples, and is not intended to either identify key or critical elements of all examples or delineate the scope of any or all examples. Its purpose is to present some concepts of one or more examples in a simplified form as a prelude to the more detailed description that is presented below.
In accordance with some embodiments, a light detection and ranging (LiDAR) scanning system, comprising: a light source, wherein the light source is configured to transmit a pulse of light to illuminate a surface of an object; a modulator operable to encode the pulse of light in response to a signal from a sequence generator; a light detector configured to detect scattered light from the surface of the object of the light pulse; a correlator electrically coupled to the light detector, wherein the correlator is configured to correlate the scattered light with the sequence code and output a peak value associated with a time that the pulse of light is received, and a microprocessor electrically coupled to the light source and the correlator, wherein the microprocessor is configured to: determine whether an amplitude of the peak value exceeds a threshold value; in accordance with a determination that the amplitude of the peak exceeds the threshold value: determine a time difference between a time that pulse of light was transmitted and the time that the pulse of light is received; and calculate a distance to the surface of the object based on the time difference.
In accordance with some embodiments, a method for light detection and ranging (LiDAR) scanning detection, the method comprising: encoding a pulse of light from a light source with a sequence code; transmitting the pulse of light to illuminate a surface of an object; detecting, at a detector, scattered light from the illuminated surface of the object; correlating the detected scattered light with the sequence code that outputs a peak value associated with a time that the pulse of light is received; determining whether an amplitude of the peak value exceeds a threshold value; in accordance with a determination that the amplitude of the peak exceeds the threshold value: determining a time difference between a time that pulse of light was transmitted and the time the pulse of light is received; and calculating a distance to the surface of the object based on the time difference.
In accordance with some embodiments, a computer-implemented method comprises: in a light detection and ranging (LiDAR) system having a light source and a light detector: transmitting, using the light source, a first pulse group signal having a first number of pulse signals and a second pulse group signal having a second number of pulse signals, wherein the first number is different from the second number; receiving, using the light detector, a returned pulse group signal having a third number of pulse signals; determining, based on the third number of pulse signals, whether the returned pulse group signal corresponds to the first pulse group signal or the second pulse group signal; in accordance with a determination that the returned pulse group signal corresponds to the first pulse group signal, determining a first distance based on the returned pulse group signal and the transmitted first pulse group signal; and in accordance with a determination that the returned pulse group signal corresponds to the second pulse group signal, determining a second distance based on the returned pulse group signal and the transmitted second pulse group signal.
In accordance with some embodiments, a light detection and ranging (LiDAR) scanning system comprises a light source, wherein the light source is configured to transmit a first pulse group signal having a first number of pulse signals and a second pulse group signal having a second number of pulse signals, wherein the first number is different from the second number; a light detector configured to detect a returned pulse group signal having a third number of pulse signals; a microprocessor electrically coupled to the light source and the light detector, wherein the microprocessor is configured to determine, based on the third number of pulse signals, whether the returned pulse group signal corresponds to the first pulse group signal or the second pulse group signal; in accordance with a determination that the returned pulse group signal corresponds to the first pulse group signal, determine a first distance based on the returned pulse group signal and the transmitted first pulse group signal; and in accordance with a determination that the returned pulse group signal corresponds to the second pulse group signal, determine a second distance based on the returned pulse group signal and the transmitted second pulse group signal.
For a better understanding of the various described aspects, reference should be made to the description below, in conjunction with the following figures in which like-referenced numerals refer to corresponding parts throughout the figures.
To determine the range of an object, a LiDAR system illuminates an object with a pulse of light and detects the scattered light that corresponds to the pulse of light. Associating a pulse of light with scattered light that does not correspond to the pulse of light may cause the LiDAR system to interpret the presence of an object, even though there is no physical object there. For example, scattered light from another pulse transmitted by the same LiDAR system or by a second LiDAR system in proximity to the LiDAR system can mistakenly be paired with the original pulse light, which can be incorrectly interpreted as an object. Current techniques typically post-process samples to correct for “false” objects by comparing adjacent samples of a capture frame, which is at best an approximation. As such, the challenge is to improve on pairing a pulse of light with the corresponding scattered light from the light pulse.
The detailed description set forth below in connection with the appended drawings is intended as a description of various configurations and is not intended to represent the only configurations in which the concepts described herein may be practiced. The detailed description includes specific details for the purpose of providing a thorough understanding of various concepts. However, it will be apparent to those skilled in the art that these concepts may be practiced without these specific details. In some instances, well-known structures and components are shown in block diagram form in order to avoid obscuring such concepts.
Examples of LiDAR systems and processes will now be presented with reference to various elements of apparatuses and methods. These apparatuses and methods will be described in the following detailed description and illustrated in the accompanying drawing by various blocks, components, circuits, steps, processes, algorithms, etc. (collectively referred to as “elements”). These elements may be implemented using electronic hardware, computer software, or any combination thereof. Whether such elements are implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system.
In the following description of examples, reference is made to the accompanying drawings which form a part hereof, and in which it is shown by way of illustration specific examples that can be practiced. It is to be understood that other examples can be used and structural changes can be made without departing from the scope of the disclosed examples.
Although the following description uses terms “first,” “second,” etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first pulse signal could be termed a second pulse signal, and, similarly, a second pulse signal could be termed a first pulse signal, without departing from the scope of the various described embodiments. The first pulse signal and the second pulse signals are both pulse signals, but they may not be the same pulse signal.
The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The term “if” is, optionally, construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” is, optionally, construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.
In this example, the fifth LiDAR system 102E of the vehicle 100 covers a “blind spot” (e.g., an area not scanned by a LiDAR system) corresponding to the non-scanned area between the front region 104A and the passenger side region 104C. As such, the fifth LiDAR system 102E has a front passenger side corner region 104E that overlaps with the front region 104A at a first overlapping region 106AE and a front passenger side corner region 104E that overlaps with the passenger side region 104C at a second overlapping region 106EC. Likewise, the sixth LiDAR system 102F of the vehicle 100 covers a “blind spot” (e.g., an area not scanned by a LiDAR system) corresponding to the non-scanned area between the front region 104A and the driver side region 104D. As such, the sixth LiDAR system 102F has a front driver side corner region 104F that overlaps with the front region 104A at a third overlapping region 106AF and a front driver side corner region 104F that overlaps with the driver side region 104D at a fourth overlapping region 106FD.
The overlapping regions can provide additional resolution since each overlapping region can range objects within each respective overlapping region from more than one LiDAR system. For example, the first LiDAR system 102A can range a surface of an object situated in the first overlapping region 106AE and the fifth LiDAR system 102E can range an adjacent surface of an object situated in the first overlapping region 106AE. As such, the first overlapping region 106AE can be over-scanned where two LiDAR systems can range objects in the same area at the same time.
Over-scanning overlapping regions (e.g., the first overlapping region 106AE, the second overlapping region 106EC, the third overlapping region 106AF, the fourth overlapping region 106FD, etc.) can also cause interference between one or more LiDAR systems. For example, the first LiDAR system 102A can range a surface of an object situated in the first overlapping region 106AE at substantially the same time and in substantially the same location that the fifth LiDAR system 102E ranges a surface of an object situated in the first overlapping region 106AE. In such an instance, a pulse of scattered light from the first LiDAR system 102A can mistakenly be detected at the fifth LiDAR system 102E. Likewise, a pulse of scattered light from the fifth LiDAR system 102E can mistakenly be detected at the first LiDAR system 102A.
In some instances, a pulse of scattered light from the first LiDAR system 102A can interfere with a pulse of scattered light from the fifth LiDAR system 102E. That is, the first LiDAR system 102A can detect both the pulses of scattered light and it can be difficult to distinguish which is the pulse of scattered light that corresponds to the pulse of light transmitted from the first LiDAR system 102A. One approach to distinguish which pulse of scattered light corresponds to the transmitted pulse of light when multiple pulses of scattered light are detected is to implement a “first to arrive” distinction, which associates the first detected scattered light to a transmitted pulse of light. The reasoning in this approach is that the first pulse of light to arrive travels the shortest distance, which corresponds to the correct transmitted pulse of light. However, pulses of scattered light from adjacent LiDAR systems can interfere with this approach. For instance, a pulse of scattered light from the fifth LiDAR system 102E can arrive at the first LiDAR system 102A prior to a pulse of scattered light transmitted from the first LiDAR system 102A. As such, selecting the “first to arrive” (e.g., in this instance, a pulse of scattered light from the fifth LiDAR system 102E) approach yields a range for an object that is closer than it really is.
Another approach to distinguish which pulse of scattered light corresponds to the transmitted pulse of light when multiple pulses of scattered light are detected is to implement a “most intense” distinction, which associates the brightest detected pulse of scattered light to a transmitted pulse of light. The reasoning in this approach is that the alignment of the light source and the detector collects a more intense pulse of light than a second light source that is randomly aligned with the detector. As such, the most intense (e.g., brightest) pulse of light to arrive corresponds to the transmitted pulse of light. For instance, the pulse of scattered light originating from the fifth LiDAR system 102E can arrive at the first LiDAR system 102A after and with a higher intensity than a pulse of scattered light originating from the first LiDAR system 102A. In such an instance, selecting the “most intense” (e.g., in this instance, a pulse of scattered light from the fifth LiDAR system 102E) approach yields a range for an object that is farther away than it really is.
To accurately distinguish which pulse of scattered light corresponds to the transmitted pulse of light when multiple pulses of light are detected, each LiDAR system depicted in
As depicted in patterns regions (e.g., 104A-104F) of
In another example, a pulse of scattered light originating from the fifth LiDAR system 102E can arrive at the first LiDAR system 102A after with a higher intensity than a pulse of scattered light originating from the first LiDAR system 102A. The pulse of scattered light originating from the first LiDAR system 102A and the pulse of scattered light originating from the fifth LiDAR system 102E are correlated with the sequence code of the first LiDAR system 102A. Because the correlation between the pulse of scattered light originating from the first LiDAR system 102A and the sequence code of the first LiDAR system 102A is higher than the correlation between the pulse of scattered light originating from the fifth LiDAR system 102E and the sequence code of the first LiDAR system 102A, the first LiDAR system 102A correctly identifies the pulse of scattered light with the lower intensity (e.g., the pulse of scattered light originating from the first LiDAR system 102A).
In the example depicted in
As depicted in
In some instances, light from the pulse of light 214 can disperse from a first surface 252 and “echo” off a second surface 254 and be directed along an optical path that is substantially parallel to the path of a direct pulse of scattered light 216. However, the extra distance that such pulse of echo-scattered light 218 takes delays the pulse of echo-scattered light 218 from the more direct path of the pulse of scattered light 216. As such, echo-scattered light 218 lag a direct pulse of scattered light 216. The photo sensor 232 can be a photodiode, an avalanche photodiode, a photo-multiplier tube, and the like. In some examples, the photo sensor 232 includes a reflective mirror facing the opposite surface of the light incident surface, which reflects light back to the absorption region of the photo sensor 232.
It should be appreciated that the LiDAR system 200 detects both the pulse of scattered light 216 and the echo-scattered light 218 and the LiDAR system 200 associates both the pulse of scattered light 216 and the echo-scattered light 218 as valid pulses transmitted by the LiDAR system 200. In some examples, the LiDAR system 200 associates both the pulses of scattered light 216 and the echo-scattered light 218 as valid pulses transmitted by the LiDAR system 200 based on the sequence code encoded in the pulses in accordance with the methods described herein. In instances where there are one or more valid pulses, the LiDAR system 200 attributes the “first to arrive” as the pulse of scattered light 214 and the remaining as pulses of echo-scattered light 218 as echo-scattered light 218 lag a direct pulse of scattered light 216.
In the examples depicted in
The example depicted in
The microprocessor 240 includes a time/clock 242, a sequence generator 244, and a correlator 246. As depicted in
The sequence generator 244 is configured to generate a sequence code. The sequence generator 244 is electrically coupled to the correlator 246, the light source 210 (e.g., internal modulator 212), and optionally to the opto-electrical modulator 220. In some examples, the sequence generator 244 is a module embedded within the microprocessor 240. In some examples, the sequence code is a pseudorandom bit sequence (PRBS) code.
The correlator 246 is electrically coupled to the light detector 230. The correlator 246 is configured to correlate a pulse of scattered light 216 with a sequence code, which measures the similarity between the pulse of scattered light 216 and the sequence code. For a high similarity, the correlator 246 outputs a peak value where the pulse of scattered light 216 and the sequence code align. The position of the peak value is associated with a time that the pulse of scattered light 216 is received. For correlation in the electrical domain, the correlator 246 accesses the digital electrical signal from the A/D converter 238, which corresponds to the electrical representation of the scattered light 216. As depicted in
Instead of the correlator 246, which correlates a pulse of scattered light 216 in the electrical domain as depicted in
In some examples. the microprocessor 240 is further configure to determine whether an amplitude of the peak value from the correlation between the scattered light 216 and the sequence code exceeds a threshold value. In some examples, the threshold value is at least one standard deviation above an average of the output from the correlator 246. In accordance with a determination that the amplitude of the peak exceeds the threshold value the microprocessor 240 is further configure to determine a time difference between a time that pulse of light 214 was transmitted and the time that the pulse of scattered light 216 was received. Based on this time difference the microprocessor 240 is configured to calculate a distance to the surface (e.g., distance to first surface 252) of the object 250. In some examples, the microprocessor 240 is further configured to determine a reflectivity of the surface (e.g., first surface 252) of the object 250 based on the amplitude of the peak value.
As depicted in
In this example, the correlator 246 correlates the different pulse of scattered light 318 originating from the light source 310 and the code sequence and also correlates the pulse of scattered 218 originating from the light source 210 and the code sequence. The correlation results indicate that the correlation is higher for the pulse of scattered 218 compared to the correlation for the different pulse of scattered light 318. As such, the LiDAR system 200′ correctly associated the different pulse of light 314 with the pulse of scattered 218.
While
It should be appreciated that the 2nd sequence 406 can be the sequence code for the second LiDAR system 102B (
It is noted that because the peak values 418A, 418B, 418C diminish with attenuation, it is contemplated that the microprocessor 240 can be configured to determine a reflectivity of the surface (e.g., first surface 252) of the object 250 based on the amplitude of the peak value 418.
It should be appreciated that even at 30 dB of attenuation 502C (
At block 604, the process 600 encodes a pulse of light from a light source with a sequence code. For example, as depicted in
At block 606, the process 600 transmits the pulse of light to illuminate a surface of an object. That is, the light source 210 (
At block 608, the process 600 detects, at a detector (e.g., detector 230), scattered light from the illuminated surface of the object. That is, the detector 230 can detect the pulse of scattered light 216 that was dispersed from the first surface 252 and directed to the light detector 230. The light detector 230 can include a photo sensor 232, an aperture mask 234, and converging lens 236 to assist in gathering more pulses of scattered light (e.g., pulse of scattered light 238). In particular, the converging lens 236 gathers and directs pulses of scattered light (e.g., pulse of scattered light 238) toward a focal region at the photo sensor 232. In some instances, the pulses of scattered light (e.g., pulse of scattered light 238) include an encoded pulse of scattered light 238 originating from the light pulse 214, echo-scattered light 218 originating from the dispersed light pulse 214 echoing off one or more surfaces, and different pulse of light scattered 318 originating from a different pulse of light 314. In some examples, the photo sensor 232 is a photodiode such as an avalanche photodiode. In some examples, the detector is a photomultiplier tube. In some examples, detecting scattered light includes converting the detected pulse of scattered light 238 to a digital electrical signal.
At block 610, the process 600 correlates the detected pulse of scattered light with the sequence code that outputs a peak value associated with a time that the pulse of light is received. For example, the correlator 246 receives the sequence code from the signal generator 244 and the converted digital electrical signal from the A/D converter 238 of the detector 230. The correlator 246 then correlates the converted digital electrical signal with the sequence code. The correlation yields a peak value 418 (e.g., peak 418
At block 612, the process 600 determines whether an amplitude of the at least one peak value exceeds a threshold value. For example, the microprocessor 240 can be configure to determine whether an amplitude of the peak value 418 from the correlation between the scattered light 216 and the sequence code exceeds a threshold value 418. For instance, the microprocessor would determine that the peak 118 depicted in
At block 614, in accordance with a determination that the amplitude of the peak exceeds the threshold value, the process 600 determines a time difference between a time that pulse of light was transmitted and the time the pulse of light is received. For example, the time/clock 242 can pair a pulse of light 214 with a scattered pulse of light 216 and determine the time difference. In some examples, the time/clock 242 uses time markers (e.g., timestamps). In some instances, firing the pulse of light 214 can trigger a time marker and the correlation at time index zero can trigger a time marker.
At block 616, the process 600 calculates a distance to the surface of the object based on the time difference. For example, the microprocessor 240 can multiple the time difference by the speed of light divided by 2 to yield the distance to an object 250. For instance, with a time difference of 0.8 microseconds the microprocessor 240 would calculate the distance to an object 250 to be around 120 meters away (e.g., 0.8e−6*2.9979e8/2). After calculating the distance, the calculator module 310 can store the values to computer-readable medium/memory 248.
At optional block 618, in accordance with a determination that the amplitude of the peak exceeds the threshold value, the process 600 determines a reflectivity of the surface of the object based on the amplitude of the peak. For example, a pulse of light 214 illuminates a surface (e.g., first surface 252) of an object 250, in which the light disperses and some of the scattered light 218 is directed to the detector 230. For highly reflective surfaces a large portion (e.g., percentage) of scattered light 218 is directed to the detector 230, whereas for low reflective surface a large portion (e.g., percentage) of scattered light 218 is directed to the detector 230. Because the amplitude of the correlation peak 418 decreases with attenuation (
The first pulse group signal 706 and the second pulse group signal 708 are separated by a time interval. The time interval is set large enough such that the two group signals do not overlap with each other. As depicted, the time interval between the transmission of pulse group signals 706 and 708 is larger than the time interval between the two pulses within the pulse group signal 708. This improves the likelihood that the scattered lights from the pulse group signals 706 and 708 are recognized as two distinct group signals. Further, it should be appreciated that, in some examples, it is desirable to set the time intervals among pulses within a pulse group signal as small as possible as long as the system can still discern the number of peaks in the group after it has been scattered. This further helps the scattered lights from multiple group signals to recognized as multiple distinct (e.g., not overlapping) pulse group signals after being scattered.
The receiver 704 receives, using the light detector, a first returned pulse group signal 712 and a second returned pulse group signal 714. For each returned pulse group signal, the system makes a determination as to which transmitted pulse group signal it corresponds to. For example, the system identifies two pulses (or peaks) within the second returned pulse group signal 714 and thus determines that the second returned pulse group signal 714 corresponds to the second pulse group signal 708. Accordingly, the system determines a distance based on the time when the pulse group signal 708 is transmitted and the time when the pulse group signal 714 is received.
Further, the system identifies one pulse (or peak) within the first returned pulse group signal 712 and thus determines that the first returned pulse group signal 712 corresponds to the first pulse group signal 706. Accordingly, the system determines a distance based on the time when the pulse group signal 706 is transmitted and the time when the pulse group signal 712 is received.
It should be appreciated that the LiDAR system 700 can correlate returned pulse group signals 712 and 714 to the respective transmitted signals regardless of the order in which the returned pulse group signals 712 and 714 are received. For example, if the first pulse group signal 706 is scattered by a relatively faraway object while the second pulse group signal 708 is scattered by a relatively nearby object, the returned pulse group signal 714 (corresponding to the second pulse group signal 708) may be received before the returned pulse group signal 712. Nevertheless, the system can still correctly correlate the returned pulse group signal 714 with the later transmitted pulse group signal 708 based on the number of peaks identified in the returned pulse group signal 714.
The above-described method of distinguishing scattered light originated from the same source improves the resolution of the LiDAR system. In a conventional system that cannot correctly correlate the scattered lights that are received in an order different from the order their corresponding light pulses were transmitted, the system may need to ensure that the scattered lights arrive in the same order, for example, by transmitting a signal and then waiting for the maximum time it takes for a light pulse to travel round trip to the farthest distance the LiDAR is designed for before transmitting the next signal. Using the above-described method, the system does not need to wait for the maximum time of flight between transmitting two consecutive signals. For example, the time between transmitting the first pulse group signal 706 and transmitting the second pulse group signal 708 can be less than the round trip time of flight for a light pulse to reach the farthest of the objects per the design specification of the system. Thus, the system is able to transmit pulse signals at a higher frequency, thus yielding higher resolution in the field of view without reducing the range of detection.
In some embodiments, the first plurality of pulse group signals are for detecting relatively faraway objects, while the second plurality of pulse group signals are for detecting relative nearby objects. Such a system eliminates the need of having electronics for multiple seed lasers in order to increase the density of the detected points without reducing the LiDAR system's range of detection. As depicted, the first plurality of pulse group signals (e.g., 706, 724) is of a higher amplitude than the second plurality of pulse group signals (e.g., 708, 720, 722, 726). The higher amplitude of signals 706 and 724 allows those signals to be used to range objects farther away. Further, the signals 706 and 724 of the first plurality are separated by a time interval t1. In some examples, the time interval t1 may be the maximum time it takes for a light pulse to travel round trip to the farthest distance the LiDAR system is designed for; as such, the system can distinguish among the signals of the first plurality using the “first to arrive” approach. Further, the signals 708 and 720 of the second plurality are separated by a time interval t2. The system can distinguish between the scattered lights corresponding to signals of the first plurality and the scattered lights corresponding to signals of the second plurality based on the respective number of peaks in each scattered light, in accordance with the method described above.
In some examples, each pulse group signal of the first plurality is separated from the neighboring pulse group signal by the same time interval t1 and each pulse group signal of the second plurality is separated from the neighboring pulse group signal by the same time interval t2. The ratio between t1 and t2 is configured such that none of the first plurality of pulse group signals overlaps with any of the second plurality of pulse group signals.
While
Exemplary methods, non-transitory computer-readable storage media, systems, and electronic devices are set out in the following items:
It is understood that the specific order or hierarchy of blocks in the processes and/or flowcharts disclosed is an illustration of exemplary approaches. Based upon design preferences, it is understood that the specific order or hierarchy of blocks in the processes and/or flowcharts may be rearranged. Further, some blocks may be combined or omitted. The accompanying method claims present elements of the various blocks in a sample order, and are not meant to be limited to the specific order or hierarchy presented.
The previous description is provided to enable any person skilled in the art to practice the various aspects described herein. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects. Thus, the claims are not intended to be limited to the aspects shown herein, but is to be accorded the full scope consistent with the language claims, wherein reference to an element in the singular is not intended to mean “one and only one” unless specifically so stated, but rather “one or more.” The word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any aspect described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects. Unless specifically stated otherwise, the term “some” refers to one or more. Combinations such as “at least one of A, B, or C,” “one or more of A, B, or C,” “at least one of A, B, and C,” “one or more of A, B, and C,” and “A, B, C, or any combination thereof” include any combination of A, B, and/or C, and may include multiples of A, multiples of B, or multiples of C. Specifically, combinations such as “at least one of A, B, or C,” “one or more of A, B, or C,” “at least one of A, B, and C,” “one or more of A, B, and C,” and “A, B, C, or any combination thereof” may be A only, B only, C only, A and B, A and C, B and C, or A and B and C, where any such combinations may contain one or more member or members of A, B, or C. All structural and functional equivalents to the elements of the various aspects described throughout this disclosure that are known or later come to be known to those of ordinary skill in the art are expressly incorporated herein by reference and are intended to be encompassed by the claims. Moreover, nothing disclosed herein is intended to be dedicated to the public regardless of whether such disclosure is explicitly recited in the claims. The words “module,” “mechanism,” “element,” “device,” and the like may not be a substitute for the word “means.” As such, no claim element is to be construed under 35 U.S.C § 112(f) unless the element is expressly recited using the phrase “means for.
This application is a Continuation Application of U.S. patent application Ser. No. 15/863,695, entitled “METHOD AND SYSTEM FOR ENCODING AND DECODING LiDAR”, filed Jan. 5, 2018, now U.S. Pat. No. 10,969,475, which claims priority to U.S. Provisional Patent Application No. 62/442,758, entitled “METHOD AND SYSTEM FOR ENCODING AND DECODING LiDAR”, filed on Jan. 5, 2017, the content of each of which is hereby incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
3897150 | Bridges et al. | Jul 1975 | A |
4464048 | Farlow | Aug 1984 | A |
5006721 | Cameron et al. | Apr 1991 | A |
5157451 | Taboada et al. | Oct 1992 | A |
5319434 | Croteau et al. | Jun 1994 | A |
5369661 | Yamaguchi et al. | Nov 1994 | A |
5442358 | Keeler et al. | Aug 1995 | A |
5546188 | Wangler et al. | Aug 1996 | A |
5579153 | Laming et al. | Nov 1996 | A |
5657077 | Deangelis et al. | Aug 1997 | A |
5793491 | Wangler et al. | Aug 1998 | A |
5838239 | Stern et al. | Nov 1998 | A |
5864391 | Hosokawa et al. | Jan 1999 | A |
5926259 | Bamberger et al. | Jul 1999 | A |
5936756 | Nakajima | Aug 1999 | A |
6163378 | Khoury | Dec 2000 | A |
6317202 | Hosokawa et al. | Nov 2001 | B1 |
6594000 | Green et al. | Jul 2003 | B2 |
6650404 | Crawford | Nov 2003 | B1 |
6950733 | Stopczynski | Sep 2005 | B2 |
7128267 | Reichenbach et al. | Oct 2006 | B2 |
7202941 | Munro | Apr 2007 | B2 |
7345271 | Boehlau et al. | Mar 2008 | B2 |
7440084 | Kane | Oct 2008 | B2 |
7440175 | Di et al. | Oct 2008 | B2 |
7489865 | Varshneya et al. | Feb 2009 | B2 |
7576837 | Liu et al. | Aug 2009 | B2 |
7830527 | Chen et al. | Nov 2010 | B2 |
7835068 | Brooks et al. | Nov 2010 | B1 |
7847235 | Krupkin et al. | Dec 2010 | B2 |
7880865 | Tanaka et al. | Feb 2011 | B2 |
7936448 | Albuquerque et al. | May 2011 | B2 |
7969558 | Hall | Jun 2011 | B2 |
7982861 | Abshire et al. | Jul 2011 | B2 |
8072582 | Meneely | Dec 2011 | B2 |
8471895 | Banks | Jun 2013 | B2 |
8736818 | Weimer et al. | May 2014 | B2 |
8749764 | Hsu | Jun 2014 | B2 |
8812149 | Doak | Aug 2014 | B2 |
8994928 | Shiraishi | Mar 2015 | B2 |
9048616 | Robinson | Jun 2015 | B1 |
9065243 | Asobe et al. | Jun 2015 | B2 |
9086273 | Gruver et al. | Jul 2015 | B1 |
9194701 | Bosch | Nov 2015 | B2 |
9255790 | Zhu | Feb 2016 | B2 |
9300321 | Zalik et al. | Mar 2016 | B2 |
9304316 | Weiss et al. | Apr 2016 | B2 |
9316724 | Gehring et al. | Apr 2016 | B2 |
9354485 | Fermann et al. | May 2016 | B2 |
9510505 | Halloran et al. | Dec 2016 | B2 |
9575184 | Gilliland et al. | Feb 2017 | B2 |
9605998 | Nozawa | Mar 2017 | B2 |
9621876 | Federspiel | Apr 2017 | B2 |
9638799 | Goodwin et al. | May 2017 | B2 |
9696426 | Zuk | Jul 2017 | B2 |
9702966 | Batcheller et al. | Jul 2017 | B2 |
9804264 | Villeneuve et al. | Oct 2017 | B2 |
9810786 | Welford et al. | Nov 2017 | B1 |
9812838 | Villeneuve et al. | Nov 2017 | B2 |
9823353 | Eichenholz et al. | Nov 2017 | B2 |
9857468 | Eichenholz et al. | Jan 2018 | B1 |
9869754 | Campbell et al. | Jan 2018 | B1 |
9880263 | Droz et al. | Jan 2018 | B2 |
9880278 | Uffelen et al. | Jan 2018 | B2 |
9885778 | Dussan | Feb 2018 | B2 |
9897689 | Dussan | Feb 2018 | B2 |
9915726 | Bailey et al. | Mar 2018 | B2 |
9927915 | Frame et al. | Mar 2018 | B2 |
9958545 | Eichenholz et al. | May 2018 | B2 |
10007001 | LaChapelle et al. | Jun 2018 | B1 |
10012732 | Eichenholz et al. | Jul 2018 | B2 |
10042159 | Dussan et al. | Aug 2018 | B2 |
10061019 | Campbell et al. | Aug 2018 | B1 |
10073166 | Dussan | Sep 2018 | B2 |
10078133 | Dussan | Sep 2018 | B2 |
10094925 | LaChapelle | Oct 2018 | B1 |
10157630 | Vaughn et al. | Dec 2018 | B2 |
10191155 | Curatu | Jan 2019 | B2 |
10215847 | Scheim et al. | Feb 2019 | B2 |
10267898 | Campbell et al. | Apr 2019 | B2 |
10295656 | Li et al. | May 2019 | B1 |
10310058 | Campbell et al. | Jun 2019 | B1 |
10324170 | Enberg, Jr. et al. | Jun 2019 | B1 |
10324185 | McWhirter et al. | Jun 2019 | B2 |
10393877 | Hall et al. | Aug 2019 | B2 |
10429495 | Wang et al. | Oct 2019 | B1 |
10444356 | Wu et al. | Oct 2019 | B2 |
10451716 | Hughes et al. | Oct 2019 | B2 |
10466342 | Zhu et al. | Nov 2019 | B1 |
10502831 | Eichenholz | Dec 2019 | B2 |
10509112 | Pan | Dec 2019 | B1 |
10520602 | Villeneuve et al. | Dec 2019 | B2 |
10557923 | Watnik et al. | Feb 2020 | B2 |
10571567 | Campbell et al. | Feb 2020 | B2 |
10578720 | Hughes et al. | Mar 2020 | B2 |
10591600 | Villeneuve et al. | Mar 2020 | B2 |
10627491 | Hall et al. | Apr 2020 | B2 |
10641872 | Dussan et al. | May 2020 | B2 |
10663564 | LaChapelle | May 2020 | B2 |
10663585 | McWhirter | May 2020 | B2 |
10663596 | Dussan et al. | May 2020 | B2 |
10684360 | Campbell | Jun 2020 | B2 |
10908262 | Dussan | Feb 2021 | B2 |
10908265 | Dussan | Feb 2021 | B2 |
10908268 | Zhou et al. | Feb 2021 | B2 |
10969475 | Li et al. | Apr 2021 | B2 |
10983218 | Hall et al. | Apr 2021 | B2 |
11002835 | Pan et al. | May 2021 | B2 |
11009605 | Li et al. | May 2021 | B2 |
11194048 | Burbank et al. | Dec 2021 | B1 |
20020136251 | Green et al. | Sep 2002 | A1 |
20040135992 | Munro | Jul 2004 | A1 |
20050033497 | Stopczynski | Feb 2005 | A1 |
20050190424 | Reichenbach et al. | Sep 2005 | A1 |
20050195383 | Breed et al. | Sep 2005 | A1 |
20060071846 | Yanagisawa et al. | Apr 2006 | A1 |
20060132752 | Kane | Jun 2006 | A1 |
20070091948 | Di et al. | Apr 2007 | A1 |
20070216995 | Bollond et al. | Sep 2007 | A1 |
20080174762 | Liu et al. | Jul 2008 | A1 |
20080193135 | Du et al. | Aug 2008 | A1 |
20090010644 | Varshneya et al. | Jan 2009 | A1 |
20090051926 | Chen | Feb 2009 | A1 |
20090059201 | Willner et al. | Mar 2009 | A1 |
20090067453 | Mizuuchi et al. | Mar 2009 | A1 |
20090147239 | Zhu | Jun 2009 | A1 |
20090262760 | Krupkin et al. | Oct 2009 | A1 |
20090316134 | Michael et al. | Dec 2009 | A1 |
20100006760 | Lee et al. | Jan 2010 | A1 |
20100020306 | Hall | Jan 2010 | A1 |
20100020377 | Brochers et al. | Jan 2010 | A1 |
20100027602 | Abshire et al. | Feb 2010 | A1 |
20100045965 | Meneely | Feb 2010 | A1 |
20100053715 | O'Neill et al. | Mar 2010 | A1 |
20100128109 | Banks | May 2010 | A1 |
20100271614 | Albuquerque et al. | Oct 2010 | A1 |
20110181864 | Schmitt et al. | Jul 2011 | A1 |
20120038903 | Weimer et al. | Feb 2012 | A1 |
20120124113 | Zalik et al. | May 2012 | A1 |
20120221142 | Doak | Aug 2012 | A1 |
20130107016 | Federspeil | May 2013 | A1 |
20130116971 | Retkowski et al. | May 2013 | A1 |
20130241761 | Cooper et al. | Sep 2013 | A1 |
20130293867 | Hsu et al. | Nov 2013 | A1 |
20130293946 | Fermann et al. | Nov 2013 | A1 |
20130329279 | Nati et al. | Dec 2013 | A1 |
20130342822 | Shiraishi | Dec 2013 | A1 |
20140078514 | Zhu | Mar 2014 | A1 |
20140104594 | Gammenthaler | Apr 2014 | A1 |
20140347650 | Bosch | Nov 2014 | A1 |
20140350836 | Stettner et al. | Nov 2014 | A1 |
20150078123 | Batcheller et al. | Mar 2015 | A1 |
20150084805 | Dawber | Mar 2015 | A1 |
20150109603 | Kim et al. | Apr 2015 | A1 |
20150116692 | Zuk et al. | Apr 2015 | A1 |
20150139259 | Robinson | May 2015 | A1 |
20150158489 | Oh et al. | Jun 2015 | A1 |
20150338270 | Williams et al. | Nov 2015 | A1 |
20150355327 | Goodwin et al. | Dec 2015 | A1 |
20160003946 | Gilliland | Jan 2016 | A1 |
20160047896 | Dussan | Feb 2016 | A1 |
20160047900 | Dussan | Feb 2016 | A1 |
20160061655 | Nozawa | Mar 2016 | A1 |
20160061935 | Mccloskey et al. | Mar 2016 | A1 |
20160100521 | Halloran et al. | Apr 2016 | A1 |
20160117048 | Frame et al. | Apr 2016 | A1 |
20160172819 | Ogaki | Jun 2016 | A1 |
20160178736 | Chung | Jun 2016 | A1 |
20160226210 | Zayhowski et al. | Aug 2016 | A1 |
20160245902 | Natnik | Aug 2016 | A1 |
20160291134 | Droz et al. | Oct 2016 | A1 |
20160313445 | Bailey et al. | Oct 2016 | A1 |
20160327646 | Scheim et al. | Nov 2016 | A1 |
20170003116 | Yee et al. | Jan 2017 | A1 |
20170153319 | Villeneuve et al. | Jun 2017 | A1 |
20170242104 | Dussan | Aug 2017 | A1 |
20170299721 | Eichenholz et al. | Oct 2017 | A1 |
20170307738 | Schwarz et al. | Oct 2017 | A1 |
20170365105 | Rao et al. | Dec 2017 | A1 |
20180040171 | Kundu et al. | Feb 2018 | A1 |
20180050704 | Tascione et al. | Feb 2018 | A1 |
20180069367 | Villeneuve et al. | Mar 2018 | A1 |
20180152691 | Pacala et al. | May 2018 | A1 |
20180158471 | Vaughn et al. | Jun 2018 | A1 |
20180164439 | Droz et al. | Jun 2018 | A1 |
20180156896 | O'Keeffe | Jul 2018 | A1 |
20180188355 | Bao et al. | Jul 2018 | A1 |
20180188357 | Li et al. | Jul 2018 | A1 |
20180188358 | Li et al. | Jul 2018 | A1 |
20180188371 | Bao et al. | Jul 2018 | A1 |
20180210084 | Zwölfer et al. | Jul 2018 | A1 |
20180275274 | Bao et al. | Sep 2018 | A1 |
20180284241 | Campbell et al. | Oct 2018 | A1 |
20180284242 | Campbell | Oct 2018 | A1 |
20180284286 | Eichenholz et al. | Oct 2018 | A1 |
20180329060 | Pacala et al. | Nov 2018 | A1 |
20180359460 | Pacala et al. | Dec 2018 | A1 |
20190025428 | Li et al. | Jan 2019 | A1 |
20190107607 | Danziger | Apr 2019 | A1 |
20190107623 | Campbell et al. | Apr 2019 | A1 |
20190120942 | Zhang et al. | Apr 2019 | A1 |
20190120962 | Gimpel et al. | Apr 2019 | A1 |
20190154804 | Eichenholz | May 2019 | A1 |
20190154807 | Steinkogler et al. | May 2019 | A1 |
20190212416 | Li et al. | Jul 2019 | A1 |
20190250254 | Campbell et al. | Aug 2019 | A1 |
20190257924 | Li et al. | Aug 2019 | A1 |
20190265334 | Zhang et al. | Aug 2019 | A1 |
20190265336 | Zhang et al. | Aug 2019 | A1 |
20190265337 | Zhang et al. | Aug 2019 | A1 |
20190265339 | Zhang et al. | Aug 2019 | A1 |
20190277952 | Beuschel et al. | Sep 2019 | A1 |
20190310368 | LaChapelle | Oct 2019 | A1 |
20190369215 | Wang et al. | Dec 2019 | A1 |
20190369258 | Hall et al. | Dec 2019 | A1 |
20190383915 | Li et al. | Dec 2019 | A1 |
20200142070 | Hall et al. | May 2020 | A1 |
20200256964 | Campbell et al. | Aug 2020 | A1 |
20200284906 | Eichenholz et al. | Sep 2020 | A1 |
20200319310 | Hall et al. | Oct 2020 | A1 |
20200400798 | Rezk et al. | Dec 2020 | A1 |
20210088630 | Zhang | Mar 2021 | A9 |
Number | Date | Country |
---|---|---|
1677050 | Oct 2005 | CN |
103116164 | May 2013 | CN |
204758260 | Nov 2015 | CN |
204885804 | Dec 2015 | CN |
105911559 | Aug 2016 | CN |
105954732 | Sep 2016 | CN |
106199562 | Dec 2016 | CN |
108132472 | Jun 2018 | CN |
207457508 | Jun 2018 | CN |
207557465 | Jun 2018 | CN |
208314210 | Jan 2019 | CN |
208421228 | Jan 2019 | CN |
208705506 | Apr 2019 | CN |
106597471 | May 2019 | CN |
209280923 | Aug 2019 | CN |
108445468 | Nov 2019 | CN |
110031823 | Mar 2020 | CN |
108089201 | Apr 2020 | CN |
109116331 | Apr 2020 | CN |
109917408 8 | Apr 2020 | CN |
109116366 | May 2020 | CN |
109116367 | May 2020 | CN |
110031822 | May 2020 | CN |
211655309 | Oct 2020 | CN |
109188397 | Nov 2020 | CN |
109814086 | Nov 2020 | CN |
109917348 | Nov 2020 | CN |
110492856 | Nov 2020 | CN |
110736975 | Nov 2020 | CN |
109725320 | Dec 2020 | CN |
110780284 | Dec 2020 | CN |
110780283 | Jan 2021 | CN |
110784220 | Feb 2021 | CN |
212623082 | Feb 2021 | CN |
110492349 | Mar 2021 | CN |
109950784 | May 2021 | CN |
213182011 | May 2021 | CN |
213750313 | Jul 2021 | CN |
214151038 | Sep 2021 | CN |
109814082 | Oct 2021 | CN |
113491043 | Oct 2021 | CN |
214795200 | Nov 2021 | CN |
214795206 | Nov 2021 | CN |
214895784 | Nov 2021 | CN |
214895810 | Nov 2021 | CN |
215641806 | Jan 2022 | CN |
112639527 | Feb 2022 | CN |
215932142 | Mar 2022 | CN |
112578396 | Apr 2022 | CN |
1085346 | Mar 2002 | EP |
0 757 257 | May 2002 | EP |
1 237 305 | Sep 2002 | EP |
1 923 721 | May 2008 | EP |
2 157 445 | Feb 2010 | EP |
2 395 368 | Dec 2011 | EP |
2 889 642 | Jul 2015 | EP |
1 427 164 | Mar 1976 | GB |
2000411 | Jan 1979 | GB |
2000137076 | May 2000 | JP |
2003-167281 | Jun 2003 | JP |
2006-322759 | Nov 2006 | JP |
2006308482 | Nov 2006 | JP |
2007144667 | Jun 2007 | JP |
2008-107286 | May 2008 | JP |
2009-156666 | Jul 2009 | JP |
2010-45965 | Feb 2010 | JP |
2010035385 | Feb 2010 | JP |
2016014665 | Jan 2016 | JP |
2016-206610 | Dec 2016 | JP |
2017-003347 | Jan 2017 | JP |
2017-138301 | Aug 2017 | JP |
10-2012-0013515 | Feb 2012 | KR |
10-2013-0068224 | Jun 2013 | KR |
10-2018-0107673 | Oct 2018 | KR |
2017110417 | Jun 2017 | WO |
2018125725 | Jul 2018 | WO |
2018129410 | Jul 2018 | WO |
2018129408 | Jul 2018 | WO |
2018129409 | Jul 2018 | WO |
2018129410 | Jul 2018 | WO |
2018175990 | Sep 2018 | WO |
2018182812 | Oct 2018 | WO |
2019079642 | Apr 2019 | WO |
2019165095 | Aug 2019 | WO |
2019165289 | Aug 2019 | WO |
2019165294 | Aug 2019 | WO |
2020013890 | Jan 2020 | WO |
Entry |
---|
Office Action issued in Chinese Application No. 201880015869.X dated Oct. 10, 2022, 18 pages. |
Office Action issued in Japanese Patent Application No. 2019-536968 dated Nov. 9, 2021, 7 pages. |
Office Action issued in European Application No. 18 736 738.8 dated Jul. 5, 2022, 6 pages. |
“Mirrors”, Physics LibreTexts, https://phys.libretexts.org/Bookshelves/Optics/Supplemental_Modules_(Components)/Mirrors, (2021), 2 pages. |
“Why Wavelengths Matter in Fiber Optics”, FirstLight, https://www.firstlight.net/why-wavelengths-matter-in-fiber-optics/, (2021), 5 pages. |
Chen, X, et al. (Feb. 2010). “Polarization Coupling of Light and Optoelectronics Devices Based on Periodically Poled Lithium Niobate,” Shanghai Jiao Tong University, China, Frontiers in Guided Wave Optics and Optoelectronics, 24 pages. |
Goldstein, R. (Apr. 1986) “Electro-Optic Devices in Review, The Linear Electro-Optic (Pockels) Effect Forms the Basis for a Family of Active Devices,” Laser & Applications, FastPulse Technology, Inc., 6 pages. |
International Preliminary Report on Patentability, dated Jul. 9, 2019, for International Application No. PCT/US2018/012703, 10 pages. |
International Preliminary Report on Patentability, dated Jul. 9, 2019, for International Application No. PCT/US2018/012704, 7 pages. |
International Preliminary Report on Patentability, dated Jul. 9, 2019, for International Application No. PCT/US2018/012705, 7 pages. |
International Search Report and Written Opinion, dated Jan. 17, 2020, for International Application No. PCT/US2019/019276, 14 pages. |
International Search Report and Written Opinion, dated Jul. 9, 2019, for International Application No. PCT/US2019/018987, 17 pages. |
International Search Report and Written Opinion, dated Sep. 18, 2018, for International Application No. PCT/US2018/012116, 12 pages. |
International Search Report and Written Opinion, dated May 3, 2019, for International Application No. PCT/US2019/019272, 16 pages. |
International Search Report and Written Opinion, dated May 6, 2019, for International Application No. PCT/US2019/019264, 15 pages. |
International Search Report and Written Opinion, dated Jan. 3, 2019, for International Application No. PCT/US2018/056577, 15 pages. |
International Search Report and Written Opinion, dated Mar. 23, 2018, for International Application No. PCT/US2018/012704, 12 pages. |
International Search Report and Written Opinion, dated Jun. 7, 2018, for International Application No. PCT/US2018/024185, 9 pages. |
International Preliminary Report on Patentability, dated Apr. 30, 2020, for International Application No. PCT/US2018/056577, 8 pages. |
European Search Report, dated Jul. 17, 2020, for EP Application No. 18776977.3, 12 pages. |
Extended European Search Report, dated Jul. 10, 2020, for EP Application No. 18736738.8, 9 pages. |
Gunzung, Kim, et al. (Mar. 2, 2016). “A hybrid 3D LIDAR imager based on pixel-by-pixel scanning and DS-OCDMA,” pages Proceedings of SPIE [Proceedings of SPIE ISSN 0277-786X vol. 10524], SPIE, US, vol. 9751, pp. 975119-975119-8. |
Extended European Search Report, dated Jul. 22, 2020, for EP Application No. 18736685.1, 10 pages. |
Gluckman, J. (May 13, 2016). “Design of the processing chain for a high-altitude, airbome, single-photon lidar mapping instrument,” Proceedings of SPIE; [Proceedings of SPIE ISSN 0277-786X vol. 10524], SPIE, US, vol. 9832, 9 pages. |
Office Action Issued in Japanese Patent Application No. 2019-536019 dated Nov. 30, 2021, 6 pages. |
European Search Report, dated Jun. 17, 2021, for EP Application No. 18868896.4, 7 pages. |
“Fiber laser,” Wikipedia, https://en.wikipedia.org/wiki/Fiber_laser, 6 pages. |
International Search Report and Written Opinion, dated Mar. 19, 2018, for International Application No. PCT/US2018/012705, 12 pages. |
International Search Report and Written Opinion, dated Mar. 20, 2018, for International Application No. PCT/US2018/012703, 13 pages. |
Office Action issued in Chinese Application No. 201880015869.X dated Apr. 12, 2023, 17 pages. |
Office Action issued in Korean Patent Application No. 10-2019-7022584 dated Dec. 14, 2022, 20 pages. |
Notice of Allowance issued in Korean Patent Application No. 10-2018-7022584 dated Jun. 21, 2023, 10 pages. |
Office Action Issued in Japanese Patent Application No. 2022-179273 dated Oct. 24, 2023, 9 pages. |
Office Action issued in European Application No. 18736738.8 dated Nov. 9, 2023, 6 pages. |
Number | Date | Country | |
---|---|---|---|
20210231784 A1 | Jul 2021 | US |
Number | Date | Country | |
---|---|---|---|
62442758 | Jan 2017 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 15863695 | Jan 2018 | US |
Child | 17210173 | US |