The invention relates to imaging systems. In particular, the invention relates to data refinement in imaging systems.
LIDAR systems output a system output signal that is reflected by objects located outside of the LIDAR system. The reflected light returns to the LIDAR system as a system return signal. The LIDAR system combines light from the system return system with a reference signal from a local oscillator to generate a beating signal. The LIDAR system includes electronics that use the beat frequency of the beating signal to determine LIDAR data (radial velocity and/or distance between the LIDAR system and the objects) for sample regions that are illuminated by the system output signal.
Identifying the value of the beat frequency for a real beat signal can be difficult as there is often more than one possible solution for the beat frequency. This ambiguity is often avoided by converting the beating signal from a real form to a complex form that combines an in-phase representation of the beating signal with its quadrature signal. Since the beating signal is represented by two different signals, multiple Analog-to-Digital Converters (ADCs) are often needed for processing of these complex signals. However, Analog-to-Digital Converters (ADCs) are expensive and add complexity to the LIDAR system. As a result, there is a need for LIDAR systems with reduced costs and complexity.
Operating a LIDAR system includes transmitting a system output signal from the LIDAR system such that a sample region is illuminated by the system output signal. Different portions of the system output signal are transmitted during different data periods. Light that returns to the LIDAR system from the system output signal is combined with light from a reference signal so as to generate beating signals that are each associated with a different one of the data periods. A set of multiple candidate frequencies is generated for each of the data periods. Each of the candidate frequencies for a data period represents a possible beat frequency for the beating signal associated with the data period. The candidate frequencies for a subject one of the data periods are used to identify which of the candidate frequencies for a subject one of the data periods is the beat frequency for the beating signal associated with the subject data period.
Operating a LIDAR system includes transmitting from the LIDAR system a system output signal such that a sample region is illuminated by the system output signal. A subject portion of the system output signal is transmitted during a subject data period. A check portion of the system output signal is transmitted during a check data period. The frequency of the system output signal changes at different rates during the subject data period and the check data period. Light that returns to the LIDAR system from the subject portion of the system output signal is combined with light from a subject reference signal so as to generate a subject beating signal beating at a subject beat frequency. Light that returns to the LIDAR system from the check portion of the system output signal is combined with light from a check reference signal so as to generate a check beating signal beating at a check beat frequency. Multiple subject candidate frequencies are identified and include a subject target frequency at the subject beat frequency and a subject image frequency at the additive inverse of the subject beat frequency. Multiple check candidate frequencies are identified and include a check target frequency at the check beat frequency and a check image frequency at the additive inverse of the check beat frequency. The check candidate frequencies are used to identify which one of the subject candidate frequencies is the subject target frequency.
A LIDAR system is configured to transmit a system output signal such that a sample region is illuminated by the system output signal. A subject portion of the system output signal is transmitted during a subject data period. A check portion of the system output signal is transmitted during a check data period. The frequency of the system output signal changes at different rates during the subject data period and the check data period. The LIDAR system includes a light combiner that combines light that returns to the LIDAR system from the subject portion of the system output signal with light from a subject reference signal so as to generate a subject beating signal beating at a subject beat frequency. The light combiner combines light that returns to the LIDAR system from the check portion of the system output signal with light from a check reference signal so as to generate a check beating signal beating at a check beat frequency. The LIDAR system includes electronics that identify multiple subject candidate frequencies and multiple check candidate frequencies. The multiple subject candidate frequencies include a subject target frequency at the subject beat frequency and a subject image frequency at the additive inverse of the subject beat frequency. The multiple check candidate frequencies include a check target frequency at the check beat frequency and a check image frequency at the additive inverse of the check beat frequency. The electronics are configured to use the check candidate frequencies to identify which one of the subject candidate frequencies is the subject target frequency.
Operating a system includes transmitting from a LIDAR system a system output signal such that a sample region is illuminated by the system output signal. Multiple different candidate LIDAR data results are calculated for the sample region. Each of the different candidate LIDAR data results is a candidate for the radial velocity and/or the distance between the LIDAR system and an object in the sample region. The candidate LIDAR data result that represents the valid LIDAR data for the sample region is identified.
Operating a LIDAR system includes transmitting from the LIDAR system a system output signal such that a sample region is illuminated by the system output signal. A first subject portion of the system output signal is transmitted during a first subject data period. A second subject portion of the system output signal is transmitted during a second subject data period. A check portion of the system output signal is transmitted during a check data period. A frequency of the system output signal changes at different rates during the first subject data period and the second subject data period. Light that returns to the LIDAR system from the first subject portion of the system output signal is combined with light from a first reference signal so as to generate a first subject beating signal beating at a first subject beat frequency. Light that returns to the LIDAR system from the second portion of the system output signal is combined with light from a second reference signal so as to generate a second subject beating signal beating at a second subject beat frequency. Light that returns to the LIDAR system from the check portion of the system output signal is combined with light from a check reference signal so as to generate a check beating signal beating at a check beat frequency. Multiple first subject candidate frequencies are identified. The first subject candidate frequencies include a first subject target frequency at the first subject beat frequency and a first image frequency at the additive inverse of the first subject beat frequency. Multiple second subject candidate frequencies are identified. The second subject candidate frequencies include a second target frequency at the second subject beat frequency and a second image frequency at the additive inverse of the second beat frequency. Multiple check candidate frequencies are identified. The check candidate frequencies include a check target frequency at the check beat frequency and a check image frequency at the additive inverse of the check beat frequency. Multiple candidate frequency pairs are identified. Each candidate frequency pair includes one of the first subject candidate frequencies paired with one of the second subject candidate frequencies. Candidate LIDAR data results are calculated for each one of the candidate frequency pairs. The candidate LIDAR data result for each of the candidate frequency pairs is calculated from the first subject target frequency and the second subject target frequency in the candidate frequency pair. The candidate LIDAR data result for each of the candidate frequency pairs is a candidate for a radial velocity and/or a distance between the LIDAR system and an object in the sample region. The candidate LIDAR data results that were calculated from the first target frequency and the second target frequency are identified.
A system includes a LIDAR system configured to transmit a system output signal such that a sample region is illuminated by the system output signal. A first subject portion of the system output signal is transmitted during a first subject one of the data periods. A second subject portion of the system output signal is transmitted during a second subject one of the data periods. A check portion of the system output signal is transmitted during a check one of the data periods. The frequency of the system output signal changes at different rates during the first subject data period and the second subject data period. A light signal combiner a light signal combiner combines light that returns to the LIDAR system from the first subject portion of the system output signal with light from a first subject portion of a reference signal so as to generate a first subject beating signal beating at a first subject beat frequency. The light signal combiner also combines light that returns to the LIDAR system from the second subject portion of the system output signal with light from a second subject portion of the reference signal so as to generate a second subject beating signal beating at a second subject beat frequency. The light signal combiner also combines light that returns to the LIDAR system from the check portion of the system output signal with light from a check portion of the reference signal so as to generate a check beating signal beating at a check beat frequency. Electronics identify multiple first candidate frequencies, multiple second candidate frequencies, and multiple check candidate frequencies. The first candidate frequencies include a first target frequency at the first subject beat frequency and a first image frequency at the additive inverse of the first subject beat frequency. The second candidate frequencies include a second target frequency at the second beat frequency and a second image frequency at the additive inverse of the second beat frequency. The third candidate frequencies include a third target frequency at the third beat frequency and a third image frequency at the additive inverse of the third beat frequency. The electronics identify multiple candidate frequency pairs and calculate candidate LIDAR data results from each one of the candidate frequency pairs. Each candidate frequency pair includes one of the first candidate frequencies paired with one of the second candidate frequencies. The candidate LIDAR data result for each of the candidate frequency pairs is a candidate for a radial velocity and/or a distance between the LIDAR system and an object in the sample region. The electronics identify which one of the candidate LIDAR data results was calculated from the first target frequency and the second target frequency. The identified candidate LIDAR data results can serve as valid LIDAR data for the sample region.
The LIDAR system transmits a system output signal from the LIDAR system such that a sample region is illuminated by the system output signal. Different portions of the system output signal are transmitted during different data periods. Light that returns to the LIDAR system from the system output signal is combined with light from a reference signal so as to generate beating signals that are each associated with a different one of the data periods. A set of multiple candidate frequencies is calculated for each of the data periods. Each of the candidate frequencies for a data period represents a possible beat frequency for the beating signal associated with that data period. The candidate frequencies for a check one of the data periods are used to identify which of the candidate frequencies for a subject one of the data periods is the correct beat frequency for the beating signal associated with the subject data period. The LIDAR data for the sample region is calculated from the candidate frequency that is identified as the correct beat frequency for the beating signal.
The presence of multiple frequencies that are each a candidate for the actual beat frequency can be a result of processing a real form of the beating signal rather than a complex form of the beating signal. Since the real form of the beating signal excludes the quadrature component for the beating signal, a single Analog-to-Digital Converter (ADC) can replace the multiple Analog-to-Digital Converters that are needed to process complex representations of the beating signal. As a result, the costs and complexity of the LIDAR system are reduced.
The LIDAR chip includes a utility waveguide 12 that receives an outgoing LIDAR signal from a light source 4. The utility waveguide 12 terminates at a facet 14 and carries the outgoing LIDAR signal to the facet 14. The facet 14 can be positioned such that the outgoing LIDAR signal traveling through the facet 14 exits the LIDAR chip and serves as a LIDAR output signal. For instance, the facet 14 can be positioned at an edge of the chip so the outgoing LIDAR signal traveling through the facet 14 exits the chip and serves as the LIDAR output signal. In some instances, the portion of the LIDAR output signal that has exited from the LIDAR chip can also be considered a system output signal. As an example, when the exit of the LIDAR output signal from the LIDAR chip is also an exit of the LIDAR output signal from the LIDAR system, the LIDAR output signal can also be considered a system output signal.
The LIDAR output signal travels away from the LIDAR system through free space in the atmosphere in which the LIDAR system is positioned. The LIDAR output signal may be reflected by one or more objects in the path of the LIDAR output signal. When the LIDAR output signal is reflected, at least a portion of the reflected light travels back toward the LIDAR chip as a LIDAR input signal. In some instances, the LIDAR input signal can also be considered a system return signal. As an example, when the exit of the LIDAR output signal from the LIDAR chip is also an exit of the LIDAR output signal from the LIDAR system, the LIDAR input signal can also be considered a system return signal.
The LIDAR input signals can enter the utility waveguide 12 through the facet 14. The portion of the LIDAR input signal that enters the utility waveguide 12 serves as an incoming LIDAR signal. The utility waveguide 12 carries the incoming LIDAR signal to a splitter 16 that moves a portion of the outgoing LIDAR signal from the utility waveguide 12 onto a comparative waveguide 18 as a comparative signal. The comparative waveguide 18 carries the comparative signal to a processing component 22 for further processing. Although
The utility waveguide 12 also carrier the outgoing LIDAR signal to the splitter 16. The splitter 16 moves a portion of the outgoing LIDAR signal from the utility waveguide 12 onto a reference waveguide 20 as a reference signal. The reference waveguide 20 carries the reference signal to the processing component 22 for further processing.
The percentage of light transferred from the utility waveguide 12 by the splitter 16 can be fixed or substantially fixed. For instance, the splitter 16 can be configured such that the power of the reference signal transferred to the reference waveguide 20 is an outgoing percentage of the power of the outgoing LIDAR signal or such that the power of the comparative signal transferred to the comparative waveguide 18 is an incoming percentage of the power of the incoming LIDAR signal. In many splitters 16, such as directional couplers and multimode interferometers (MMIs), the outgoing percentage is equal or substantially equal to the incoming percentage. In some instances, the outgoing percentage is greater than 30%, 40%, or 49% and/or less than 51%, 60%, or 70% and/or the incoming percentage is greater than 30%, 40%, or 49% and/or less than 51%, 60%, or 70%. A splitter 16 such as a multimode interferometer (MMI) generally provides an outgoing percentage and an incoming percentage of 50% or about 50%. However, multimode interferometers (MMIs) can be easier to fabricate in platforms such as silicon-on-insulator platforms than some alternatives. In one example, the splitter 16 is a multimode interferometer (MMI) and the outgoing percentage and the incoming percentage are 50% or substantially 50%. As will be described in more detail below, the processing component 22 combines the comparative signal with the reference signal to form a composite signal that carries LIDAR data for a sample region on the field of view. Accordingly, the composite signal can be processed so as to extract LIDAR data (radial velocity and/or distance between a LIDAR system and an object external to the LIDAR system) for the sample region.
The LIDAR chip can include a control branch for controlling operation of the light source 4. The control branch includes a splitter 26 that moves a portion of the outgoing LIDAR signal from the utility waveguide 12 onto a control waveguide 28. The coupled portion of the outgoing LIDAR signal serves as a tapped signal. Although
The control waveguide 28 carries the tapped signal to control components 30. The control components can be in electrical communication with electronics 32. All or a portion of the control components can be included in the electronics 32. During operation, the electronics can employ output from the control components 30 in a control loop configured to control a process variable of one, two, or three loop controlled light signals selected from the group consisting of the tapped signal, the system output signal, and the outgoing LIDAR signal. Examples of the suitable process variables include the frequency of the loop controlled light signal and/or the phase of the loop controlled light signal.
The LIDAR system can be modified so the incoming LIDAR signal and the outgoing LIDAR signal can be carried on different waveguides. For instance,
The LIDAR chips can be modified to receive multiple LIDAR input signals. For instance,
The outgoing LIDAR signal exits the LIDAR chip through the facet 14 and serves as the LIDAR output signal. When light from the LIDAR output signal is reflected by one or more object located external to the LIDAR system, at least a portion of the reflected light returns to the LIDAR chip as a first LIDAR input signal. The first LIDAR input signals enters the comparative waveguide 18 through the facet 35 and serves as a first comparative signal. The comparative waveguide 18 carries the first comparative signal to a first processing component 46 for further processing.
Additionally, when light from the LIDAR output signal is reflected by one or more object located external to the LIDAR system, at least a portion of the reflected signal returns to the LIDAR chip as a second LIDAR input signal. The second LIDAR input signals enters a second comparative waveguide 50 through a facet 52 and serves as a second comparative signal carried by the second comparative waveguide 50. The second comparative waveguide 50 carries the second comparative signal to a second processing component 48 for further processing.
Although the light source 4 is shown as being positioned on the LIDAR chip, the light source 4 can be located off the LIDAR chip. For instance, the utility waveguide 12 can terminate at a second facet through which the outgoing LIDAR signal can enter the utility waveguide 12 from a light source 4 located off the LIDAR chip.
In some instances, a LIDAR chip constructed according to
An example of a LIDAR adapter that is suitable for use with the LIDAR chip of
The LIDAR adapter can be configured such that the output of the LIDAR output signal from the second port 106 can also serve as the output of the LIDAR output signal from the LIDAR adapter and accordingly from the LIDAR system. As a result, the LIDAR output signal can be output from the LIDAR adapter such that the LIDAR output signal is traveling toward a sample region in the field of view. Accordingly, in some instances, the portion of the LIDAR output signal that has exited from the LIDAR adapter can also be considered the system output signal. As an example, when the exit of the LIDAR output signal from the LIDAR adapter is also an exit of the LIDAR output signal from the LIDAR system, the LIDAR output signal can also be considered a system output signal.
The LIDAR output signal output from the LIDAR adapter includes, consists of, or consists essentially of light from the LIDAR output signal received from the LIDAR chip. Accordingly, the LIDAR output signal output from the LIDAR adapter may be the same or substantially the same as the LIDAR output signal received from the LIDAR chip. However, there may be differences between the LIDAR output signal output from the LIDAR adapter and the LIDAR output signal received from the LIDAR chip. For instance, the LIDAR output signal can experience optical loss as it travels through the LIDAR adapter and/or the LIDAR adapter can optionally include an amplifier configured to amplify the LIDAR output signal as it travels through the LIDAR adapter.
When one or more objects in the sample region reflect the LIDAR output signal, at least a portion of the reflected light travels back to the circulator 100 as a system return signal. The system return signal enters the circulator 100 through the second port 106.
The system return signal exits the circulator 100 through the third port 108 and is directed to the comparative waveguide 18 on the LIDAR chip. Accordingly, all or a portion of the system return signal can serve as the first LIDAR input signal and the first LIDAR input signal includes or consists of light from the system return signal. Accordingly, the LIDAR output signal and the first LIDAR input signal travel between the LIDAR adapter and the LIDAR chip along different optical paths.
As is evident from
The LIDAR adapter can also include one or more direction changing components such as mirrors.
The LIDAR chips include one or more waveguides that constrains the optical path of one or more light signals. While the LIDAR adapter can include waveguides, the optical path that the system return signal and the LIDAR output signal travel between components on the LIDAR adapter and/or between the LIDAR chip and a component on the LIDAR adapter can be free space. For instance, the system return signal and/or the LIDAR output signal can travel through the atmosphere in which the LIDAR chip, the LIDAR adapter, and/or the base 102 is positioned when traveling between the different components on the LIDAR adapter and/or between a component on the LIDAR adapter and the LIDAR chip. As a result, optical components such as lenses and direction changing components can be employed to control the characteristics of the optical path traveled by the system return signal and the LIDAR output signal on, to, and from the LIDAR adapter.
Suitable bases 102 for the LIDAR adapter include, but are not limited to, substrates, platforms, and plates. Suitable substrates include, but are not limited to, glass, silicon, and ceramics. The components can be discrete components that are attached to the substrate. Suitable techniques for attaching discrete components to the base 102 include, but are not limited to, epoxy, solder, and mechanical clamping. In one example, one or more of the components are integrated components and the remaining components are discrete components. In another example, the LIDAR adapter includes one or more integrated amplifiers and the remaining components are discrete components.
The LIDAR system can be configured to compensate for polarization. Light from a laser source is typically linearly polarized and hence the LIDAR output signal is also typically linearly polarized. Reflection from an object may change the angle of polarization of the returned light. Accordingly, the system return signal can include light of different linear polarization states. For instance, a first portion of a system return signal can include light of a first linear polarization state and a second portion of a system return signal can include light of a second linear polarization state. The intensity of the resulting composite signals is proportional to the square of the cosine of the angle between the comparative and reference signal polarization fields. If the angle is 90 degrees, the LIDAR data can be lost in the resulting composite signal. However, the LIDAR system can be modified to compensate for changes in polarization state of the LIDAR output signal.
The first portion of the system return signal is directed to the comparative waveguide 18 on the LIDAR chip and serves as the first LIDAR input signal described in the context of
The beamsplitter 120 can be a polarizing beam splitter. One example of a polarizing beamsplitter is constructed such that the first portion of the system return signal has a first polarization state but does not have or does not substantially have a second polarization state and the second portion of the system return signal has a second polarization state but does not have or does not substantially have the first polarization state. The first polarization state and the second polarization state can be linear polarization states and the second polarization state is different from the first polarization state. For instance, the first polarization state can be TE and the second polarization state can be TM or the first polarization state can be TM and the second polarization state can be TE. In some instances, the laser source can linearly polarized such that the LIDAR output signal has the first polarization state. Suitable beamsplitters include, but are not limited to, Wollaston prisms, and MEMs-based polarizing beamsplitters.
A polarization rotator can be configured to change the polarization state of the first portion of the system return signal and/or the second portion of the system return signal. For instance, the polarization rotator 122 shown in
Since the first LIDAR input signal and the second LIDAR carry light of the same polarization state, the comparative signals that result from the first LIDAR input signal have the same polarization angle as the comparative signals that result from the second LIDAR input signal.
Suitable polarization rotators include, but are not limited to, rotation of polarization-maintaining fibers, Faraday rotators, half-wave plates, MEMs-based polarization rotators and integrated optical polarization rotators using asymmetric y-branches, Mach-Zehnder interferometers and multi-mode interference couplers.
Since the outgoing LIDAR signal is linearly polarized, the first reference signals can have the same linear polarization state as the second reference signals. Additionally, the components on the LIDAR adapter can be selected such that the first reference signals, the second reference signals, the comparative signals and the second comparative signals each have the same polarization state. In the example disclosed in the context of
As a result of the above configuration, first composite signals generated by the first processing component 46 and second composite signals generated by the second processing component 48 each results from combining a reference signal and a comparative signal of the same polarization state and will accordingly provide the desired beating between the reference signal and the comparative signal. For instance, the composite signal results from combining a first reference signal and a first comparative signal of the first polarization state and excludes or substantially excludes light of the second polarization state or the composite signal results from combining a first reference signal and a first comparative signal of the second polarization state and excludes or substantially excludes light of the first polarization state. Similarly, the second composite signal includes a second reference signal and a second comparative signal of the same polarization state will accordingly provide the desired beating between the reference signal and the comparative signal. For instance, the second composite signal results from combining a second reference signal and a second comparative signal of the first polarization state and excludes or substantially excludes light of the second polarization state or the second composite signal results from combining a second reference signal and a second comparative signal of the second polarization state and excludes or substantially excludes light of the first polarization state.
The above configuration results in the LIDAR data for a single sample region in the field of view being generated from multiple different composite signals (i.e. first composite signals and the second composite signal) from the sample region. In some instances, determining the LIDAR data for the sample region includes the electronics combining the LIDAR data from different composite signals (i.e. the composite signals and the second composite signal). Combining the LIDAR data can include taking an average, median, or mode of the LIDAR data generated from the different composite signals. For instance, the electronics can average the distance between the LIDAR system and the reflecting object determined from the composite signal with the distance determined from the second composite signal and/or the electronics can average the radial velocity between the LIDAR system and the reflecting object determined from the composite signal with the radial velocity determined from the second composite signal.
In some instances, determining the LIDAR data for a sample region includes the electronics identifying one or more composite signals (i.e. the composite signal and/or the second composite signal) as the source of the LIDAR data that is most represents reality (the representative LIDAR data). The electronics can then use the LIDAR data from the identified composite signal as the representative LIDAR data to be used for additional processing. For instance, the electronics can identify the signal (composite signal or the second composite signal) with the larger amplitude as having the representative LIDAR data and can use the LIDAR data from the identified signal for further processing by the LIDAR system. In some instances, the electronics combine identifying the composite signal with the representative LIDAR data with combining LIDAR data from different LIDAR signals. For instance, the electronics can identify each of the composite signals with an amplitude above an amplitude threshold as having representative LIDAR data and when more than two composite signals are identified as having representative LIDAR data, the electronics can combine the LIDAR data from each of identified composite signals. When one composite signal is identified as having representative LIDAR data, the electronics can use the LIDAR data from that composite signal as the representative LIDAR data. When none of the composite signals is identified as having representative LIDAR data, the electronics can discard the LIDAR data for the sample region associated with those composite signals.
Although
The above system configurations result in the first portion of the system return signal and the second portion of the system return signal being directed into different composite signals. As a result, since the first portion of the system return signal and the second portion of the system return signal are each associated with a different polarization state but electronics can process each of the composite signals, the LIDAR system compensates for changes in the polarization state of the LIDAR output signal in response to reflection of the LIDAR output signal.
The LIDAR adapter of
When the LIDAR system includes a LIDAR chip and a LIDAR adapter, the LIDAR chip, electronics, and the LIDAR adapter can be positioned on a common mount. Suitable common mounts include, but are not limited to, glass plates, metal plates, silicon plates and ceramic plates. As an example,
The LIDAR systems can include components including additional passive and/or active optical components. For instance, the LIDAR system can include one or more components that receive the LIDAR output signal from the LIDAR chip or from the LIDAR adapter. The portion of the LIDAR output signal that exits from the one or more components can serve as the system output signal. As an example, the LIDAR system can include one or more beam steering components that receive the LIDAR output signal from the LIDAR chip or from the LIDAR adapter and that output all or a fraction of the LIDAR output signal that serves as the system output signal. For instance,
The electronics can operate the one or more beam steering component 142 so as to steer the system output signal to different sample regions 144. The sample regions can extend away from the LIDAR system to a maximum distance for which the LIDAR system is configured to provide reliable LIDAR data. The sample regions can be stitched together to define the field of view. For instance, the field of view of for the LIDAR system includes or consists of the space occupied by the combination of the sample regions.
The comparative waveguide 196 carries the comparative signal to the light signal combiner 211. The reference waveguide 198 carries the reference signal to the light signal combiner 211. The first light signal combiner 211 combines the comparative signal and the reference signal into a first composite signal. Due to the difference in frequencies between the comparative signal and the reference signal, the first composite signal is beating between the comparative signal and the reference signal.
The first light signal combiner 211 also splits the first composite signal onto a first detector waveguide 221 and a second detector waveguide 222. The first detector waveguide 221 carries a first portion of the first composite signal to a first light sensor 223 that converts the first portion of the second composite signal to a first electrical signal. The second detector waveguide 222 carries a second portion of the second composite signal to a second light sensor 224 that converts the second portion of the second composite signal to a second electrical signal. Examples of suitable light sensors include germanium photodiodes (PDs), and avalanche photodiodes (APDs).
In some instances, the light signal combiner 211 splits the first composite signal such that the portion of the comparative signal included in the first portion of the composite signal is phase shifted by 180° relative to the portion of the comparative signal in the second portion of the composite signal but the portion of the reference signal in the first portion of the composite signal is not phase shifted relative to the portion of the reference signal in the second portion of the composite signal. Alternately, the light signal combiner 211 splits the composite signal such that the portion of the reference signal in the first portion of the composite signal is phase shifted by 180° relative to the portion of the reference signal in the second portion of the composite signal but the portion of the comparative signal in the first portion of the composite signal is not phase shifted relative to the portion of the comparative signal in the second portion of the composite signal.
The first light sensor 223 and the second light sensor 224 can be connected as a balanced detector. For instance,
The electronics connect the first light sensor 223 and the second light sensor 224 as a first balanced detector 225. In particular, the first light sensor 223 and the second light sensor 224 are connected in series. The serial connection in the first balanced detector is in communication with a first data line 228 that carries the output from the first balanced detector as a first data signal. The first data signal is an electrical representation of the first composite signal. Accordingly, the first data signal includes a contribution from a first waveform and a second waveform. The first data signal is beating as a result of the beating between the comparative signal and the reference signal. Other light detectors can be used in place of the balanced detector. For instance, a single photodiode can replace the balanced detector.
The electronics 32 includes a transform mechanism 238 configured to perform a mathematical transform on the first data signal. For instance, the mathematical transform can be a real Fourier transform with the first data signal as a real input. Since the transform operates on a real signal rather than a complex signal, the first data signal can be an electrical in-phase representation of the composite signal and can exclude a quadrature signal.
The transform mechanism 238 includes a first Analog-to-Digital Converter (ADC) 264 that receives the first data signal from the first data line 228. The first Analog-to-Digital Converter (ADC) 264 converts the first data signal from an analog form to a digital form and outputs a first digital data signal. The first digital data signal is a digital representation of the first data signal.
The transform mechanism 238 includes a transform component 268 that receives the first data signal from the first Analog-to-Digital Converter (ADC) 264 as an input. The transform component 268 can be configured to perform a mathematical transform on the first data signal so as to convert from the time domain to the frequency domain. The mathematical transform can be a real transform such as a real Fast Fourier Transform (FFT). A real transform such as a real Fast Fourier Transform (FFT) provides an output with one or more frequency peaks. The electronics use the one or more frequency peaks output from the transform component 268 for further processing to generate the LIDAR data (distance and/or radial velocity between the reflecting object and the LIDAR chip or LIDAR system). The transform component 268 can execute the attributed functions using firmware, hardware or software or a combination thereof.
The electronics 32 includes a peak finder 270 that receives output from the transform component 268. The peak finder 270 is configured to find a peak in the output of the transform component 268 in order to identify the beat frequency of the composite optical signal. In some instances, the peak finder is configured such that the identified peak frequencies each have a magnitude above a threshold selected to reduce noise and/or prevent false peak frequencies. In some instances, the peak finder 270 can store the peak frequencies in a memory 271 for later use by a LIDAR data generator 274. The LIDAR data generator 274 uses the peak frequencies to generate the LIDAR data (distance and/or radial velocity between the reflecting object and the LIDAR chip or LIDAR system). Suitable memories 271 include, but are not limited to, buffers. The peak finder 270 can execute the attributed functions using firmware, hardware or software or a combination thereof.
The electronics tune the frequency of the system output signal over time. The system output signal has a frequency versus time pattern with a repeated cycle.
Each cycle includes M data periods that are each associated with a period index m and are labeled DPm. Suitable values for M include M≥2. In the example of
During the data period DPm, the electronics can operate the light source such that the frequency of the system output signal changes linearly as a function of time. For instance, during data period DPm, the frequency of the system output signal can change at a constant or substantially constant rate αm (the chirp rate). The chirp rate can continue for all or a portion of the duration of the data period. For instance, during the data periods labeled DP1 the electronics operate the light source such that the frequency of the system output signal changes at a linear rate α1, during the data periods labeled DP2 the electronics operate the light source such that the frequency of the system output signal changes at a linear rate α2 and during the data periods labeled DP3 the electronics operate the light source such that the frequency of the system output signal changes at a linear rate α3.
The data periods associated with a sample region include multiple subject data periods and at least one check data period. In
Different portions of the system output signal are transmitted from the LIDAR system during different data periods. For instance, a first subject portion of the system output signal can be transmitted during a first subject data period (m=1 in the example of
Although
The frequency of the system output signal can increase during one of the subject data periods associated with a sample region as is evident from the data period DP1 of
Each object illuminated by a system output signal results in a set of frequency peaks in the frequency spectrum. For instance, a composite signal can result in a real Fourier transform outputting multiple different peak frequencies that are each separated from the DC frequency by the same amount. As an example,
In circumstances where multiple different objects are present in a sample region, the peak finder can output multiple sets of frequency peaks that are each associated with a different one of the objects. As a result, the frequency spectrum can include multiple target beat frequencies and multiple image beat frequencies. Each of the peak frequencies output from the peak finder can be a candidate for one of the target beat frequencies. The candidate frequencies can be represented by fm,n where m represents a period index and n represents the index of the frequency peak within data period m. As an example,
As is evident from the period index m in the candidate frequencies (fm,n), when one of more objects is present in the sample region illuminated during data period m, each of the data periods is associated with a set of candidate frequencies that include at least one target beat frequency and at least one image beat frequency. For instance, when the system output signal has a frequency versus time pattern according to
The number of candidate frequencies that occur in data period m (i.e. fm,1, fm,2, and fm,3, and fm,4 in
The beat frequencies from two or more different data periods that are associated with the same sample region can be combined to generate the LIDAR data for that sample region. For instance, the beat frequency determined from DP1 during the illumination of sample region SRk can be combined with the beat frequency determined from DP2 during the illumination of sample region SRk to determine the LIDAR data for sample region SRk. As an example, the beat frequency during data period DPm can be written as the following Equation 1: fm=2αmR/c−2v/λ where m is period index, R represents the distance between the LIDAR system and the object, c represents the speed of light, ν represents the radial velocity between the reflecting object and the LIDAR system, λ represents the wavelength of the system output signal, and the direction from the reflecting object toward the LIDAR system is assumed to be the positive direction.
In the above Equation 1 (fm=2αmR/c−2v/λ), the values of v and R are unknown. As a result, the results of Equation 1 from two different data periods associated with the sample region can be used to calculate the values of v and R for the sample region. Solving these equations for the distance between the LIDAR system and the object (R) provides Equation 2: R=c(fub−fdb)/(2(αub−Cdb)). Additionally, solving these equations for the radial velocity between the reflecting object and the LIDAR system (v) provides Equation 3:
As shown in
The electronics can include a LIDAR data validator 276 that receives the candidate LIDAR data from the LIDAR data generator 274. The LIDAR data validator 276 can also receive peak frequencies such as check period peak frequencies (fchk,n) from the memory 271 and/or peak finder 270. When the system output signal has a frequency versus time pattern according to
The LIDAR data validator 276 can use the check data period associated with a sample region to identify which of the candidate LIDAR data values associated with that sample region are correct. For instance, the LIDAR data validator 276 can calculate a comparative check period beat frequencies (cfchk,i′) for each candidate frequency pair from the candidate LIDAR data associated with the candidate frequency pair Pi′. A comparative check period beat frequency (cfchk) can be determined by substituting the rate of frequency change during the check data period αchk into Equation 1 to provide Equation 4: cfchk=2αchkR/c−2v/λ. When the system output signal has a frequency versus time pattern according to
The LIDAR data validator 276 can use the comparative check period beat frequency for the candidate frequency pairs (cfchk,i′) to identify the No valid candidate frequency pairs (the valid frequency pair(s)) and accordingly, the LIDAR data for the one or more valid frequency pairs. For instance, the LIDAR data validator 276 can apply one or more check criteria to each candidate frequency pair Pi′. As an example, the LIDAR data validator 276 can compare the values of the 2No check period beat frequencies (fchk,n) and the comparative check period beat frequencies (cfchk,i′) from the same sample region so as to identify matching values. As a more specific example, in some instances, the matches are identified by comparing the value of each of the check period beat frequencies (fchk,n) for calculated for a sample region to the value of one of the comparative check period beat frequencies (cfchk,i′) calculated for the region where one of the comparisons is made for each of the comparative check period beat frequencies (cfchk,i′) calculated for the sample region. For instance, the LIDAR data validator 276 can subtract each of the check data period (fchk,n) values from each of the comparative check period beat frequencies (cfchk,i′) to generate match indicators. The number of match indicators can be equal to 2No*(2(No))2. The LIDAR data validator 276 can identify the No match indicators with the smallest absolute values. As an example, the LIDAR data validator 276 can calculate a value for match indicator Xi′n=|cfchk,i′−fchk,n| for all values of i′ from 1 to (2(No))2 and all values of n from 1 to 2No. The LIDAR data validator 276 can identify No of the Xi′,n results with the smallest values as the matching values. Matching values indicate a match between the beat frequency that is estimated for a check data period from the data for a candidate pair (cfchk,i′) and one of the actually measured beat frequencies (fchk,n). Each of the values of i′ for the No identified match indicators indicates the candidate frequency pairs Pi′ that is associated with one of the objects in the sample region. For instance, when LIDAR data validator 276 identifies the match indicators X5,3 and X9,1, the candidate frequency pairs associated with i′=5 and i′=9 are identified as a valid frequency pair for the sample region m, i.e. P5=(fm,n, fm,n) and P9=(fm,n, fm,n). Accordingly, the peak frequencies in each of the identified candidate pairs Pi′ are identified as representing valid beat frequencies that occurring during the subject data periods and as being produced by the same object in the sample region. For instance, if the candidate frequency pair P5=(f1,1, f2,4) is identified, the peak frequencies f1,1 and f2,4 are identified as representing the actual beat frequencies that occur during the subject data periods m=1 and m=2 and resulting from reflection of the system output signal by the same object in the sample region. Similarly, the candidate LIDAR data associated with the identified i′ values is also assigned to serve as the LIDAR data for sample region m. For instance, the sample region is treated as containing an object at distance R5 with radial velocity vs and an object at distance R9 with radial velocity v9. The LIDAR data validator 276 can discard frequency pairs having pair indices (i′) that are associated with the match indicators that are not identified by the LIDAR data validator 276. Similarly, the LIDAR data validator 276 can discard LIDAR data (Ri′ and/or vi′) associated with the match indicators that are not identified by the LIDAR data validator 276. The LIDAR data validator 276 can execute the attributed functions using firmware, hardware or software or a combination thereof.
The comparative check period beat frequencies (cfchk,i′) are each an approximation of the value of one of the check period beat frequencies (fchk,n) but rather than being a function of the value of the beat frequency in the check period, the comparative check period beat frequencies (cfchk,i′) are a function of the beat frequencies from multiple different subject data periods. The comparative beat frequency for each candidate frequency pair represents a value that the beat frequency associated with the check data period would have if the first subject beat frequency were equal to the candidate frequency from the first subject data period in the candidate frequency pair and the second subject beat frequency were equal to the candidate frequency from the second subject data period in the candidate frequency pair. The comparative check period beat frequencies (cfchk,i′) are each calculated from the beat frequencies in multiple different subject data periods. For instance, in the above examples, the comparative check period beat frequencies (cfchk,i′) are calculated from the beat frequencies during an increasing subject data period and a decreasing subject data period. As a result, the comparative check period beat frequencies (cfchk,i′) are a function of the distance (R) and radial velocity (v) values during data periods other than the check data period. In contrast, the check period beat frequencies (fchk,n) are a function of the distance (R) and radial velocity (v) values during the check data period. Accordingly, the values of each check period beat frequency (fchk,n) matches the value of one of the comparative check period beat frequencies (cfchk,i′) when the distance (R) and radial velocity (v) values match during both the check data period and the associated subject data periods. For instance, the values of each check period beat frequency (fchk,n) matches the value of one of the comparative check period beat frequencies (cfchk,i′) when the distance (R) and radial velocity (v) remain constant or substantially constant during the check data period, the associated increasing data period, and the associated decreasing data period. The comparative check period beat frequencies (cfchk,i) that do not result in matches and the associated candidate LIDAR data are discarded.
At process block 312, the LIDAR data generator can identify a set of candidate frequencies (fm,n). A set of candidate frequencies (fm,n) can be determined for each data period associated with the sample region SRk. For instance, if the system output signal has a frequency versus time pattern according to
In order to find a set of candidate frequencies (fm,n), a peak finder 270 can search the whole frequency spectrum for frequency peaks. Alternately, the peak finder 270 can search the positive side of the frequency spectrum (>DC) or the negative side of the frequency spectrum. When the peak finder 270 searches the positive side of the frequency spectrum (>DC) or the negative side of the frequency spectrum, the peak finder identifies No frequencies but does not identify the corresponding frequencies. As a result, the LIDAR data generator 274 can receive only a portion of the candidate frequencies (fm,n) for the sample region SRk. When the LIDAR data generator 274 receives only a portion of the candidate frequencies (fm,n) for the sample region SRk, the LIDAR data generator 274 can add the corresponding frequencies to the received candidate frequencies (fm,n) to identify the full set of candidate frequencies (fm,n) for the sample region SRk. When the peak finder 270 searches the whole frequency spectrum for frequency peaks, the received candidate frequencies (fm,n) can serve as the full set of candidate frequencies (fm,n) for the sample region SRk.
At process block 314, the LIDAR data generator 274 can identify the candidate frequency pairs from the candidate frequencies identified at process block 312.
At process block 316, the LIDAR data generator 274 can calculate a comparative check period beat frequency for each of the candidate frequency pairs. In some instances, the LIDAR data generator 274 also calculates the candidate LIDAR data for each of the candidate frequency pairs. For instance, the LIDAR data generator 274 can use Equation 2 and/or Equation 3 to calculate a candidate distance (Ri′) and/or a candidate radial velocity (vi′). The candidate distance and/or candidate radial velocity (Ri′ and/or vi′) are calculated for each of the candidate frequency pairs Pi′. When the LIDAR data generator 274 calculates a candidate distance and/or a candidate radial velocity (Ri′ and/or vi′) for each of the candidate frequency pairs Pi′, the comparative check period beat frequency for each of the candidate frequency pairs Pi′(cfchk,i′) can be calculated from Equation 5. When the LIDAR data generator 274 does not calculate a candidate distance and candidate radial velocity (Ri′ and/or vi′) for each of the candidate frequency pairs Pi′, the comparative check period beat frequency for each of the candidate frequency pairs Pi′(cfchk,i′) can be calculated directly from the values of fub and fdb by substituting Equations 2 and 3 into Equation 5.
At process block 318, the LIDAR data validator 276 identifies the valid frequency pairs and/or valid LIDAR data for the sample region. For instance, the LIDAR data validator 276 can apply one or more check criteria to each candidate frequency pair Pi′ so as to identify the valid frequency pairs and/or valid LIDAR data. In one example, the LIDAR data validator 276 calculate a value for match indicator Xi′,n=|cfchk,i′−fchk,n| for all values of i′ from 1 to (2(No))2 and all values of n from 1 to 2No. The LIDAR data validator 276 identifies No of the Xi′,n results with the smallest values as matching values. The No values of i′ for the identified match indicators belong to the valid candidate frequency pairs Pi′ (valid frequency pairs). In some instances, the LIDAR data validator 276 identifies the valid LIDAR data at process block 318. For instance, the candidate LIDAR data associated with the identified i′ values is identified as the valid LIDAR data for sample region m. For instance, the sample region is treated as containing an object at distance Ri and/or having radial velocity vi for each of the identified i′ values. Accordingly, when the LIDAR data generator 274 calculated candidate LIDAR data for each of the candidate frequency pairs at process block 316, the candidate LIDAR data associated with the identified i′ values can serve as the valid LIDAR data for the sample region. For instance, when the LIDAR data generator 274 calculated, at process block 316, a candidate distance and/or a candidate radial velocity (Ri′ and/or vi′) for each of the candidate frequency pairs Pi′ the candidate distance (Ri′) values for each of the identified i′ values and/or the candidate radial velocity (vi′) values for each of the identified i′ values can serve as the valid distance (Ri′) value(s) and/or the valid radial velocity (vi′) value(s) for the one or more objects in the sample region. When the sample region includes more than one object, the valid distance (Ri′) and valid radial velocity (vi′) value having the same i′ index value are for the same object. As a result, the LIDAR data for each of the different objects in the sample region can be identified. Since the valid LIDAR data are associated with the identified i′ value, identifying the valid LIDAR data also identifies the valid frequency pairs by identifying which one of the candidate LIDAR data results was calculated from the candidate frequency pair that included the first target frequency and the second target frequency associated with the same object.
When the LIDAR data generator 274 did not calculate candidate LIDAR data for each of the candidate frequency pairs at process block 316, the LIDAR data validator 276 can use the identified i′ values to calculate the valid LIDAR data for the sample region. For instance, the LIDAR data validator 276 can use Equation 2 and/or Equation 3 to calculate a valid distance and/or a valid radial velocity (Ri′ and/or vi′) for each of the identified i′ values. When the sample region includes more than one object, the valid distance (Ri′) and valid radial velocity (vi′) value having the same i′ index value correspond to the same object. As a result, the LIDAR data for each of the different objects in the sample region can be identified.
At process block 320, the LIDAR data validator 276 can retain the valid LIDAR data for the sample region and/or make available to an application for further processing. For instance, the valid LIDAR data for the sample region can be stored in a storage device such as a memory and/or can be processed further. In some instances, further processing includes screening the valid LIDAR data for errors. After further processing, the screened LIDAR data for the sample region can be stored in a storage device such as a memory and/or can be processed further. An application can access the valid and/or screened LIDAR data for the sample region from a storage device or directly from the electronics 32. At process block 320, the LIDAR data validator 276 can optionally discard and/or flag as invalid any candidate frequency pairs and/or candidate LIDAR data for the sample region. As a result, a first portion of the candidate frequency pairs and/or candidate LIDAR data is classified as valid while a second portion of the candidate frequency pairs and/or candidate LIDAR data is classified as invalid.
Although the LIDAR system is disclosed as having a system output signal with a frequency versus time pattern that includes two subject data periods per sample region, the system output signal can have a frequency versus time pattern with a single subject data period. For instance, for fields of view that are stationary have a radial velocity equal to zero for each of the sample regions. As a result, the range (R) can be resolved with a single subject data period. In these instances, the candidate frequencies for the subject data period can serve as the candidate frequency pairs, fdb or fub can be set to zero depending on the frequency versus time pattern, and the value of vi′ can be set to zero in the above equations.
Although the LIDAR system is described as generating a composite signal with multiple different beat frequencies when multiple objects are present in a sample regions and/or illuminated by the system output signal. However, a composite signal with multiple different beat frequencies can also result from different surfaces of the same physical entity. As a result, multiple objects being present in a sample regions and/or illuminated by a system output signal can also include multiple surfaces of the same physical entity.
Suitable electronics 32 can include, but are not limited to, a controller that includes or consists of analog electrical circuits, digital electrical circuits, processors, microprocessors, digital signal processors (DSPs), Field Programmable Gate Arrays (FPGAs), computers, microcomputers, or combinations suitable for performing the operation, monitoring and control functions described above. In some instances, the controller has access to a memory that includes instructions to be executed by the controller during performance of the operation, control and monitoring functions. In some instances, the functions of the LIDAR data generator and the peak finder can be executed by Field Programmable Gate Arrays (FPGAs), digital signal processors (DSPs), Application Specific Integrated Circuits, firmware, software, hardware, and combinations thereof. Although the electronics are illustrated as a single component in a single location, the electronics can include multiple different components that are independent of one another and/or placed in different locations. Additionally, as noted above, all or a portion of the disclosed electronics can be included on the chip including electronics that are integrated with the chip.
Suitable platforms for the LIDAR chips include, but are not limited to, silica, indium phosphide, and silicon-on-insulator wafers.
The portion of the chip illustrated in
The dimensions of the ridge waveguide are labeled in
Light sensors that are interfaced with waveguides on a LIDAR chip can be a component that is separate from the chip and then attached to the chip. For instance, the light sensor can be a photodiode, or an avalanche photodiode. Examples of suitable light sensor components include, but are not limited to, InGaAs PIN photodiodes manufactured by Hamamatsu located in Hamamatsu City, Japan, or an InGaAs APD (Avalanche Photo Diode) manufactured by Hamamatsu located in Hamamatsu City, Japan. These light sensors can be centrally located on the LIDAR chip. Alternately, all or a portion the waveguides that terminate at a light sensor can terminate at a facet located at an edge of the chip and the light sensor can be attached to the edge of the chip over the facet such that the light sensor receives light that passes through the facet. The use of light sensors that are a separate component from the chip is suitable for all or a portion of the light sensors selected from the group consisting of the first auxiliary light sensor 218, the second auxiliary light sensor 220, the first light sensor 223, and the second light sensor 224.
As an alternative to a light sensor that is a separate component, all or a portion of the light sensors can be integrated with the chip. For instance, examples of light sensors that are interfaced with ridge waveguides on a chip constructed from a silicon-on-insulator wafer can be found in Optics Express Vol. 15, No. 21, 13965-13971 (2007); U.S. Pat. No. 8,093,080, issued on Jan. 10, 2012; U.S. Pat. No. 8,242,432, issued Aug. 14, 2012; and U.S. Pat. No. 6,108,472, issued on Aug. 22, 2000 each of which is incorporated herein in its entirety. The use of light sensors that are integrated with the chip are suitable for all or a portion of the light sensors selected from the group consisting of the auxiliary light sensor 218, the second auxiliary light sensor 220, the first light sensor 223, and the second light sensor 224.
The light source 4 that is interfaced with the utility waveguide 12 can be a laser chip that is separate from the LIDAR chip and then attached to the LIDAR chip. For instance, the light source 4 can be a laser chip that is attached to the chip using a flip-chip arrangement. Use of flip-chip arrangements is suitable when the light source 4 is to be interfaced with a ridge waveguide on a chip constructed from silicon-on-insulator wafer. Alternately, the utility waveguide 12 can include an optical grating (not shown) such as Bragg grating that acts as a reflector for an external cavity laser. In these instances, the light source 4 can include a gain element that is separate from the LIDAR chip and then attached to the LIDAR chip in a flip-chip arrangement. Examples of suitable interfaces between flip-chip gain elements and ridge waveguides on chips constructed from silicon-on-insulator wafer can be found in U.S. Pat. No. 9,705,278, issued on Jul. 11, 2017 and in U.S. Pat. No. 5,991,484 issued on Nov. 23, 1999; each of which is incorporated herein in its entirety. When the light source 4 is a gain element or laser chip, the electronics 32 can change the frequency of the outgoing LIDAR signal by changing the level of electrical current applied to through the gain element or laser cavity.
The above LIDAR systems include multiple optical components such as a LIDAR chip, LIDAR adapters, light source, light sensors, waveguides, and amplifiers. In some instances, the LIDAR systems include one or more passive optical components in addition to the illustrated optical components or as an alternative to the illustrated optical components. The passive optical components can be solid-state components that exclude moving parts. Suitable passive optical components include, but are not limited to, lenses, mirrors, optical gratings, reflecting surfaces, splitters, demulitplexers, multiplexers, polarizers, polarization splitters, and polarization rotators. In some instances, the LIDAR systems include one or more active optical components in addition to the illustrated optical components or as an alternative to the illustrated optical components. Suitable active optical components include, but are not limited to, optical switches, phase tuners, attenuators, steerable mirrors, steerable lenses, tunable demulitplexers, tunable multiplexers.
Other embodiments, combinations and modifications of this invention will occur readily to those of ordinary skill in the art in view of these teachings. Therefore, this invention is to be limited only by the following claims, which include all such embodiments and modifications when viewed in conjunction with the above specification and accompanying drawings.