The invention relates to imaging systems. In particular, the invention relates to LIDAR systems.
There is an increasing commercial demand for 3D imaging systems that can be economically deployed in applications such as ADAS (Advanced Driver Assistance Systems) and AR (Augmented Reality). Imaging systems such as LIDAR (Light Detection and Ranging) are used to construct a 3D image of a target scene by illuminating the scene with laser light and measuring the returned signal.
Many LIDAR approaches transmit a system output signal. The system output signal is reflected by an object and a portion of the reflected light signal returns to the LIDAR chip as a LIDAR input signal. The LIDAR input signal is processed by electronics so as to determine the distance and radial velocity between the LIDAR system and the object. Because the LIDAR input signal is generally an analog signal but the processing is performed on digital signals, the LIDAR system often includes one or more an Analog-to-Digital Converters (ADC) for converting a light signal that includes light from the LIDAR input signal to a digital signal. The Analog-to-Digital Converters (ADC) become a significant expense in the commercialization of LIDAR systems.
For the above, reasons there is a need for a LIDAR system having reduced costs and complexity.
An imaging system includes one or more cores that each outputs a system output signal that illuminates multiple sample regions in a field of view. A reference one of the cores includes a light combiner configured to generate a composite signal beating at a beat frequency. The system also includes electronics configured to use a value of the beat frequency of the composite signal to calculate a magnitude of a radial velocity indicator for a reference one of the sample regions illuminated by the system output signal output from the reference core. The radial velocity indicator indicates a radial velocity between the LIDAR system and an object in the reference sample region. The electronics are configured to identify a direction of the radial velocity indicator by comparing the magnitude of the radial velocity indicator to data calculated for a subject one of the sample regions. The reference sample region is different from the subject sample region.
Another embodiment of an imaging system includes one or more cores. Each of the cores outputs a system output signal that illuminates multiple sample regions in a field of view. A subject one of the cores includes a light combiner that generates a composite signal beating at a beat frequency. Electronics use a value of the beat frequency to calculate multiple different possible LIDAR data solutions for a subject one of the sample regions illuminated by the system output signal output from the subject core. Each of the possible LIDAR data solutions includes a comparative component that indicates a value of a radial velocity between the LIDAR system and an object in the subject sample region. The electronics identify a correct one of the LIDAR data solutions by comparing the LIDAR data solutions to data calculated for one or more reference sample regions selected from among the sample regions. The one or more reference sample regions are different from the subject sample region.
A method of operating an imaging system includes illuminating multiple sample regions in a field of view with system output signals output from different cores. The method also includes combining light signals so as to generate a composite signal beating at a beat frequency. The method also includes using the value of the beat frequency of the composite signal to calculate a magnitude of a radial velocity indicator for a reference one of the sample regions illuminated by the system output signal output from the reference core. The radial velocity indicator indicates a radial velocity between the LIDAR system and an object in the reference sample region. The method also includes identifying a direction of the radial velocity indicator by comparing the magnitude of the radial velocity indicator to data calculated for a subject one of the sample regions. The reference sample region is different from the subject sample region.
Another method of operating an imaging system includes illuminating multiple sample regions in a field of view with system output signals output from different cores. The method also includes combining light signals so as to generate a composite signal beating at a beat frequency. The method also include using the value of the beat frequency to calculate multiple different possible LIDAR data solutions for a subject one of the sample regions. Each of the possible LIDAR data solutions includes a comparative component that indicates a value of a radial velocity between the LIDAR system and an object in the subject sample region. The method further includes identifying a correct one of the LIDAR data solutions by comparing the LIDAR data solutions to data calculated for one or more reference sample regions selected from among the sample regions. The one or more reference sample regions are different from the subject sample region.
LIDAR systems typically illuminate multiple different sample regions in a field of view. The systems generate LIDAR data for each of the sample regions. The LIDAR data can indicate the radial velocity and/or distance between the LIDAR system and any object(s) located in each of the fields of view. These systems frequently apply a mathematical transform such as a Fourier transform to a beating signal so as to identify the beat frequency of the beating signal. When a real transform is used, the transform can output multiple different frequencies. In many circumstances, it is not clear which of these frequencies is the correct frequency. As a result, multiple solutions for a sample region's LIDAR data are often possible. In order to identify which of the solutions is correct for a sample region, the LIDAR system compares the possible LIDAR data solution for the sample region with data from other sample regions. As a result, the LIDAR system can use real Fourier transforms rather than complex Fourier transforms. Real Fourier transforms typically require fewer Analog-to-Digital Converters (ADC) than are required by complex Fourier transforms. As a result, the ability to use real Fourier transforms reduces the costs and complexity of the LIDAR system.
The LIDAR chip includes a utility waveguide 12 that receives an outgoing LIDAR signal from a light source 4. The utility waveguide 12 terminates at a facet 14 and carries the outgoing LIDAR signal to the facet 14. The facet 14 can be positioned such that the outgoing LIDAR signal traveling through the facet 14 exits the LIDAR chip and serves as a LIDAR output signal. For instance, the facet 14 can be positioned at an edge of the chip so the outgoing LIDAR signal traveling through the facet 14 exits the chip and serves as the LIDAR output signal. In some instances, the portion of the LIDAR output signal that has exited from the LIDAR chip can also be considered a system output signal. As an example, when the exit of the LIDAR output signal from the LIDAR chip is also an exit of the LIDAR output signal from the LIDAR system, the LIDAR output signal can also be considered a system output signal.
The LIDAR output signal travels away from the LIDAR system through free space in the environment and/or atmosphere in which the LIDAR system is positioned. The LIDAR output signal may be reflected by one or more objects in the path of the LIDAR output signal. When the LIDAR output signal is reflected, at least a portion of the reflected light travels back toward the LIDAR chip as a LIDAR input signal. In some instances, the LIDAR input signal can also be considered a system return signal. As an example, when the exit of the LIDAR output signal from the LIDAR chip is also an exit of the LIDAR output signal from the LIDAR core, the LIDAR input signal can also be considered a system return signal.
The LIDAR input signals can enter the utility waveguide 12 through the facet 14. The portion of the LIDAR input signal that enters the utility waveguide 12 serves as an incoming LIDAR signal. The utility waveguide 12 carries the incoming LIDAR signal to a splitter 16 that moves a portion of the outgoing LIDAR signal from the utility waveguide 12 onto a comparative waveguide 18 as a comparative signal. The comparative waveguide 18 carries the comparative signal to a signal processor 22 for further processing. Although
The utility waveguide 12 also carrier the outgoing LIDAR signal to the splitter 16. The splitter 16 moves a portion of the outgoing LIDAR signal from the utility waveguide 12 onto a reference waveguide 20 as a reference signal. The reference waveguide 20 carries the reference signal to the signal processor 22 for further processing.
The percentage of light transferred from the utility waveguide 12 by the splitter 16 can be fixed or substantially fixed. For instance, the splitter 16 can be configured such that the power of the reference signal transferred to the reference waveguide 20 is an outgoing percentage of the power of the outgoing LIDAR signal or such that the power of the comparative signal transferred to the comparative waveguide 18 is an incoming percentage of the power of the incoming LIDAR signal. In many splitters 16, such as directional couplers and multimode interferometers (MMIs), the outgoing percentage is equal or substantially equal to the incoming percentage. In some instances, the outgoing percentage is greater than 30%, 40%, or 49% and/or less than 51%, 60%, or 70% and/or the incoming percentage is greater than 30%, 40%, or 49% and/or less than 51%, 60%, or 70%. A splitter 16 such as a multimode interferometer (MMI) generally provides an outgoing percentage and an incoming percentage of 50% or about 50%. However, multimode interferometers (MMIs) can be easier to fabricate in platforms such as silicon-on-insulator platforms than some alternatives. In one example, the splitter 16 is a multimode interferometer (MIMI) and the outgoing percentage and the incoming percentage are 50% or substantially 50%. As will be described in more detail below, the signal processor 22 combines the comparative signal with the reference signal to form a composite signal that carries LIDAR data for a sample region on the field of view. Accordingly, the composite signal can be processed so as to extract LIDAR data (radial velocity and/or distance between a LIDAR core and an object external to the LIDAR core) for the sample region.
The LIDAR chip can include a control branch for controlling operation of the light source 4. The control branch includes a splitter 26 that moves a portion of the outgoing LIDAR signal from the utility waveguide 12 onto a control waveguide 28. The coupled portion of the outgoing LIDAR signal serves as a tapped signal. Although
The control waveguide 28 carries the tapped signal to control components 30. The control components can be in electrical communication with local electronics 32. All or a portion of the control components can be included in the local electronics 32. During operation, the electronics can employ output from the control components 30 in a control loop configured to control a process variable of one, two, or three loop controlled light signals selected from the group consisting of the tapped signal, the system output signal, and the outgoing LIDAR signal. Examples of the suitable process variables include the frequency of the loop controlled light signal and/or the phase of the loop controlled light signal.
The LIDAR core can be modified so the incoming LIDAR signal and the outgoing LIDAR signal can be carried on different waveguides. For instance,
The LIDAR chips can be modified to receive multiple LIDAR input signals. For instance,
The outgoing LIDAR signal exits the LIDAR chip through the facet 14 and serves as the LIDAR output signal. When light from the LIDAR output signal is reflected by one or more object located external to the LIDAR core, at least a portion of the reflected light returns to the LIDAR chip as a first LIDAR input signal. The first LIDAR input signals enters the comparative waveguide 18 through the facet 35 and serves as a first comparative signal. The comparative waveguide 18 carries the first comparative signal to a first signal processor 46 for further processing.
Additionally, when light from the LIDAR output signal is reflected by one or more object located external to the LIDAR core, at least a portion of the reflected signal returns to the LIDAR chip as a second LIDAR input signal. The second LIDAR input signals enters a second comparative waveguide 50 through a facet 52 and serves as a second comparative signal carried by the second comparative waveguide 50. The second comparative waveguide 50 carries the second comparative signal to a second signal processor 48 for further processing.
Although the light source 4 is shown as being positioned on the LIDAR chip, the light source 4 can be located off the LIDAR chip. For instance, the utility waveguide 12 can terminate at a second facet through which the outgoing LIDAR signal can enter the utility waveguide 12 from a light source 4 located off the LIDAR chip.
In some instances, a LIDAR chip constructed according to
An example of a LIDAR adapter that is suitable for use with the LIDAR chip of
The LIDAR adapter can be configured such that the output of the LIDAR output signal from the second port 106 can also serve as the output of the LIDAR output signal from the LIDAR adapter and accordingly from the LIDAR core. As a result, the LIDAR output signal can be output from the LIDAR adapter such that the LIDAR output signal is traveling toward a sample region in the field of view. Accordingly, in some instances, the portion of the LIDAR output signal that has exited from the LIDAR adapter can also be considered the system output signal. As an example, when the exit of the LIDAR output signal from the LIDAR adapter is also an exit of the LIDAR output signal from the LIDAR core, the LIDAR output signal can also be considered a system output signal.
The LIDAR output signal output from the LIDAR adapter includes, consists of, or consists essentially of light from the LIDAR output signal received from the LIDAR chip. Accordingly, the LIDAR output signal output from the LIDAR adapter may be the same or substantially the same as the LIDAR output signal received from the LIDAR chip. However, there may be differences between the LIDAR output signal output from the LIDAR adapter and the LIDAR output signal received from the LIDAR chip. For instance, the LIDAR output signal can experience optical loss as it travels through the LIDAR adapter and/or the LIDAR adapter can optionally include an amplifier configured to amplify the LIDAR output signal as it travels through the LIDAR adapter.
When one or more objects in the sample region reflect the LIDAR output signal, at least a portion of the reflected light travels back to the circulator 100 as a system return signal. The system return signal enters the circulator 100 through the second port 106.
The system return signal exits the circulator 100 through the third port 108 and is directed to the comparative waveguide 18 on the LIDAR chip. Accordingly, all or a portion of the system return signal can serve as the first LIDAR input signal and the first LIDAR input signal includes or consists of light from the system return signal. Accordingly, the LIDAR output signal and the first LIDAR input signal travel between the LIDAR adapter and the LIDAR chip along different optical paths.
As is evident from
The LIDAR adapter can also include one or more direction changing components such as mirrors.
The LIDAR chips include one or more waveguides that constrains the optical path of one or more light signals. While the LIDAR adapter can include waveguides, the optical path that the system return signal and the LIDAR output signal travel between components on the LIDAR adapter and/or between the LIDAR chip and a component on the LIDAR adapter can be free space. For instance, the system return signal and/or the LIDAR output signal can travel through the environment and/or atmosphere in which the LIDAR chip, the LIDAR adapter, and/or the base 102 is positioned when traveling between the different components on the LIDAR adapter and/or between a component on the LIDAR adapter and the LIDAR chip. As a result, optical components such as lenses and direction changing components can be employed to control the characteristics of the optical path traveled by the system return signal and the LIDAR output signal on, to, and from the LIDAR adapter.
Suitable bases 102 for the LIDAR adapter include, but are not limited to, substrates, platforms, and plates. Suitable substrates include, but are not limited to, glass, silicon, and ceramics. The components can be discrete components that are attached to the substrate. Suitable techniques for attaching discrete components to the base 102 include, but are not limited to, epoxy, solder, and mechanical clamping. In one example, one or more of the components are integrated components and the remaining components are discrete components. In another example, the LIDAR adapter includes one or more integrated amplifiers and the remaining components are discrete components.
The LIDAR core can be configured to compensate for polarization. Light from a laser source is typically linearly polarized and hence the LIDAR output signal is also typically linearly polarized. Reflection from an object may change the angle of polarization of the returned light. Accordingly, the system return signal can include light of different linear polarization states. For instance, a first portion of a system return signal can include light of a first linear polarization state and a second portion of a system return signal can include light of a second linear polarization state. The intensity of the resulting composite signals is proportional to the square of the cosine of the angle between the comparative and reference signal polarization fields. If the angle is 90°, the LIDAR data can be lost in the resulting composite signal. However, the LIDAR core can be modified to compensate for changes in polarization state of the LIDAR output signal.
The first portion of the system return signal is directed to the comparative waveguide 18 on the LIDAR chip and serves as the first LIDAR input signal described in the context of
The beamsplitter 120 can be a polarizing beam splitter. One example of a polarizing beamsplitter is constructed such that the first portion of the system return signal has a first polarization state but does not have or does not substantially have a second polarization state and the second portion of the system return signal has a second polarization state but does not have or does not substantially have the first polarization state. The first polarization state and the second polarization state can be linear polarization states and the second polarization state is different from the first polarization state. For instance, the first polarization state can be TE and the second polarization state can be TM or the first polarization state can be TM and the second polarization state can be TE. In some instances, the laser source can linearly polarized such that the LIDAR output signal has the first polarization state. Suitable beamsplitters include, but are not limited to, Wollaston prisms, and MEMs-based polarizing beamsplitters.
A polarization rotator can be configured to change the polarization state of the first portion of the system return signal and/or the second portion of the system return signal. For instance, the polarization rotator 122 shown in
Since the first LIDAR input signal and the second LIDAR carry light of the same polarization state, the comparative signals that result from the first LIDAR input signal have the same polarization angle as the comparative signals that result from the second LIDAR input signal.
Suitable polarization rotators include, but are not limited to, rotation of polarization-maintaining fibers, Faraday rotators, half-wave plates, MEMs-based polarization rotators and integrated optical polarization rotators using asymmetric y-branches, Mach-Zehnder interferometers and multi-mode interference couplers.
Since the outgoing LIDAR signal is linearly polarized, the first reference signals can have the same linear polarization state as the second reference signals. Additionally, the components on the LIDAR adapter can be selected such that the first reference signals, the second reference signals, the comparative signals and the second comparative signals each have the same polarization state. In the example disclosed in the context of
As a result of the above configuration, first composite signals generated by the first signal processor 46 and second composite signals generated by the second signal processor 48 each results from combining a reference signal and a comparative signal of the same polarization state and will accordingly provide the desired beating between the reference signal and the comparative signal. For instance, the composite signal results from combining a first reference signal and a first comparative signal of the first polarization state and excludes or substantially excludes light of the second polarization state or the composite signal results from combining a first reference signal and a first comparative signal of the second polarization state and excludes or substantially excludes light of the first polarization state. Similarly, the second composite signal includes a second reference signal and a second comparative signal of the same polarization state will accordingly provide the desired beating between the reference signal and the comparative signal. For instance, the second composite signal results from combining a second reference signal and a second comparative signal of the first polarization state and excludes or substantially excludes light of the second polarization state or the second composite signal results from combining a second reference signal and a second comparative signal of the second polarization state and excludes or substantially excludes light of the first polarization state.
The above configuration results in the LIDAR data for a single sample region in the field of view being generated from multiple different composite signals (i.e. first composite signals and the second composite signal) from the sample region. In some instances, determining the LIDAR data for the sample region includes the electronics combining the LIDAR data from different composite signals (i.e. the composite signals and the second composite signal). Combining the LIDAR data can include taking an average, median, or mode of the LIDAR data generated from the different composite signals. For instance, the electronics can average the distance between the LIDAR core and the reflecting object determined from the composite signal with the distance determined from the second composite signal and/or the electronics can average the radial velocity between the LIDAR core and the reflecting object determined from the composite signal with the radial velocity determined from the second composite signal.
In some instances, determining the LIDAR data for a sample region includes the electronics identifying one or more composite signals (i.e. the composite signal and/or the second composite signal) as the source of the LIDAR data that is most represents reality (the representative LIDAR data). The electronics can then use the LIDAR data from the identified composite signal as the representative LIDAR data to be used for additional processing. For instance, the electronics can identify the signal (composite signal or the second composite signal) with the larger amplitude as having the representative LIDAR data and can use the LIDAR data from the identified signal for further processing by the LIDAR core. In some instances, the electronics combine identifying the composite signal with the representative LIDAR data with combining LIDAR data from different LIDAR signals. For instance, the electronics can identify each of the composite signals with an amplitude above an amplitude threshold as having representative LIDAR data and when more than two composite signals are identified as having representative LIDAR data, the electronics can combine the LIDAR data from each of identified composite signals. When one composite signal is identified as having representative LIDAR data, the electronics can use the LIDAR data from that composite signal as the representative LIDAR data. When none of the composite signals is identified as having representative LIDAR data, the electronics can discard the LIDAR data for the sample region associated with those composite signals.
Although
The above system configurations result in the first portion of the system return signal and the second portion of the system return signal being directed into different composite signals. As a result, since the first portion of the system return signal and the second portion of the system return signal are each associated with a different polarization state but electronics can process each of the composite signals, the LIDAR core compensates for changes in the polarization state of the LIDAR output signal in response to reflection of the LIDAR output signal.
The LIDAR adapter of
When the LIDAR core includes a LIDAR chip and a LIDAR adapter, the LIDAR chip, electronics, and the LIDAR adapter can be positioned on a common mount. Suitable common mounts include, but are not limited to, glass plates, metal plates, silicon plates and ceramic plates. As an example,
The signal processor includes a second splitter 200 that divides the comparative signal carried on the comparative waveguide 196 onto a first comparative waveguide 204 and a second comparative waveguide 206. The first comparative waveguide 204 carries a first portion of the comparative signal to the signal combiner 211. The second comparative waveguide 208 carries a second portion of the comparative signal to the second signal combiner 212.
The signal processor includes a first splitter 202 that divides the reference signal carried on the reference waveguide 198 onto a first reference waveguide 204 and a second reference waveguide 206. The first reference waveguide 204 carries a first portion of the reference signal to the signal combiner 211. The second reference waveguide 208 carries a second portion of the reference signal to the second signal combiner 212.
The second signal combiner 212 combines the second portion of the comparative signal and the second portion of the reference signal into a second composite signal. Due to the difference in frequencies between the second portion of the comparative signal and the second portion of the reference signal, the second composite signal is beating between the second portion of the comparative signal and the second portion of the reference signal.
The second signal combiner 212 also splits the resulting second composite signal onto a first auxiliary detector waveguide 214 and a second auxiliary detector waveguide 216. The first auxiliary detector waveguide 214 carries a first portion of the second composite signal to a first auxiliary light sensor 218 that converts the first portion of the second composite signal to a first auxiliary electrical signal. The second auxiliary detector waveguide 216 carries a second portion of the second composite signal to a second auxiliary light sensor 220 that converts the second portion of the second composite signal to a second auxiliary electrical signal. Examples of suitable light sensors include germanium photodiodes (PDs), and avalanche photodiodes (APDs).
In some instances, the second signal combiner 212 splits the second composite signal such that the portion of the comparative signal (i.e. the portion of the second portion of the comparative signal) included in the first portion of the second composite signal is phase shifted by 180° relative to the portion of the comparative signal (i.e. the portion of the second portion of the comparative signal) in the second portion of the second composite signal but the portion of the reference signal (i.e. the portion of the second portion of the reference signal) in the second portion of the second composite signal is not phase shifted relative to the portion of the reference signal (i.e. the portion of the second portion of the reference signal) in the first portion of the second composite signal. Alternately, the second signal combiner 212 splits the second composite signal such that the portion of the reference signal (i.e. the portion of the second portion of the reference signal) in the first portion of the second composite signal is phase shifted by 180° relative to the portion of the reference signal (i.e. the portion of the second portion of the reference signal) in the second portion of the second composite signal but the portion of the comparative signal (i.e. the portion of the second portion of the comparative signal) in the first portion of the second composite signal is not phase shifted relative to the portion of the comparative signal (i.e. the portion of the second portion of the comparative signal) in the second portion of the second composite signal. Examples of suitable light sensors include germanium photodiodes (PDs), and avalanche photodiodes (APDs).
The first signal combiner 211 combines the first portion of the comparative signal and the first portion of the reference signal into a first composite signal. Due to the difference in frequencies between the first portion of the comparative signal and the first portion of the reference signal, the first composite signal is beating between the first portion of the comparative signal and the first portion of the reference signal.
The first signal combiner 211 also splits the first composite signal onto a first detector waveguide 221 and a second detector waveguide 222. The first detector waveguide 221 carries a first portion of the first composite signal to a first light sensor 223 that converts the first portion of the second composite signal to a first electrical signal. The second detector waveguide 222 carries a second portion of the second composite signal to a second light sensor 224 that converts the second portion of the second composite signal to a second electrical signal. Examples of suitable light sensors include germanium photodiodes (PDs), and avalanche photodiodes (APDs).
In some instances, the signal combiner 211 splits the first composite signal such that the portion of the comparative signal (i.e. the portion of the first portion of the comparative signal) included in the first portion of the composite signal is phase shifted by 180° relative to the portion of the comparative signal (i.e. the portion of the first portion of the comparative signal) in the second portion of the composite signal but the portion of the reference signal (i.e. the portion of the first portion of the reference signal) in the first portion of the composite signal is not phase shifted relative to the portion of the reference signal (i.e. the portion of the first portion of the reference signal) in the second portion of the composite signal. Alternately, the signal combiner 211 splits the composite signal such that the portion of the reference signal (i.e. the portion of the first portion of the reference signal) in the first portion of the composite signal is phase shifted by 180° relative to the portion of the reference signal (i.e. the portion of the first portion of the reference signal) in the second portion of the composite signal but the portion of the comparative signal (i.e. the portion of the first portion of the comparative signal) in the first portion of the composite signal is not phase shifted relative to the portion of the comparative signal (i.e. the portion of the first portion of the comparative signal) in the second portion of the composite signal.
When the second signal combiner 212 splits the second composite signal such that the portion of the comparative signal in the first portion of the second composite signal is phase shifted by 180° relative to the portion of the comparative signal in the second portion of the second composite signal, the signal combiner 211 also splits the composite signal such that the portion of the comparative signal in the first portion of the composite signal is phase shifted by 180° relative to the portion of the comparative signal in the second portion of the composite signal. When the second signal combiner 212 splits the second composite signal such that the portion of the reference signal in the first portion of the second composite signal is phase shifted by 180° relative to the portion of the reference signal in the second portion of the second composite signal, the signal combiner 211 also splits the composite signal such that the portion of the reference signal in the first portion of the composite signal is phase shifted by 180° relative to the portion of the reference signal in the second portion of the composite signal.
The first reference waveguide 210 and the second reference waveguide 208 are constructed to provide a phase shift between the first portion of the reference signal and the second portion of the reference signal. For instance, the first reference waveguide 210 and the second reference waveguide 208 can be constructed so as to provide a 90 degree phase shift between the first portion of the reference signal and the second portion of the reference signal. As an example, one reference signal portion can be an in-phase component and the other a quadrature component. Accordingly, one of the reference signal portions can be a sinusoidal function and the other reference signal portion can be a cosine function. In one example, the first reference waveguide 210 and the second reference waveguide 208 are constructed such that the first reference signal portion is a cosine function and the second reference signal portion is a sine function. Accordingly, the portion of the reference signal in the second composite signal is phase shifted relative to the portion of the reference signal in the first composite signal, however, the portion of the comparative signal in the first composite signal is not phase shifted relative to the portion of the comparative signal in the second composite signal.
The first light sensor 223 and the second light sensor 224 can be connected as a balanced detector and the first auxiliary light sensor 218 and the second auxiliary light sensor 220 can also be connected as a balanced detector. For instance,
The electronics connect the first light sensor 223 and the second light sensor 224 as a first balanced detector 225 and the first auxiliary light sensor 218 and the second auxiliary light sensor 220 as a second balanced detector 226. In particular, the first light sensor 223 and the second light sensor 224 are connected in series. Additionally, the first auxiliary light sensor 218 and the second auxiliary light sensor 220 are connected in series. The serial connection in the first balanced detector is in communication with a first data line 228 that carries the output from the first balanced detector as a first data signal. The serial connection in the second balanced detector is in communication with a second data line 232 that carries the output from the second balanced detector as a second data signal. The first data signal is an electrical representation of the first composite signal and the second data signal is an electrical representation of the second composite signal. Accordingly, the first data signal includes a contribution from a first waveform and a second waveform and the second data signal is a composite of the first waveform and the second waveform. The portion of the first waveform in the first data signal is phase-shifted relative to the portion of the first waveform in the first data signal but the portion of the second waveform in the first data signal being in-phase relative to the portion of the second waveform in the first data signal. For instance, the second data signal includes a portion of the reference signal that is phase shifted relative to a different portion of the reference signal that is included the first data signal. Additionally, the second data signal includes a portion of the comparative signal that is in-phase with a different portion of the comparative signal that is included in the first data signal. The first data signal and the second data signal are beating as a result of the beating between the comparative signal and the reference signal, i.e. the beating in the first composite signal and in the second composite signal.
The local electronics 32 include a beat frequency finder 238 configured to find the beat frequency of the composite signal. The beat frequency finder 238 can perform a mathematical transform on the first data signal and the second data signal. For instance, the mathematical transform can be a complex Fourier transform with the first data signal and the second data signal as inputs. Since the first data signal is an in-phase component and the second data signal its quadrature component, the first data signal and the second data signal together act as a complex data signal where the first data signal is the real component and the second data signal is the imaginary component of the input.
The beat frequency finder 238 includes a first Analog-to-Digital Converter (ADC) 264 that receives the first data signal from the first data line 228. The first Analog-to-Digital Converter (ADC) 264 converts the first data signal from an analog form to a digital form and outputs a first digital data signal. The beat frequency finder 238 includes a second Analog-to-Digital Converter (ADC) 266 that receives the second data signal from the second data line 232. The second Analog-to-Digital Converter (ADC) 266 converts the second data signal from an analog form to a digital form and outputs a second digital data signal. The first digital data signal is a digital representation of the first data signal and the second digital data signal is a digital representation of the second data signal. Accordingly, the first digital data signal and the second digital data signal act together as a complex signal where the first digital data signal acts as the real component of the complex signal and the second digital data signal acts as the imaginary component of the complex data signal.
The beat frequency finder 238 includes a transformer 268 that receives the complex data signal. For instance, the transformer 268 receives the first digital data signal from the first Analog-to-Digital Converter (ADC) 264 as an input and also receives the second digital data signal from the second Analog-to-Digital Converter (ADC) 266 as an input. The transformer 268 can be configured to perform a mathematical transform on the complex signal so as to convert from the time domain to the frequency domain. The mathematical transform can be a complex transform such as a complex Fast Fourier Transform (FFT). A complex transform such as a complex Fast Fourier Transform (FFT) provides an unambiguous solution for the shift in frequency of LIDAR input signal relative to the LIDAR output signal that is caused by the radial velocity between the reflecting object and the LIDAR chip. The electronics use the one or more frequency peaks output from the transformer 268 for further processing to generate the LIDAR data (distance and/or radial velocity between the reflecting object and the LIDAR chip or LIDAR core). The local electronics 32 can include a peak finder (not shown) to identify the beat frequencies of the one or more frequency peaks.
The local electronics 32 can include a preliminary LIDAR data generator 269 configured receive the beat frequencies from the transformer 268. The preliminary LIDAR data generator 269 is configured to generate preliminary LIDAR data for a sample region. LIDAR data for a sample region includes values for the radial velocity and/or separation distance between the LIDAR system and an object in the sample region. In some instances, the LIDAR data includes an indicator that the LIDAR data for that sample region is “not available.” In some instances, the preliminary LIDAR data generator 269 calculates LIDAR data that serves as the preliminary LIDAR data. For instance, in some instances, the preliminary LIDAR data generator 269 calculates the radial velocity and/or separation distance between the LIDAR system and an object in the sample region as the preliminary LIDAR data. As will be discussed below, other examples of preliminary LIDAR data that can be calculated by the preliminary data generator include, but are not limited to, possible solutions for the LIDAR data for the sample region and a potential radial velocity magnitude indicator and/or a velocity magnitude indicator for the sample region. The transformer 268 and/or the preliminary LIDAR data generator 269 can execute the attributed functions using firmware, hardware or software or a combination thereof<-Is this last sentence correct? XXX
Although
The electronics tune the frequency of the system output signal over time. The system output signal has a frequency versus time pattern with a repeated cycle.
Each cycle includes M data periods that are each associated with a period index m and are labeled DPm. In the example of
During the data period DPm, the electronics operate the light source such that the frequency of the system output signal changes at a linear rate am (the chirp rate). In
The frequency output from the Complex Fourier transform represents the beat frequency of the composite signals that each includes a comparative signal beating against a reference signal. The beat frequencies from two or more different data periods that are associated with the same sample region can be combined to generate the LIDAR data. For instance, the beat frequency determined from DP1 during the illumination of sample region SRk can be combined with the beat frequency determined from DP2 during the illumination of sample region SRk to determine the LIDAR data for sample region SRk. As an example, the following equation applies during a data period where electronics increase the frequency of the outgoing LIDAR signal during the data period such as occurs in data period DP1 of
The following equation applies during a data period where the frequency of the outgoing LIDAR signal decreases such as occurs in data period DP2 of
When a LIDAR core includes a signal processor constructed as disclosed in the context of
In an example of a velocity core, the electronics can operate the light source 4 such that the system output signal having a frequency that is a function of time disclosed in the context of
Since the frequency of system output signal is constant, changing the distance between reflecting object and LIDAR chip does not cause a change to the frequency of the LIDAR input signal. As a result, the separation distance does not contribute to the shift in the frequency of the LIDAR input signal relative to the frequency of the LIDAR output signal. Accordingly, the effect of the separation distance has been removed or substantially from the shift in the frequency of the LIDAR input signal relative to the frequency of the system output signal.
A velocity core can have a signal processor constructed as disclosed in the context of
The transformer 268 receives the complex data signal. The transformer 268 can be configured to perform a mathematical transform on the complex signal so as to convert from the time domain to the frequency domain. The mathematical transform can be a complex transform such as a complex Fast Fourier Transform (FFT). A complex transform such as a complex Fast Fourier Transform (FFT) provides an unambiguous solution for the shift in frequency of LIDAR input signal relative to the LIDAR output signal that is caused by the radial velocity between the reflecting object and the LIDAR chip. Since the frequency shift provided by the transformer 268 does not have input from a frequency shift due to the separation distance between the reflecting object and the LIDAR chip, and because of the complex nature of the velocity data signal, the output of the transformer 268 can be used to calculate the radial velocity between the reflecting object and the LIDAR chip. For instance, the electronics, such as a preliminary LIDAR data generator, can approximate the radial velocity between the reflecting object and the LIDAR chip (v) using Equation 4: v=c*fd/(2*G) where fd is approximated as the peak frequency output from the transformer 268, c is the speed of light, and fd represents the frequency of the LIDAR output signal. As a result, multiple data periods and/or chirping are not needed for a velocity core to calculate the radial velocity.
The first Analog-to-Digital Converter (ADC) 264 converts the first data signal to the first digital data signal by sampling the first data signal at a sampling rate. Similarly, the second Analog-to-Digital Converter (ADC) 266 converts the second data signal to the second digital data signal by sampling the second data signal at a sampling rate. When a velocity core uses a continuous wave as a first data signal and a second data signal, the effects of distance between the reflecting object and LIDAR chip are effectively removed from the beating of the composite signal and the resulting electrical signals. Accordingly, the beat frequency of the composite signal is reduced and the required sampling rate is reduced. For instance, the sampling rate of the Analog-to-Digital Converters in a range and velocity core can be on the order of 4GSPS. In contrast, the sampling rate of the Analog-to-Digital Converters in a velocity core can be on the order of 400 MSPS.
Although the signal processor of
A LIDAR system can include one or more range and velocity cores and one or more velocity cores. As an example,
Each of the LIDAR cores outputs a different system output signal. The system output signal are each received by a redirection component 274 that re-directs the system output signals. Suitable redirection component 274 include, but are not limited to, convex lenses and concave mirrors. The system output signal output from the collimator 274 are received by one or more beam steering components 276 that output the system output signals. The direction that the system output signal travels away from the LIDAR system is labeled d2 in
As noted above, the sampling rates for the ADCs on the velocity cores can be lower than the sampling rates for the ADCs on the range and velocity cores. In some instances, the LIDAR assembly includes velocity cores having ADCs with sampling rates greater than 100, 200, or 300 and less than 500, 800, or 1000 MSPS (mega-samples per second) and/or the range and velocity cores having ADCs with sampling rates greater than 1, 2, or 3 and less than 5, 8, or 10 GSPS (giga-samples per second). In some instances, a ratio of the sampling rates for the ADCs on the one or more velocity cores to the sampling rates on the one or more range and velocity cores is greater than 2:1, 5:1, or 10:1 and less than 15:1, 50:1, or 100:1. Additionally or alternately, the velocity cores can be lower bandwidth cores than the range and velocity cores. As an example, the light detectors in the velocity cores can be used with Transimpedance Amplifiers (TIAs) that convert the current of the resulting data signal output from the light detectors to a voltage. For instance,
The portion of each sample region that corresponds to one of the data periods are each labeled DP1 or DP2 in
Each of the sample regions includes a dashed line labeled Lk. The dashed line labeled Lk can serve as a location reference line for sample region k.
The field locations (flk) that are associated with a distance, Rk, can also be associated with a radial velocity Vk where k represents the sample region index. The radial velocity Vk can be the radial velocity that the electronics generate for sample region with sample region index k.
The one or more orientation angle(s) (θk) and the distances Rk associated with each field location (flk) can effectively serve as polar coordinates or as spherical coordinates. As a result, the electronics can optionally convert the coordinates of the field locations flk to other coordinates systems including, but not limited to, Cartesian coordinates. As an example,
In some instances, a field location (flk) is not present in all or a portion of the sample regions. For instance, when an object is not present in a sample region (SRk), a beating signal is generally not produced and LIDAR data is not generated for that sample region. As a result, a portion of the sample region indices may not be associated with a field location (flk).
When a core is a range and velocity core, all or a portion of the sample regions illuminated by that core (range and velocity sample regions, RV sample regions) can each be associated with a field location, coordinates, distances Rk, and a radial velocity Vk. In contrast, when a core is a velocity core, all or a portion of the sample regions illuminated by that core (velocity sample regions, V sample regions) can each be associated with a field location, coordinates, and a radial velocity Vk.
The sample regions are each labeled Ci where i is a core index that identifies the core that illuminated the sample region. The core index is an integer can extend from i=1 to i=M where M is the number of system output signals output by the LIDAR system. The labels Ci indicate which of the system output signals illuminated the sample region. For instance, the sample regions labeled C1 were illuminated by the range and velocity labeled C1 in
The LIDAR system includes electronics configured to operate the LIDAR system. The electronics can include local electronics 32 from one or more cores and common electronics 280. The common electronics 280 can be positioned on the common support 140 as shown in
The common electronics 280 can be in electrical communication with the local electronics 32 associated with different cores. For instance, the common electronics 280 can include a LIDAR data generator 291 in electrical communication with the local electronics 32 from different cores.
The electrical communication between the common electronics 280 and the local electronics 32 associated with different cores allows the common electronics 280 to access preliminary LIDAR data generated from different cores. For instance, the common electronics 280 can access the range and or velocity that the local electronics 32 associated with a range and velocity core calculates for a sample region and/or can access the velocity that the local electronics 32 associated with a velocity core calculates for a sample region. The LIDAR data generator 291 can combine preliminary LIDAR data generated by different cores to calculate LIDAR data for one of the sample regions. Additionally or alternately, The LIDAR data generator 291 can combine preliminary LIDAR data generated for different sample regions by the same core to calculate LIDAR data for one of the sample regions.
The preliminary LIDAR data that the electronics generate for a sample region can include isolated LIDAR data and shared LIDAR data. Isolated LIDAR data can be LIDAR data that the local electronics calculate for a sample region where the one or more beat frequencies used to calculate the isolated LIDAR data result from the illumination of that sample region by the system output signal. As a result, the illumination of another sample region by a system output signal is not needed to calculate the isolated LIDAR data for a sample region. As a result, the radial velocity (Vk) for a V sample region with sample region index k can be calculated without illuminating another one of the sample regions with a system output signal. However, the LIDAR data generator 291 can combine the isolated LIDAR data and/or shared LIDAR data from different cores and/or that result from illuminating different sample regions so as to approximate the shared LIDAR data. As a result, shared LIDAR data for a sample region can be calculated by combining the beat frequencies that result from illuminating different sample regions. As an example, the range (Rk) for a V sample region can be calculated by combining the beat frequencies from multiple different sample regions. Accordingly, the range (Rk) calculated for a V sample region can be shared LIDAR data while the radial velocity (Vk) for the same V sample region can be isolated LIDAR data. In contrast, the range (Rk) and radial velocity (Vk) for the same V sample region can both be isolated LIDAR data.
An example of calculating shared LIDAR data is calculating the range (Rk) for a subject V sample region by interpolating or extrapolating the coordinates of the field location for the V sample region from the coordinates of the field locations associated with RV sample regions. When the coordinates are polar coordinates or spherical coordinates, the range (distance) for subject V sample region k (Rk) can be extracted directly from the coordinates. Alternately, a range (distance) for V sample region k (Rk) can be calculated from the coordinates. For instance, when the coordinates are Cartesian coordinates, the coordinates can be converted to polar coordinates or spherical coordinates and the desired range extracted. In some applications of the LIDAR system, the desired data for the V sample region is the coordinates of the field location for that sample region rather than the range. As a result, in some applications, the range is not calculated for all or a portion of the V sample regions for which coordinates are calculated. The range and/or coordinates estimated for a V sample region can serve as location data for the V sample region. Accordingly, interpolation and extrapolation provide an estimate of the location data of an object in a subject sample region. The interpolation or extrapolation is made relative to coordinates and/or ranges from multiple RV sample regions. The field locations in the RV sample regions from which the location data for a V region is calculated serve as the known points in an interpolation or extrapolation algorithm.
The LIDAR data generator 291 can identify a subject sample region for which the coordinates and/or a range is to be interpolated or extrapolated and can identify potential sample regions that include potential data points from which the coordinates and/or range is to be interpolated or extrapolated. As an example,
The LIDAR data generator 291 can apply an identification algorithm to identify the potential data points. The identification algorithm can associate a particular group of RV sample regions with each of the different possible subject sample regions. The association can be specific to each of the possible subject sample regions or can be general to multiple different possible subject sample regions. As an example of a specific association, the identification algorithm can associate the group of potential data points shown in
In another example of suitable identification algorithms, the potential data points can be identified by application of an identification criteria to the subject sample region and the adjacent RV sample regions. For instance, each of the RV sample regions that has a field locations are Rfl of the field location in the subject sample region can each be identified as a potential data point where Rfl is a constant.
The LIDAR data generator 291 can compare the LIDAR data at the potential data points to one or more criteria to determine which of the potential data points is suitable for use as a known data point. In some instances, the one or more criteria include or consist of velocity criteria that are a function of the radial velocities associated with the potential data points. For instance, the LIDAR data generator 291 can compare the LIDAR data associated with the subject sample region and the data associated with each of the potential data points to one or more velocity criteria to determine whether the potential data point is suitable for use as a known data point.
The velocity criteria can be selected such that the criteria are satisfied when the same object is likely positioned in the subject sample region and in the sample region associated with a potential data point. When an object is positioned in a subject sample region and the sample region associated with a potential data point, the radial velocity calculated for these sample regions is likely the same or similar. For instance, an example application of velocity criteria can include comparing a variable that is a function of the radial velocity calculated for the subject sample region and the velocity associated with the potential data point to a threshold. The threshold can be a constant or can be function of the radial velocity calculated for the subject sample region and/or the radial velocity calculated for the potential data point. As an example, the difference between the radial velocity associated with the subject sample region and the radial velocity associated with the potential data point can be compared to a velocity threshold. When the difference is less than the velocity threshold, the velocity criteria is satisfied but when the difference is greater than or equal to the velocity threshold the velocity criteria is not satisfied. Another example of applying velocity criteria compares the percentage change from the radial velocity associated the subject sample region to the radial velocity associated with the potential data point to a velocity threshold. When the difference is less than the velocity threshold, the velocity criteria is satisfied but when the difference is greater than or equal to the velocity threshold the velocity criteria is not satisfied.
The potential data points that satisfy the one or more criteria are flagged as known data points while the potential data points that do not satisfy the one or more criteria are not flagged as known data points. As an example, the field locations in the RV sample regions labeled F in
Suitable interpolation algorithms include, but are not limited to, piecewise constant interpolation, linear interpolation, polynomial interpolation, spline interpolation, interpolation by function approximation, and Gaussian interpolation. Suitable extrapolation algorithms include, but are not limited to, linear extrapolation, polynomial extrapolation, conic extrapolation, and French curve extrapolation.
At process block 300, the local electronics for each of the cores generate the isolated LIDAR data for the sample regions scanned by that core. For instance, the preliminary LIDAR data generators 269 in the velocity cores calculate the radial velocity for each of the V sample regions scanned by the core. Additionally, the preliminary LIDAR data generators 269 in the range and velocity cores calculate the range and radial velocity for each of the RV sample regions scanned by the RV core. As noted above, the one or more orientation angle(s) (θk) associated with a sample region and the range or distance Rk calculated for the sample region can effectively serve as polar or spherical coordinates for a field location in that sample region. Alternately, the local electronics can optionally convert the polar or spherical coordinates to another coordinate system. Accordingly, the preliminary LIDAR data generators 269 associated with each of the range and velocity cores can calculate the radial velocity and coordinates of the field locations associated with the RV sample regions scanned by those cores.
At process block 302, the LIDAR data generator 281 can identify one of the V sample regions to serve as a subject sample region for which coordinates and/or a range are to be estimated. The field location in the subject sample region can serve as a subject field location.
The LIDAR data generator 281 can proceed from process block 302 to process block 304. At process block 304, the LIDAR data generator 281 can perform the identification algorithm so as to identify RV sample regions that contain field locations that may be suitable for serving as known data points. The identified RV sample regions and/or field locations can serve as potential data points.
The LIDAR data generator 281 can proceed from process block 304 to process block 306. At process block 306, the LIDAR data generator 281 can initialize the identified potential data points and/or the RV sample regions that include the identified potential data points. For instance, the LIDAR data generator 281 can flag each of the identified potential data points and/or the sample regions containing the identified potential data points as not being a known data point.
The LIDAR data generator 281 can proceed from process block 306 to process block 308. At process block 308, the LIDAR data generator 281 can compare the radial velocity associated with the subject field location (or the subject V sample region) and the radial velocity associated with a subject one of the potential data points (or the potential RV sample region) to the one or more velocity criteria so as to determine whether it is likely that the same object is positioned in the sample region associated with the subject field location and also in the sample region associated with the potential field location. This comparison can be repeated until each of the potential data points has served as the subject potential data point, until a pre-determined number of potential data points has served as the subject potential data point, or until a pre-determined number of potential data points has satisfied the one or more velocity criteria. The LIDAR data generator 281 can flag each of the potential data points that satisfies the one or more velocity criteria as a known data point.
The LIDAR data generator 281 can proceed from process block 308 to process block 310. At process block 310, the LIDAR data generator 281 can interpolate or extrapolate coordinates for the subject field location from the coordinates of the known data point. The potential data points that are not flagged as a known data point are not used in the interpolation or extrapolation.
In some instances, the interpolation or extrapolation of the coordinates includes an interpolation or extrapolation of the range associated with the subject field location. For instance, when the interpolation or extrapolation of the coordinates is done in polar coordinates or spherical coordinates, the range is one of the coordinate variables. Alternately, the range can be calculated from the coordinates for the subject field location. When the range is determined for a subject field location flk, the range can serve as the distance Rk for the V sample region SRk. As a result, the V sample region SRk can be associated with a radial velocity Vk. Accordingly, a V sample region that has served as the subject sample region can be associated with a field location, an estimated distance Rk, and a radial velocity Vk.
The LIDAR data generator 281 can proceed from process block 310 to determination block 312 where a determination is made whether the desired number of V sample regions has served as the subject sample region. It can be desirable for all or a portion of the sample regions in the field of view for the LIDAR system to serve as the subject sample region. In some instances, each of the V sample regions in the field of view for the LIDAR system is to serve as the subject sample region. As a result, in some instances, the common electronics can determine whether each of the each of the V sample regions in the field of view for the LIDAR system has served as the subject sample region. When the determination is negative, the common electronics can return to process block 302.
When the determination at determination block 310 is positive, the LIDAR data generator 281 has estimated distance (Rk) values for all or a portion of the V sample regions. The estimated distance (Rk) values are estimated from the beat frequencies of the composite signals that result from illuminating multiple different sample regions with a system output signal. As a result, the estimated distance (Rk) values can be considered shared LIDAR data. The estimated distance (Rk) values for the V sample regions can be added to the isolated LIDAR data for the RV regions and the isolated LIDAR data for the V regions to provide LIDAR data for the LIDAR system's field of view. As a result, all or a portion of the V sample regions in the field of view of the LIDAR system are associated with a field location, an estimated distance Rk, and a radial velocity Vk. Similarly, all or a portion of the RV sample regions in the field of view of the LIDAR system are associated with a field location, an estimated distance Rk, and a radial velocity Vk.
When the determination at determination block 310 is positive, the common electronics 280 proceed from determination block 312 to process block 314. At process block 314, the common electronics can perform further processing of the LIDAR data for the LIDAR system's field of view. The further processing is a function of the application of the LIDAR system. Examples of further processing applications include, but are not limited to, image generation, control of self-driving vehicles, point cloud generation, object recognition, and statistical analysis. The further processing can make use of all or a portion of the ranges, radial velocities, and field locations associated with the V sample regions and associated with the RV sample regions in the field of view for the LIDAR system.
The LIDAR core constructions disclosed above are examples and other LIDAR core constructions can be used. As an example,
The LIDAR core of
The beat frequency finder 238 includes a transformer 268 that receives the first digital data signal from the first Analog-to-Digital Converter (ADC) 264 as an input. The transformer 268 can be configured to perform a mathematical transform on the first digital data signal so as to convert from the time domain to the frequency domain. The mathematical transform can be a real transform such as a Fourier Transform. The local electronics use the one or more frequency peaks output from the transformer 268 for further processing to generate the LIDAR data (distance and/or radial velocity between the reflecting object and the LIDAR chip or LIDAR core). The local electronics 32 can include a peak finder (not shown) to identify the beat frequencies of the one or more frequency peaks. The transformer 268 and/or the preliminary LIDAR data generator 269 can execute the attributed functions using firmware, hardware or software or a combination thereof.
The local electronics 32 can include a preliminary LIDAR data generator 269 configured receive the beat frequencies from the transformer 268. The preliminary LIDAR data generator 269 is configured to generate preliminary LIDAR data for a sample region. LIDAR data for a sample region includes values for the radial velocity and/or separation distance between the LIDAR system and an object in the sample region. In some instances, the LIDAR data includes an indicator that the LIDAR data for that sample region is “not available.” In some instances, the preliminary LIDAR data generator 269 calculates LIDAR data that serves as the preliminary LIDAR data. For instance, in some instances, the preliminary LIDAR data generator 269 calculates the radial velocity and/or separation distance between the LIDAR system and an object in the sample region as the preliminary LIDAR data. As will be discussed below, other examples of preliminary LIDAR data that can be calculated by the preliminary data generator include, but are not limited to, possible solutions for the LIDAR data for the sample region and a potential radial velocity magnitude indicator for the sample region.
Different cores having local electronics 32 configured as disclosed in the context of
The system output signal from the LIDAR core of
The LIDAR cores illustrated in any of
The beat frequencies from two or more different data periods that are associated with the same sample region can be combined to generate possible LIDAR data solutions for an RV sample region illuminated by a system output signal from a LIDAR core constructed according to any of
As noted above, beat frequency of the composite signal during a data period where the frequency of the outgoing LIDAR signal increases can be represented by fub and the beat frequency of the composite signal during a data period where the frequency of the outgoing LIDAR signal decreases can be represented by fdb. The contribution of the range between the LIDAR system and the object to these beat frequencies can be represented by fr where fr=2*αuRk/c where αu represents a chirp rate (αm) for the data period where the frequency of the system output signal increases with time (α1 in this case), Rk represents the distance between the LIDAR system and an object in sample region SRk, and c represents the speed of light. The contribution of the Doppler effect to these beat frequencies can be represented by fd=2Vkfc/c where G represents the base frequency (fo), Vk is the radial velocity between the reflecting object in sample region k and the LIDAR system with radial velocity assumed to be positive when the object is moving toward the LIDAR system.
There are three possible LIDAR data solutions for the combination of fr and fd values for an RV sample region. For instance, fr=(fub+fdb)/2 and fd=(fdb−fub)/2 can serve as a first solution. A second solution can be fr=(fdb−fub)/2 and fd=(fdb+fub)/2. A third solution can be fr=(fub−fdb)/2 and fd=−(fdb+fub)/2. As noted above, a real Fourier transform outputs a positive beat frequency and a negative beat frequency with the same magnitude. As a result, in these LIDAR data solutions, fub represents the magnitude of the peak frequency output from the transformer 268 and fd represents the magnitude of the peak frequency output from the transformer 268. As noted above, the values of fd and fr are directly related to the radial velocity (VK) and the range (Rk) for the RV sample region by fd=2Vkfc/c and fr=2*αu*Rk/c respectively. As a result, each of the possible LIDAR data solution for the RV sample region SRk can have all or a portion of the components selected from the group consisting of an fr value, an fd value, a radial velocity (VK) value and a range (Rk) value. In some instances, each of the possible LIDAR data solutions includes at least a possible fr value, a possible fd value. In some instances, each of the possible LIDAR data solutions includes at least a possible radial velocity (VK) value and a possible range (Rk) value for the RV sample region SRk.
At process block 322, the LIDAR data generator 281 identify the correct solution. For instance, when each of the possible LIDAR data solutions does not already include a radial velocity (Vk), a radial velocity (Vk) can be calculated for each solution using the fd value associated with the solution and fd=2Vkfc/c. The Vk results from the different solutions can be compared to the radial velocity result from one or more V sample regions to identify the correct Vk result. The LIDAR data solution that includes the identified Vk result can be selected as the correct LIDAR data solution. Accordingly, the Vk value of the selected LIDAR data solution can be selected as the correct Vk value and Rk value.
At process block 323, the LIDAR data generator 281 can determine the LIDAR data for the RV sample region associated with sample region index k. For instance, when the selected possible LIDAR data solution does not already include a range (RK), the range (RK) can be calculated for the selected LIDAR data solution using the fr value associated with the selected LIDAR data solution and fr=2*αu* Rk/c. The values of Vk and Rk associated with the selected LIDAR data solution can serve as shared LIDAR data for the RV sample region SRk. Accordingly, the LIDAR data for the RV sample region associated with sample region index k can include or consist of the values of Vk and Rk selected in process block 322.
A LIDAR system can include one or more range and velocity cores that are real data signal cores and one or more velocity cores that are real data signal cores. As an example,
The sample regions are each labeled C1 where i is a core index that identifies the core that illuminated the sample region. The core index is an integer can extend from i=1 to i=M where M is the number of system output signals output by the LIDAR system. The labels C1 indicate which of the system output signals illuminated the sample region. For instance, the sample regions labeled C1 were illuminated by the range and velocity core labeled C1 in
The local electronics 32 can be local electronics in that they are specific to each of the cores on the LIDAR system. The LIDAR system can include common electronics 280 in addition to the local electronics 32. The common electronics 280 can be positioned on the common support 140 as shown in
The LIDAR data generator 281 can combine possible LIDAR data solutions with isolated LIDAR data from one or more V sample regions so as to select the correct LIDAR data solution as disclosed in the context of
To identify the correct possible LIDAR data solution, the possible LIDAR data solutions for a subject RV sample region can be compared to the radial velocity calculated for one or more V sample regions that each serves as a reference V sample region. All or a portion of the reference V sample regions and the subject sample region can be illuminated by the same cores or by different cores. For instance, the electronics can identify a subject RV sample region for which a correct LIDAR data solution is to be identified.
One or more V sample regions can each be identified as a reference V sample region. The possible LIDAR data solutions for the subject RV sample region can be compared to the radial velocity (Vk) calculated for each of the one or more reference V sample regions so as to identify the correct LIDAR data solution for the subject RV sample region from among the possible LIDAR data solutions for the subject RV sample region. In some instances, the V sample region that is physically closest to the subject RV sample region is identified as the only reference V sample region. As an example, in
The LIDAR data generator 281 can employ one or more solution identification criteria to identify the correct LIDAR data solution for the subject RV sample region from among the possible LIDAR data solutions for the subject RV sample region. An example solution identification criterion includes a proximate velocity criterion where the possible LIDAR data solution having the radial velocity that is closest to the radial velocity of one or more of the reference V sample regions is identified as the correct LIDAR data solution. For instance, the V sample region that is physically closest to the subject RV sample region can be identified as the only reference V sample region and the possible LIDAR data solution having the radial velocity Vk that is closest to the radial velocity of one or more of the reference V sample regions can be selected as the correct LIDAR data solution for the subject RV sample region. Accordingly, the radial velocity Vk and distance Rk associated with the LIDAR data solution can serve as the LIDAR data for the subject RV sample region.
The LIDAR data generator 281 can apply other identification criteria in addition or as an alternative to the proximate velocity criteria. Another example of an identification criterion can be a range criterion where the radial velocity Vk for each of the identified reference V sample region is within a range of radial velocity values. Examples of suitable ranges for radial velocity values include, but are not limited to, the radial velocity of the subject RV sample region +/−10%, 20%, or 30% of the radial velocity of the subject RV sample region. In the event that the radial velocity (Vk) for one of the identified reference V sample regions falls outside of the range for radial velocity values, the reference V sample region can be removed from the identified reference V sample regions. In the event that none of the identified reference V sample regions has a radial velocity that falls within the range for radial velocity values, the LIDAR data for the subject RV sample region can be classified as unavailable. In some instances, the LIDAR data generator 281 applies both a range criterion and a proximate velocity criteria to a subject RV sample region.
At process block 327, the isolated LIDAR data for each of the V sample regions can be calculated. As noted above, the isolated LIDAR data for a sample region is the LIDAR data that can be calculated without use of a composite signal that results from illuminating a different sample region with a system output signal. For instance, to generate the isolated LIDAR data, the preliminary LIDAR data generator 269 for each of the velocity cores can calculate the radial velocity for each of the V sample regions illuminated by the velocity core.
At process block 328, the preliminary LIDAR data generator 269 for each of the range and velocity cores can calculate the possible LIDAR data can for each of the RV sample regions illuminated by one of the range and velocity cores. For instance, the preliminary LIDAR data generator 269 for each of the range and velocity cores can calculate the possible LIDAR data solutions for each of the RV sample regions illuminated by one of the range and velocity cores as disclosed in the context of
At process block 329, the correct LIDAR data solution can be selected for each of the RV sample regions illuminated by each of the range and velocity core. For instance, the LIDAR data generator 281 can select the correct LIDAR data solution for an RV sample region from among the possible LIDAR data solutions as disclosed on the context of
The LIDAR data for the RV sample regions can serve as the range and radial velocity for each of the RV sample regions scanned by the RV cores in process block 300 of
The fields of view illustrated in
Although the LIDAR system of
The real data signal cores that are disclosed in the context of
At process block 342, the LIDAR data generator 281 can identify the direction of the radial velocity indicator for V sample region SRk. For instance, the velocity magnitude indicator for V sample region SRk can be compared to a comparative component of LIDAR data solutions from one or more RV sample regions to identify the direction of the radial velocity indicator. As an example, when the velocity magnitude indicator for V sample region SRk matches the magnitude of a possible radial velocity solution from a neighboring RV sample region, it is likely the system output signals that illuminated the different sample regions were incident on the same object. As a result, the direction of the possible radial velocity solution that matched the velocity magnitude indicator is assigned to the velocity magnitude indicator to provide a directional radial velocity indicator. Accordingly, the directional radial velocity indicator has the magnitude of the velocity magnitude indicator and the direction of the comparative component from the matched LIDAR data solution. As an example where the radial velocity indicator for V sample region SRk is a radial velocity (Vk) calculation that provides a velocity magnitude indicator of 20 mph and matches with a possible radial velocity solution of −20 mph, the negative value of the possible radial velocity solution is assigned to the velocity magnitude indicator to provide a directional radial velocity indicator value of −20 mph.
At process block 344, the LIDAR data generator 281 can determine the radial velocity for V sample regions SRk. When the velocity magnitude indicator is the magnitude of a radial velocity calculation, the directional radial velocity indicator can serve as the radial velocity for sample regions SRk. When the velocity magnitude indicator is the magnitude of something other than a radial velocity calculation, the radial velocity can be calculated from the directional radial velocity indicator. For instance, when the velocity magnitude indicator is the magnitude of either of the beat frequencies (fd), the radial velocity (Vk) can be calculated from Cfd=2Vkfc/c where Cfd represents the directional radial velocity indicator.
One or more of the LIDAR cores in the LIDAR system of
The sample regions are each labeled Ci where i is a core index that identifies the core that illuminated the sample region. The core index is an integer can extend from i=1 to i=M where M is the number of system output signals output by the LIDAR system. The labels C1 indicate which of the system output signals illuminated the sample region. For instance, the sample regions labeled C1 were illuminated by the range and velocity core labeled C1 in
The local electronics 32 can be local electronics in that they are specific to each of the cores on the LIDAR system. The LIDAR system can include common electronics 280 in addition to the local electronics 32. The common electronics 280 can be positioned on the common support 140 as shown in
The common electronics can be in electrical communication with the local electronics 32 associated with different cores as disclosed in the context of
The electronics can combine possible LIDAR data solutions with a radial velocity indicator and/or velocity magnitude indicator from one or more V sample regions so as to identify the correct LIDAR data for the RV sample regions and the V sample regions in the field of view.
To identify the correct possible LIDAR data solution for an RV sample region and the correct direction for a radial velocity indicator, the electronics can compare possible LIDAR data solutions for a subject RV sample region and the radial velocity magnitude indicator for one or more V sample regions that each serves as a reference V sample region.
All or a portion of the reference V sample regions and a subject RV sample region can be illuminated by the same cores or by different cores. For instance, the electronics, such as the LIDAR data generator 281, can identify a subject RV sample region for which a correct one of the LIDAR data solutions is to be identified.
The LIDAR data generator 281 can identify one or more V sample regions as a reference V sample region. The LIDAR data generator 281 can compare possible LIDAR data solutions for the subject RV sample region to the velocity magnitude indicator calculated for each of the one or more reference V sample regions so as to identify the correct LIDAR data solution for the subject RV sample region from among the possible LIDAR data solutions for the subject RV sample region. In some instances, the V sample region that is physically closest to the subject RV sample region is identified as the only reference V sample region. As an example, in
The LIDAR data generator 281 can employ one or more solution identification criteria to identify the correct LIDAR data solution for the subject RV sample region from among the possible LIDAR data solutions for the subject RV sample region and/or to identify the correct direction for a direction of the radial velocity indicator for a reference V sample region. An example identification criterion includes a proximate magnitude velocity criterion that provides a match between the velocity magnitude indicator for a reference V sample region SRk and a comparative component of a LIDAR data solution for a subject RV sample region. For instance, the possible LIDAR data solutions for the reference V sample regions have a component that serves as a comparative component that is an equivalent of the radial velocity indicator and can be compared to the velocity magnitude indicator. For instance, when the velocity magnitude indicator is the magnitude of a radial velocity calculation, each of the possible LIDAR data solutions for the reference V sample includes a radial velocity (VK) value that can serve as the comparative component. As another example, when the velocity magnitude indicator is the magnitude of a Doppler frequency shift, each of the possible LIDAR data solutions for the reference V sample includes an fd value that can serve as the comparative component. The LIDAR data solution that is for the subject RV sample region and that has the comparative component with the magnitude that is closest to the velocity magnitude indicator of the reference V sample regions can be selected as the correct LIDAR data solution for the subject RV sample region. Accordingly, the radial velocity Vk and distance Rk associated with the selected LIDAR data solution can serve as the LIDAR data for the subject RV sample region. Additionally, the direction of the comparative component in the selected LIDAR data solution can serve as the direction of the radial velocity indicator for the reference V sample region associated with the radial velocity indicator. As a result, the direction of the comparative component in the selected LIDAR data solution is assigned to the radial velocity indicator to provide a directional radial velocity indicator. Accordingly, the directional radial velocity indicator has the magnitude of the velocity magnitude indicator and the direction (positive or negative) of the comparative component in the selected LIDAR data solution. As an example where the radial velocity indicator is a radial velocity (Vk) calculation that provides a velocity magnitude indicator of 20 mph and the comparative component in the selected LIDAR data solution has a value of −20 mph, the negative value of the comparative component is assigned to the velocity magnitude indicator to provide a directional radial velocity indicator value of −20 mph.
The LIDAR data generator 281 can apply other solution identification criteria in addition or as an alternative to the proximate velocity magnitude criteria. Another example of an identification criterion can be a range criterion where the comparative component in each of the LIDAR data solutions for the subject sample region has a value within a range of comparative component values. In some instances, ranges for the magnitude of the comparative component values include, but are not limited to, the value of the velocity magnitude indicator of the reference V sample region +/−10%, 20%, or 30% of the velocity magnitude indicator of the reference V sample. In some instances, ranges for the magnitude of the comparative component values include, but are not limited to, the value of the velocity magnitude indicator of the reference V sample region +/−a constant value. In the event that the magnitude of the comparative component value for a subject RV sample region falls outside of the range, the LIDAR data solution that includes the comparative component value can be removed from the list of possible LIDAR data solutions. In the event that none of the possible LIDAR data solutions for a subject RV sample falls within the range, the LIDAR data for the subject RV sample region can be classified as unavailable. In some instances, the LIDAR data generator 281 applies both a range criterion and a proximate velocity magnitude criterion to a subject RV sample region.
At process block 347, the LIDAR data generator 281 can access the possible LIDAR data solutions that a preliminary LIDAR data generator calculated for a subject RV sample region as disclosed in the context of
At process block 349, the LIDAR data generator 281 can identify the correct solution. The radial velocity (Vk) component and/or the fd component of each LIDAR data solution can serve as the comparative component for the LIDAR data solution. The component that serves as the comparative component can be determined by the velocity magnitude indicator. For instance, as noted above, when the velocity magnitude indicator is the magnitude of a radial velocity calculation, each of the possible LIDAR data solutions for the reference V sample includes a radial velocity (VK) value that can serve as the comparative component but when the velocity magnitude indicator is the magnitude of a Doppler frequency shift each of the possible LIDAR data solutions for the reference V sample includes an fd value that can serve as the comparative component. When the radial velocity (VK) value serve as the comparative component and a possible LIDAR data solution does not already have a radial velocity (VK) component, a radial velocity (Vk) can be calculated for each of the possible LIDAR data solutions using the fd value associated with the LIDAR data solution and fd=2Vkfc/c.
The LIDAR data generator 281 can use the one or more solution identification criteria to compare the comparative component from the different LIDAR data solutions to the velocity magnitude indicator from one or more V sample regions so as to identify the correct LIDAR data solution. The LIDAR data generator 281 can select the LIDAR data solution that includes the identified comparative component as the correct LIDAR data solution.
At process block 350, the LIDAR data generator 281 identifies the LIDAR data for the subject RV sample region associated with sample region index k. For instance, when the components of the selected possible LIDAR data solution do not already include a range (RK), the range (RK) can be calculated for the selected LIDAR data solution using the fr value associated with the selected LIDAR data solution and fr=2*αu*Rk/c. Additionally, when the components of the selected possible LIDAR data solution do not already include a radial velocity (VK), the radial velocity (VK) can be calculated for the selected LIDAR data solution using the fa value associated with the selected LIDAR data solution and fd=2Vkfc/c. The values of Vk and Rk associated with the selected LIDAR data solution can serve as shared LIDAR data for the subject RV sample region SRk. Accordingly, the LIDAR data for the RV sample region associated with sample region index k can include or consist of the values of Vk and Rk selected in process block 322.
At process block 351, the LIDAR data generator 281 can determine the radial velocity for the reference V sample regions. The direction of the radial velocity indicator can be identified. For instance, the direction of the comparative component in the selected LIDAR data solution can serve as the direction of the radial velocity indicator for the reference V sample region associated with the radial velocity indicator. As a result, the direction of the comparative component in the selected LIDAR data solution is assigned to the radial velocity indicator to provide a directional radial velocity indicator. Accordingly, the directional radial velocity indicator has the magnitude of the velocity magnitude indicator and the direction (positive or negative) of the comparative component in the selected LIDAR data solution. When the velocity magnitude indicator is the magnitude of a radial velocity calculation, the directional radial velocity indicator can serve as the radial velocity (Vk) for sample regions SRk. When the velocity magnitude indicator is the magnitude of something other than a radial velocity calculation, the radial velocity can be calculated from the directional radial velocity indicator. For instance, when the velocity magnitude indicator is the magnitude of either of the beat frequencies (fd), the radial velocity (Vk) can be calculated from Cfd=2Vkfc/c where Cfd represents the directional radial velocity indicator.
At process block 353, the preliminary LIDAR data generators in the one or more velocity cores calculate the velocity magnitude indicator for each of the V sample regions. At process block 354, the preliminary LIDAR data generators in the one or more range and velocity cores calculate the possible LIDAR data solutions for each of the RV sample regions illuminated by one of the range and velocity cores. For instance, the preliminary LIDAR data generators 269 can calculate the possible LIDAR data solutions for each of the RV sample regions illuminated by one of the range and velocity cores.
At process block 355, the LIDAR data generator 281 identifies a subject RV sample region. The LIDAR data generator 281 also identifies one or more reference V sample region. In some instances, the V sample region that is physically closest to the subject RV sample region is identified as the only reference V sample region.
At process block 356, the LIDAR data generator 281 identifies the correct LIDAR data solution for the subject RV sample region. For instance, the LIDAR data generator 281 can select the correct LIDAR data solution for an RV sample region from among the possible LIDAR data solutions as disclosed on the context of
At process block 358, the LIDAR data generator 281 can determine the radial velocity (Vk) for each of the V reference sample regions. For instance, the common electronics 280 can determine the radial velocity (Vk) for each of the V reference sample regions as disclosed on the context of
Process block 355 through process block 358 can be repeated until each of the RV sample regions has served as a subject RV sample region or until the desired portion of the RV sample regions has served as a subject RV sample region and until each of the V sample regions has served as a reference V sample region or until the desired portion of the V sample regions has served as a reference V sample region.
The LIDAR data for the RV sample regions can serve as the range and radial velocity for each of the RV sample regions scanned by the RV cores in process block 300 of
A LIDAR system has a two-dimensional field of view. The field location fl1 is located in RV sample region SR1 and is identified as a known data point with coordinates R1=10 m and an angular orientation of θ1=10°. The field location fl10 is located in RV sample region SR10 and is identified as a known data point with coordinates R10=16 m and an angular orientation of θ10=12°. The field location fl15 is selected as a subject field location and is located in V sample region SR15 with an angular orientation of θ15=11°. The range R15 for field location fl15 is interpolated from the known data points fl1 and fl10 to be R15=13 m using a linear interpolation where R15=R1+(R10−R1)(θ15−θ1)(θ10−θ1).
Suitable platforms for the LIDAR chips include, but are not limited to, silica, indium phosphide, and silicon-on-insulator wafers.
The dimensions of the ridge waveguide are labeled in
As noted above, the electronics that operate the system include local electronics 32 and common electronics 280. The distinction between local electronics and common electronics is used to illustrate the portion of the electronics that are each associated with one of the cores (the local electronics) and the portion of the electronics associated with multiple cores (the common electronics). While the local electronics 32 and common electronics 104 are shown as being in different locations, the local electronics 32 and common electronics 104 can be in a common location and/or common packaging. Further, the local electronics 32 and common electronics 104 can be integrated and need not refer to discrete or distinct electronic components. As a result, functionality described as being performed by local electronics can be performed by common electronic and/or functionality described as being performed by common electronics can be performed by local electronic. Certain components of the electronics are disclosed above such as the preliminary LIDAR data generators and the LIDAR data generator; however, the electronics include additional components that are not illustrated. For instance, a portion of the local electronics and/or the common electronics can be configured to control the frequency of the systems output signal, steering of the system output signals, and operation of a frequency shifter 298
Suitable local electronics 32 and/or common electronics 104 can include, but are not limited to, a controller that includes or consists of analog electrical circuits, Application Specific Integrated Circuits (ASICSs), digital electrical circuits, processors, microprocessors, digital signal processors (DSPs), Field Programmable Gate Arrays (FPGAs), computers, microcomputers, or combinations suitable for performing the operation, monitoring and control functions described above. In some instances, the controller has access to a memory that includes instructions to be executed by the controller during performance of the operation, control and monitoring functions. Although the electronics are illustrated as a single component in a single location, the electronics can include multiple different components that are independent of one another and/or placed in different locations. Additionally, as noted above, all or a portion of the disclosed electronics can be included on the chip including electronics that are integrated with the chip.
Light sensors that are interfaced with waveguides on a LIDAR chip can be a component that is separate from the chip and then attached to the chip. For instance, the light sensor can be a photodiode, or an avalanche photodiode. Examples of suitable light sensor components include, but are not limited to, InGaAs PIN photodiodes manufactured by Hamamatsu located in Hamamatsu City, Japan, or an InGaAs APD (Avalanche Photo Diode) manufactured by Hamamatsu located in Hamamatsu City, Japan. These light sensors can be centrally located on the LIDAR chip. Alternately, all or a portion the waveguides that terminate at a light sensor can terminate at a facet located at an edge of the chip and the light sensor can be attached to the edge of the chip over the facet such that the light sensor receives light that passes through the facet. The use of light sensors that are a separate component from the chip is suitable for all or a portion of the light sensors selected from the group consisting of the first auxiliary light sensor 218, the second auxiliary light sensor 220, the first light sensor 223, and the second light sensor 224.
As an alternative to a light sensor that is a separate component, all or a portion of the light sensors can be integrated with the chip. For instance, examples of light sensors that are interfaced with ridge waveguides on a chip constructed from a silicon-on-insulator wafer can be found in Optics Express Vol. 15, No. 21, 13965-13971 (2007); U.S. Pat. No. 8,093,080, issued on Jan. 10 2012; U.S. Pat. No. 8,242,432, issued Aug. 14 2012; and U.S. Pat. No. 6,108,472, issued on Aug. 22, 2000 each of which is incorporated herein in its entirety. The use of light sensors that are integrated with the chip are suitable for all or a portion of the light sensors selected from the group consisting of the auxiliary light sensor 218, the second auxiliary light sensor 220, the first light sensor 223, and the second light sensor 224.
The light source 4 that is interfaced with the utility waveguide 12 can be a laser chip that is separate from the LIDAR chip and then attached to the LIDAR chip. For instance, the light source 4 can be a laser chip that is attached to the chip using a flip-chip arrangement. Use of flip-chip arrangements is suitable when the light source 4 is to be interfaced with a ridge waveguide on a chip constructed from silicon-on-insulator wafer. Alternately, the utility waveguide 12 can include an optical grating (not shown) such as Bragg grating that acts as a reflector for an external cavity laser. In these instances, the light source 4 can include a gain element that is separate from the LIDAR chip and then attached to the LIDAR chip in a flip-chip arrangement. Examples of suitable interfaces between flip-chip gain elements and ridge waveguides on chips constructed from silicon-on-insulator wafer can be found in U.S. Pat. No. 9,705,278, issued on Jul. 11, 2017 and in U.S. Pat. No. 5,991,484 issued on Nov. 23, 1999; each of which is incorporated herein in its entirety. When the light source 4 includes a gain element or laser chip, the local electronics 32 can tune the frequency of the outgoing LIDAR signal by changing the level of electrical current applied to through the gain element or laser cavity.
The above LIDAR systems include multiple optical components such as a LIDAR chip, LIDAR adapters, light source, light sensors, waveguides, and amplifiers. In some instances, the LIDAR systems include one or more passive optical components in addition to the illustrated optical components or as an alternative to the illustrated optical components. The passive optical components can be solid-state components that exclude moving parts. Suitable passive optical components include, but are not limited to, lenses, mirrors, optical gratings, reflecting surfaces, splitters, demulitplexers, multiplexers, polarizers, polarization splitters, and polarization rotators. In some instances, the LIDAR systems include one or more active optical components in addition to the illustrated optical components or as an alternative to the illustrated optical components. Suitable active optical components include, but are not limited to, optical switches, phase tuners, attenuators, steerable mirrors, steerable lenses, tunable demulitplexers, tunable multiplexers.
Other embodiments, combinations and modifications of this invention will occur readily to those of ordinary skill in the art in view of these teachings. Therefore, this invention is to be limited only by the following claims, which include all such embodiments and modifications when viewed in conjunction with the above specification and accompanying drawings.