The present invention generally relates to navigation and more specifically to systems and methods for navigation using lidar devices.
A Doppler effect (may also be referred to as “Doppler shift” or “Doppler”) may be described as a change in frequency of a wave in relation to an observer who is moving relative to the wave source. For example, the Doppler effect is observed when the source of the waves is moving towards or away from the observer. If the source is moving towards the observer, the perceived frequency is higher than the emitted frequency. If the source is moving away from the observer, the perceived frequency is lower than the emitted frequency.
The various embodiments of the present systems and methods for navigation using lidar devices (may collective be referred to as “Reconfigurable Navigation Doppler Lidars” (RNDLs)) contain several features, no single one of which is solely responsible for their desirable attributes. Without limiting the scope of the present embodiments, their more prominent features will now be discussed below. In particular, the present RNDLs will be discussed in the context of measuring velocity and/or position relative to terrain. However, the use of velocity and position is merely exemplary and various other measurements may be utilized for navigation using lidar devices as appropriate to the requirements of a specific application in accordance with various embodiments of the invention. After considering this discussion, and particularly after reading the section entitled “Detailed Description,” one will understand how the features of the present embodiments provide the advantages described here.
In many embodiments, RNDLs may include components (may also be referred to as “modules” or “elements”) such as, but not limited to, a signal processing and control module (SPCM) and optical transceivers. In several embodiments, a RNDL may measure radial velocity and distance of points in a terrain relative to itself. For example, radial velocity may be a projection of velocity vector onto a line of sight, which may be defined as a line connecting the sensor to the point that is being measured. This point may also be called a target. In some embodiments, the point may have some spatial extent rather than being a point in a purely mathematical sense. In various embodiments, the terrain or environment may include static objects and/or surfaces external to the sensor system. Examples may include the ground, buildings, and/or static or slowly moving objects. The various measurements may also be made for moving objects that are not part of the terrain. As further described below, the target may be a small surface area that belongs to some object.
In some embodiments, the components may include an optical waveform generator, collimating and beam steering optics, a digital signal processing (DSP) module, an inertial measurement unit (IMU), a global navigation satellite system (GNSS) receiver, a digital camera, and other submodules. The various components may be implemented in many ways known to one skilled in the art. For example, the transceiver may be implemented on an integrated optics platform represented by a chip with waveguides and other elements. The parts responsible for optical waveform generation may be located on both the chip and on the printed circuit board (PCB) or a separate chip (e.g., a chip that includes the SPCM electronics).
In various embodiments, the transceiver may aim laser emission in one or more directions, receive light reflected along those directions, mix received light with a local oscillator light, and produce electric return signals related to mixing optical fields. In certain embodiments, a RNDL may have one or more optical transceivers that perform this function. In some embodiments, each transceiver may have a dedicated laser generating a laser emission. In various embodiments, there may be one laser providing laser emission to multiple transceivers. In several embodiments, a RNDL may include an integrated optics chip. The integrated optics chip may include a laser that may be integrated on the chip or may be separate from the chip, an optical isolator, and optical elements that collimate light emitted by the chip or by the laser. In many embodiments, an isolator may be used to prevent laser emission reflections from returning to the laser. In several embodiments, the collimating optics may include no lens, a single lens, or a combination of lenses. In some embodiments, the emitting and receiving apertures may be located on the chip. For example, an on-chip aperture may include, but is not limited to, optical phased arrays, grating coupler structures, combinations of waveguides, scattering or emitting structures, and phase delay structures; these components may work together to provide collimated emission from the surface of the integrated optics chip. In many embodiments, light may travel in waveguides and components of the integrated optics chip and may be emitted into the environment as a free space beam. In some embodiments, lidar emissions may be directed at an angle from the chip surface. In many embodiments, the lidar emissions may reflect from a target in the environment and return to the optical aperture to be coupled back into the optical chip waveguide.
In many embodiments, the control module of the SPCM may provide signals to establish optical emission from the laser and to control its frequency, power, and temperature. For example, a RNDL may include a control module configured to provide a stable bias current to the laser such that laser frequency does not change in time. In some embodiments, the control module may be configured so that laser emission frequency is a repeating pattern with linearly increasing and decreasing optical frequency. In certain embodiments, the bandwidth of optical frequency excursions during this pattern and the repetition rate of the pattern may be adjusted to optimize sensor performance for a variety of measurement conditions. In some embodiments, the control module may also reconfigure optical transceivers or a DSP to process electrical signals generated by transceivers using a plurality of data processing modes or regimes.
In many embodiments, RDNLs may operate in a regime where the laser may emit light with a single stable optical frequency. In several embodiments, a DSP may perform a recording of digital samples of electric return signals through an analog-to-digital converter (ADC) and store it in memory. In some embodiments, a DSP may perform time to frequency conversions including, but not limited to, fast Fourier transforms on measurement data to reveal Doppler shifts in optical frequencies. For example, a Doppler shift of the frequency of an optical return signal may detected or measured if a target has a non-zero radial velocity. In some embodiments, velocity of the sensor system relative to a target surface may be measured in some, or all, of the channels. In many embodiments, the channels may point in different directions. In several embodiments, the length of a digital record that is transformed may be changed to adjust measurement rates or to adjust the resulting signal-to-noise ratio (SNR) of measurements. For example, in certain embodiments, at high altitudes when an optical signal reflecting off a target may be weaker the length of a recording segment may be longer to provide better SNR, and there may also be more segments processed and their spectra averaged. In some embodiments, when at lower altitudes or when maneuvering is required, the recording may be shorter to provide a faster measurement rate. In many embodiments, the velocity regime may provide better SNR compared to other operating regimes and may be used for positioning or localization.
In many embodiments, RNDLs may operate in a regime where a laser may emit light with a repeating pattern of frequency modulation. In certain embodiments, this frequency modulated continuous wave (FMCW) emission may lead to generation of the electrical return signal in a transceiver. This signal may be used to calculate the relative velocity and/or relative range to a target. In some embodiments, this may be used for mapping and surveying, for landing of autonomous aerial vehicles, for imaging the ground, or for detection of obstacles (e.g., wires, branches, poles, etc.). In many embodiments, the rate of the repeating pattern and the optical bandwidth may be adjusted to optimize for better range resolution or for higher data rate. In some embodiments, a digitized electrical return signal may be processed in different ways which are known to one skilled in the art. In some embodiments, the SNR in FMCW mode may be lower than in a velocity regime.
In several embodiments, RNDLs may measure state variables with respect to the environment and to characterize the environment through Doppler imaging. In certain embodiments, Doppler imaging includes, but is not limited to, imaging in which each point in the image may contain range and/or radial velocity information. In many embodiments, the RNDL may measure state variables including, but not limited to, vector velocity, range to a reference point or to several reference points, elevation over the ground, and angle of the sensor with respect to reference points including targets, terrain, and initial position. In certain embodiments, a RNDL may be rigidly attached to a movable platform, including, but not limited to, ground or aerial vehicles. In some embodiments, a RNDL may provide measured state variables to a host vehicle. In some embodiments, state variables may assist in performing vehicle navigation in the event of a GNSS outages or degradations. In many embodiments, the precision and update rate of measurements provided by a RNDL may greatly exceed what is possible with GNSS. For example, in many embodiments, a RNDL may measure velocity to mm/s levels of accuracy or precision and range to mm levels of accuracy or precision with respect to a target at rates of thousands of measurements per second. In many embodiments, the environment may be characterized to detect obstacles and to increase safety of vehicles equipped with a RNDL. In some embodiments, a RNDL may assess the flatness of a potential landing location. In certain embodiments, a RNDL may fuse range and velocity measurements with outputs from an onboard inertial measurement unit (IMU) through a filter algorithm, and any resulting positioning data may be much higher quality compared to using an IMU without a RNDL. In many embodiments, higher quality data may be used for navigation without a GNSS. In some embodiments, a RNDL may enable a dead reckoning approach to be effective, which provides many benefits to practical applications.
In a first aspect, a RNDL for measuring velocity and position relative to terrain is provided, the RNDL comprising an optical module including: at least one laser source configured to generate a laser emission, where the at least one laser source is capable of operating in a plurality of operating modes, and a transceiver configured to generate at least one electrical return signal, and a signal processing and control module configured to receive the at least one electrical return signal, generate a control signal, and transmit the control signal to the at least one laser source, where the control signal causes the at least one laser source to switch between the plurality of operating modes.
In an embodiment of the first aspect, the plurality of operating modes includes a velocity mode, where the velocity mode uses a stable laser emission frequency.
In another embodiment, the plurality of operating modes includes a range-plus-velocity mode, where the range-plus-velocity mode uses a Frequency-Modulated Continuous Wave (FMCW) laser emission.
In another embodiment, the plurality of operating modes includes an imaging mode, where the imaging mode uses a FMCW laser emission and where range and velocity data are produced at an increased rate compared to the range-plus-velocity mode.
In another embodiment, the RNDL further includes a plurality of transceivers.
In another embodiment, each of the plurality of transceivers operates independently.
In another embodiment, the transceiver is further configured to convert a portion of the laser emission into at least one sensing optical signal and a local oscillator optical signal, receive an optical return signal, where the optical return signal includes a portion of the at least one sensing optical signal that was scattered by a target, and generate the at least one electrical return signal by mixing the optical return signal and the local oscillator optical signal using a detector.
In another embodiment, the signal processing and control module is further configured to process the at least one electrical return signal to calculate a radial velocity.
In another embodiment, the signal processing and control module is further configured to process the at least one electrical return signal to calculate a range.
In another embodiment, the signal processing and control module is further configured to process the radial velocity from at least two transceivers to calculate a vector velocity.
In another embodiment, optical power emitted by the at least one laser source can be arbitrarily distributed among the at least two transceivers.
In another embodiment, each of the plurality of transceivers further comprises a dedicated laser source with a selectable operating mode.
In another embodiment, the RNDL further includes at least one optical element to collimate the at least one sensing optical signal.
In another embodiment, the at least one optical element changes a direction associated with the at least one sensing optical signal.
In another embodiment, the at least one electrical return signal generated by the transceiver includes in-phase (I) and quadrature (Q) signals.
In another embodiment, the processing and control module is further configured to determine a Doppler velocity sign.
In another embodiment, the RNDL further includes an inertial measurement unit (IMU) configured to detect the RNDL's acceleration.
In another embodiment, the IMU is further configured to detect the RNDL's rotation.
In another embodiment, the RNDL further includes a digital camera configured to record image data.
In another embodiment, the RNDL further includes a global navigation satellite system (GNSS) receiver.
The various embodiments of the present systems and methods for navigation using lidar devices will be discussed in detail with an emphasis on highlighting the advantageous features. In particular, the present embodiments include Reconfigurable Navigation Doppler Lidars (RNDLs) and these embodiments depict the novel and non-obvious RNDLs shown in the accompanying drawings, which are for illustrative purposes only. These drawings include the following figures:
The following detailed description describes the present embodiments with reference to the drawings. In the drawings, reference numbers label elements of the present embodiments. These reference numbers are reproduced below in connection with the discussion of the corresponding drawing features.
Turning now to the drawings, systems and methods for navigation using lidar devices (may collectively be referred to as “Reconfigurable Navigation Doppler Lidars” (RNDLs)) in accordance with embodiments of the invention are now disclosed. In many embodiments, RNDLs may include at least one laser source, at least one transceiver, and a signal processing and control module (SPCM) configured to adjust the at least one laser source between a plurality of modes, as further described below. In various embodiments, the plurality of modes may include a velocity-only mode that may utilize a constant laser emission frequency, a range-plus-velocity mode that may utilize an FMCW laser emission, and an imaging mode that may utilize an FMCW laser emission such that an increased measurement or data rate compared to range-plus-velocity mode is established. In many embodiments, the lidar device may cause the laser source to emit optical beams. Each of these beams, upon contacting an object, may create scattered light. Some of that light may then return to the RNDL's photodetectors in the channel that emitted the light beam. Mixing of this optical return with a portion of the laser light (the so-called local oscillator light) by photodetectors may be used to generate an electrical return signal that is digitized and processed in the RNDL's signal processing and control module (SPCM). The SPCM may provide various control functions such as, but not limited to, controlling the laser to create a desired optical frequency modulation or no modulation. In some embodiments, the SPCM may cause the reconfiguration of the optical transceiver, the allocation of laser power between transceivers and/or the beam steering of the optical signals.
In some embodiments, a RNDL may provide navigation data by utilizing Doppler shifts. A Doppler shift may be considered as the change in frequency a wave undergoes when it reflects off a moving surface. This frequency shift may be proportional to the velocity of the reflector along a line of sight, which may also be referred to as radial velocity. In many embodiments, a RNDL may use measurements taken in multiple non-coplanar directions to derive the vector velocity of the observer (e.g., a vessel utilizing a RNDL) with respect to multiple static points in the terrain that reflected the beams. In certain embodiments, two measurements may be used to derive a vector velocity in a plane if the third direction is constrained. A RNDL may be useful for tasks including, but not limited to, collision avoidance, skid detection in wheeled vehicles, navigating without GPS/GNSS, and correcting data from inertial measurement units (IMU). In some embodiments, a RNDL may assist with collision avoidance by detecting potential hazards within a given flight path. By enhancing collision avoidance and enabling high performance dead reckoning, a RNDL may facilitate tasks requiring safe autonomous navigation (e.g., delivery of goods, aerial mapping, etc.). In many embodiments, a RNDL may use vector velocity measurements to correct position derived from IMU readings to improve navigation accuracy.
In certain embodiments, a RNDL may be used to calculate real-time range and velocity relative to objects. In some embodiments, optical components of an optical module may be aligned to guide, collimate or shape laser emission and to receive reflected laser emissions. A reflected laser emission may be converted into an electrical signal which may be used to calculate navigational variables. In some embodiments, the electrical signal may be received by a SPCM or other module and those modules may perform the calculation of navigational data. In many embodiments, a control module may receive inputs including, but not limited to, flight data, navigation data or external commands, and may use the inputs to assist in controlling a laser source. RNDLs in accordance with embodiments of the invention are discussed further below.
RNDLs may be used to perform various functions such as, but not limited to calculating relative ranges and velocities of nearby locations (e.g., targets) in the surrounding environments (e.g., terrains). A schematic diagram illustrating an RNDL in accordance with an embodiment of the invention is shown in
A schematic diagram illustrating an RNDL in accordance with another embodiment of the invention is shown
Although specific RNDLs and components are discussed above with respect to
A schematic diagram of one optical waveform generator integrated with one signal processing and control module (SPCM) and one or more optical transceivers in accordance with an embodiment of the invention is shown in
In reference to
A schematic diagram of a SPCM integrated with multiple laser devices in accordance with an embodiment of the invention is shown in
A schematic diagram illustrating an optical mixer (may also be referred to as “mixer”) with a balanced detection in accordance with an embodiment of the invention is shown in
A schematic diagram illustrating a balanced detector in accordance with an embodiment of the invention is shown in
In many embodiments, the transceiver may be an optical module which may perform functions such as, but not limited to, emitting laser light in one or more directions, receiving light reflected in one or more directions, mixing received light with a local oscillator light, and producing an electric signal related to the mixing optical fields. An optical module can have one or more optical channels that perform these functions. Triangular FMCW waves are discussed further below.
Although specific signal collection and processing considerations are discussed above with respect to
A graph depicting a laser beam frequency modulated with a linear triangular waveform in accordance with an embodiment of the invention is depicted in
Although specific triangular FMCW waves are discussed above with respect to
RNDLs may be used to perform various processes that support navigation. For example, RNDLs may be used to generate a laser emission where the laser emission generated may have a stable frequency without modulation. Alternatively, the laser emission generated may be an FMCW emission. Further, after or during generating a laser emission, RNDLs may collect an electrical return signal resulting from the laser emission and RNDLs may process the return signal and use it to calculate navigation data. Moreover, based on navigation data (and external requests), RNDLs may determine an operating mode and, in some embodiments, reconfigure the SPCM, the transceivers, or both, to the operating mode.
A flowchart of a process of using a RNDL to set initial mode, generate a laser signal, receive and process a return signal, and determine and set the appropriate operating mode in accordance with an embodiment of the invention is shown in
A change in operating mode may be made by the user, the system, and/or by another method of determination. After determining (740) an appropriate operating mode, the SPCM may compare that to the current operating mode to determine if a change is necessary. If necessary, the SPCM may change and set (750) the operating mode so that the selected operating mode is the appropriate operating mode. If the previously selected mode is the same as the operating mode, the SPCM determines that it is appropriate, then no operating mode change may be necessary. After confirming or switching operating modes, the RNDL may next check to determine (760) if the measurements are still active. If the measurements are not active (760) or requested to be not active, the process is complete. If the measurements are active (760), however, the process may return to the generating (720) laser emission. This may continue until the measurements are no longer requested or the power is turned off.
The optical module may generate FMCW emissions. It may also generate laser emission with nearly constant optical frequency without modulation. At any given time, an optical module may generate the desired type of emission. A flowchart illustrating a process of generating laser emission with desired frequency modulation type in accordance with an embodiment of the invention is shown in
In many embodiments, if the SPCM determines (820) that an FMCW mode is not set (e.g., when a constant frequency emission is desired) it may reconfigure itself and the DSP to process electric return signals produced in the non-FMCW mode, as further described below. The process 800 may include sending (826) control signals to optical modules causing generation (828) of frequency emissions at a stable frequency. Once the laser source generates the desired emission, the process 800 may be complete. In many embodiments, the process 800 may be repeated continuously, or for as long as the SPCM sends control signals 822, 826 to the optical modules and laser sources.
In various embodiments, the process 800 may be performed by a single laser source or plurality laser sources. In some embodiments, if a plurality of laser sources is present, a RNDL may operate using one, some, or all the laser sources simultaneously. For example, one laser source 212 may provide laser emission to one or more transceiver channels 260. Further, one or more transceiver channels 320a . . . 320z may use a dedicated laser source. An RNDL may be configured to utilize a single laser source in accordance with an embodiment of the invention as shown in
The RNDL may also be configured to utilize a plurality of laser sources simultaneously. For example, an RNDL may include a laser controller 211 configured to control a plurality of lasers, each of which may operate independently of the other lasers. In this case, a channel 320 may include the transceiver 260 and its dedicated laser. For example, an RNDL may include a plurality of transceivers 320a . . . 320z and each transceiver channel may use its own laser modulation format.
A RNDL, via an optical module, may receive optical return signals originating from its laser emission. An optical module may then process the return signals to generate electrical return signals. A flowchart illustrating a process of receiving and processing the return signals in accordance with an embodiment of the invention is shown in
Return signals may contain information that is relevant to determining which operating mode is appropriate. By exploiting the data in the return signal via the DSP and taking into account any external mode requests, the SPCM may determine which operating mode to select. A flowchart illustrating a process of determining appropriate operating mode from calculated data and from mode requests in accordance with an embodiment of the invention is shown in
In reference to
Whichever mode is determined to be appropriate can then enable the next process, mode reconfiguration 1100. A flowchart illustrating a process of reconfiguring a SPCM to operate in the appropriate operating mode in accordance with an embodiment of the invention is shown in
Although specific processes for navigation using RNDLs are discussed above with respect to
This invention was made with Government support under contract 80NSSC21C0131 awarded by NASA. The Government has certain rights in the invention.