Light detection and ranging (lidar) is a technology that can be used to measure distances to remote targets. Typically, a lidar system includes a light source and an optical receiver. The light source can include, for example, a laser which emits light having a particular operating wavelength. The operating wavelength of a lidar system may lie, for example, in the infrared, visible, or ultraviolet portions of the electromagnetic spectrum. The light source emits light towards a target which scatters the light, and some of the scattered light is received back at the receiver. The system determines the distance to the target based on one or more characteristics associated with the received light. For example, the lidar system may determine the distance to the target based on the time of flight for a pulse of light emitted by the light source to travel to the target and back to the lidar system.
Various embodiments of the invention are disclosed in the following detailed description and the accompanying drawings.
The invention can be implemented in numerous ways, including as a process; an apparatus; a system; a composition of matter; a computer program product embodied on a computer readable storage medium; and/or a processor, such as a processor configured to execute instructions stored on and/or provided by a memory coupled to the processor. In this specification, these implementations, or any other form that the invention may take, may be referred to as techniques. In general, the order of the steps of disclosed processes may be altered within the scope of the invention. Unless stated otherwise, a component such as a processor or a memory described as being configured to perform a task may be implemented as a general component that is temporarily configured to perform the task at a given time or a specific component that is manufactured to perform the task. As used herein, the term ‘processor’ refers to one or more devices, circuits, and/or processing cores configured to process data, such as computer program instructions.
A detailed description of one or more embodiments of the invention is provided below along with accompanying figures that illustrate the principles of the invention. The invention is described in connection with such embodiments, but the invention is not limited to any embodiment. The scope of the invention is limited only by the claims and the invention encompasses numerous alternatives, modifications and equivalents. Numerous specific details are set forth in the following description in order to provide a thorough understanding of the invention. These details are provided for the purpose of example and the invention may be practiced according to the claims without some or all of these specific details. For the purpose of clarity, technical material that is known in the technical fields related to the invention has not been described in detail so that the invention is not unnecessarily obscured.
Multi-wavelength lidar systems are disclosed. Using the disclosed systems and techniques, a lidar system can utilize multiple different wavelength pulses and achieve significantly higher point densities. For example, by transmitting light pulses at two or more different wavelengths, the density of the disclosed lidar systems can increase by a factor of two or more when compared to a lidar system that emits pulses at only a single wavelength. In various embodiments, pulses of different wavelengths are emitted as a group with the pulses within the group intentionally delayed in time. The delay between the pulses within the group is selected and programmed using an encoding scheme, such as a fixed or variable encoding time delay. When a detection is registered at the lidar receiver, the time delay between different received pulses is measured. The measured time delay is then correlated with a transmit delay to determine the transmitted pulse that corresponds to each received pulse. In some embodiments, neighboring pulse groups utilize different encoding delays allowing the received pulses to be correlated to their corresponding transmit pulses with improved performance. In various embodiments, the disclosed techniques, including the multi-wavelength pulse encoding techniques, allow a lidar system to emit and decode two or more different wavelength pulse sources. As an example, a two-wavelength system can utilize both 1530 nm and 1550 nm wavelength pulses that are multiplexed. In some embodiments, the different pulses of different wavelengths are emitted with an offset, such as a slight transverse offset, and each received beam is directed to a different detector based on the offset. In some embodiments, the different pulses of different wavelengths are combined using an optical combiner or multiplexer, such as a fiber-optic or free-space wavelength combiner, into a single output beam. When the corresponding emitted beams are received, each received beam is separated according to wavelength, for example, using an optical splitter or demultiplexer.
In some embodiments, a lidar system comprises one or more light sources, one or more detectors, and one or more processors. The one or more light sources are configured to transmit a first transmit pulse group and a second transmit pulse group. The first transmit pulse group includes a first light pulse in a first wavelength and a second light pulse in a second wavelength with a first encoding time delay between the first light pulse and the second light pulse. The second transmit pulse group includes a third light pulse in the first wavelength and a fourth light pulse in the second wavelength with a second encoding time delay between the third light pulse and the fourth light pulse. In some embodiments, the first encoding time delay and the second encoding time delay are included in a history of transmitted encoding time delays. For example, the light pulses emitted from a lidar system are grouped into pulse groups. Each pulse group includes multiple pulses at different wavelengths with an encoded delay between the different pulses within the group. The different encoded delays between the pulses within each group are stored in a history of transmitted delays. In various embodiments, the stored history of encoded delays can be used to decode and match corresponding received pulses to their transmitted pulses.
In some embodiments, the one or more detectors of the lidar system are configured to detect received light pulses in the first wavelength and the second wavelength. For example, the lidar system includes one or more detectors, such as one or more avalanche photodiodes (APDs), to capture and detect the reflected pulses that correspond to the transmitted pulses. One or more instances of a single detector can be configured to detect the multiple pulses at different wavelengths and/or multiple detectors, where each detector is configured to detect only a single wavelength, can be utilized to detect the different pulses at different wavelengths. In some embodiments, in the case of multiple detectors, the detectors may be offset in space, for example, on the receive image plane of a lidar receiver, to account for output spacing associated with emitting the transmitted pulses.
In some embodiments, the one or more processors of the lidar system are configured to perform one or more correlations between a detected timing between a pair of received pulses included in the received light pulses and one or more encoding time delays from the history of transmitted encoding time delays to identify which transmit pulse group among candidate transmit pulse groups including the first transmit pulse group and the second transmit pulse group corresponds to the pair of received pulses included in the received light pulses. For example, when a group of received light pulses is received, the timing between the pulses is detected and measured. The measured timing is correlated to an encoded time delay applied to a previously transmitted pulse group. The correlation between transmitted and received pulses and pulse groups can be determined by referencing the stored history of transmitted encoding time delays. In various embodiments, the pulse groups that are transmitted closely in time are encoded with different time delays. The lidar system can use the different encoded time delays to decode and match the received pulses to their corresponding transmitted pulses.
Although the disclosed techniques are at times described herein with respect to a pulse group with two pulses at two different wavelengths, the disclosed techniques similarly apply to a pulse group with two or more pulses and two or more different wavelengths. For example, the disclosed techniques apply to a multi-wavelength lidar system that transmits pulse groups where each pulse group can include three different pulses at three different wavelengths. In various embodiments, the encoded timing delay for each pulse group can be stored in a variety of different formats. For pulse groups with more than two pulses, the encoded timing delay can be stored using different delays between the different pulses within a group, such as the delays between each pulse and the next pulse in the group, the delays for different pulses of the group with respect to the first (or a reference) pulse in the group, or another appropriate encoding format. In various embodiments, once a pulse group is identified, its corresponding encoded delay is marked as identified in the history of transmitted encoding time delays. In some embodiments, the history of transmitted encoding time delays is further used to discard received pulses that do not match a corresponding transmitted pulse and/or pulse group.
In various embodiments, the components of the lidar system used to emit and detect pulses at multiple wavelengths can vary. For example, a multi-wavelength lidar system can utilize one or more seed lasers. In some embodiments, a single seed laser is utilized to generate the pulses at different wavelengths. For example, the single seed laser is configured to rapidly switch between emitting pulses at different wavelengths. In some embodiments, multiple different seed lasers are utilized to generate the different wavelength pulses and each seed laser is configured for emitted pulses at a single wavelength. In some embodiments, multiple wavelengths of light are combined, for example, using an optical combiner or multiplexer, into a single output beam. Other laser configurations, including combinations of the described embodiments, may be appropriate as well. Similarly, in various embodiments, the lidar system can include one or more detectors to detect received pulses at different wavelengths. For example, a single detector can be used to detect multiple wavelengths. In an alternative embodiment, multiple detectors, each configured to detect a single wavelength, are used. For example, each detector can be coated with a bandpass or similar filter to decrease optical crosstalk between channels for detecting pulses at a single wavelength. In various embodiments, the detectors configured for detecting different wavelength pulses can be placed at a spacing relative to the offset used to transmit the different transmit pulses. For example, the pulses emitted at different wavelengths can be transmitted using the same transmit lens but with different output beams that are aimed at different locations. This can be accomplished by configuring the output beams with a transmit offset. The locations of the receiving detectors are configured to be positioned at locations on a receive image plane of a receiver based on the transmit offset used for the output beams. In some embodiments, the receive beam includes multiple wavelengths that are separated according to wavelength, for example, by using an optical splitter or demultiplexer. The separated wavelength beams can be detected by different detectors of the receiver.
A lidar system operates in a vehicle and includes multiple “eyes,” each of which has its own field of regard, or an angular range over which the eye scans targets using pulses of light in accordance with a scan pattern. The fields of regard can combine along a certain dimension (e.g., horizontally) to define the overall field of regard of the lidar system. The lidar system then can use data received via both eyes to generate a point cloud or otherwise process the received data.
In a two-eye configuration of the lidar system, the two eyes can be housed together and scan the respective fields of regard via a shared window or separate windows, or the eyes can be housed separately. In the latter case, an assembly referred to as a “sensor head” can include a scanner, a receiver, and an optical element such as a collimator or a laser diode to generate or convey a beam of light.
Depending on the implementation, each eye of a lidar system can include a separate scanner (e.g., each eye can be equipped with a pivotable scan mirror to scan the field of regard vertically and another pivotable scan mirror to scan the field of regard horizontally), a partially shared scanner (e.g., each eye can be equipped with a pivotable scan mirror to scan the field of regard vertically, and a shared polygon mirror can scan the corresponding fields of regard horizontally, using different reflective surfaces), or a fully shared scanner (e.g., a pivotable planar mirror can scan the fields of regard vertically by reflecting incident beams at different regions on the reflective surface, and a shared polygon mirror can scan the corresponding fields of regard horizontally, using different reflective surfaces).
Different hardware configurations allow the lidar system to operate the eyes more independently of each other, as is the case with separate scanners, or less independently, as is the case with a fully shared scanner. For example, the two or more eyes may scan the respective fields of regard using similar or different scan patterns. In one implementation, the two eyes trace out the same pattern, but with a certain time differential to maintain angular separation between light-source fields of view and thereby reduce the probability of cross-talk events between the sensor heads. In another implementation, the two eyes scan the corresponding fields of regard according to different scan patterns, at least in some operational states (e.g., when the vehicle is turning right or left).
Further, according to one approach, two eyes of a lidar system are arranged so that the fields of regard of the eyes are adjacent and non-overlapping. For example, each field of regard can span approximately 60 degrees horizontally and 30 degrees vertically, so that the combined field of regard of the lidar system spans approximately 120 degrees horizontally and 30 degrees vertically. The corresponding scanners (or paths within a shared scanner) can point away from each other at a certain angle, for example, so that the respective fields of regard abut approximately at an axis corresponding to the forward-facing direction of the vehicle.
Alternatively, the lidar system can operate in a “cross-eyed” configuration to create an area of overlap between the fields of regard. The area of overlap can be approximately centered along the forward-facing direction or another direction, which in some implementations a controller can determine dynamically. In this implementation, the two sensor heads can yield a higher density of scan in the area that generally is more important. In some implementations, the fields of regard in a cross-eyed two-eye configuration are offset from each other by a half-pixel value, so that the area of overlap has twice as many pixels. In general, the fields of regard can overlap angularly or translationally. To reduce the probability of cross-talk events (e.g., the situation when a pulse emitted by the light source associated with the first eye is received by the receiver of the second eye), the lidar system can use output beams with different wavelengths.
Once the output beam 125 reaches the downrange target 130, the target may scatter or reflect at least a portion of light from the output beam 125, and some of the scattered or reflected light may return toward the lidar system 100. In the example of
In particular embodiments, output beam 125 may include or may be referred to as an optical signal, output optical signal, emitted optical signal, output light, emitted pulse of light, laser beam, light beam, optical beam, emitted beam, emitted light, or beam. In particular embodiments, input beam 135 may include or may be referred to as a received optical signal, received pulse of light, input pulse of light, input optical signal, return beam, received beam, return light, received light, input light, scattered light, or reflected light. As used herein, scattered light may refer to light that is scattered or reflected by a target 130. As an example, an input beam 135 may include: light from the output beam 125 that is scattered by target 130; light from the output beam 125 that is reflected by target 130; or a combination of scattered and reflected light from target 130.
In particular embodiments, receiver 140 may receive or detect photons from input beam 135 and produce one or more representative signals. For example, the receiver 140 may produce an output electrical signal 145 that is representative of the input beam 135, and the electrical signal 145 may be sent to controller 150. In particular embodiments, receiver 140 or controller 150 may include a processor, computing system (e.g., an ASIC or FPGA), or other suitable circuitry. A controller 150 may be configured to analyze one or more characteristics of the electrical signal 145 from the receiver 140 to determine one or more characteristics of the target 130, such as its distance downrange from the lidar system 100. This may be done, for example, by analyzing a time of flight or a frequency or phase of a transmitted beam of light 125 or a received beam of light 135. If lidar system 100 measures a time of flight of T (e.g., T represents a round-trip time of flight for an emitted pulse of light to travel from the lidar system 100 to the target 130 and back to the lidar system 100), then the distance D from the target 130 to the lidar system 100 may be expressed as D=c·T/2, where c is the speed of light (approximately 3.0×108 m/s). As an example, if a time of flight is measured to be T=300 ns, then the distance from the target 130 to the lidar system 100 may be determined to be approximately D=45.0 m. As another example, if a time of flight is measured to be T=1.33 μs, then the distance from the target 130 to the lidar system 100 may be determined to be approximately D=199.5 m. In particular embodiments, a distance D from lidar system 100 to a target 130 may be referred to as a distance, depth, or range of target 130. As used herein, the speed of light c refers to the speed of light in any suitable medium, such as for example in air, water, or vacuum. As an example, the speed of light in vacuum is approximately 2.9979×108 m/s, and the speed of light in air (which has a refractive index of approximately 1.0003) is approximately 2.9970×108 m/s.
In particular embodiments, light source 110 may include one or more pulsed or CW lasers. As an example, light source 110 may be one or more pulsed lasers configured to produce or emit pulses of light with a pulse duration or pulse width of approximately 10 picoseconds (ps) to 100 nanoseconds (ns). The pulses may have a pulse duration of approximately 100 ps, 200 ps, 400 ps, 1 ns, 2 ns, 5 ns, 10 ns, 20 ns, 50 ns, 100 ns, or any other suitable pulse duration. As another example, light source 110 may be one or more pulsed lasers that produce pulses with a pulse duration of approximately 1-5 ns. As another example, light source 110 may be one or more pulsed lasers that produce pulses at a pulse repetition frequency of approximately 100 kHz to 10 MHz or a pulse period (e.g., a time between consecutive pulses) of approximately 100 ns to 10 μs. In particular embodiments, light source 110 may have a substantially constant pulse repetition frequency, or light source 110 may have a variable or adjustable pulse repetition frequency. As an example, light source 110 may be a pulsed laser that produces pulses at a substantially constant pulse repetition frequency of approximately 640 kHz (e.g., 640,000 pulses per second), corresponding to a pulse period of approximately 1.56 μs. As another example, light source 110 may have a pulse repetition frequency (which may be referred to as a repetition rate) that can be varied from approximately 200 kHz to 3 MHz. As used herein, a pulse of light may be referred to as an optical pulse, a light pulse, or a pulse. In some embodiments, light source 110 may emit pulses at different wavelengths and with a particular encoding time delay between the pulses of different wavelengths. For example, two different groups of pulses can each include pulses of different wavelengths and each pulse group can utilize a different encoding time delay.
In particular embodiments, light source 110 may include one or more pulsed or CW lasers that produce a free-space output beam 125 having any suitable average optical power. As an example, output beam 125 may have an average power of approximately 1 milliwatt (mW), 10 mW, 100 mW, 1 watt (W), 10 W, or any other suitable average power. In particular embodiments, output beam 125 may include optical pulses with any suitable pulse energy or peak optical power. As an example, output beam 125 may include pulses with a pulse energy of approximately 0.01 μJ, 0.1 μJ, 0.5 μJ, 1 μJ, 2 μJ, 10 μJ, 100 μJ, 1 mJ, or any other suitable pulse energy. As another example, output beam 125 may include pulses with a peak power of approximately 10 W, 100 W, 1 kW, 5 kW, 10 kW, or any other suitable peak power. The peak power (Ppeak) of a pulse of light can be related to the pulse energy (E) by the expression E=Ppeak·Δt, where Δt is the duration of the pulse, and the duration of a pulse may be defined as the full width at half maximum duration of the pulse. For example, an optical pulse with a duration of 1 ns and a pulse energy of 1 μJ has a peak power of approximately 1 kW. The average power (Pav) of an output beam 125 can be related to the pulse repetition frequency (PRF) and pulse energy by the expression Pav=PRF·E. For example, if the pulse repetition frequency is 500 kHz, then the average power of an output beam 125 with 1-μJ pulses is approximately 0.5 W.
In particular embodiments, light source 110 may include a laser diode, such as for example, a Fabry-Perot laser diode, a quantum well laser, a distributed Bragg reflector (DBR) laser, a distributed feedback (DFB) laser, a vertical-cavity surface-emitting laser (VCSEL), a quantum dot laser diode, a grating-coupled surface-emitting laser (GCSEL), a slab-coupled optical waveguide laser (SCOWL), a single-transverse-mode laser diode, a multi-mode broad area laser diode, a laser-diode bar, a laser-diode stack, or a tapered-stripe laser diode. As an example, light source 110 may include an aluminum-gallium-arsenide (AlGaAs) laser diode, an indium-gallium-arsenide (InGaAs) laser diode, an indium-gallium-arsenide-phosphide (InGaAsP) laser diode, or a laser diode that includes any suitable combination of aluminum (Al), indium (In), gallium (Ga), arsenic (As), phosphorous (P), or any other suitable material. In particular embodiments, light source 110 may include a pulsed or CW laser diode with a peak emission wavelength between 1200 nm and 1600 nm. As an example, light source 110 may include a current-modulated InGaAsP DFB laser diode that produces optical pulses at a wavelength of approximately 1550 nm. As another example, light source 110 may include a laser diode that emits light at a wavelength between 1500 nm and 1510 nm.
In particular embodiments, light source 110 may include a pulsed or CW laser diode followed by one or more optical-amplification stages. For example, a seed laser diode may produce a seed optical signal, and an optical amplifier may amplify the seed optical signal to produce an amplified optical signal that is emitted by the light source 110. In particular embodiments, an optical amplifier may include a fiber-optic amplifier or a semiconductor optical amplifier (SOA). For example, a pulsed laser diode may produce relatively low-power optical seed pulses which are amplified by a fiber-optic amplifier. As another example, a light source 110 may include a fiber-laser module that includes a current-modulated laser diode with an operating wavelength of approximately 1550 nm followed by a single-stage or a multi-stage erbium-doped fiber amplifier (EDFA) or erbium-ytterbium-doped fiber amplifier (EYDFA) that amplifies the seed pulses from the laser diode. As another example, light source 110 may include a continuous-wave (CW) or quasi-CW laser diode followed by an external optical modulator (e.g., an electro-optic amplitude modulator). The optical modulator may modulate the CW light from the laser diode to produce optical pulses which are sent to a fiber-optic amplifier or SOA. As another example, light source 110 may include a pulsed or CW seed laser diode followed by a semiconductor optical amplifier (SOA). The SOA may include an active optical waveguide configured to receive light from the seed laser diode and amplify the light as it propagates through the waveguide. The optical gain of the SOA may be provided by pulsed or direct-current (DC) electrical current supplied to the SOA. The SOA may be integrated on the same chip as the seed laser diode, or the SOA may be a separate device with an anti-reflection coating on its input facet or output facet. As another example, light source 110 may include a seed laser diode followed by an SOA, which in turn is followed by a fiber-optic amplifier. For example, the seed laser diode may produce relatively low-power seed pulses which are amplified by the SOA, and the fiber-optic amplifier may further amplify the optical pulses.
In particular embodiments, light source 110 may include a direct-emitter laser diode. A direct-emitter laser diode (which may be referred to as a direct emitter) may include a laser diode which produces light that is not subsequently amplified by an optical amplifier. A light source 110 that includes a direct-emitter laser diode may not include an optical amplifier, and the output light produced by a direct emitter may not be amplified after it is emitted by the laser diode. The light produced by a direct-emitter laser diode (e.g., optical pulses, CW light, or frequency-modulated light) may be emitted directly as a free-space output beam 125 without being amplified. A direct-emitter laser diode may be driven by an electrical power source that supplies current pulses to the laser diode, and each current pulse may result in the emission of an output optical pulse.
In particular embodiments, light source 110 may include a diode-pumped solid-state (DPSS) laser. A DPSS laser (which may be referred to as a solid-state laser) may refer to a laser that includes a solid-state, glass, ceramic, or crystal-based gain medium that is pumped by one or more pump laser diodes. The gain medium may include a host material that is doped with rare-earth ions (e.g., neodymium, erbium, ytterbium, or praseodymium). For example, a gain medium may include a yttrium aluminum garnet (YAG) crystal that is doped with neodymium (Nd) ions, and the gain medium may be referred to as a Nd:YAG crystal. A DPSS laser with a Nd:YAG gain medium may produce light at a wavelength between approximately 1300 nm and approximately 1400 nm, and the Nd:YAG gain medium may be pumped by one or more pump laser diodes with an operating wavelength between approximately 730 nm and approximately 900 nm. A DPSS laser may be a passively Q-switched laser that includes a saturable absorber (e.g., a vanadium-doped crystal that acts as a saturable absorber). Alternatively, a DPSS laser may be an actively Q-switched laser that includes an active Q-switch (e.g., an acousto-optic modulator or an electro-optic modulator). A passively or actively Q-switched DPSS laser may produce output optical pulses that form an output beam 125 of a lidar system 100.
In particular embodiments, an output beam of light 125 emitted by light source 110 may be a collimated optical beam having any suitable beam divergence, such as for example, a full-angle beam divergence of approximately 0.5 to 10 milliradians (mrad). A divergence of output beam 125 may refer to an angular measure of an increase in beam size (e.g., a beam radius or beam diameter) as output beam 125 travels away from light source 110 or lidar system 100. In particular embodiments, output beam 125 may have a substantially circular cross section with a beam divergence characterized by a single divergence value. As an example, an output beam 125 with a circular cross section and a full-angle beam divergence of 2 mrad may have a beam diameter or spot size of approximately 20 cm at a distance of 100 m from lidar system 100. In particular embodiments, output beam 125 may have a substantially elliptical cross section characterized by two divergence values. As an example, output beam 125 may have a fast axis and a slow axis, where the fast-axis divergence is greater than the slow-axis divergence. As another example, output beam 125 may be an elliptical beam with a fast-axis divergence of 4 mrad and a slow-axis divergence of 2 mrad.
In particular embodiments, an output beam of light 125 emitted by light source 110 may be unpolarized or randomly polarized, may have no specific or fixed polarization (e.g., the polarization may vary with time), or may have a particular polarization (e.g., output beam 125 may be linearly polarized, elliptically polarized, or circularly polarized). As an example, light source 110 may produce light with no specific polarization or may produce light that is linearly polarized.
In particular embodiments, lidar system 100 may include one or more optical components configured to reflect, focus, filter, shape, modify, steer, or direct light within the lidar system 100 or light produced or received by the lidar system 100 (e.g., output beam 125 or input beam 135). As an example, lidar system 100 may include one or more lenses, mirrors, filters (e.g., band-pass or interference filters), beam splitters, optical splitters, polarizers, polarizing beam splitters, wave plates (e.g., half-wave or quarter-wave plates), diffractive elements, holographic elements, isolators, couplers, detectors, beam combiners, or collimators. The optical components in a lidar system 100 may be free-space optical components, fiber-coupled optical components, or a combination of free-space and fiber-coupled optical components.
In particular embodiments, lidar system 100 may include a telescope, one or more lenses, or one or more mirrors configured to expand, focus, or collimate the output beam 125 or the input beam 135 to a desired beam diameter or divergence. As an example, the lidar system 100 may include one or more lenses to focus the input beam 135 onto a photodetector of receiver 140. As another example, the lidar system 100 may include one or more flat mirrors or curved mirrors (e.g., concave, convex, or parabolic mirrors) to steer or focus the output beam 125 or the input beam 135. For example, the lidar system 100 may include an off-axis parabolic mirror to focus the input beam 135 onto a photodetector of receiver 140. As illustrated in
In particular embodiments, mirror 115 may provide for output beam 125 and input beam 135 to be substantially coaxial so that the two beams travel along approximately the same optical path (albeit in opposite directions). The input and output beams being substantially coaxial may refer to the beams being at least partially overlapped or sharing a common propagation axis so that input beam 135 and output beam 125 travel along substantially the same optical path (albeit in opposite directions). As an example, output beam 125 and input beam 135 may be parallel to each other to within less than 10 mrad, 5 mrad, 2 mrad, 1 mrad, 0.5 mrad, or 0.1 mrad. As output beam 125 is scanned across a field of regard, the input beam 135 may follow along with the output beam 125 so that the coaxial relationship between the two beams is maintained.
In particular embodiments, lidar system 100 may include a scanner 120 configured to scan an output beam 125 across a field of regard of the lidar system 100. As an example, scanner 120 may include one or more scanning mirrors configured to pivot, rotate, oscillate, or move in an angular manner about one or more rotation axes. The output beam 125 may be reflected by a scanning mirror, and as the scanning mirror pivots or rotates, the reflected output beam 125 may be scanned in a corresponding angular manner. As an example, a scanning mirror may be configured to periodically pivot back and forth over a 30-degree range, which results in the output beam 125 scanning back and forth across a 60-degree range (e.g., a 0-degree rotation by a scanning mirror results in a 20-degree angular scan of output beam 125).
In particular embodiments, a scanning mirror (which may be referred to as a scan mirror) may be attached to or mechanically driven by a scanner actuator or mechanism which pivots or rotates the mirror over a particular angular range (e.g., over a 5° angular range, 30° angular range, 60° angular range, 120° angular range, 360° angular range, or any other suitable angular range). A scanner actuator or mechanism configured to pivot or rotate a mirror may include a galvanometer scanner, a resonant scanner, a piezoelectric actuator, a voice coil motor, an electric motor (e.g., a DC motor, a brushless DC motor, a synchronous electric motor, or a stepper motor), a microelectromechanical systems (MEMS) device, or any other suitable actuator or mechanism. As an example, a scanner 120 may include a scanning mirror attached to a galvanometer scanner configured to pivot back and forth over a 1° to 30° angular range. As another example, a scanner 120 may include a scanning mirror that is attached to or is part of a MEMS device configured to scan over a 1° to 30° angular range. As another example, a scanner 120 may include a polygon mirror configured to rotate continuously in the same direction (e.g., rather than pivoting back and forth, the polygon mirror continuously rotates 360 degrees in a clockwise or counterclockwise direction). The polygon mirror may be coupled or attached to a synchronous motor configured to rotate the polygon mirror at a substantially fixed rotational frequency (e.g., a rotational frequency of approximately 1 Hz, 10 Hz, 50 Hz, 100 Hz, 500 Hz, or 1,000 Hz).
In particular embodiments, scanner 120 may be configured to scan the output beam 125 (which may include at least a portion of the light emitted by light source 110) across a field of regard of the lidar system 100. A field of regard (FOR) of a lidar system 100 may refer to an area, region, or angular range over which the lidar system 100 may be configured to scan or capture distance information. As an example, a lidar system 100 with an output beam 125 with a 30-degree scanning range may be referred to as having a 30-degree angular field of regard. As another example, a lidar system 100 with a scanning mirror that rotates over a 30-degree range may produce an output beam 125 that scans across a 60-degree range (e.g., a 60-degree FOR). In particular embodiments, lidar system 100 may have a FOR of approximately 10°, 20°, 40°, 60°, 120°, 360°, or any other suitable FOR.
In particular embodiments, scanner 120 may be configured to scan the output beam 125 horizontally and vertically, and lidar system 100 may have a particular FOR along the horizontal direction and another particular FOR along the vertical direction. As an example, lidar system 100 may have a horizontal FOR of 10° to 120° and a vertical FOR of 2° to 45°. In particular embodiments, scanner 120 may include a first scan mirror and a second scan mirror, where the first scan mirror directs the output beam 125 toward the second scan mirror, and the second scan mirror directs the output beam 125 downrange from the lidar system 100. As an example, the first scan mirror may scan the output beam 125 along a first direction, and the second scan mirror may scan the output beam 125 along a second direction that is substantially orthogonal to the first direction. As another example, the first scan mirror may scan the output beam 125 along a substantially horizontal direction, and the second scan mirror may scan the output beam 125 along a substantially vertical direction (or vice versa). As another example, the first and second scan mirrors may each be driven by galvanometer scanners. As another example, the first or second scan mirror may include a polygon mirror driven by an electric motor. In particular embodiments, scanner 120 may be referred to as a beam scanner, optical scanner, or laser scanner.
In particular embodiments, one or more scanning mirrors may be communicatively coupled to controller 150 which may control the scanning mirror(s) so as to guide the output beam 125 in a desired direction downrange or along a desired scan pattern. In particular embodiments, a scan pattern may refer to a pattern or path along which the output beam 125 is directed. As an example, scanner 120 may include two scanning mirrors configured to scan the output beam 125 across a 60° horizontal FOR and a 20° vertical FOR. The two scanner mirrors may be controlled to follow a scan path that substantially covers the 60°×20° FOR. As an example, the scan path may result in a point cloud with pixels that substantially cover the 60°×20° FOR. The pixels may be approximately evenly distributed across the 60°×20° FOR. Alternatively, the pixels may have a particular nonuniform distribution (e.g., the pixels may be distributed across all or a portion of the 60°×20° FOR, and the pixels may have a higher density in one or more particular regions of the 60°×20° FOR).
In particular embodiments, a lidar system 100 may include a scanner 120 with a solid-state scanning device. A solid-state scanning device may refer to a scanner 120 that scans an output beam 125 without the use of moving parts (e.g., without the use of a mechanical scanner, such as a mirror that rotates or pivots). For example, a solid-state scanner 120 may include one or more of the following: an optical phased array scanning device; a liquid-crystal scanning device; or a liquid lens scanning device. A solid-state scanner 120 may be an electrically addressable device that scans an output beam 125 along one axis (e.g., horizontally) or along two axes (e.g., horizontally and vertically). In particular embodiments, a scanner 120 may include a solid-state scanner and a mechanical scanner. For example, a scanner 120 may include an optical phased array scanner configured to scan an output beam 125 in one direction and a galvanometer scanner that scans the output beam 125 in an orthogonal direction. The optical phased array scanner may scan the output beam relatively rapidly in a horizontal direction across the field of regard (e.g., at a scan rate of 50 to 1,000 scan lines per second), and the galvanometer may pivot a mirror at a rate of 1-30 Hz to scan the output beam 125 vertically.
In particular embodiments, a lidar system 100 may include a light source 110 configured to emit pulses of light and a scanner 120 configured to scan at least a portion of the emitted pulses of light across a field of regard of the lidar system 100. One or more of the emitted pulses of light may be scattered by a target 130 located downrange from the lidar system 100, and a receiver 140 may detect at least a portion of the pulses of light scattered by the target 130. A receiver 140 may be referred to as a photoreceiver, optical receiver, optical sensor, detector, photodetector, or optical detector. In particular embodiments, lidar system 100 may include a receiver 140 that receives or detects at least a portion of input beam 135 and produces an electrical signal that corresponds to input beam 135. As an example, if input beam 135 includes an optical pulse, then receiver 140 may produce an electrical current or voltage pulse that corresponds to the optical pulse detected by receiver 140. As another example, receiver 140 may include one or more avalanche photodiodes (APDs) or one or more single-photon avalanche diodes (SPADs). As another example, receiver 140 may include one or more PN photodiodes (e.g., a photodiode structure formed by a p-type semiconductor and an n-type semiconductor, where the PN acronym refers to the structure having p-doped and n-doped regions) or one or more PIN photodiodes (e.g., a photodiode structure formed by an undoped intrinsic semiconductor region located between p-type and n-type regions, where the PIN acronym refers to the structure having p-doped, intrinsic, and n-doped regions). An APD, SPAD, PN photodiode, or PIN photodiode may each be referred to as a detector, photodetector, or photodiode. A detector may have an active region or an avalanche-multiplication region that includes silicon, germanium, InGaAs, InAsSb (indium arsenide antimonide), AlAsSb (aluminum arsenide antimonide), or AlInAsSb (aluminum indium arsenide antimonide). The active region may refer to an area over which a detector may receive or detect input light. An active region may have any suitable size or diameter, such as for example, a diameter of approximately 10 μm, 25 μm, 50 μm, 80 μm, 100 μm, 200 μm, 500 μm, 1 mm, 2 mm, or 5 mm.
In particular embodiments, receiver 140 may include electronic circuitry that performs signal amplification, sampling, filtering, signal conditioning, analog-to-digital conversion, time-to-digital conversion, pulse detection, threshold detection, rising-edge detection, or falling-edge detection. As an example, receiver 140 may include a transimpedance amplifier that converts a received photocurrent (e.g., a current produced by an APD in response to a received optical signal) into a voltage signal. The voltage signal may be sent to pulse-detection circuitry that produces an analog or digital output signal 145 that corresponds to one or more optical characteristics (e.g., rising edge, falling edge, amplitude, duration, or energy) of a received optical pulse. As an example, the pulse-detection circuitry may perform a time-to-digital conversion to produce a digital output signal 145. The electrical output signal 145 may be sent to controller 150 for processing or analysis (e.g., to determine a time-of-flight value corresponding to a received optical pulse).
In particular embodiments, a controller 150 (which may include or may be referred to as a processor, an FPGA, an ASIC, a computer, or a computing system) may be located within a lidar system 100 or outside of a lidar system 100. Alternatively, one or more parts of a controller 150 may be located within a lidar system 100, and one or more other parts of a controller 150 may be located outside a lidar system 100. In particular embodiments, one or more parts of a controller 150 may be located within a receiver 140 of a lidar system 100, and one or more other parts of a controller 150 may be located in other parts of the lidar system 100. For example, a receiver 140 may include an FPGA or ASIC configured to process an output electrical signal from the receiver 140, and the processed signal may be sent to a computing system located elsewhere within the lidar system 100 or outside the lidar system 100. In particular embodiments, a controller 150 may include any suitable arrangement or combination of logic circuitry, analog circuitry, or digital circuitry.
In particular embodiments, controller 150 may be electrically coupled or communicatively coupled to light source 110, scanner 120, or receiver 140. As an example, controller 150 may receive electrical trigger pulses or edges from light source 110, where each pulse or edge corresponds to the emission of an optical pulse by light source 110. As another example, controller 150 may provide instructions, a control signal, or a trigger signal to light source 110 indicating when light source 110 should produce optical pulses. Controller 150 may send an electrical trigger signal that includes electrical pulses, where each electrical pulse results in the emission of an optical pulse by light source 110. In particular embodiments, the frequency, period, duration, pulse energy, peak power, average power, or wavelength of the optical pulses produced by light source 110 may be adjusted based on instructions, a control signal, or trigger pulses provided by controller 150. In particular embodiments, controller 150 may be coupled to light source 110 and receiver 140, and controller 150 may determine a time-of-flight value for an optical pulse based on timing information associated with when the pulse was emitted by light source 110 and when a portion of the pulse (e.g., input beam 135) was detected or received by receiver 140. In particular embodiments, controller 150 may include circuitry that performs signal amplification, sampling, filtering, signal conditioning, analog-to-digital conversion, time-to-digital conversion, pulse detection, threshold detection, rising-edge detection, or falling-edge detection.
In particular embodiments, lidar system 100 may include one or more processors (e.g., a controller 150) configured to determine a distance D from the lidar system 100 to a target 130 based at least in part on a round-trip time of flight for an emitted pulse of light to travel from the lidar system 100 to the target 130 and back to the lidar system 100. The target 130 may be at least partially contained within a field of regard of the lidar system 100 and located a distance D from the lidar system 100 that is less than or equal to an operating range (ROP) of the lidar system 100. In particular embodiments, an operating range (which may be referred to as an operating distance) of a lidar system 100 may refer to a distance over which the lidar system 100 is configured to sense or identify targets 130 located within a field of regard of the lidar system 100. The operating range of lidar system 100 may be any suitable distance, such as for example, 25 m, 50 m, 100 m, 200 m, 250 m, 500 m, or 1 km. As an example, a lidar system 100 with a 200-m operating range may be configured to sense or identify various targets 130 located up to 200 m away from the lidar system 100. The operating range ROP of a lidar system 100 may be related to the time τ between the emission of successive optical signals by the expression ROP=c·τ/2. For a lidar system 100 with a 200-m operating range (ROP=200 m), the time τ between successive pulses (which may be referred to as a pulse period, a pulse repetition interval (PRI), or a time period between pulses) is approximately 2 ROP/c≅1.33 μs. The pulse period τ may also correspond to the time of flight for a pulse to travel to and from a target 130 located a distance ROP from the lidar system 100. Additionally, the pulse period τ may be related to the pulse repetition frequency (PRF) by the expression τ=1/PRF. For example, a pulse period of 1.33 μs corresponds to a PRF of approximately 752 kHz.
In particular embodiments, a lidar system 100 may be used to determine the distance to one or more downrange targets 130. By scanning the lidar system 100 across a field of regard, the system may be used to map the distance to a number of points within the field of regard. Each of these depth-mapped points may be referred to as a pixel or a voxel. A collection of pixels captured in succession (which may be referred to as a depth map, a point cloud, or a frame) may be rendered as an image or may be analyzed to identify or detect objects or to determine a shape or distance of objects within the FOR. As an example, a point cloud may cover a field of regard that extends 60° horizontally and 15° vertically, and the point cloud may include a frame of 100-2000 pixels in the horizontal direction by 4-400 pixels in the vertical direction.
In particular embodiments, lidar system 100 may be configured to repeatedly capture or generate point clouds of a field of regard at any suitable frame rate between approximately 0.1 frames per second (FPS) and approximately 1,000 FPS. As an example, lidar system 100 may generate point clouds at a frame rate of approximately 0.1 FPS, 0.5 FPS, 1 FPS, 2 FPS, 5 FPS, 10 FPS, 20 FPS, 100 FPS, 500 FPS, or 1,000 FPS. As another example, lidar system 100 may be configured to produce optical pulses at a rate of 5×105 pulses/second (e.g., the system may determine 500,000 pixel distances per second) and scan a frame of 1000×50 pixels (e.g., 50,000 pixels/frame), which corresponds to a point-cloud frame rate of 10 frames per second (e.g., 10 point clouds per second). In particular embodiments, a point-cloud frame rate may be substantially fixed, or a point-cloud frame rate may be dynamically adjustable. As an example, a lidar system 100 may capture one or more point clouds at a particular frame rate (e.g., 1 Hz) and then switch to capture one or more point clouds at a different frame rate (e.g., 10 Hz). A slower frame rate (e.g., 1 Hz) may be used to capture one or more high-resolution point clouds, and a faster frame rate (e.g., 10 Hz) may be used to rapidly capture multiple lower-resolution point clouds.
In particular embodiments, a lidar system 100 may be configured to sense, identify, or determine distances to one or more targets 130 within a field of regard. As an example, a lidar system 100 may determine a distance to a target 130, where all or part of the target 130 is contained within a field of regard of the lidar system 100. All or part of a target 130 being contained within a FOR of the lidar system 100 may refer to the FOR overlapping, encompassing, or enclosing at least a portion of the target 130. In particular embodiments, target 130 may include all or part of an object that is moving or stationary relative to lidar system 100. As an example, target 130 may include all or a portion of a person, vehicle, motorcycle, truck, train, bicycle, wheelchair, pedestrian, animal, road sign, traffic light, lane marking, road-surface marking, parking space, pylon, guard rail, traffic barrier, pothole, railroad crossing, obstacle in or near a road, curb, stopped vehicle on or beside a road, utility pole, house, building, trash can, mailbox, tree, any other suitable object, or any suitable combination of all or part of two or more objects. In particular embodiments, a target may be referred to as an object.
In particular embodiments, light source 110, scanner 120, and receiver 140 may be packaged together within a single housing, where a housing may refer to a box, case, or enclosure that holds or contains all or part of a lidar system 100. As an example, a lidar-system enclosure may contain a light source 110, mirror 115, scanner 120, and receiver 140 of a lidar system 100. Additionally, the lidar-system enclosure may include a controller 150. The lidar-system enclosure may also include one or more electrical connections for conveying electrical power or electrical signals to or from the enclosure. In particular embodiments, one or more components of a lidar system 100 may be located remotely from a lidar-system enclosure. As an example, all or part of light source 110 may be located remotely from a lidar-system enclosure, and pulses of light produced by the light source 110 may be conveyed to the enclosure via optical fiber. As another example, all or part of a controller 150 may be located remotely from a lidar-system enclosure.
In particular embodiments, light source 110 may include an eye-safe laser, or lidar system 100 may be classified as an eye-safe laser system or laser product. An eye-safe laser, laser system, or laser product may refer to a system that includes a laser with an emission wavelength, average power, peak power, peak intensity, pulse energy, beam size, beam divergence, exposure time, or scanned output beam such that emitted light from the system presents little or no possibility of causing damage to a person's eyes. As an example, light source 110 or lidar system 100 may be classified as a Class 1 laser product (as specified by the 60825-1:2014 standard of the International Electrotechnical Commission (IEC)) or a Class I laser product (as specified by Title 21, Section 1040.10 of the United States Code of Federal Regulations (CFR)) that is safe under all conditions of normal use. In particular embodiments, lidar system 100 may be an eye-safe laser product (e.g., with a Class 1 or Class I classification) configured to operate at any suitable wavelength between approximately 900 nm and approximately 2100 nm. As an example, lidar system 100 may include a laser with an operating wavelength between approximately 1200 nm and approximately 1400 nm or between approximately 1400 nm and approximately 1600 nm, and the laser or the lidar system 100 may be operated in an eye-safe manner. As another example, lidar system 100 may be an eye-safe laser product that includes a scanned laser with an operating wavelength between approximately 900 nm and approximately 1700 nm. As another example, lidar system 100 may be a Class 1 or Class I laser product that includes a laser diode, fiber laser, or solid-state laser with an operating wavelength between approximately 1200 nm and approximately 1600 nm. As another example, lidar system 100 may have operating wavelengths between approximately 1500 nm and approximately 1550 nm.
In particular embodiments, one or more lidar systems 100 may be integrated into a vehicle. As an example, multiple lidar systems 100 may be integrated into a car to provide a complete 360-degree horizontal FOR around the car. As another example, 2-10 lidar systems 100, each system having a 45-degree to 180-degree horizontal FOR, may be combined together to form a sensing system that provides a point cloud covering a 360-degree horizontal FOR. The lidar systems 100 may be oriented so that adjacent FORs have an amount of spatial or angular overlap to allow data from the multiple lidar systems 100 to be combined or stitched together to form a single or continuous 360-degree point cloud. As an example, the FOR of each lidar system 100 may have approximately 1-30 degrees of overlap with an adjacent FOR. In particular embodiments, a vehicle may refer to a mobile machine configured to transport people or cargo. For example, a vehicle may include, may take the form of, or may be referred to as a car, automobile, motor vehicle, truck, bus, van, trailer, off-road vehicle, farm vehicle, lawn mower, construction equipment, forklift, robot, golf cart, motorhome, taxi, motorcycle, scooter, bicycle, skateboard, train, snowmobile, watercraft (e.g., a ship or boat), aircraft (e.g., a fixed-wing aircraft, helicopter, or dirigible), unmanned aerial vehicle (e.g., drone), or spacecraft. In particular embodiments, a vehicle may include an internal combustion engine or an electric motor that provides propulsion for the vehicle.
In particular embodiments, one or more lidar systems 100 may be included in a vehicle as part of an advanced driver assistance system (ADAS) to assist a driver of the vehicle in operating the vehicle. For example, a lidar system 100 may be part of an ADAS that provides information (e.g., about the surrounding environment) or feedback to a driver (e.g., to alert the driver to potential problems or hazards) or that automatically takes control of part of a vehicle (e.g., a braking system or a steering system) to avoid collisions or accidents. A lidar system 100 may be part of a vehicle ADAS that provides adaptive cruise control, automated braking, automated parking, collision avoidance, alerts the driver to hazards or other vehicles, maintains the vehicle in the correct lane, or provides a warning if an object or another vehicle is in a blind spot.
In particular embodiments, one or more lidar systems 100 may be integrated into a vehicle as part of an autonomous-vehicle driving system. As an example, a lidar system 100 may provide information about the surrounding environment to a driving system of an autonomous vehicle. An autonomous-vehicle driving system may be configured to guide the autonomous vehicle through an environment surrounding the vehicle and toward a destination. An autonomous-vehicle driving system may include one or more computing systems that receive information from a lidar system 100 about the surrounding environment, analyze the received information, and provide control signals to the vehicle's driving systems (e.g., steering mechanism, accelerator, brakes, lights, or turn signals). As an example, a lidar system 100 integrated into an autonomous vehicle may provide an autonomous-vehicle driving system with a point cloud every 0.1 seconds (e.g., the point cloud has a 10 Hz update rate, representing 10 frames per second). The autonomous-vehicle driving system may analyze the received point clouds to sense or identify targets 130 and their respective locations, distances, or speeds, and the autonomous-vehicle driving system may update control signals based on this information. As an example, if lidar system 100 detects a vehicle ahead that is slowing down or stopping, the autonomous-vehicle driving system may send instructions to release the accelerator and apply the brakes.
In particular embodiments, an autonomous vehicle may be referred to as an autonomous car, driverless car, self-driving car, robotic car, or unmanned vehicle. In particular embodiments, an autonomous vehicle may refer to a vehicle configured to sense its environment and navigate or drive with little or no human input. As an example, an autonomous vehicle may be configured to drive to any suitable location and control or perform all safety-critical functions (e.g., driving, steering, braking, parking) for the entire trip, with the driver not expected to control the vehicle at any time. As another example, an autonomous vehicle may allow a driver to safely turn their attention away from driving tasks in particular environments (e.g., on freeways), or an autonomous vehicle may provide control of a vehicle in all but a few environments, requiring little or no input or attention from the driver.
In particular embodiments, an autonomous vehicle may be configured to drive with a driver present in the vehicle, or an autonomous vehicle may be configured to operate the vehicle with no driver present. As an example, an autonomous vehicle may include a driver's seat with associated controls (e.g., steering wheel, accelerator pedal, and brake pedal), and the vehicle may be configured to drive with no one seated in the driver's seat or with little or no input from a person seated in the driver's seat. As another example, an autonomous vehicle may not include any driver's seat or associated driver's controls, and the vehicle may perform substantially all driving functions (e.g., driving, steering, braking, parking, and navigating) without human input. As another example, an autonomous vehicle may be configured to operate without a driver (e.g., the vehicle may be configured to transport human passengers or cargo without a driver present in the vehicle). As another example, an autonomous vehicle may be configured to operate without any human passengers (e.g., the vehicle may be configured for transportation of cargo without having any human passengers onboard the vehicle).
In particular embodiments, an optical signal (which may be referred to as a light signal, a light waveform, an optical waveform, an output beam, an emitted optical signal, or emitted light) may include pulses of light, CW light, amplitude-modulated light, frequency-modulated (FM) light, or any suitable combination thereof. Although this disclosure describes or illustrates example embodiments of lidar systems 100 or light sources 110 that produce optical signals that include pulses of light, the embodiments described or illustrated herein may also be applied, where appropriate, to other types of optical signals, including continuous-wave (CW) light, amplitude-modulated optical signals, or frequency-modulated optical signals. For example, a lidar system 100 as described or illustrated herein may be a pulsed lidar system and may include a light source 110 that produces pulses of light. Alternatively, a lidar system 100 may be configured to operate as a frequency-modulated continuous-wave (FMCW) lidar system and may include a light source 110 that produces CW light or a frequency-modulated optical signal.
In particular embodiments, a lidar system 100 may be an FMCW lidar system where the emitted light from the light source 110 (e.g., output beam 125 in
A light source 110 for a FMCW lidar system may include at least one instance of (i) a direct-emitter laser diode, (ii) a seed laser diode followed by an SOA, (iii) a seed laser diode followed by a fiber-optic amplifier, or (iv) a seed laser diode followed by an SOA and then a fiber-optic amplifier. A seed laser diode or a direct-emitter laser diode may be operated in a CW manner (e.g., by driving the laser diode with a substantially constant DC current), and a frequency modulation may be provided by an external modulator (e.g., an electro-optic phase modulator may apply a frequency modulation to seed-laser light). Alternatively, a frequency modulation may be produced by applying a current modulation to a seed laser diode or a direct-emitter laser diode. The current modulation (which may be provided along with a DC bias current) may produce a corresponding refractive-index modulation in the laser diode, which results in a frequency modulation of the light emitted by the laser diode. The current-modulation component (and the corresponding frequency modulation) may have any suitable frequency or shape (e.g., piecewise linear, sinusoidal, triangle-wave, or sawtooth). For example, the current-modulation component (and the resulting frequency modulation of the emitted light) may increase or decrease monotonically over a particular time interval. As another example, the current-modulation component may include a triangle or sawtooth wave with an electrical current that increases or decreases linearly over a particular time interval, and the light emitted by the laser diode may include a corresponding frequency modulation in which the optical frequency increases or decreases approximately linearly over the particular time interval. For example, a light source 110 that emits light with a linear frequency change of 200 MHz over a 2-μs time interval may be referred to as having a frequency modulation m of 1014 Hz/s (or, 100 MHz/μs).
In addition to producing frequency-modulated emitted light, a light source 110 may also produce frequency-modulated local-oscillator (LO) light. The LO light may be coherent with the emitted light, and the frequency modulation of the LO light may match that of the emitted light. The LO light may be produced by splitting off a portion of the emitted light prior to the emitted light exiting the lidar system. Alternatively, the LO light may be produced by a seed laser diode or a direct-emitter laser diode that is part of the light source 110. For example, the LO light may be emitted from the back facet of a seed laser diode or a direct-emitter laser diode, or the LO light may be split off from the seed light emitted from the front facet of a seed laser diode. The received light (e.g., emitted light that is scattered by a target 130) and the LO light may each be frequency modulated, with a frequency difference or offset that corresponds to the distance to the target 130. For a linearly chirped light source (e.g., a frequency modulation that produces a linear change in frequency with time), the larger the frequency difference is between the received light and the LO light, the farther away the target 130 is located.
A frequency difference between received light and LO light may be determined by mixing the received light with the LO light (e.g., by coupling the two beams onto a detector so they are coherently mixed together at the detector) and determining the resulting beat frequency. For example, a photocurrent signal produced by an APD may include a beat signal resulting from the coherent mixing of the received light and the LO light, and a frequency of the beat signal may correspond to the frequency difference between the received light and the LO light. The photocurrent signal from an APD (or a voltage signal that corresponds to the photocurrent signal) may be analyzed using a frequency-analysis technique (e.g., a fast Fourier transform (FFT) technique) to determine the frequency of the beat signal. If a linear frequency modulation m (e.g., in units of Hz/s) is applied to a CW laser, then the round-trip time T may be related to the frequency difference Δf between the received scattered light and the LO light by the expression T=Δf/m. Additionally, the distance D from the target 130 to the lidar system 100 may be expressed as D=(Δf/m)·c/2, where c is the speed of light. For example, for a light source 110 with a linear frequency modulation of 1014 Hz/s, if a frequency difference (between the received scattered light and the LO light) of 33 MHz is measured, then this corresponds to a round-trip time of approximately 330 ns and a distance to the target of approximately 50 meters. As another example, a frequency difference of 133 MHz corresponds to a round-trip time of approximately 1.33 μs and a distance to the target of approximately 200 meters. A receiver or processor of an FMCW lidar system may determine a frequency difference between received scattered light and LO light, and the distance to a target may be determined based on the frequency difference. The frequency difference Δf between received scattered light and LO light corresponds to the round-trip time T (e.g., through the relationship T=Δf/m), and determining the frequency difference may correspond to or may be referred to as determining the round-trip time.
In the example of
In particular embodiments, a scan pattern 200 may include multiple pixels 210, and each pixel 210 may be associated with one or more laser pulses or one or more distance measurements. Additionally, a scan pattern 200 may include multiple scan lines 230, where each scan line represents one scan across at least part of a field of regard, and each scan line 230 may include multiple pixels 210. In
In particular embodiments, a pixel 210 may refer to a data element that includes (i) distance information (e.g., a distance from a lidar system 100 to a target 130 from which an associated pulse of light was scattered) or (ii) an elevation angle and an azimuth angle associated with the pixel (e.g., the elevation and azimuth angles along which the associated pulse of light was emitted). Each pixel 210 may be associated with a distance (e.g., a distance to a portion of a target 130 from which an associated laser pulse was scattered) or one or more angular values. As an example, a pixel 210 may be associated with a distance value and two angular values (e.g., an azimuth and altitude) that represent the angular location of the pixel 210 with respect to the lidar system 100. A distance to a portion of target 130 may be determined based at least in part on a time-of-flight measurement for a corresponding pulse. An angular value (e.g., an azimuth or altitude) may correspond to an angle (e.g., relative to reference line 220) of output beam 125 (e.g., when a corresponding pulse is emitted from lidar system 100) or an angle of input beam 135 (e.g., when an input signal is received by lidar system 100). In particular embodiments, an angular value may be determined based at least in part on a position of a component of scanner 120. As an example, an azimuth or altitude value associated with a pixel 210 may be determined from an angular position of one or more corresponding scanning mirrors of scanner 120.
In particular embodiments, a polygon mirror 301 may be configured to rotate along a Θx or Θy direction and scan output beam 125 along a substantially horizontal or vertical direction, respectively. A rotation along a Θx direction may refer to a rotational motion of mirror 301 that results in output beam 125 scanning along a substantially horizontal direction. Similarly, a rotation along a Θy direction may refer to a rotational motion that results in output beam 125 scanning along a substantially vertical direction. In
In particular embodiments, a polygon mirror 301 may refer to a multi-sided object having reflective surfaces 320 on two or more of its sides or faces. As an example, a polygon mirror may include any suitable number of reflective faces (e.g., 2, 3, 4, 5, 6, 7, 8, or 10 faces), where each face includes a reflective surface 320. A polygon mirror 301 may have a cross-sectional shape of any suitable polygon, such as for example, a triangle (with three reflecting surfaces 320), square (with four reflecting surfaces 320), pentagon (with five reflecting surfaces 320), hexagon (with six reflecting surfaces 320), heptagon (with seven reflecting surfaces 320), or octagon (with eight reflecting surfaces 320). In
In particular embodiments, a polygon mirror 301 may be continuously rotated in a clockwise or counter-clockwise rotation direction about a rotation axis of the polygon mirror 301. The rotation axis may correspond to a line that is perpendicular to the plane of rotation of the polygon mirror 301 and that passes through the center of mass of the polygon mirror 301. In
In particular embodiments, output beam 125 may be reflected sequentially from the reflective surfaces 320A, 320B, 320C, and 320D as the polygon mirror 301 is rotated. This results in the output beam 125 being scanned along a particular scan axis (e.g., a horizontal or vertical scan axis) to produce a sequence of scan lines, where each scan line corresponds to a reflection of the output beam 125 from one of the reflective surfaces of the polygon mirror 301. In
In particular embodiments, scanner 120 may be configured to scan both a light-source field of view and a receiver field of view across a field of regard of the lidar system 100. Multiple pulses of light may be emitted and detected as the scanner 120 scans the FOVL and FOVR across the field of regard of the lidar system 100 while tracing out a scan pattern 200. In particular embodiments, the light-source field of view and the receiver field of view may be scanned synchronously with respect to one another, so that as the FOVL is scanned across a scan pattern 200, the FOVR follows substantially the same path at the same scanning speed. Additionally, the FOVL and FOVR may maintain the same relative position to one another as they are scanned across the field of regard. As an example, the FOVL may be substantially overlapped with or centered inside the FOVR (as illustrated in
In particular embodiments, the FOVL may have an angular size or extent ΘL that is substantially the same as or that corresponds to the divergence of the output beam 125, and the FOVR may have an angular size or extent ΘR that corresponds to an angle over which the receiver 140 may receive and detect light. In particular embodiments, the receiver field of view may be any suitable size relative to the light-source field of view. As an example, the receiver field of view may be smaller than, substantially the same size as, or larger than the angular extent of the light-source field of view. In particular embodiments, the light-source field of view may have an angular extent of less than or equal to 50 milliradians, and the receiver field of view may have an angular extent of less than or equal to 50 milliradians. The FOVL may have any suitable angular extent ΘL, such as for example, approximately 0.1 mrad, 0.2 mrad, 0.5 mrad, 1 mrad, 1.5 mrad, 2 mrad, 3 mrad, 5 mrad, 10 mrad, 20 mrad, 40 mrad, or 50 mrad. Similarly, the FOVR may have any suitable angular extent ΘR, such as for example, approximately 0.1 mrad, 0.2 mrad, 0.5 mrad, 1 mrad, 1.5 mrad, 2 mrad, 3 mrad, 5 mrad, 10 mrad, 20 mrad, 40 mrad, or 50 mrad. In particular embodiments, the light-source field of view and the receiver field of view may have approximately equal angular extents. As an example, ΘL and ΘR may both be approximately equal to 1 mrad, 2 mrad, or 4 mrad. In particular embodiments, the receiver field of view may be larger than the light-source field of view, or the light-source field of view may be larger than the receiver field of view. As an example, ΘL may be approximately equal to 3 mrad, and ΘR may be approximately equal to 4 mrad. As another example, ΘR may be approximately L times larger than ΘL, where L is any suitable factor, such as for example, 1.1, 1.2, 1.5, 2, 3, 5, or 10.
In particular embodiments, a pixel 210 may represent or may correspond to a light-source field of view or a receiver field of view. As the output beam 125 propagates from the light source 110, the diameter of the output beam 125 (as well as the size of the corresponding pixel 210) may increase according to the beam divergence ΘL. As an example, if the output beam 125 has a ΘL of 2 mrad, then at a distance of 100 m from the lidar system 100, the output beam 125 may have a size or diameter of approximately 20 cm, and a corresponding pixel 210 may also have a corresponding size or diameter of approximately 20 cm. At a distance of 200 m from the lidar system 100, the output beam 125 and the corresponding pixel 210 may each have a diameter of approximately 40 cm.
In particular embodiments, a unidirectional scan pattern 200 may be produced by a scanner 120 that includes a polygon mirror (e.g., polygon mirror 301 of
An amplifier 350 and a pulse-detection circuit 365 may be located within a receiver 140, or all or part of an amplifier 350 or pulse-detection circuit 365 may be located external to the receiver. For example, an amplifier 350 may be part of a receiver 140, and a pulse-detection circuit 365 may be located external to the receiver 140 (e.g., within a controller 150 located external to the receiver 140). As another example, an amplifier 350 and a pulse-detection circuit 365 may be located within a receiver 140, as illustrated in
In
The receiver 140 in
In particular embodiments, an amplifier 350 may include a TIA 352 configured to receive a photocurrent signal i from a detector 340 and produce a voltage signal 360 that corresponds to the received photocurrent. As an example, in response to a received pulse of light 410 (e.g., light from an emitted pulse of light 400 that is scattered by a remote target 130), a detector 340 may produce photocurrent i that includes a pulse of electrical current corresponding to the received pulse of light 410. A TIA 352 may receive the electrical-current pulse from the detector 340 and produce a voltage signal 360 that includes a voltage pulse corresponding to the received current pulse. The voltage pulse and the current pulse corresponding to one another may refer to the voltage pulse and the current pulse having similar rise times, fall times, shapes, durations, or other similar pulse characteristics. For example, the voltage pulse may have a rise time, fall time, or duration that is between 1× and 1.5× that of the pulse of electrical current. The voltage pulse may have a somewhat longer rise time, fall time, or duration due to a limited electrical bandwidth of the TIA circuitry. As another example, the pulse of electrical current may have a 1.2-ns rise time and a 5-ns duration, and the corresponding voltage pulse may have a 1.5-ns rise time and a 7-ns duration.
A TIA 352 may be referred to as a current-to-voltage converter, and producing a voltage signal from a received photocurrent signal may be referred to as performing current-to-voltage conversion. The transimpedance gain or amplification of a TIA 352 may be expressed in units of ohms (0), or equivalently volts per ampere (V/A). For example, if a TIA 352 has a gain of 100 V/A, then for a photocurrent i with a peak current of 10 μA, the TIA 352 may produce a voltage signal 360 with a corresponding peak voltage of approximately 1 mV. In particular embodiments, in addition to acting as a current-to-voltage converter, a TIA 352 may also act as an electronic filter (e.g., a low-pass, high-pass, or band-pass filter). As an example, a TIA 352 may be configured as a low-pass filter that removes or attenuates high-frequency electrical noise by attenuating signals above a particular frequency (e.g., above 1 MHz, 10 MHz, 20 MHz, 50 MHz, 100 MHz, 200 MHz, 300 MHz, 1 GHz, or any other suitable frequency).
In particular embodiments, an amplifier 350 may not include a separate voltage-gain circuit. For example, a TIA 352 may produce a voltage signal 360 that is directly coupled to a pulse-detection circuit 365 without an intervening gain circuit. In other embodiments, in addition to a TIA 352, an electronic amplifier 350 may also include a voltage-gain circuit 354. The electronic amplifier 350 in
In particular embodiments, a pulse-detection circuit 365 may include a comparator 370 configured to receive a voltage signal 360 from a TIA 352 or gain circuit 354 and produce an electrical-edge signal (e.g., a rising edge or a falling edge) when the received voltage signal 360 rises above or falls below a particular threshold voltage VT. As an example, when a received voltage signal 360 rises above VT, a comparator 370 may produce a rising-edge digital-voltage signal (e.g., a signal that steps from approximately 0 V to approximately 2.5 V, 3.3 V, 5 V, or any other suitable digital-high level). Additionally or alternatively, when a received voltage signal 360 falls below VT, a comparator 370 may produce a falling-edge digital-voltage signal (e.g., a signal that steps down from approximately 2.5 V, 3.3 V, 5 V, or any other suitable digital-high level to approximately 0 V). The voltage signal 360 received by the comparator 370 may be received from a TIA 352 or gain circuit 354 and may correspond to a photocurrent signal i produced by a detector 340. As an example, the voltage signal 360 received by the comparator 370 may include a voltage pulse that corresponds to an electrical-current pulse produced by the detector 340 in response to a received pulse of light 410. The voltage signal 360 received by the comparator 370 may be an analog signal, and an electrical-edge signal produced by the comparator 370 may be a digital signal.
In particular embodiments, a pulse-detection circuit 365 may include a time-to-digital converter (TDC) 380 configured to receive an electrical-edge signal from a comparator 370 and produce an electrical output signal (e.g., a digital signal, a digital word, or a digital value) that represents a time when the edge signal is received from the comparator 370. The time when the edge signal is received from the comparator 370 may correspond to a time of arrival of a received pulse of light 410, which may be used to determine a round-trip time of flight for a pulse of light to travel from a lidar system 100 to a target 130 and back to the lidar system 100. The output of the TDC 380 may include one or more numerical values, where each numerical value (which may be referred to as a numerical time value, a time value, a digital value, or a digital time value) corresponds to a time interval determined by the TDC 380. A TDC 380 may have an internal counter or clock with any suitable period, such as for example, 5 ps, 10 ps, 15 ps, 20 ps, 30 ps, 50 ps, 100 ps, 0.5 ns, 1 ns, 2 ns, 5 ns, or 10 ns. As an example, the TDC 380 may have an internal counter or clock with a 20-ps period, and the TDC 380 may determine that an interval of time between emission and receipt of an optical pulse is equal to 25,000 time periods, which corresponds to a time interval of approximately 0.5 microseconds. The TDC 380 may send an output signal 145 that includes the numerical value “25000” to a controller 150 of the lidar system 100. In particular embodiments, a lidar system 100 may include a controller 150 that determines a distance from the lidar system 100 to a target 130 based on one or more intervals of time determined by one or more TDCs 380. As an example, the controller 150 may receive a numerical value (e.g., “25000”) from the TDC 380, and based on the received value, the controller may determine a time of arrival of a received pulse of light 410. Additionally, the controller 150 may determine the distance from the lidar system to the target 130 based on the time of arrival of the received pulse of light 410.
In particular embodiments, determining an interval of time between emission and receipt of a pulse of light may be based on determining (1) a time associated with the emission of a pulse of light 400 and (2) a time when a received pulse of light 410 (which may include a portion of the emitted pulse of light 400 scattered by a target 130) is detected by a receiver 140. As an example, a TDC 380 may count the number of time periods, clock cycles, or fractions of clock cycles between an electrical edge associated with emission of a pulse of light and an electrical edge associated with detection of scattered light from the emitted pulse of light. Determining when scattered light from the pulse of light is detected by receiver 140 may be based on determining one or more times for one or more rising or falling edges (e.g., rising or falling edges produced by one or more comparators 370) associated with the detected pulse of light. In particular embodiments, determining a time associated with emission of a pulse of light 400 may be based on an electrical trigger signal. As an example, a light source 110 may produce an electrical trigger signal for each pulse of light that is emitted, or an electrical device (e.g., controller 150) may provide a trigger signal to the light source 110 to initiate the emission of each pulse of light. A trigger signal associated with emission of an optical pulse may be provided to TDC 380, and a rising edge or falling edge of the trigger signal may correspond to a time when the optical pulse is emitted. In particular embodiments, a time associated with emission of an optical pulse may be determined based on an optical trigger signal. As an example, a time associated with the emission of a pulse of light 400 may be determined based at least in part on detection of a portion of light from the emitted pulse of light. The portion of the emitted pulse of light (which may be referred to as an optical trigger pulse) may be detected prior to or just after the corresponding emitted pulse of light exits the lidar system 100 (e.g., less than 10 ns after the emitted pulse of light exits the lidar system). The optical trigger pulse may be detected by a separate detector (e.g., a PIN photodiode or an APD) or by the receiver 140. The optical trigger pulse may be produced when a portion of light from an emitted pulse of light is scattered or reflected from a surface located within lidar system 100 (e.g., a surface of a beam splitter or window, or a surface of light source 110, mirror 115, or scanner 120). Some of the scattered or reflected light may be received by a detector 340 of receiver 140, and a pulse-detection circuit 365 coupled to the detector 340 may be used to determine that an optical trigger pulse has been detected. The time at which the optical trigger pulse was detected may be used to determine the emission time of the pulse of light 400.
In
The pulse-detection circuit 365 in
In particular embodiments, an output signal 145 of a pulse-detection circuit 365 may include an electrical signal that corresponds to a received pulse of light 410. For example, the output signal 145 in
The output signal 145 in
In
The example voltage signal 360 illustrated in
A round-trip time of flight (e.g., a time for an emitted pulse of light to travel from the lidar system 100 to a target 130 and back to the lidar system 100) may be determined based on a difference between a time of arrival and a time of emission for a pulse of light, and the distance D to the target 130 may be determined based on the round-trip time of flight. A time of arrival for a received pulse of light 410 may correspond to (i) a time associated with a peak of voltage signal 360, (ii) a time associated with a temporal center of voltage signal 360, or (iii) a time associated with a rising edge of voltage signal 360. For example, in
A duration of a received pulse of light 410 may be determined from a duration or width of a corresponding voltage signal 360. For example, the difference between two time values of an output signal 145 may be used to determine a duration of a received pulse of light. In the example of
In particular embodiments, a temporal correction or offset may be applied to a determined time of emission or time of arrival to account for signal delay within a lidar system 100. For example, there may be a time delay of 2 ns between an electrical trigger signal that initiates emission of a pulse of light and a time when the emitted pulse of light exits the lidar system 100. To account for the 2-ns time delay, a 2-ns offset may be added to an initial time of emission determined by a receiver 140 or a controller of the lidar system 100. For example, a receiver 140 may receive an electrical trigger signal at time tTRIG indicating emission of a pulse of light by light source 110. To compensate for the 2-ns delay between the trigger signal and the pulse of light exiting the lidar system 100, the emission time of the pulse of light may be indicated as (tTRIG+2 ns). Similarly, there may be a 1-ns time delay between a received pulse of light entering the lidar system 100 and a time when electrical edge signals corresponding to the received pulse of light are received by one or more TDCs 380 of a receiver 140. To account for the 1-ns time delay, a 1-ns offset may be subtracted from a determined time of arrival.
In particular embodiments, a controller 150 or a receiver 140 may determine, based on a photocurrent signal i produced by a detector 340, a round-trip time T for a portion of an emitted optical signal to travel to a target 130 and back to a lidar system 100. Additionally, a controller 150 or a receiver 140 may determine a distance D from the lidar system 100 to the target 130 based on the round-trip time T. For example, a detector 340 may produce a pulse of photocurrent i in response to a received pulse of light 410, and an amplifier 350 may produce a voltage pulse (e.g., voltage signal 360) corresponding to the pulse of photocurrent. Based on the voltage signal 360, a controller 150 or a receiver 140 may determine a time of arrival for the received pulse of light. Additionally, the receiver 140 or controller 150 may determine a time of emission for a pulse of light 400 (e.g., a time at which the pulse of light was emitted by a light source 110), where the received pulse of light 410 includes scattered light from the emitted pulse of light. For example, based on the time of arrival (TA) and the time of emission (TE), the controller 150 or receiver 140 may determine the round-trip time T (e.g., T=TA−TE), and the distance D may be determined from the expression D=c·T/2.
In particular embodiments, a receiver 140 of a lidar system 100 may include one or more analog-to-digital converters (ADCs). As an example, instead of including multiple comparators and TDCs, a receiver 140 may include an ADC that receives a voltage signal 360 from amplifier 350 and produces a digital representation of the voltage signal 360. Although this disclosure describes or illustrates example receivers 140 that include one or more comparators 370 and one or more TDCs 380, a receiver 140 may additionally or alternatively include one or more ADCs. As an example, in
In particular embodiments, a light source 110 may include an electronic driver 480 that (i) supplies electrical current to a seed laser 450 and (ii) supplies electrical current to an SOA 460. In
In some embodiments, an electronic driver supplies SOA current I2 to the SOA 460, and the SOA current I2 provides optical gain to temporal portions of the seed light 440 that propagate through a waveguide of the SOA 460. The SOA current I2 may include pulses of electrical current, where each pulse of current causes the SOA 460 to amplify one temporal portion of the seed light 440 to produce an emitted pulse of light 400. The SOA current I2 may have a duration of approximately 0.5 ns, 1 ns, 2 ns, 5 ns, 10 ns, 20 ns, 50 ns, 100 ns, or any other suitable duration. The SOA current I2 may have a peak amplitude of approximately 1 A, 2 A, 5 A, 10 A, 20 A, 50 A, 100 A, 200 A, 500 A, or any other suitable peak current. For example, the SOA current I2 supplied to the SOA 460 may include a series of current pulses having a duration of approximately 5-10 ns and a peak current of approximately 100 A. The series of current pulses may result in the emission of a corresponding series of pulses of light 400, and each emitted pulse of light 400 may have a duration that is less than or equal to the duration of the corresponding electrical current pulse. For example, an electronic driver 480 may supply 5-ns duration current pulses to the SOA 460 at a repetition frequency of 700 kHz. This may result in emitted pulses of light 400 that have a duration of approximately 4 ns and a pulse repetition frequency of 700 kHz.
A pulsed optical amplifier may refer to an optical amplifier that is operated in a pulsed mode so that the output beam 125 emitted by the optical amplifier includes pulses of light 400. For example, a pulsed optical amplifier may include an SOA 460 that is operated in a pulsed mode by supplying the SOA 460 with pulses of current. The seed light 440 may include CW light or light having a substantially constant optical power, and each pulse of current supplied to the SOA 460 may amplify a temporal portion of seed light to produce an emitted pulse of light 400. As another example, a pulsed optical amplifier may include an optical amplifier along with an optical modulator. The optical modulator may be an acousto-optic modulator (AOM) or an electro-optic modulator (EOM) operated in a pulsed mode so that the modulator selectively transmits pulses of light. The SOA 460 may also be operated in a pulsed mode in synch with the optical modulator to amplify the temporal portions of the seed light, or the SOA 460 may be supplied with substantially DC current to operate as a CW optical amplifier. The optical modulator may be located between the seed laser diode 450 and the SOA 460, and the optical modulator may be operated in a pulsed mode to transmit temporal portions of the seed light 440 which are then amplified by the SOA 460. Alternatively, the optical modulator may be located after the SOA 460, and the optical modulator may be operated in a pulsed mode to transmit the emitted pulses of light 400.
The seed laser diode 450 illustrated in
In particular embodiments, a waveguide of the SOA 460 may include a semiconductor optical waveguide formed at least in part by the semiconductor material of the SOA 460, and the waveguide may confine light along transverse directions while the light propagates through the SOA 460. In particular embodiments, a waveguide may have a substantially fixed width or a waveguide may have a tapered width. For example, a waveguide may have a substantially fixed width of approximately 5 μm, 10 μm, 20 μm, 50 μm, 100 μm, 200 μm, 500 μm, or any other suitable width. In
In particular embodiments, the input end or the output end of SOA 460 may be a discrete facet formed by a semiconductor air interface. Additionally, the input end or the output end may include a dielectric coating (e.g., an anti-reflection coating to reduce the reflectivity of the input end or the output end). An anti-reflection (AR) coating may have a reflectivity at the seed-laser operating wavelength of less than 5%, 2%, 0.5%, 0.1%, or any other suitable reflectivity value. In
In particular embodiments, a light source 110 may include a seed laser diode 450 and an SOA 460 that are integrated together and disposed on or in a single chip or substrate. For example, a seed laser diode 450 and an SOA 460 may each be fabricated separately and then attached to the same substrate (e.g., using epoxy or solder). The substrate may be electrically or thermally conductive, and the substrate may have a coefficient of thermal expansion (CTE) that is approximately equal to the CTE of the seed laser 450 and the SOA 460. As another example, the seed laser diode 450 and the SOA 460 may be fabricated together on the same substrate (e.g., using semiconductor fabrication processes, such as for example, lithography, deposition, and etching). The seed laser diode 450 and the SOA 460 may each include InGaAs or InGaAsP semiconductor structures, and the substrate may include indium phosphide (InP). The InP substrate may be n-doped or p-doped so that it is electrically conductive, and a portion of the InP substrate may act as an anode or cathode for both the seed laser diode 450 and the SOA 460. The substrate may be thermally coupled to (i) a heat sink that dissipates heat produced by the seed laser diode 450 or the SOA 460 or (ii) a temperature-control device (e.g., a thermoelectric cooler) that stabilizes the temperature of the seed laser diode 450 or the SOA 460 to a particular temperature setpoint or to within a particular temperature range. In the example of
In
In particular embodiments, during a period of time between two successive temporal portions of seed light 440, an SOA 460 may be configured to optically absorb most of the seed light 440 propagating in the SOA 460. The seed light 440 from the seed laser diode 450 may be coupled into the waveguide of the SOA 460. Depending on the amount of SOA current I2 supplied to the SOA 460, the seed light 440 may be optically amplified or optically absorbed while propagating along the waveguide. If the SOA current I2 exceeds a threshold gain value (e.g., 100 mA) that overcomes the optical loss of the SOA 460, then the seed light 440 may be optically amplified by stimulated emission of photons. Otherwise, if the SOA current I2 is less than the threshold gain value, then the seed light 440 may be optically absorbed. The process of optical absorption of the seed light 440 may include photons of the seed light 440 being absorbed by electrons located in the semiconductor structure of the SOA 460.
In particular embodiments, the SOA current I2 may include pulses of current separated by a period of time that corresponds to the pulse period T of the light source 110, and each pulse of current may result in the emission of a pulse of light 400. For example, if the SOA current I2 includes 20-A current pulses with a 10-ns duration, then for each current pulse, a corresponding 10-ns temporal portion of the seed light 440 may be amplified, resulting in the emission of a pulse of light 400. During the time periods T between successive pulses of current, the SOA current I2 may be set to approximately zero or to some other value below the threshold gain value, and the seed light 440 present in the SOA 460 during those time periods may be optically absorbed. The optical absorption of the SOA 460 when the SOA current I2 is zero may be greater than or equal to approximately 10 decibels (dB), 15 dB, 20 dB, 25 dB, or 30 dB. For example, if the optical absorption is greater than or equal to 20 dB, then less than or equal to 1% of the seed light 440 that is coupled into the input end of the waveguide of the SOA 460 may be emitted from the output end of the SOA 460 as unwanted leakage light. Having most of the seed light 440 absorbed in the SOA 460 may prevent unwanted seed light 440 (e.g., seed light 440 located between successive pulses of light 400) from leaking out of the SOA 460 and propagating through the rest of the lidar system 100. Additionally, optically absorbing the unwanted seed light 440 may allow the seed laser 450 to be operated with a substantially constant current I1 or a substantially constant output power so that the wavelengths of the seed light 440 and LO light are stable and substantially constant.
In particular embodiments, an SOA 460 may include an anode and a cathode that convey SOA current I2 from an electronic driver 480 to or from the SOA 460. For example, the anode of the SOA 460 may include or may be electrically coupled to a conductive electrode material (e.g., gold) deposited onto the top surface of the SOA 460, and the cathode may include or may be electrically coupled to a substrate located on the opposite side of the SOA 460. Alternatively, the anode of the SOA 460 may include or may be electrically coupled to the substrate of the SOA 460, and the cathode may include or may be electrically coupled to the electrode on the top surface of the SOA 460. An anode may correspond to the p-doped side of a semiconductor p-n junction, and a cathode may correspond to the n-doped side. The anode and cathode may be electrically coupled to the electronic driver 480, and the driver 480 may supply a positive SOA current I2 that flows from the driver 480 into the anode, through the SOA 460, out of the cathode, and back to the driver 480. When considering the electrical current as being made up of a flow of electrons, then the electrons may be viewed as flowing in the opposite direction (e.g., from the driver 480 into the cathode, through the SOA 460, and out of the anode and back to the driver 480).
In particular embodiments, an electronic driver 480 may electrically couple the SOA anode to the SOA cathode during a period of time between two successive pulses of current. For example, for most or all of the time period T between two successive pulses of current, the electronic driver 480 may electrically couple the anode and cathode of the SOA 460. Electrically coupling the anode and cathode may include electrically shorting the anode directly to the cathode or coupling the anode and cathode through a particular electrical resistance (e.g., approximately 1Ω, 10Ω, or 100Ω). Alternatively, electrically coupling the anode and the cathode may include applying a reverse-bias voltage (e.g., approximately −1 V, −5 V, or −10 V) to the anode and cathode, where the reverse-bias voltage has a polarity that is opposite the forward-bias polarity associated with the applied pulses of current. By electrically coupling the anode to the cathode, the optical absorption of the SOA may be increased. For example, the optical absorption of the SOA 460 when the anode and cathode are electrically coupled may be increased (compared to the anode and cathode not being electrically coupled) by approximately 3 dB, 5 dB, 10 dB, 15 dB, or 20 dB. The optical absorption of the SOA 460 when the anode and cathode are electrically coupled may be greater than or equal to approximately 20 dB, 25 dB, 30 dB, 35 dB, or 40 dB. For example, the optical absorption of an SOA 460 when the SOA current I2 is zero and the anode and cathode are not electrically coupled may be 20 dB. When the anode and cathode are electrically shorted together, the optical absorption may increase by 10 dB to 30 dB. If the optical absorption of the SOA 460 is greater than or equal to 30 dB, then less than or equal to 0.1% of the seed light 440 that is coupled into the input end of the waveguide of the SOA 460 may be emitted from the output end of the SOA 460 as unwanted leakage light.
An SOA 460 and a fiber-optic amplifier 500 may each have an optical power gain of 10 dB, 15 dB, 20 dB, 25 dB, 30 dB, 35 dB, 40 dB, or any other suitable optical power gain. In the example of
A fiber-optic amplifier 500 may include an optical gain fiber 501 that is optically pumped (e.g., provided with energy) by one or more pump lasers 510. The optically pumped gain fiber 501 may provide optical gain to each input pulse of light 400a while propagating through the gain fiber 501. The pump-laser light may travel through the gain fiber 501 in the same direction (co-propagating) as the pulse of light 400a or in the opposite direction (counter-propagating). The fiber-optic amplifier 500 in
The fiber-optic core of a gain fiber 501 may be doped with a gain material that absorbs pump-laser light and provides optical gain to pulses of light 400a as they propagate along the gain fiber 501. The gain material may include rare-earth ions, such as for example, erbium (Er3+), ytterbium (Yb3+), neodymium (Nd3+), praseodymium (Pr3+), holmium (Ho3+), thulium (Tm3+), dysprosium (Dy3+), or any other suitable rare-earth element, or any suitable combination thereof. For example, the gain fiber 501 may include a core doped with erbium ions or with a combination of erbium and ytterbium ions. The rare-earth dopants absorb pump-laser light and are “pumped” or promoted into excited states that provide amplification to the pulses of light 400a through stimulated emission of photons. The rare-earth ions in excited states may also emit photons through spontaneous emission, resulting in the production of amplified spontaneous emission (ASE) light by the gain fiber 501.
A gain fiber 501 may include a single-clad or multi-clad optical fiber with a core diameter of approximately 6 μm, 7 μm, 8 μm, 9 μm, 10 μm, 12 μm, 20 μm, 25 μm, or any other suitable core diameter. A single-clad gain fiber 501 may include a core surrounded by a cladding material, and the pump light and the pulses of light 400a may both propagate substantially within the core of the gain fiber 501. A multi-clad gain fiber 501 may include a core, an inner cladding surrounding the core, and one or more additional cladding layers surrounding the inner cladding. The pulses of light 400a may propagate substantially within the core, while the pump light may propagate substantially within the inner cladding and the core. The length of gain fiber 501 in an amplifier 500 may be approximately 0.5 m, 1 m, 2 m, 4 m, 6 m, 10 m, 20 m, or any other suitable gain-fiber length.
A fiber-optic amplifier 500 may include one or more optical filters 560 located at the input or output side of the amplifier 500. An optical filter 560 (which may include an absorptive filter, dichroic filter, long-pass filter, short-pass filter, band-pass filter, notch filter, Bragg grating, or fiber Bragg grating) may transmit light over a particular optical pass-band and substantially block light outside of the pass-band. The optical filter 560 in
A fiber-optic amplifier 500 may include one or more optical isolators 530. An isolator 530 may reduce or attenuate backward-propagating light, which may destabilize or cause damage to a seed laser diode 450, SOA 460, pump laser 510, or gain fiber 501. The isolators 530 in
A fiber-optic amplifier 500 may include one or more optical splitters 470 and one or more detectors 550. A splitter 470 may split off a portion of light (e.g., approximately 0.1%, 0.5%, 1%, 2%, or 5% of light received by the splitter 470) and direct the split off portion to a detector 550. In
In particular embodiments, a fiber-optic amplifier 500 may include an input optical fiber configured to receive input pulses of light 400a from an SOA 460. The input optical fiber may be part of or may be coupled or spliced to one of the components of the fiber-optic amplifier 500. For example, pulses of light 400a may be coupled into an optical fiber which is spliced to an input optical fiber of the isolator 530 located at the input to the amplifier 500. As another example, the pulses of light 400a from an SOA 460 may be part of a free-space beam that is coupled into an input optical fiber of fiber-optical amplifier 500 using one or more lenses. As another example, an input optical fiber of fiber-optic amplifier 500 may be positioned at or near the output end of an SOA 460 so that the pulses of light 400a are directly coupled from the SOA 460 into the input optical fiber.
In particular embodiments, the optical components of a fiber-optic amplifier 500 may be free-space components, fiber-coupled components, or a combination of free-space and fiber-coupled components. As an example, each optical component in
In some embodiments, detector site locations 1203 and 1205 are positioned to each detect light pulses of different wavelengths. For example, detector site location 1203 can be positioned and configured to detect light pulses corresponding to a first wavelength (e.g., 1530 nm) and detector site location 1205 can be positioned and configured to detect light pulses corresponding to a second and different wavelength (e.g., 1550 nm). The different detected wavelength pulses correspond to light pulses emitted at different wavelengths. In various embodiments, the spacing between detector site locations 1203 and 1205 on main body component 1201 is based on the spacing used for the corresponding output beams. For example, detector site location 1203 is positioned outside (and/or to minimize the overlap with) focused input beam 1215 and detector site location 1205 is positioned outside (and/or to minimize the overlap with) focused input beam 1213. In some embodiments, the detectors corresponding to detector site locations 1203 and 1205 are coated to further decrease optical crosstalk, for example, by applying bandpass and/or low/high pass filters. Although ROIC 1200 is shown with only two detector site locations (detector site locations 1203 and 1205), in various embodiments, a lidar system can include additional detector locations to detect additional light pulses of different wavelengths.
In some embodiments, main body component 1201 of ROIC 1200 is the main component of a readout integrated circuit. In some embodiments, ROIC 1200 is an application-specific integrated circuit (ASIC) with light detectors. For example, main body component 1201 can be an ASIC designed for reading/processing signals from light detectors positioned at detector site locations 1203 and 1205. The actual light detectors can be coupled and/or mounted directly to the ASIC and may have an output that is electrically connected to the input of the ASIC. In various embodiments, ROIC 1200, including main body component 1201, captures sensor data from associated light detectors and can output corresponding output signals such as readout values that can be used to analyze the captured sensor data results. In some embodiments, ROIC 1200 outputs a signal that can be analyzed by a processor such as processor 1910 of
At 1301, one or more light sources are emitted. For example, an output light beam is emitted from the lidar system. In some embodiments, the lidar system emits multiple output beams, each potentially offset and/or scanning a different field of regard. In some embodiments, the one or more of the different output beams are at different wavelengths and the different wavelength output beams can be separated in time by an encoding time delay. The encoding time delay used can be stored, for example, as a history of transmitted encoding time delays, and used to match received reflected light to the original transmitted source. In some embodiments, the output beam includes multiple wavelengths that have been multiplexed. In various embodiments, each output beam can reach downrange objects and can be scattered and/or reflected by the downrange object.
At 1303, scattered light is received. For example, light scattered and/or reflected by an object is received at the lidar sensor. The corresponding object can be a downrange object. In various embodiments, the received light has a particular wavelength and corresponds to one of the light sources emitted at 1301. For example, a lidar system emits light pulses of different wavelengths and receives scattered light associated with the different emitted pulses.
At 1305, the received scattered light is analyzed. For example, the received scattered light is directed to a receiver component of the lidar system where sensor data can be captured and analyzed. In some embodiments, the receiver component includes a receive lens for focusing the received scattered light onto a readout integrated circuit (ROIC) of the receiver where one or more detector site locations of the detector plane are located. The detector site locations can be used to detect scatter patterns associated with the received scattered light and the different detector site locations can be offset at least in part to minimize crosstalk between light corresponding to differently aimed output beams. In some embodiments, the received scattered light includes multiple wavelengths that are then split into their different corresponding received pulses by wavelength.
Using detectors positioned at the detector site locations, sensor data can be captured and analyzed for sensor readings. In some embodiments, the analysis is performed at least in part by the readout integrated circuit (ROIC) and/or processor of the receiver and/or a controller of the lidar system. The processing can include determining an output signal corresponding to the detected scatter pattern. In some embodiments, the output signal is a sensor reading that corresponds to a measurement of the detected scattered light, such as an intensity reading or another measured sensor reading. In some embodiments, the received scattered light is associated into groups of received light pulses and the timing between different light pulses in a group is measured. Based on the measured timing, different light pulses are differentiated from one another and used to identify a corresponding transmit pulse to match a received pulse.
At 1307, a sensor reading is provided. For example, one or more sensor readings are provided in response to the analysis of the received scattered light performed at 1305. The sensor reading can be an intensity reading and/or another measurement or measurements. In some embodiments, the sensor reading includes location and/or distance data. For example, sensor readings can correspond to a point cloud based on objects detected in the fields of regard scanned by the lidar system.
At 1401, light pulses are transmitted. For example, one or more pulses of different wavelengths are transmitted as a pulse group. In some embodiments, pulses of different wavelengths are emitted as a group with the pulses within the group intentionally delayed in time. The delay between the pulses within the group is selected and programmed using an encoding scheme, such as a fixed or variable encoding time delay. In some embodiments, a pulse group includes at least a single pulse that is emitted with multiple combined wavelengths. For example, using an optical combiner/multiplexer, different wavelengths can be combined into a single output. When multiple wavelengths are combined into a single output beam, a pulse group may include only a single pulse.
At 1403, scattered light corresponding to different wavelengths is received. For example, light corresponding to one or more pulses transmitted at 1401 is scattered and/or reflected by an object. Portions of the scattered and/or reflected light are received at the lidar sensor. In various embodiments, the received light can correspond to one or more different pulses transmitted at 1401 and may include light with one or more different wavelengths.
At 1405, pulses from the received scattered light are determined. For example, the scattered light received at 1403 is analyzed to determine light pulses for particular wavelengths. In some embodiments, the light is analyzed, at least in part, as described with respect to step 1305 of
At 1407, the received pulses are matched to transmitted pulses. For example, each pulse of a particular wavelength determined from the received light is matched to a transmit pulse of the same wavelength. In some embodiments, the transmit and receive pulses are matched to one another based on wavelength and timing. For example, the timing between pulse groups can be used to differentiate and determine which transmit pulse matches a received pulse. In various embodiments, the measured timing between pulses within a group is used to determine which corresponding transmit pulse group a received pulse matches and which corresponding transmitted pulse within the identified group the received pulse matches. For example, a history of transmitted encoding time delays used for transmitted pulses can be used to match a transmitted pulse to a received pulse.
At 1409, one or more sensor readings are provided. For example, matched transmit and receive pulses are analyzed and used to determine and provide sensor readings. In some embodiments, the one or more sensor readings are provided as described with respect to step 1307 of
At 1501, a time delay for encoding is determined. For example, an encoding time delay is determined for insertion between pulses of the same pulse group. In various embodiments, the delay is selected based on previously utilized delays. For example, in some embodiments, neighboring pulse groups utilize different encoding time delays allowing the corresponding received pulse groups to be differentiated from one another. In various embodiments, the encoding time delay is selected to allow the different pulse groups to be differentiated from one another and can include a margin of error to allow for additional delays that may be introduced. As one example, a first pulse group can utilize an encoding time delay of +3 ns, a second pulse group can utilize an encoding time delay of −5 ns, and a third pulse group can utilize an encoding time delay of +1 ns. The time delay can be selected by using a random, dynamic, pre-determined, and/or another appropriate technique. For example, in some embodiments, a pre-determined and repeated sequence of encoding time delays is used.
At 1503, a light pulse with a first wavelength is emitted. For example, a first light pulse using a first wavelength is emitted from the lidar system. The light pulse is aimed to detect objects downrange from the lidar system.
At 1505, a light pulse with a second wavelength is emitted using the determined time delay. For example, after allowing for a time delay determined at 1501 to elapse, a second light pulse is emitted. The second light pulse is emitted using a second wavelength that is different from the wavelength of the first light pulse emitted at 1503. For example, the first light pulse may have a 1530 nm wavelength and the second light pulse may have a 1550 nm wavelength. In some embodiments, the second light pulse is aimed with a slight offset from the first light pulse.
At 1507, the encoding time delay utilized is stored. For example, the encoding time delay used for transmitting the light pulses at 1503 and 1505 is stored. In some embodiments, the encoding time delays are stored in a history of transmitted encoding time delays. In various embodiments, each stored encoding time delay is stored along with a pulse group identifier and/or individual light pulse identifiers. In some embodiments, the pulse group identifier is used to differentiate different pulse groups from one another, for example, when resolving received light pulses.
At 1601, a pulse group is received. For example, scattered light associated with multiple transmitted pulses is received. The received light is analyzed, and pulses and pulse groups are identified from the received light. In some embodiments, the identified pulses are associated into pulse groups based on detection factors, such as the order and/or timing of their arrival. In various embodiments, a pulse group includes light pulses from each of the different transmitted wavelengths. For example, a lidar system that utilizes three different wavelengths can include at least three different light pulses, one of each wavelength, within the pulse group. The process of
At 1603, the encoding time delay for pulses within a pulse group is measured. For example, the time delay between when pulses within a pulse group are received is measured. In some embodiments, each light pulse within a group has a different wavelength and the timing between the pulses is unique when compared to neighboring pulse groups. When analyzing a pulse group with two light pulses, the encoding time delay between the first light pulse of the group and the second light pulse of the group is measured. In some embodiments, the measured encoding time delay can include multiple time delay measurements such as when the pulse group includes more than two light pulses (and light pulses with more than two wavelengths). The measured time delays for the light pulse group can utilize different reference points for calculating the multiple time delays of the group, such as the first light pulse of the group, the last light pulse of the group, the previously received light pulse for each subsequent light pulse of the group, or another appropriate reference point.
At 1605, the measured encoding time delay is compared with stored encoding time delays. For example, the encoding time delay measured at 1603 is compared against a stored history of encoding time delays used for transmit pulse groups. The stored history of encoding time delays is searched to identify whether any of the stored encoding time delays associated with transmit pulse groups match the measured encoding time delay of the receive pulse group. In some embodiments, only a single match will be identified. For example, the encoding time delays of the transmit pulse groups are selected to ensure that multiple non-expired transmit pulse groups will not share an encoding time delay that can match to the same measured encoding time delay of a receive pulse group. In some embodiments, the measured encoding time delay of the receive pulse group may match to multiple encoding time delay entries in the stored history of encoding time delays used for transmit pulse groups. In some embodiments, the matching transmit pulse group is identified based on the order and/or transmit time of the transmit pulse groups corresponding to the matching entries. In some embodiments, the matching transmit pulse group is identified based at least in part on the order of the entries in the stored history of encoding time delays. In some embodiments, the encoding time delays used when transmitting each pulse group are stored at 1507 of
At 1607, a determination is made whether a transmit pulse group is found that matches the receive pulse group. In the event a transmit pulse group match is found, processing proceeds to 1609. In the event a transmit pulse group match is not found, processing proceeds to 1611.
At 1609, transmit pulses and receive pulses of the matching pulse groups are paired together. For example, each light pulse of the receive pulse group is paired with its corresponding transmit light pulse from the matching transmit pulse group. Once the light pulses of the transmit and receive pulse groups are paired, each transmit pulse is paired with its corresponding receive pulse that is the result of a reflection (and/or scattering) of the transmit pulse by a target object. Using the timing properties associated with each matching pair of transmit and receive light pulses, the captured sensor data associated with the received light pulses can be further analyzed to determine sensor readings.
At 1611, a non-matching pulse group is processed. For example, the receive pulse group is analyzed and one or more non-matching pulse groups are identified. In some embodiments, the receive pulse group does not have a matching transmit pulse group. For example, the measured encoding time delay of the receive pulse group does not match any of the stored encoding time delays used for transmit pulse groups. In various embodiments, the received light pulses of the non-matching receive pulse group are processed as non-matching light pulses. In some embodiments, the unmatched received light pulses are logged along with properties of the received light pulses. In various embodiments, the sensor data of the unmatched light pulses does not contribute to sensor readings. For example, the unmatched light pulses are not utilized for generating and/or updating point cloud data.
In some embodiments, a transmit pulse group is identified as a non-matching pulse group. For example, a transmit pulse group has timed out without detecting its corresponding receive pulse group. In various embodiments, the entry associated with the unmatched transmit pulse group that is stored in the history of encoding time delays has expired and can be removed. In some embodiments, the unmatched transmit pulse group and its light pulses are logged along with properties of their transmission. In various embodiments, the expiration of transmit pulse groups does not necessarily need to be performed as part of step 1611 and can be performed asynchronous from the steps of the process of
At 1613, one or more sensor readings are provided. For example, one or more sensor readings are provided for the analyzed pulse group. In some embodiments, the sensor readings are provided for the pulse group as described with respect to step 1409 of
In the example shown, each of transmit pulse groups 1711, 1713, and 1715 and receive pulse groups 1731, 1733, and 1735 includes two light pulses, represented by the two rectangles within each pulse group. The light pulses of each pulse group include a light pulse of a first wavelength (shown as a white colored rectangle) and a light pulse of a second and different wavelength from the first wavelength (shown as a black colored rectangle). For some pulse groups, such as pulse groups 1711, 1715, 1731, and 1735, the light pulse corresponding to the white colored rectangle is sent first. For pulse groups 1713 and 1733, the light pulse transmit order is reversed and the light pulse corresponding to the black colored rectangle is sent first. In the example shown, the reflected (and/or scattered) light of transmit pulse group 1711 corresponds to receive pulse group 1731, the reflected (and/or scattered) light of transmit pulse group 1713 corresponds to receive pulse group 1733, and the reflected (and/or scattered) light of transmit pulse group 1715 corresponds to receive pulse group 1735. Using the processes of
In the example of
In the example shown, each of transmit pulse groups 1711, 1713, and 1715 is sent with a different encoding time delay inserted between the light pulses of their respective group. As shown in the example, transmit pulse group 1713 is sent with a negative encoding time delay (−5 ns) that results in the light pulse corresponding to the black colored rectangle being transmitted before the light pulse corresponding to the white colored rectangle. In various embodiments, the encoding time delay is selected to allow the lidar system the ability to match the received light pulses to their corresponding transmit light pulses. Although only three transmit pulse groups are shown in
In the example shown, the distances between the displayed components of
As shown in
As described above, transmitters 1801 and 1811 emit output light pulses of different wavelengths. As one example, transmitter 1801 can emit output beam 1803 at a first wavelength (e.g., 1530 nm) and transmitter 1811 can emit output beam 1813 at a second and different wavelength (e.g., 1550 nm). The selection of specific wavelengths can vary and can be configured by one or more corresponding seed lasers (not shown). In some embodiments, transmitters 1801 and 1811 are attached to optical fibers used to transmit light pulses at their corresponding configured wavelengths. In some embodiments, transmitters 1801 and 1811 are further associated with corresponding optical couplers, an optional optical splitter, and other optical components of one or more light sources. For example, transmitters 1801 and 1811 can be associated with one or more instances of light source 110 and related transmission components of light source 110 as shown in
In some embodiments, transmitters 1801 and 1811 can be used to emit a pulse group that includes light pulses of different wavelengths. For example, transmitters 1801 and 1811 can be used to emit transmit pulse group 1711 of
In various embodiments, transmitters 1801 and 1811 are aligned to transmit lens 1831 and the spacing between the two transmitters determines the relative aim of their respective output beams. Further, the positioning of transmitters 1801 and 1811, including their positioning relative to one another, determines the locations of corresponding input beam detectors and their detector site locations. For example, the placement and locations of detector site locations for a lidar system configured with two detectors, each for a particular wavelength, is based at least in part on the location and placement of transmitters 1801 and 1811. Other transmit and receive optical parameters, such as the properties of transmit lens 1831 and the positioning of transmitters 1801 and 1811 relative to transmit lens 1831 can impact the placement and locations of detector site locations as well.
Computer system 1900 may take any suitable physical form. As an example, computer system 1900 may be an embedded computer system, a system-on-chip (SOC), a single-board computer system (SBC), a desktop computer system, a laptop or notebook computer system, a mainframe, a mesh of computer systems, a server, a tablet computer system, or any suitable combination of two or more of these. As another example, all or part of computer system 1900 may be combined with, coupled to, or integrated into a variety of devices, including, but not limited to, a camera, camcorder, personal digital assistant (PDA), mobile telephone, smartphone, electronic reading device (e.g., an e-reader), game console, smart watch, clock, calculator, television monitor, flat-panel display, computer monitor, vehicle display (e.g., odometer display or dashboard display), vehicle navigation system, lidar system, ADAS, autonomous vehicle, autonomous-vehicle driving system, cockpit control, camera view display (e.g., display of a rear-view camera in a vehicle), eyewear, or head-mounted display. Where appropriate, computer system 1900 may include one or more computer systems 1900; be unitary or distributed; span multiple locations; span multiple machines; span multiple data centers; or reside in a cloud, which may include one or more cloud components in one or more networks. Where appropriate, one or more computer systems 1900 may perform without substantial spatial or temporal limitation one or more steps of one or more methods described or illustrated herein. As an example, one or more computer systems 1900 may perform in real time or in batch mode one or more steps of one or more methods described or illustrated herein. One or more computer systems 1900 may perform at different times or at different locations one or more steps of one or more methods described or illustrated herein, where appropriate.
As illustrated in the example of
In particular embodiments, processor 1910 may include hardware for executing instructions, such as those making up a computer program. As an example, to execute instructions, processor 1910 may retrieve (or fetch) the instructions from an internal register, an internal cache, memory 1920, or storage 1930; decode and execute them; and then write one or more results to an internal register, an internal cache, memory 1920, or storage 1930. In particular embodiments, processor 1910 may include one or more internal caches for data, instructions, or addresses. Processor 1910 may include any suitable number of any suitable internal caches, where appropriate. As an example, processor 1910 may include one or more instruction caches, one or more data caches, or one or more translation lookaside buffers (TLBs). Instructions in the instruction caches may be copies of instructions in memory 1920 or storage 1930, and the instruction caches may speed up retrieval of those instructions by processor 1910. Data in the data caches may be copies of data in memory 1920 or storage 1930 for instructions executing at processor 1910 to operate on; the results of previous instructions executed at processor 1910 for access by subsequent instructions executing at processor 1910 or for writing to memory 1920 or storage 1930; or other suitable data. The data caches may speed up read or write operations by processor 1910. The TLBs may speed up virtual-address translation for processor 1910. In particular embodiments, processor 1910 may include one or more internal registers for data, instructions, or addresses. Processor 1910 may include any suitable number of any suitable internal registers, where appropriate. Where appropriate, processor 1910 may include one or more arithmetic logic units (ALUs); may be a multi-core processor; or may include one or more processors 1910.
In particular embodiments, memory 1920 may include main memory for storing instructions for processor 1910 to execute or data for processor 1910 to operate on. As an example, computer system 1900 may load instructions from storage 1930 or another source (such as, for example, another computer system 1900) to memory 1920. Processor 1910 may then load the instructions from memory 1920 to an internal register or internal cache. To execute the instructions, processor 1910 may retrieve the instructions from the internal register or internal cache and decode them. During or after execution of the instructions, processor 1910 may write one or more results (which may be intermediate or final results) to the internal register or internal cache. Processor 1910 may then write one or more of those results to memory 1920. One or more memory buses (which may each include an address bus and a data bus) may couple processor 1910 to memory 1920. Bus 1960 may include one or more memory buses. In particular embodiments, one or more memory management units (MMUs) may reside between processor 1910 and memory 1920 and facilitate accesses to memory 1920 requested by processor 1910. In particular embodiments, memory 1920 may include random access memory (RAM). This RAM may be volatile memory, where appropriate. Where appropriate, this RAM may be dynamic RAM (DRAM) or static RAM (SRAM). Memory 1920 may include one or more memories 1920, where appropriate.
In particular embodiments, storage 1930 may include mass storage for data or instructions. As an example, storage 1930 may include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disc, a magneto-optical disc, magnetic tape, or a Universal Serial Bus (USB) drive or a combination of two or more of these. Storage 1930 may include removable or non-removable (or fixed) media, where appropriate. Storage 1930 may be internal or external to computer system 1900, where appropriate. In particular embodiments, storage 1930 may be non-volatile, solid-state memory. In particular embodiments, storage 1930 may include read-only memory (ROM). Where appropriate, this ROM may be mask ROM (MROM), programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, or a combination of two or more of these. Storage 1930 may include one or more storage control units facilitating communication between processor 1910 and storage 1930, where appropriate. Where appropriate, storage 1930 may include one or more storages 1930.
In particular embodiments, I/O interface 1940 may include hardware, software, or both, providing one or more interfaces for communication between computer system 1900 and one or more I/O devices. Computer system 1900 may include one or more of these I/O devices, where appropriate. One or more of these I/O devices may enable communication between a person and computer system 1900. As an example, an I/O device may include a keyboard, keypad, microphone, monitor, mouse, printer, scanner, speaker, camera, stylus, tablet, touch screen, trackball, another suitable I/O device, or any suitable combination of two or more of these. An I/O device may include one or more sensors. Where appropriate, I/O interface 1940 may include one or more device or software drivers enabling processor 1910 to drive one or more of these I/O devices. I/O interface 1940 may include one or more I/O interfaces 1940, where appropriate.
In particular embodiments, communication interface 1950 may include hardware, software, or both providing one or more interfaces for communication (such as, for example, packet-based communication) between computer system 1900 and one or more other computer systems 1900 or one or more networks. As an example, communication interface 1950 may include a network interface controller (NIC) or network adapter for communicating with an Ethernet or other wire-based network or a wireless NIC (WNIC); a wireless adapter for communicating with a wireless network, such as a WI-FI network; or an optical transmitter (e.g., a laser or a light-emitting diode) or an optical receiver (e.g., a photodetector) for communicating using fiber-optic communication or free-space optical communication. Computer system 1900 may communicate with an ad hoc network, a personal area network (PAN), an in-vehicle network (IVN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), or one or more portions of the Internet or a combination of two or more of these. One or more portions of one or more of these networks may be wired or wireless. As an example, computer system 1900 may communicate with a wireless PAN (WPAN) (such as, for example, a BLUETOOTH WPAN), a WI-FI network, a Worldwide Interoperability for Microwave Access (WiMAX) network, a cellular telephone network (such as, for example, a Global System for Mobile Communications (GSM) network), or other suitable wireless network or a combination of two or more of these. As another example, computer system 1900 may communicate using fiber-optic communication based on 100 Gigabit Ethernet (100 GbE), 10 Gigabit Ethernet (10 GbE), or Synchronous Optical Networking (SONET). Computer system 1900 may include any suitable communication interface 1950 for any of these networks, where appropriate. Communication interface 1950 may include one or more communication interfaces 1950, where appropriate.
In particular embodiments, bus 1960 may include hardware, software, or both coupling components of computer system 1900 to each other. As an example, bus 1960 may include an Accelerated Graphics Port (AGP) or other graphics bus, a controller area network (CAN) bus, an Enhanced Industry Standard Architecture (EISA) bus, a front-side bus (FSB), a HYPERTRANSPORT (HT) interconnect, an Industry Standard Architecture (ISA) bus, an INFINIBAND interconnect, a low-pin-count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCIe) bus, a serial advanced technology attachment (SATA) bus, a Video Electronics Standards Association local bus (VLB), or another suitable bus or a combination of two or more of these. Bus 1960 may include one or more buses 1960, where appropriate.
In particular embodiments, various modules, circuits, systems, methods, or algorithm steps described in connection with the implementations disclosed herein may be implemented as electronic hardware, computer software, or any suitable combination of hardware and software. In particular embodiments, computer software (which may be referred to as software, computer-executable code, computer code, a computer program, computer instructions, or instructions) may be used to perform various functions described or illustrated herein, and computer software may be configured to be executed by or to control the operation of computer system 1900. As an example, computer software may include instructions configured to be executed by processor 1910. In particular embodiments, owing to the interchangeability of hardware and software, the various illustrative logical blocks, modules, circuits, or algorithm steps have been described generally in terms of functionality. Whether such functionality is implemented in hardware, software, or a combination of hardware and software may depend upon the particular application or design constraints imposed on the overall system.
In particular embodiments, a computing device may be used to implement various modules, circuits, systems, methods, or algorithm steps disclosed herein. As an example, all or part of a module, circuit, system, method, or algorithm disclosed herein may be implemented or performed by a general-purpose single- or multi-chip processor, a digital signal processor (DSP), an ASIC, a FPGA, any other suitable programmable-logic device, discrete gate or transistor logic, discrete hardware components, or any suitable combination thereof. A general-purpose processor may be a microprocessor, or, any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, e.g., a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
In particular embodiments, one or more implementations of the subject matter described herein may be implemented as one or more computer programs (e.g., one or more modules of computer-program instructions encoded or stored on a computer-readable non-transitory storage medium). As an example, the steps of a method or algorithm disclosed herein may be implemented in a processor-executable software module which may reside on a computer-readable non-transitory storage medium. In particular embodiments, a computer-readable non-transitory storage medium may include any suitable storage medium that may be used to store or transfer computer software and that may be accessed by a computer system. Herein, a computer-readable non-transitory storage medium or media may include one or more semiconductor-based or other integrated circuits (ICs) (such, as for example, field-programmable gate arrays (FPGAs) or application-specific ICs (ASICs)), hard disk drives (HDDs), hybrid hard drives (HHDs), optical discs (e.g., compact discs (CDs), CD-ROM, digital versatile discs (DVDs), blu-ray discs, or laser discs), optical disc drives (ODDs), magneto-optical discs, magneto-optical drives, floppy diskettes, floppy disk drives (FDDs), magnetic tapes, flash memories, solid-state drives (SSDs), RAM, RAM-drives, ROM, SECURE DIGITAL cards or drives, any other suitable computer-readable non-transitory storage media, or any suitable combination of two or more of these, where appropriate. A computer-readable non-transitory storage medium may be volatile, non-volatile, or a combination of volatile and non-volatile, where appropriate.
In particular embodiments, certain features described herein in the context of separate implementations may also be combined and implemented in a single implementation. Conversely, various features that are described in the context of a single implementation may also be implemented in multiple implementations separately or in any suitable sub-combination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination may in some cases be excised from the combination, and the claimed combination may be directed to a sub-combination or variations of a sub-combination.
While operations may be depicted in the drawings as occurring in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all operations be performed. Further, the drawings may schematically depict one more example processes or methods in the form of a flow diagram or a sequence diagram. However, other operations that are not depicted may be incorporated in the example processes or methods that are schematically illustrated. For example, one or more additional operations may be performed before, after, simultaneously with, or between any of the illustrated operations. Moreover, one or more operations depicted in a diagram may be repeated, where appropriate. Additionally, operations depicted in a diagram may be performed in any suitable order. Furthermore, although particular components, devices, or systems are described herein as carrying out particular operations, any suitable combination of any suitable components, devices, or systems may be used to carry out any suitable operation or combination of operations. In certain circumstances, multitasking or parallel processing operations may be performed. Moreover, the separation of various system components in the implementations described herein should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems may be integrated together in a single software product or packaged into multiple software products.
Various embodiments have been described in connection with the accompanying drawings. However, it should be understood that the figures may not necessarily be drawn to scale. As an example, distances or angles depicted in the figures are illustrative and may not necessarily bear an exact relationship to actual dimensions or layouts of the devices illustrated.
The scope of this disclosure encompasses all changes, substitutions, variations, alterations, and modifications to the example embodiments described or illustrated herein that a person having ordinary skill in the art would comprehend. The scope of this disclosure is not limited to the example embodiments described or illustrated herein. Moreover, although this disclosure describes or illustrates respective embodiments herein as including particular components, elements, functions, operations, or steps, any of these embodiments may include any combination or permutation of any of the components, elements, functions, operations, or steps described or illustrated anywhere herein that a person having ordinary skill in the art would comprehend.
The term “or” as used herein is to be interpreted as an inclusive or meaning any one or any combination, unless expressly indicated otherwise or indicated otherwise by context. Therefore, herein, the expression “A or B” means “A, B, or both A and B.” As another example, herein, “A, B or C” means at least one of the following: A; B; C; A and B; A and C; B and C; A, B and C. An exception to this definition will occur if a combination of elements, devices, steps, or operations is in some way inherently mutually exclusive.
As used herein, words of approximation such as, without limitation, “approximately, “substantially,” or “about” refer to a condition that when so modified is understood to not necessarily be absolute or perfect but would be considered close enough to those of ordinary skill in the art to warrant designating the condition as being present. The extent to which the description may vary will depend on how great a change can be instituted and still have one of ordinary skill in the art recognize the modified feature as having the required characteristics or capabilities of the unmodified feature. In general, but subject to the preceding discussion, a numerical value herein that is modified by a word of approximation such as “approximately” may vary from the stated value by ±0.5%, ±1%, ±2%, ±3%, ±4%, ±5%, ±10%, ±12%, or ±15%. The term “substantially constant” refers to a value that varies by less than a particular amount over any suitable time interval. For example, a value that is substantially constant may vary by less than or equal to 20%, 10%, 1%, 0.5%, or 0.1% over a time interval of approximately 104 s, 103 s, 102 s, 10 s, 1 s, 100 ms, 10 ms, 1 ms, 100 μs, 10 μs, or 1 μs. The term “substantially constant” may be applied to any suitable value, such as for example, an optical power, a pulse repetition frequency, an electrical current, a wavelength, an optical or electrical frequency, or an optical or electrical phase.
As used herein, the terms “first,” “second,” “third,” etc. may be used as labels for nouns that they precede, and these terms may not necessarily imply a particular ordering (e.g., a particular spatial, temporal, or logical ordering). As an example, a system may be described as determining a “first result” and a “second result,” and the terms “first” and “second” may not necessarily imply that the first result is determined before the second result.
As used herein, the terms “based on” and “based at least in part on” may be used to describe or present one or more factors that affect a determination, and these terms may not exclude additional factors that may affect a determination. A determination may be based solely on those factors which are presented or may be based at least in part on those factors. The phrase “determine A based on B” indicates that B is a factor that affects the determination of A. In some instances, other factors may also contribute to the determination of A. In other instances, A may be determined based solely on B.
Although the foregoing embodiments have been described in some detail for purposes of clarity of understanding, the invention is not limited to the details provided. There are many alternative ways of implementing the invention. The disclosed embodiments are illustrative and not restrictive.