There is an ongoing demand for three-dimensional (3D) object tracking and object scanning for various applications, one of which is autonomous driving. The wavelengths of some types of signals, such as radar, are too long to provide the sub-millimeter resolution needed to detect smaller objects. Light detection and ranging (LiDAR) systems use optical wavelengths that can provide finer resolution than other types of systems, thereby providing good range, accuracy, and resolution. In general, to determine the distances to objects, LiDAR systems illuminate a target area or scene with pulsed laser light and measure how long it takes for reflected pulses to be returned to a receiver.
One type of LiDAR system is referred to in the art as flash LiDAR. A flash LiDAR system operates similarly to a camera. A single, high-powered laser pulse illuminates a large field-of-view (FOV). An array of detectors (typically in close proximity to the laser) simultaneously detects light reflected by objects in the FOV. Typically, a lens focuses the reflected light onto the array of detectors. For each pulsed beam of light directed by the flash LiDAR system into the FOV, the detector array can receive reflected light corresponding to a frame of data. By using one or more frames of data, the ranges or distances of objects in the FOV can be obtained by determining the elapsed time between transmission of the pulsed beam of light by the laser and reception of the reflected light at the light detector array.
Thus, for some applications (e.g., autonomous driving), it may be challenging or impossible to design a conventional flash LiDAR system that meets all of the cost, size, resolution, and power consumption requirements. Moreover, because of at least power limitations, the range of a conventional flash LiDAR system is generally limited to a couple hundred meters, which may be inadequate for some applications (e.g., autonomous driving).
Objects, features, and advantages of the disclosure will be readily apparent from the following description of certain embodiments taken in conjunction with the accompanying drawings in which:
To facilitate understanding, identical reference numerals have been used, where possible, to designate identical elements that are common to the figures. It is contemplated that elements disclosed in one embodiment may be beneficially utilized in other embodiments without specific recitation. Moreover, the description of an element in the context of one drawing is applicable to other drawings illustrating that element.
Conventional flash LiDAR systems suffer from a number of drawbacks, including a need for high power. Because the FOV 22 is large, there is a trade-off between the power emitted by the illuminator 20 and the distance at which objects can be detected. For example, in order to illuminate an entire scene of interest and allow the detector array 35 to detect reflections off of objects at a reasonable distance from the flash LiDAR system 10, the illuminator 20 generally must emit high-power pulses so that enough energy reflected off of a target 15 reaches the detector array 35. These high power levels may violate eye safety standards.
Disclosed herein are long-range LiDAR systems that mitigate or eliminate at least some of the problems of conventional flash LiDAR systems and provide high target resolution over much larger distances than conventional flash LiDAR systems. The disclosed long-range LiDAR systems include a plurality of illuminators (e.g., lasers) and a plurality of optical detectors (e.g., photodetectors, such as avalanche photodiodes (APDs)). The illuminators and detectors may be disposed in one or more arrays, which, in autonomous driving applications, may be mounted to the roof of a vehicle or in another location.
Rather than using a single, high-powered laser to illuminate the entire scene, the disclosed long-range LiDAR systems use an array of illuminators, each of which has a FOV that is much narrower than that of the single laser used in conventional flash LiDAR systems. Together, the array of illuminators can simultaneously illuminate the entire scene at distances that are considerably further away from the system than the maximum distance at which a conventional flash LiDAR system can detect objects. Furthermore, the disclosed long-range LiDAR systems provide high resolution at distances much larger than those feasible for conventional flash LiDAR systems. Because the FOV of each illuminator is narrow, the power of each illuminator can be lower than in a conventional LiDAR system, yet illuminate objects at larger distances from the long-range LiDAR system without violating eye-safety standards.
In some embodiments, each illuminator of the long-range LiDAR system is associated with a respective detector array that can be significantly smaller (e.g., have fewer optical detectors) than the massive detector array that is typically required in a conventional flash LiDAR system. In these embodiments, the number of detector arrays is equal to the number of illuminators.
In other embodiments, a plurality of illuminators with non-overlapping fields-of-view can be fired (caused to emit signals) simultaneously. The corresponding detectors assigned to each illuminator, whether portions of a single detector or a respective plurality of detectors, will correspondingly have non-overlapping fields-of-view. Therefore, each portion of the detector array is unambiguously associated with a respective one of the plurality of illuminators. This allows the long-range LiDAR system to unambiguously detect the time-of-flight and angular position of a target even when simultaneous illuminators are fired. The ability to fire a plurality of illuminators (e.g., lasers) simultaneously allows one to scan the scenery in a more rapid fashion and yields a higher frame-per-second rate for the output of the long-range LiDAR system.
In some embodiments, a single detector array is used to detect reflections of optical signals emitted by all of the illuminators in the long-range LiDAR system.
Accordingly, in some aspects, the techniques described herein relate to a light detection and ranging (LiDAR) system, including: a plurality of N illuminators, each of the plurality of N illuminators configured to illuminate a respective one of a plurality of N illuminator fields-of-view (FOVs); a detector including at least one focusing component and at least one detector array, wherein the detector is configured to observe a detector FOV that overlaps at least a first illuminator FOV of the plurality of N illuminator FOVs; and at least one processor configured to: cause a first illuminator of the plurality of N illuminators to emit an optical pulse to illuminate the first illuminator FOV, obtain a signal representing at least one reflected optical pulse detected by the detector, and determine a position of at least one target using the signal.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the detector FOV is a first detector FOV, and wherein the detector is further configured to observe a second detector FOV that overlaps at least a second illuminator FOV of the plurality of N illuminator FOVs.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the detector FOV overlaps a second illuminator FOV of the plurality of N illuminator FOVs.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one detector array includes a plurality of detector arrays, and wherein a particular focusing component of the at least one focusing component is configured to focus reflected signals on the plurality of detector arrays.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the particular focusing component includes a lens and/or a mirror.
In some aspects, the techniques described herein relate to a LiDAR system, each of the plurality of N illuminators includes a respective laser.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one focusing component includes a plurality of focusing components, and the at least one detector array includes a plurality of detector arrays.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the plurality of focusing components includes N focusing components and the plurality of detector arrays includes N detector arrays.
In some aspects, the techniques described herein relate to a LiDAR system, wherein each of the plurality of N illuminators is associated with a respective one of the N focusing components and a respective one of the N detector arrays.
In some aspects, the techniques described herein relate to a LiDAR system, wherein each of the N detector arrays includes at least 200 optical detectors.
In some aspects, the techniques described herein relate to a LiDAR system, wherein each of the at least 200 optical detectors includes an avalanche photodiode (APD), a single-photon avalanche diode (SPAD), or a silicon photomultiplier (SiPM).
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one detector array includes a plurality of avalanche photodiodes, single-photon avalanche diode (SPAD) detectors, or silicon photomultiplier (SiPM) detectors.
In some aspects, the techniques described herein relate to a LiDAR system, wherein each of the plurality of N illuminators includes a respective laser.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one focusing component includes a lens.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one detector array includes a plurality of detector arrays, and wherein the lens is shared by the plurality of detector arrays.
In some aspects, the techniques described herein relate to a LiDAR system, wherein each of the plurality of detector arrays includes at least 200 optical detectors.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one focusing component includes a mirror.
In some aspects, the techniques described herein relate to a LiDAR system, wherein each of the plurality of N illuminator FOVs is 1 degree or less in an azimuth direction and 1 degree or less in an elevation direction.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the plurality of N illuminators includes at least 40 illuminators.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one detector array includes at least 200 optical detectors.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the detector FOV is a first detector FOV and the optical pulse is a first optical pulse, and wherein the detector is further configured to observe a second detector FOV that overlaps a second illuminator FOV of the plurality of N illuminator FOVs, and wherein the at least one processor is further configured to cause a second illuminator of the plurality of N illuminators to emit a second optical pulse to illuminate the second illuminator FOV.
In some aspects, the techniques described herein relate to a light detection and ranging (LiDAR) system, including: a plurality of illuminators, including: a first illuminator configured to illuminate a first illuminator field-of-view (FOV), and a second illuminator configured to illuminate a second illuminator FOV; a plurality of detectors, including: a first detector including a first focusing component and a first detector array, wherein the first detector is configured to observe at least a portion of the first illuminator FOV, and a second detector including a second focusing component and a second detector array, wherein the second detector is configured to observe at least a portion of the second illuminator FOV; and at least one processor configured to: cause the first illuminator to emit a first optical pulse to illuminate the first illuminator FOV, cause the second illuminator to emit a second optical pulse to illuminate the second illuminator FOV, obtain at least one signal representing at least one reflected optical pulse detected by the first detector or the second detector, and determine a position of at least one target using the at least one signal.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one processor is configured to cause the first illuminator to emit the first optical pulse and to cause the second illuminator to emit the second optical pulse at a substantially same time.
In some aspects, the techniques described herein relate to a LiDAR system, wherein each of the first illuminator FOV and second illuminator FOV is 1 degree or less in an azimuth direction and 1 degree or less in an elevation direction.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least one target is within the first illuminator FOV and within the second illuminator FOV.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the first illuminator FOV and the second illuminator FOV are non-overlapping.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the first illuminator FOV and the second illuminator FOV partially overlap.
In some aspects, the techniques described herein relate to a LiDAR system, wherein a detector FOV of the first detector and a detector FOV of the second detector are non-overlapping.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the first focusing component and/or the second focusing component includes a lens.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the first focusing component and/or the second focusing component includes a mirror.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the first illuminator and/or the second illuminator includes a laser.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the first detector array and/or the second detector array includes a plurality of avalanche photodiodes (APDs), single-photon avalanche diode (SPAD) detectors, or silicon photomultiplier (SiPM) detectors.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the first detector array and/or the second detector array includes at least 200 optical detectors.
In some aspects, the techniques described herein relate to a LiDAR system, wherein the at least 200 optical detectors include avalanche photodiodes (APDs), single-photon avalanche diode (SPAD) detectors, or silicon photomultiplier (SiPM) detectors.
The illuminator 120 may be, for example, a laser operating at any suitable wavelength, for example, 905 nm or 1550 nm. The illuminator 120 is shown in
Each illuminator 120 of a LiDAR system has a position in three-dimensional space, which can be characterized in Cartesian coordinates (x, y, z) on x-, y-, and z-axes, as shown in
As illustrated in
As shown in
The elevation FOV angle 127 of an illuminator 120 may be the same as or different from the azimuth FOV angle 126 of that illuminator 120. As will be understood by those having ordinary skill in the art, the beams emitted by illuminators 120 can have any suitable shape in three dimensions. For example, the emitted beams may be generally conical (where a cone is an object made up of a collection of (infinitely many) rays). The cross section of the cone can be any arbitrary shape, e.g., circular, ellipsoidal, square, rectangular, etc. In some embodiments, the cross section of the emitted beams are circular or square.
The volume of space illuminated by an illuminator 120 having boresight angles 124, 125 and FOV angles 126, 127 is referred to herein as the illuminator FOV 122. Objects that are within the illuminator FOV 122 of a particular illuminator 120 are illuminated by optical signals transmitted by that illuminator 120. The illuminator FOV 122 of an illuminator 120 is dependent on and determined by the position of the illuminator 120, and the boresight angles 124, 125 and FOV angles 126, 127 of the illuminator 120. The range of the illuminator 120 is dependent on its optical power and its vertical and horizontal FOV angles (e.g., intensity in watts per steradian).
The illuminators 120 in a long-range LiDAR system 100 may be identical to each other, or they may differ in one or more characteristics. For example, different illuminators 120 have different positions in the long-range LiDAR system 100 and therefore in space (i.e., they have different (x, y, z) coordinates).
The boresight angles 124, 125 and FOV angles 126, 127 of different illuminators 120 may also be the same or different. For example, subsets of illuminators 120 may have configurations whereby they illuminate primarily targets within a certain range of the long-range LiDAR system 100 and are used in connection with detectors 130 that are configured primarily to detect targets within that same range. Similarly, the power of optical signals emitted by different illuminators 120 can be the same or different. For example, illuminators 120 intended to illuminate targets at very large distances from the long-range LiDAR system 100 may use more power than illuminators 120 intended to illuminate targets at somewhat closer distances from the long-range LiDAR system 100.
The boresight angles 124, 125 and the FOV angles 126, 127 of the illuminators 120 can be selected so that the beams emitted by different illuminators 120 overlap, thereby resulting in different illuminators 120 illuminating overlapping portions of a scene. Unlike conventional LiDAR systems, the long-range LiDAR systems 100 disclosed herein are able to resolve the three-dimensional positions of multiple targets within these overlapping regions of space. Moreover, they do not require any moving parts.
In some embodiments, multiple illuminators 120 emit optical signals simultaneously. If the illuminator FOVs 122 of the illuminators 120 that emit optical signals simultaneously are non-overlapping, there is no ambiguity in the times-of-flight of optical signals emitted by the illuminators 120, reflected by the target(s) 15, and detected by the detectors 130. The ability to fire (cause optical signals to be emitted by) multiple illuminators 120 at the same time can allow the long-range LiDAR system 100 to scan the scenery faster and thus increase the number frames per second (FPS) that the long-range LiDAR system 100 generates.
The detector 130 is shown having a cuboid shape, which is merely symbolic. Each detector 130 has a position in three-dimensional space, which, as explained previously, can be characterized by Cartesian coordinates (x, y, z) on x-, y-, and z-axes, as shown in
As illustrated in
As shown in
The volume of space sensed by a detector 130 having boresight angles 134, 135 and FOV angles 136, 137 is referred to herein as a detector FOV 132. Optical signals reflected by objects within a particular detector 130's detector FOV 132 can be detected by that detector 130. The detector FOV 132 of a detector 130 is dependent on and determined by the position of the detector 130 within the LiDAR system, and the boresight angles 134, 135 and FOV angles 136, 137 of the detector 130. In some embodiments, the azimuth boresight angle 124, the azimuth FOV angle 126, the azimuth boresight angle 134, and the azimuth FOV angle 136 of a particular detector 130 are selected so that the detector FOV 132 largely coincides with the illuminator FOV 122 of a respective illuminator 120. The range of the detector 130 is dependent on the sensitivity of the detector 130 and irradiance on target. The detectors 130 may be identical to each other, or they may differ in one or more characteristics.
For example, different detectors 130 have different positions in the long-range LiDAR system 100 and therefore in space (i.e., they have different (x, y, z) coordinates). The boresight angles 134, 135 and FOV angles 136, 137 of different detectors 130 may also be the same or different. For example, subsets of detectors 130 may have configurations whereby they observe targets within a certain range of the long-range LiDAR system 100 and are used in connection with illuminators 120 that are configured primarily to illuminate targets within that same range.
As shown in
The detector array 140 shown in
The exemplary long-range LiDAR system 100 also includes a plurality of detectors 130. To avoid obscuring the drawing, only the detector 130C is labeled in
In the example of
An example illustrates potential benefits of the disclosed long-range LiDAR systems 100, such as the exemplary embodiment shown in
The disclosed long-range LiDAR systems 100 offer several advantages relative to conventional LiDAR systems (e.g., flash LiDAR systems). For example, because the illuminator FOVs 122 are narrow, pulses emitted by the illuminators 120 travel further without being dispersed as they would be if the FOV were wider. Thus, for a given power level, pulses originating from the illuminators 120 (emitted pulses 60) can reach and be reflected by objects (targets) at distances from the long-range LiDAR system 100 that are considerably larger than the maximum detectable-object distance of a conventional flash LiDAR system. Likewise, because the illuminator FOVs 122 are narrow, the reflected pulses 61 caused by emitted optical signals from individual illuminators 120 can reach and be detected by detectors 130 using a much smaller number of optical detectors 142 that “looks at” only a narrow FOV. The narrow detector FOV 132 of each detector 130 substantially coincides with the illuminator FOV 122 of the respective illuminator 120 (e.g., by collocating each illuminator 120 and its respective detector 130).
Additionally, a benefit of having multiple spatially-separated illuminators 120 is that the long-range LiDAR system 100 can reach longer distances without violating eye safety restrictions. For example, if the beams of two illuminators 120 overlap at a particular point in the field (scene), a person situated at that location will see two separated beams from the illuminators 120, which will form two different spots on the person's retina. Laser eye safety guidelines (e.g., ANSI Z13.1-2014 or similar) may treat this configuration as an extended source and may be less restrictive than if all the incident power at the person's eye were coming from a single illuminator 120.
Furthermore, the power levels of individual illuminators 120 can be dynamically adjusted to, for example, maintain the quality of reflected pulses 61 (and thereby avoid detector saturation), and to meet eye safety standards while not affecting the overall long-range FOV of the long-range LiDAR system 100.
The exemplary long-range LiDAR system 100 also includes a detector 130. The detector 130 has a detector FOV 132 that overlaps all of the illuminator FOVs 122A, 122B, 122C, and 122D at some distance (or range of distances). The exemplary detector 130 of
As illustrated in the example of
As explained above, a benefit of having multiple spatially-separated illuminators 120 is that the long-range LiDAR system 100 can reach longer distances without violating eye safety restrictions. For example, referring to
In some embodiments, individual illuminators 120 in the long-range LiDAR system 100 comprise multiple spatially-separated illuminators 120 that illuminate overlapping illuminator FOVs 122. As an example,
It is also to be appreciated that although the drawings herein show lenses 133 as the focusing components, the detectors 130 can include additional and/or alternative focusing components (e.g., mirrors, etc.), as explained above.
The detector arrays 140 described herein can be implemented using various technologies, including, but not limited to, avalanche photo-diodes (APDs), single-photon avalanche diode (SPAD) detectors (e.g., solid-state detectors that can detect individual photons), and/or silicon photomultiplier (SiPM) detectors (e.g., solid-state single-photon-sensitive devices based on single-photon avalanche diodes implemented on a common silicon substrate).
The array of optical components 110 may be in the same physical housing (or enclosure) as the at least one processor 150, or it may be physically separate. Although the description herein refers to a single array of optical components 110, it is to be understood that the illuminators 120 and the detector(s) 130 can be situated within the long-range LiDAR system 100 in any suitable physical arrangement (e.g., in multiple sub-arrays, etc.).
The long-range LiDAR system 100 may optionally also include one or more analog-to-digital converters (ADCs) 115 disposed between the array of optical components 110 and the at least one processor 150. If present, the one or more ADCs 115 convert analog signals provided by detectors 130 in the array of optical components 110 to digital format for processing by the at least one processor 150. The analog signal provided by each of the detectors 130 may be a superposition of reflected optical signals (e.g., reflected pulses 61) detected by that detector 130, which the at least one processor 150 may then process to determine the positions of targets 15 corresponding to (causing) the reflected optical signals.
It is to be understood that in addition to or instead of the ADC(s) 115 illustrated in
In the foregoing description and in the accompanying drawings, specific terminology has been set forth to provide a thorough understanding of the disclosed embodiments. In some instances, the terminology or drawings may imply specific details that are not required to practice the invention. To avoid obscuring the present disclosure unnecessarily, well-known components are shown in block diagram form and/or are not discussed in detail or, in some cases, at all.
Unless otherwise specifically defined herein, all terms are to be given their broadest possible interpretation, including meanings implied from the specification and drawings and meanings understood by those skilled in the art and/or as defined in dictionaries, treatises, etc. As set forth explicitly herein, some terms may not comport with their ordinary or customary meanings.
As used in the specification and the appended claims, the singular forms “a,” “an” and “the” do not exclude plural referents unless otherwise specified. The word “or” is to be interpreted as inclusive unless otherwise specified. Thus, the phrase “A or B” is to be interpreted as meaning all of the following: “both A and B,” “A but not B,” and “B but not A.” Any use of “and/or” herein does not mean that the word “or” alone connotes exclusivity.
As used in the specification and the appended claims, phrases of the form “at least one of A, B, and C,” “at least one of A, B, or C,” “one or more of A, B, or C,” and “one or more of A, B, and C” are interchangeable, and each encompasses all of the following meanings: “A only,” “B only,” “C only,” “A and B but not C,” “A and C but not B,” “B and C but not A,” and “all of A, B, and C.” To the extent that the terms “include(s),” “having,” “has,” “with,” and variants thereof are used in the detailed description or the claims, such terms are intended to be inclusive in a manner similar to the term “comprising,” i.e., meaning “including but not limited to.” The terms “exemplary” and “embodiment” are used to express examples, not preferences or requirements.
The term “coupled” is used herein to express a direct connection/attachment as well as a connection/attachment through one or more intervening elements or structures.
The terms “over,” “under,” “between,” and “on” are used herein refer to a relative position of one feature with respect to other features. For example, one feature disposed “over” or “under” another feature may be directly in contact with the other feature or may have intervening material. Moreover, one feature disposed “between” two features may be directly in contact with the two features or may have one or more intervening features or materials. In contrast, a first feature “on” a second feature is in contact with that second feature.
The term “substantially” is used to describe a structure, configuration, dimension, etc. that is largely or nearly as stated, but, due to manufacturing tolerances and the like, may in practice result in a situation in which the structure, configuration, dimension, etc. is not always or necessarily precisely as stated. For example, describing two lengths as “substantially equal” means that the two lengths are the same for all practical purposes, but they may not (and need not) be precisely equal at sufficiently small scales. As another example, a structure that is “substantially vertical” would be considered to be vertical for all practical purposes, even if it is not precisely at 90 degrees relative to horizontal.
The drawings are not necessarily to scale, and the dimensions, shapes, and sizes of the features may differ substantially from how they are depicted in the drawings.
Although specific embodiments have been disclosed, it will be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the disclosure. For example, features or aspects of any of the embodiments may be applied, at least where practicable, in combination with any other of the embodiments or in place of counterpart features or aspects thereof. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense.
This application claims priority to U.S. Provisional Application No. 63/180,049, filed Apr. 26, 2021 and entitled “Long-Range LiDAR” (Attorney Docket No. NPS011P) and U.S. Provisional Application No. 63/180,059, filed Apr. 26, 2021 and entitled “Long-Range LiDAR” (Attorney Docket No. NPS011P2). Both of the above-referenced applications are incorporated by reference in their entireties.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US2022/026269 | 4/26/2022 | WO |
Number | Date | Country | |
---|---|---|---|
63180049 | Apr 2021 | US | |
63180059 | Apr 2021 | US |