The present disclosure relates generally to systems and methods for light transmission and reception, and more particularly to improving the accuracy and reliability of the detection by applying unique and identifiable light pulse sequences.
Light detection and ranging systems, such as a LiDAR system, may operate by transmitting a series of light pulses that reflect off objects. The reflected signal, or return signal, is received by the light detection and ranging system, and based on the detected time-of-flight (TOF), the system determines the range (distance) the system is located from the object. Light detection and ranging systems may have a wide range of applications including autonomous driving and aerial mapping of a surface. These applications may place a high priority on the security, accuracy and reliability of the operation. If another party intentionally or unintentionally distorts the laser beam or the return signal, the accuracy and reliability may be negatively impacted. In some embodiments, multi-return detection and pulse encoding of a laser beam may improve the performance of the LiDAR system.
Accordingly, what is needed are systems and methods for improving detection of a return signal in a light detection and ranging system.
References will be made to embodiments of the invention, examples of which may be illustrated in the accompanying figures. These figures are intended to be illustrative, not limiting. Although the invention is generally described in the context of these embodiments, it should be understood that it is not intended to limit the scope of the invention to these particular embodiments. Items in the figures are not to scale.
In the following description, for purposes of explanation, specific details are set forth in order to provide an understanding of the invention. It will be apparent, however, to one skilled in the art that the invention can be practiced without these details. Furthermore, one skilled in the art will recognize that embodiments of the present invention, described below, may be implemented in a variety of ways, such as a process, an apparatus, a system, a device, or a method on a tangible computer-readable medium.
Components, or modules, shown in diagrams are illustrative of exemplary embodiments of the invention and are meant to avoid obscuring the invention. It shall also be understood that throughout this discussion that components may be described as separate functional units, which may comprise sub-units, but those skilled in the art will recognize that various components, or portions thereof, may be divided into separate components or may be integrated together, including integrated within a single system or component. It should be noted that functions or operations discussed herein may be implemented as components. Components may be implemented in software, hardware, or a combination thereof.
Furthermore, connections between components or systems within the figures are not intended to be limited to direct connections. Rather, data between these components may be modified, re-formatted, or otherwise changed by intermediary components. Also, additional or fewer connections may be used. It shall also be noted that the terms “coupled,” “connected,” or “communicatively coupled” shall be understood to include direct connections, indirect connections through one or more intermediary devices, and wireless connections.
Reference in the specification to “one embodiment,” “preferred embodiment,” “an embodiment,” or “embodiments” means that a particular feature, structure, characteristic, or function described in connection with the embodiment is included in at least one embodiment of the invention and may be in more than one embodiment. Also, the appearances of the above-noted phrases in various places in the specification are not necessarily all referring to the same embodiment or embodiments.
The use of certain terms in various places in the specification is for illustration and should not be construed as limiting. A service, function, or resource is not limited to a single service, function, or resource; usage of these terms may refer to a grouping of related services, functions, or resources, which may be distributed or aggregated.
The terms “include,” “including,” “comprise,” and “comprising” shall be understood to be open terms and any lists the follow are examples and not meant to be limited to the listed items. Any headings used herein are for organizational purposes only and shall not be used to limit the scope of the description or the claims. Each reference mentioned in this patent document is incorporate by reference herein in its entirety.
Furthermore, one skilled in the art shall recognize that: (1) certain steps may optionally be performed; (2) steps may not be limited to the specific order set forth herein; (3) certain steps may be performed in different orders; and (4) certain steps may be done concurrently.
A light detection and ranging system, such as a LiDAR system, may be a tool to measure the shape and contour of the environment surrounding the system. LiDAR systems may be applied to numerous applications including both autonomous navigation and aerial mapping of a surface. LiDAR systems emit a light pulse that is subsequently reflected off an object within the environment in which a system operates. The time each pulse travels from being emitted to being received may be measured (i.e., time-of-flight “TOF”) to determine the distance between the object and the LiDAR system. The science is based on the physics of light and optics. References made herein to a LiDAR system, or a light detection and ranging system, may also apply to other light detection systems.
In a LiDAR system, light may be emitted from a rapidly firing laser. Laser light travels through a medium and reflects off points of things in the environment like buildings, tree branches and vehicles. The reflected light energy returns to a LiDAR receiver (detector) where it is recorded and used to map the environment.
Some embodiments of a LiDAR system may capture distance data in a 2-D (i.e. single plane) point cloud manner. These LiDAR systems may be often used in industrial applications and may be often repurposed for surveying, mapping, autonomous navigation, and other uses. Some embodiments of these devices rely on the use of a single laser emitter/detector pair combined with some type of moving mirror to effect scanning across at least one plane. This mirror not only reflects the emitted light from the diode, but may also reflect the return light to the detector. Use of a rotating mirror in this application may be a means to achieving 90-180-360 degrees of azimuth view while simplifying both the system design and manufacturability.
LiDAR system 300 comprises laser electronics 302, which comprises a single light emitter and light detector. The emitted laser signal 301 may be directed to a fixed mirror 304, which reflects the emitted laser signal 301 to rotating mirror 306. As rotating mirror 306 “rotates”, the emitted laser signal 301 may reflect off object 308 in its propagation path. The reflected signal 303 may be coupled to the detector in laser electronics 302 via the rotating mirror 306 and fixed mirror 304.
Coupled to rotor components 352 via connections 354 are ring 356 and ring 358. Ring 356 and ring 358 are circular bands located on the inner surface of rotor 351 and provide electrode plate functionality for one side of the air gap capacitor. Coupled to shaft components 366 via connections 364 are ring 360 and ring 362. Ring 360 and ring 362 are circular bands located on the outer surface of shaft 361 and provide electrode plate functionality for the other side of the air gap capacitor. A capacitor C1 may be created based on a space between ring 356 and ring 360. Another capacitor C2 may be created based on a space between ring 358 and ring 362. The capacitance for the aforementioned capacitors may be defined, in part, by air gap 368.
Ring 356 and ring 360 are the electrode plate components of capacitor C1 and ring 358 and ring 362 are the electrode plate components of capacitor C2. The vertical gap 370 between ring 356 and ring 358 may impact the performance of a capacitive link between capacitor C1 and capacitor C2 inasmuch as the value of the vertical gap 370 may determine a level of interference between the two capacitors. One skilled in the art will recognize that rotor 351 and shaft 361 may each comprise N rings that may support N capacitive links.
As previously noted, time of flight or TOF is the method a LiDAR system uses to map the environment and provides a viable and proven technique used for detecting target objects. Simultaneously, as the lasers fire, firmware within a LiDAR system may be analyzing and measuring the received data. The optical receiving lens within the LiDAR system acts like a telescope gathering fragments of light photons returning from the environment. The more lasers employed in a system, the more the information about the environment may be gathered. Single laser LiDAR systems may be at a disadvantage compared with systems with multiple lasers because fewer photons may be retrieved, thus less information may be acquired. Some embodiments, but without limitation, of LiDAR systems may be implemented in multiples of 8, i.e., 8, 16, 32 and 64 lasers. Also, some LiDAR embodiments, but without limitation, may have a vertical field of view (FOV) of 30-40° with laser beam spacing as tight as 0.3° and may have rotational speeds of 5-20 rotations per second.
The rotating mirror functionality may also be implemented with a solid state technology such as MEMS. Solid-state LiDAR sensors can enable hidden and low-profile sensing for a range of advanced driver-assistance systems (ADAS) and autonomous applications. One example, but without limitation, is the fixed laser, solid state Velarray™ LiDAR (Light Detection and Ranging) sensor, which can be a cost effective, high performance and rugged automotive product in a small form factor. In one embodiment, the Velarray™ LiDAR sensor may be implemented in a package size of 125 mm×50 mm×55 mm that can be embedded into the front, sides, and corners of vehicles. It may provide up to a 120 degree horizontal and 35 degree vertical field of view, with a 200 meter range even for low reflectivity objects.
One objective of embodiments of the present documents is the improvement in the reliability and accuracy for light detection and ranging systems. As used herein, the light detection and ranging system may be, but not limited to, a LiDAR system. In some embodiments, multi-return detection and pulse encoding of a laser beam may improve the performance of the LiDAR system. A motivation for pulse encoding may be the rejection of interference from other LiDAR sensors. A motivation for multiple return signals is to provide an ability to scan space with minimal sensor movement, and hence providing faster acquisition times for mapping data. There are number applications for which a single return signal may not provide enough accuracy and reliability. As with human vision system, one can see scenes which are partially occluded, e.g. seeing behind glass-doors/windows, seeing through mist, seeing through tree canopies etc. Multiple return signals from a LiDAR system may allow for mapping of partially occluded objects.
Imagine a helicopter or drone scanning a tree canopy shape for a forest survey. If there is only one return signal or two return signals available, the LiDAR system may have to carry out multiple missions to map out at various heights, and many of the acquisitions may be impossible with aerial survey. The LiDAR system may have to resort to manual point and shoot terrestrial survey methods for this application.
A LiDAR system may have the ability to analyze a return signal comprising a sequence of pulses and match the received sequence of pulses with a transmitted sequence of pulses in order to distinguish from other spurious pulses. Generally, a return signal may refer to a multi-return signal or a single return signal.
The reliability and accuracy of detection of a LiDAR return signal may be improved with a signature based on pulse encoding. A signature may uniquely identify a valid reflected light signal. A signature may be encoded or embedded in the pulses that are subsequently fired by the LiDAR system. When the LiDAR system receives a return signal, the LiDAR system may extract the signature from the single-return or multiple return signals and may determine if the decoded pulse(s) of the received return signal match the pulses transmitted in the laser beam. If the pulses do match, the return signal may be considered authenticated and data may be decoded from the return signal pulse(s). If the pulses do not match, the return signal may be considered a spurious signal, and the return signal may be discarded. Effectively, the system authenticates or validates the return signal using the characteristics of the transmitted pulses that comprises the embedded signature. The system may identify intentional or unintentional spurious return signals than may erroneously trigger a bogus return signal calculation. That is, the LiDAR system may distinguish and confirm the transmitted pulses from spurious pulses.
Signatures may be based, but without limitations, the number of pulses, the distance between pulses, the amplitude and ratio of amplitudes of the pulses and the shape of pulses. As an example of one signature, the number of pulses in a two firing sequences may comprise X pulses in a first sequence and Y pulses in a second sequence, where X is not equal to Y
One skilled in the art will recognize that the signatures may vary based on the application and environment in which embodiments of the invention are implemented, all of which are intended to fall under the scope of the invention. Signatures may be utilized separately or in combination. Signature detection may be implemented with fixed or variable thresholds.
Moreover, the system may include additional features to further improve the reliability and accuracy of return signal detection.
First, the LiDAR system may dynamically change the characteristics of the pulses for the next or subsequent laser firing. As previously discussed, the characteristics of the pulses may be defined by the signature. This feature allows the LiDAR system to respond to a spoofing attack of spurious pulses. A malicious party may be monitoring the transmitted laser beam or return signals in order to spoof the LiDAR system. With a static operation, rather than a dynamic operation, for the signature, the malicious party may be able to readily spoof the LiDAR system.
The LiDAR system may also dynamically change the signature for the next firing when the transmitted sequences of pulse match the return signal sequences of pulses. As noted, by dynamically changing the signature for the next laser firing, the potential for intentional or unintentional spoofing may be mitigated. Typically, the time for the time of flight (TOF) for a laser beam to travel to an object and be reflected back to the LiDAR system is a function of distance and speed of light. In this time period, the LiDAR system may analyze the return signal and decide to change or not the signature for the next laser firing.
In various embodiments, the LiDAR system may also dynamically change the transmitted sequence of pulses to include the signature as well as adapt the pulse sequence to the environment in which it operates. For example, if a LiDAR system is employed within an autonomous navigation system, weather patterns and/or traffic congestion may affect the manner in which the light signals propagate. In this embodiment, the LiDAR system may adjust the pattern of light pulses to not only uniquely identify it to a receiver but also to improve performance of the system based on the environment in which it operates.
Second, to add another element of security, the LiDAR system may randomly alter transmitted pulses. Encoding based on a random algorithm may be initiated by an instruction from a controller. This feature may be beneficial to mitigate the impact of non-intentional return signals. Unintentional return signals may increase with the growth of autonomous driving based on LiDAR systems.
Detecting multi-return LiDAR signals may be problematic with the presence of other LiDAR signals or other optical signals. One scenario is illustrated in
As previously discussed, the reliability and accuracy of detection of a LiDAR return signal may be improved with a signature based on pulse encoding. A signature may uniquely identify a valid reflected light signal. A signature may be encoded or embedded in the pulses that are subsequently fired by the LiDAR system. When the LiDAR system receives a return signal, the LiDAR system may extract the signature from the single-return or multiple return signals and may determine if the decoded pulse(s) of the received return signal match the pulses transmitted in the laser beam. A signature may also be referred to as a “user signature” inasmuch as signatures may be assigned to different users or different systems.
In summary, with embodiments having received pulses 500, i.e., no overlapping pulses between return pulses from separate LiDAR firings, the encoding schemes for
A mathematical model for the design of a signature set may be based on the following problem statement:
Design signature set:
S={s
1
,s
2
, . . . ,s
K
},s∈{±1}L
with K user signatures of length L, such that total squared correlation (TSC) of set S is minimized, i.e.,
It is proved [1] that the lower bound on TSC of signature sets.
Hadamard matrix with K=L and K is some order of 2 and can achieve the lower bound.
An exemplary signature set with an 8-bit length may be illustrated with a permutated Hadamard matrix.
For example, transmitter 801 and receiver 809 may be configured to support the functionality of
Receiver 809 comprises a matched filter 810, peak detection 812, pulse decoder 814, and detection (correlation) 816. A return signal may be received from channel 808 and processed by matched filter 810 in order to optimize the S/N ratio of the return signal. The optimized signal may be coupled to peak detection 812, which generates a peak return signal. With the knowledge of the signature, pulse decoder 814 decodes the peak ratio and the pulse interval. These calculations are correlated and validated by detection (correlation) 816.
Encoding a sequence of pulses based on a user signature. (step 902)
Optically transmitting the encoded sequence of pulses. (step 904)
Receiving a multi-return signal comprising the encoded sequence of pulses. (step 906)
Decoding a first pulse in the encoded sequences of pulses amplitude (Pulse1). (step 908)
Decoding pulse interval between first pulse and the next pulse. (Pulse1 and Pulse2). (step 910)
Decoding second/next pulse amplitude. (Pulse2) (step 912)
Authenticating the decoded multi-return signal via a correlation calculation. The authentication may be partially determined based on maintaining a tolerance margin for a shape of received pulses from the sequence of pulses relative to a shape of the transmitted pulses of the sequence of pulses (step 914)
In summary, each LiDAR system may be manufactured with a specific user signature based on pulse encoding. The specific signature may be determined based an assignment of a specific number of bits for pulse amplitudes and/or pulse intervals and/or pulse widths. The signature may be based on any or all of the aforementioned parameters. Optionally, the LiDAR system may be designed with a controller that may dynamically assign signatures to determine the pulse encoding of the laser firing. That is, for a next sequence of pulses to be transmitted, the pulse encoder may dynamically change the user signature.
In embodiments, aspects of the present patent document may be directed to or implemented on information handling systems/computing systems. For purposes of this disclosure, a computing system may include any instrumentality or aggregate of instrumentalities operable to compute, calculate, determine, classify, process, transmit, receive, retrieve, originate, route, switch, store, display, communicate, manifest, detect, record, reproduce, handle, or utilize any form of information, intelligence, or data for business, scientific, control, or other purposes. For example, a computing system may be an optical measuring system such as a LiDAR system that uses time of flight to map objects within its environment. The computing system may include random access memory (RAM), one or more processing resources such as a central processing unit (CPU) or hardware or software control logic, ROM, and/or other types of memory. Additional components of the computing system may include one or more network or wireless ports for communicating with external devices as well as various input and output (I/O) devices, such as a keyboard, a mouse, touchscreen and/or a video display. The computing system may also include one or more buses operable to transmit communications between the various hardware components.
As illustrated in
A number of controllers and peripheral devices may also be provided, as shown in
In the illustrated system, all major system components may connect to a bus 1016, which may represent more than one physical bus. However, various system components may or may not be in physical proximity to one another. For example, input data and/or output data may be remotely transmitted from one physical location to another. In addition, programs that implement various aspects of this invention may be accessed from a remote location (e.g., a server) over a network. Such data and/or programs may be conveyed through any of a variety of machine-readable medium including, but are not limited to: magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and holographic devices; magneto-optical media; and hardware devices that are specially configured to store or to store and execute program code, such as application specific integrated circuits (ASICs), programmable logic devices (PLDs), flash memory devices, and ROM and RAM devices.
Embodiments of the present invention may be encoded upon one or more non-transitory computer-readable media with instructions for one or more processors or processing units to cause steps to be performed. It shall be noted that the one or more non-transitory computer-readable media shall include volatile and non-volatile memory. It shall be noted that alternative implementations are possible, including a hardware implementation or a software/hardware implementation. Hardware-implemented functions may be realized using ASIC(s), programmable arrays, digital signal processing circuitry, or the like. Accordingly, the “means” terms in any claims are intended to cover both software and hardware implementations. Similarly, the term “computer-readable medium or media” as used herein includes software and/or hardware having a program of instructions embodied thereon, or a combination thereof. With these implementation alternatives in mind, it is to be understood that the figures and accompanying description provide the functional information one skilled in the art would require to write program code (i.e., software) and/or to fabricate circuits (i.e., hardware) to perform the processing required.
It shall be noted that embodiments of the present invention may further relate to computer products with a non-transitory, tangible computer-readable medium that have computer code thereon for performing various computer-implemented operations. The media and computer code may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind known or available to those having skill in the relevant arts. Examples of tangible computer-readable media include, but are not limited to: magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD-ROMs and holographic devices; magneto-optical media; and hardware devices that are specially configured to store or to store and execute program code, such as application specific integrated circuits (ASICs), programmable logic devices (PLDs), flash memory devices, and ROM and RAM devices. Examples of computer code include machine code, such as produced by a compiler, and files containing higher level code that are executed by a computer using an interpreter. Embodiments of the present invention may be implemented in whole or in part as machine-executable instructions that may be in program modules that are executed by a processing device. Examples of program modules include libraries, programs, routines, objects, components, and data structures. In distributed computing environments, program modules may be physically located in settings that are local, remote, or both.
One skilled in the art will recognize no computing system or programming language is critical to the practice of the present invention. One skilled in the art will also recognize that a number of the elements described above may be physically and/or functionally separated into sub-modules or combined together.
It will be appreciated to those skilled in the art that the preceding examples and embodiments are exemplary and not limiting to the scope of the present disclosure. It is intended that all permutations, enhancements, equivalents, combinations, and improvements thereto that are apparent to those skilled in the art upon a reading of the specification and a study of the drawings are included within the true spirit and scope of the present disclosure. It shall also be noted that elements of any claims may be arranged differently including having multiple dependencies, configurations, and combinations.