The present disclosure relates to light detection and ranging (LiDAR), and in particular to LiDAR systems and methods that use virtual windows to enhance safety.
Systems exist that enable vehicles to be driven semi-autonomously or fully autonomously. Such systems may use one or more range finding, mapping, or object detection systems to provide sensory input to assist in semi-autonomous or fully autonomous vehicle control. LiDAR systems, for example, can provide the sensory input required by a semi-autonomous or fully autonomous vehicle. LiDAR systems can use a laser that projects beams of light. As LiDAR system become more ubiquitous, safe operation of the laser is desired.
Embodiments discussed herein refer to LiDAR systems and methods that use a virtual window to monitor for potentially unsafe operation of a laser.
In one embodiment, a system for use in a vehicle is provided that can include a LiDAR system operative to direct light pulses originating from a light source to specific locations within a field of view, proximity detection system operative to detect presence of an object within a fixed distance of the LiDAR system, and control system operative to instruct the LiDAR system to deactivate the light source in response to detection of the object within the fixed distance.
In another embodiment, a method for selectively disabling a LiDAR system is provided. This method can include monitoring a virtual window with a proximity detection system, wherein the virtual window extends a fixed distance beyond a periphery of the LiDAR system, detecting, via the proximity detection system, presence of an object within the virtual window, and deactivating a portion of the LiDAR system in response to detecting the object within the virtual window, wherein the portion prevents emission of light pulses from the LiDAR system.
In another embodiment, a method for enforcing safe operation of a LiDAR system is provided by transmitting light pulses from the LiDAR system, detecting whether a person is located within a virtual window zone of the LiDAR system, and deactivating the LiDAR system when the person is detected to be within the virtual window zone.
A further understanding of the nature and advantages of the embodiments discussed herein may be realized by reference to the remaining portions of the specification and the drawings.
Illustrative embodiments are now described more fully hereinafter with reference to the accompanying drawings, in which representative examples are shown. Indeed, the disclosed LiDAR systems and methods may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Like numbers refer to like elements throughout.
In the following detailed description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of the various embodiments. Those of ordinary skill in the art will realize that these various embodiments are illustrative only and are not intended to be limiting in any way. Other embodiments will readily suggest themselves to such skilled persons having the benefit of this disclosure.
In addition, for clarity purposes, not all of the routine features of the embodiments described herein are shown or described. One of ordinary skill in the art would readily appreciate that in the development of any such actual embodiment, numerous embodiment-specific decisions may be required to achieve specific design objectives. These design objectives will vary from one embodiment to another and from one developer to another. Moreover, it will be appreciated that such a development effort might be complex and time-consuming but would nevertheless be a routine engineering undertaking for those of ordinary skill in the art having the benefit of this disclosure.
Some light detection and ranging (LiDAR) systems use a single light source to produce one or more light signals of a single wavelength that scan the surrounding environment. The signals are scanned using steering systems that direct the pulses in one or two dimensions to cover an area of the surrounding environment (the scan area). When these systems use mechanical means to direct the pulses, the system complexity increases because more moving parts are required. Additionally, only a single signal can be emitted at any one time because two or more identical signals would introduce ambiguity in returned signals. In some embodiments of the present technology, these disadvantages and/or others are overcome.
For example, some embodiments of the present technology use one or more light sources that produce light of different wavelengths and/or along different optical paths. These light sources send light to a steering system at different angles so that the scan areas for the light signals are different (e.g., if two light sources are used to create two light signals, the scan area associated with each light source is different). This allows for tuning the signals to appropriate transmit powers and the possibility of having overlapping scan areas that cover scans of different distances. Longer ranges can be scanned with signals having higher power and/or slower repetition rate (e.g., when using pulsed light signals). Shorter ranges can be scanned with signals having lower power and/or high repetition rate (e.g., when using pulse light signals) to increase point density.
As another example, some embodiments of the present technology use signal steering systems with one or more dispersion elements (e.g., gratings, optical combs, prisms, etc.) to direct pulse signals based on the wavelength of the pulse. A dispersion element can make fine adjustments to a pulse's optical path, which may be difficult or impossible with mechanical systems. Additionally, using one or more dispersion elements allows the signal steering system to use few mechanical components to achieve the desired scanning capabilities. This results in a simpler, more efficient (e.g., lower power) design that is potentially more reliable (due to few moving components).
Some LiDAR systems use the time-of-flight of light signals (e.g., light pulses) to determine the distance to objects in the path of the light. For example, with respect to
Referring back to
By directing many light pulses, as depicted in
If a corresponding light pulse is not received for a particular transmitted light pulse, then it can be determined that there are no objects that can scatter sufficient amount of signal for the LiDAR light pulse within a certain range of LiDAR system 100 (e.g., the max scanning distance of LiDAR system 100). For example, in
In
The density of points in point cloud or image from a LiDAR system 100 is equal to the number of pulses within a frame divided by the field of view. Given that the field of view is fixed, to increase the density of points generated by one set of transmission-receiving optics, the LiDAR system should fire a pulse more frequently, in other words, a light source with a higher repetition rate is needed. However, by sending pulses more frequently the farthest distance that the LiDAR system can detect may be more limited by speed of light. For example, if a returned signal from a far object is received after the system transmits the next pulse, the return signals may be detected in a different order than the order in which the corresponding signals are transmitted and get mixed up if the system cannot correctly correlate the returned signals with the transmitted signals. To illustrate, consider an exemplary LiDAR system that can transmit laser pulses with a repetition rate between 500 kHz and 1 MHz. Based on the time it takes for a pulse to return to the LiDAR system and to avoid mix-up of returned pulses from consecutive pulses in conventional LiDAR design, the farthest distance the LiDAR system can detect may be 300 meters and 150 meters for 500 kHz and 1 Mhz, respectively. The density of points of a LiDAR system with 500 kHz repetition rate is half of that with 1 MHz. Thus, this example demonstrates that, if the system cannot correctly correlate returned signals that arrive out of order, increasing the repetition rate from 500 kHz to 1 MHz (and thus improving the density of points of the system) would significantly reduce the detection range of the system.
LiDAR system 100 can also include other components not depicted in
Signal steering system 404 includes any number of components for steering light signals generated by light source 402. In some examples, signal steering system 404 may include one or more optical redirection elements (e.g., mirrors or lens) that steer light pulses (e.g., by rotating, vibrating, or directing) along a transmit path to scan the external environment. For example, these optical redirection elements may include MEMS mirrors, rotating polyhedron mirrors, or stationary mirrors to steer the transmitted pulse signals to different directions. Signal steering system 404 optionally also includes other optical components, such as dispersion optics (e.g., diffuser lenses, prisms, or gratings) to further expand the coverage of the transmitted signal in order to increase the LiDAR system 100's transmission area (i.e., field of view). An example signal steering system is described in U.S. Patent Application Publication No. 2018/0188355, entitled “2D Scanning High Precision LiDAR Using Combination of Rotating Concave Mirror and Beam Steering Devices,” the content of which is incorporated by reference in its entirety herein for all purposes. In some examples, signal steering system 404 does not contain any active optical components (e.g., it does not contain any amplifiers). In some other examples, one or more of the components from light source 402, such as a booster amplifier, may be included in signal steering system 404. In some instances, signal steering system 404 can be considered a LiDAR head or LiDAR scanner.
Some implementations of signal steering systems include one or more optical redirection elements (e.g., mirrors or lens) that steers returned light signals (e.g., by rotating, vibrating, or directing) along a receive path to direct the returned light signals to the light detector. The optical redirection elements that direct light signals along the transmit and receive paths may be the same components (e.g., shared), separate components (e.g., dedicated), and/or a combination of shared and separate components. This means that in some cases the transmit and receive paths are different although they may partially overlap (or in some cases, substantially overlap).
Controller 408 contains components for the control of LiDAR system 100 and communication with external devices that use the system. For example, controller 408 optionally includes one or more processors, memories, communication interfaces, sensors, storage devices, clocks, ASICs, FPGAs, and/or other devices that control light source 402, signal steering system 404, and/or light detector 406. In some examples, controller 408 controls the power, rate, timing, and/or other properties of light signals generated by light source 402; controls the speed, transmit direction, and/or other parameters of light steering system 404; and/or controls the sensitivity and/or other parameters of light detector 406.
Controller 408 optionally is also configured to process data received from these components. In some examples, controller determines the time it takes from transmitting a light pulse until a corresponding returned light pulse is received; determines when a returned light pulse is not received for a transmitted light pulse; determines the transmitted direction (e.g., horizontal and/or vertical information) for a transmitted/returned light pulse; determines the estimated range in a particular direction; and/or determines any other type of data relevant to LiDAR system 100.
Proximity detection system 520 may use any suitable detection sensor or detection means to determine whether an object is located within a fixed distance of LiDAR system 510. For example, proximity detection system 520 may use one or more infrared sensors, ultrasonic sensors, cameras, proximity sensors, facial recognition systems, thermal sensors, radar, LiDAR, or any combination thereof. In some embodiments, proximity detection system 520 may be specifically configured for detection of human beings. For example, detection system 520 may be able to apply analytics to data to distinguish between persons and non-persons. Proximity detection system 520 may be able to project a virtual window beyond a periphery of LiDAR system 510. The virtual window may define a zone that is monitored for the presence of an object. If an object is detected within the virtual window zone, detection system 520 may communicate a signal indicating detection of the object to control system 530, which may instruct LiDAR system 510 to deactivate, or least deactivate a light source responsible for transmitting light pulses. In another embodiment, a shutter or other light blocking mechanism may be used to prevent transmission of the light pulses in response to detection of the object within the virtual window zone.
It should be understood that the steps in
It should be understood that the steps in
The embodiments discussed herein provide the necessary monitoring capabilities and laser shutdown mechanism to prevent unsafe laser exposure. It is believed that the disclosure set forth herein encompasses multiple distinct inventions with independent utility. While each of these inventions has been disclosed in its preferred form, the specific embodiments thereof as disclosed and illustrated herein are not to be considered in a limiting sense as numerous variations are possible. Each example defines an embodiment disclosed in the foregoing disclosure, but any one example does not necessarily encompass all features or combinations that may be eventually claimed. Where the description recites “a” or “a first” element or the equivalent thereof, such description includes one or more such elements, neither requiring nor excluding two or more such elements. Further, ordinal indicators, such as first, second or third, for identified elements are used to distinguish between the elements, and do not indicate a required or limited number of such elements, and do not indicate a particular position or order of such elements unless otherwise specifically stated.
Moreover, any processes described with respect to
It is to be understood that any or each module or state machine discussed herein may be provided as a software construct, firmware construct, one or more hardware components, or a combination thereof. For example, any one or more of the state machines or modules may be described in the general context of computer-executable instructions, such as program modules, that may be executed by one or more computers or other devices. Generally, a program module may include one or more routines, programs, objects, components, and/or data structures that may perform one or more particular tasks or that may implement one or more particular abstract data types. It is also to be understood that the number, configuration, functionality, and interconnection of the modules or state machines are merely illustrative, and that the number, configuration, functionality, and interconnection of existing modules may be modified or omitted, additional modules may be added, and the interconnection of certain modules may be altered.
Whereas many alterations and modifications of the present invention will no doubt become apparent to a person of ordinary skill in the art after having read the foregoing description, it is to be understood that the particular embodiments shown and described by way of illustration are in no way intended to be considered limiting. Therefore, reference to the details of the preferred embodiments is not intended to limit their scope.
This application claims the benefit of U.S. Provisional Application No. 62/722,480, filed Aug. 24, 2018, the disclosure of which is incorporated herein in its entirety.
Number | Date | Country | |
---|---|---|---|
62722480 | Aug 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16546702 | Aug 2019 | US |
Child | 18101083 | US |