LIDAR WITH OBSTRUCTION DETECTION

Information

  • Patent Application
  • 20220413104
  • Publication Number
    20220413104
  • Date Filed
    June 28, 2022
    a year ago
  • Date Published
    December 29, 2022
    a year ago
Abstract
A light detection and ranging system can have an occlusion module connected to a light emitter and light detector with the light emitter and light detector each positioned behind a front glass. The occlusion module can be configured to generate an occlusion strategy in response to a real-time map of the front glass with the occlusion strategy populated with at least one operational alteration to correct for the presence of foreign matter indicated by the map of the front glass.
Description
SUMMARY

Light detection and ranging can be optimized, in various embodiments, by connecting an occlusion module to a light emitter and light detector with the light emitter and light detector each positioned behind a front glass. The occlusion module generates an occlusion strategy in response to a real-time map of the front glass with the occlusion strategy populated with at least one operational alteration to correct for the presence of foreign matter indicated by the map of the front glass.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a block representation of an example environment in which assorted embodiments can be practiced.



FIG. 2 plots operational information for an example detection system configured in accordance with some embodiments.



FIGS. 3A & 3B respectively depict portions of an example detection system arranged and operated in accordance with various embodiments.



FIG. 4 depicts portions of an example detection system constructed and employed in accordance with some embodiments.



FIG. 5 depicts a block representation of portions of an example detection system employed in accordance with assorted embodiments.



FIG. 6 depict line representations of portions of an example detection system that may be utilized with in assorted embodiments.



FIG. 7 is a block representation of an example occlusion module that can be employed in various embodiments of a light detection and ranging system.





DETAILED DESCRIPTION

Various embodiments of the present disclosure are generally directed to optimization of an active light detection system.


Advancements in computing capabilities have corresponded with smaller physical form factors that allow intelligent systems to be implemented into a diverse variety of environments. Such intelligent systems can complement, or replace, manual operation, such as with the driving of a vehicle or flying a drone. The detection and ranging of stationary and/or moving objects with radio or sound waves can provide relatively accurate identification of size, shape, and distance. However, the use of radio waves (300 GHz-3 kHz) and/or sound waves (20 kHZ-200 kHz) can be significantly slower than light waves (430-750 Terahertz), which can limit the capability of object detection and ranging while moving.


The advent of light detection and ranging (LiDAR) systems employ light waves that propagate at the speed of light to identify the size, shape, location, and movement of objects with the aid of intelligent computing systems. The ability to utilize multiple light frequencies and/or beams concurrently allows LiDAR systems to provide robust volumes of information about objects in a multitude of environmental conditions, such as rain, snow, wind, and darkness. Yet, current LiDAR systems can suffer from inefficiencies and inaccuracies during operation that jeopardize object identification as well as the execution of actions in response to gathered object information. Hence, embodiments are directed to structural and functional optimization of light detection and ranging systems to provide increased reliability, accuracy, safety, and efficiency for object information gathering.



FIG. 1 depicts a block representation of portions of an example object detection environment 100 in which assorted embodiments can be practiced. One or more energy sources 102, such as a laser or other optical emitter, can produce photons that travel at the speed of light towards at least one target 104 object. The photons bounce off the target 104 and are received by one or more detectors 106. An intelligent controller 108, such as a microprocessor or other programmable circuitry, can translate the detection of returned photons into information about the target 104, such as size and shape.


The use of one or more energy sources 102 can emit photons over time that allow the controller 108 to track an object and identify the target's distance, speed, velocity, and direction. FIG. 2 plots operational information for an example light detection and ranging system 120 that can be utilized in the environment 100 of FIG. 1. Solid line 122 conveys the volume of photons received by a detector over time. The greater the intensity of returned photons (Y axis) can be interpreted by a system controller as surfaces and distances that that can be translated into at least object size and shape.


It is contemplated that a system controller can interpret some, or all, of the collected photon information from line 122 to determine information about an object. For instance, the peaks 124 of photon intensity can be identified and used alone as part of a discrete object detection and ranging protocol. A controller, in other embodiments, can utilize the entirety of photon information from line 122 as part of a full waveform object detection and ranging protocol. Regardless of how collected photon information is processed by a controller, the information can serve to locate and identify objects and surfaces in space in front of the light energy source.



FIGS. 3A & 3B respectively depict portions of an example light detection assembly 130 that can be utilized in a light detection and ranging system 140 in accordance with various embodiments. In the block representation of FIG. 3A, the light detection assembly 130 consists of an optical energy source 132 coupled to a phase modulation module 134 and an antennae 136 to form a solid-state light emitter and receiver. Operation of the phase modulation module 134 can direct beams of optical energy in selected directions relative to the antennae 136, which allows the single assembly 130 to stream one or more light energy beams in different directions over time.



FIG. 3B conveys an example optical phase array (OPA) system 140 that employs multiple light detection assemblies 130 to concurrently emit separate optical energy beams 142 to collect information about any downrange targets 104. It is contemplated that the entire system 140 is physically present on a single system on chip (SOC), such as a silicon substrate. The collective assemblies 130 can be connected to one or more controllers 108 that direct operation of the light energy emission and target identification in response to detected return photons. The controller 108, for example, can direct the steering of light energy beams 142 to a particular direction 144, such as a direction that is non-normal to the antennae 138, like 45°.


The use of the solid-state OPA system 140 can provide a relatively small physical form factor and fast operation, but can be plagued by interference and complex processing that jeopardizes accurate target 104 detection. For instance, return photons from different beams 142 may cancel, or alter, one another and result in an inaccurate target detection. Another non-limiting issue with the OPA system 140 stems from the speed at which different beam 142 directions can be executed, which can restrict the practical field of view of an assembly 130 and system 140.



FIG. 4 depicts a block representation of a mechanical light detection and ranging system 150 that can be utilized in assorted embodiments. In contrast to the solid-state OPA system 140 in which all components are physically stationary, the mechanical system 150 employs a moving reflector 152 that distributes light energy from a source 154 downrange towards one or more targets 104. While not limiting or required, the reflector 152 can be a single plane mirror, prism, lens, or polygon with reflecting surfaces. Controlled movement of the reflector 152 and light energy source 154, as directed by the controller 108, can produce a continuous, or sporadic, emission of light beams 156 downrange.


Although the mechanical system 150 can provide relatively fast distribution of light beams 156 in different directions, the mechanism to physically move the reflector 152 can be relatively bulky and larger than the solid-state OPA system 140. The physical reflection of light energy off the reflector 152 also requires a clean environment to operate properly, which restricts the range of conditions and uses for the mechanical system 150. The mechanical system 150 further requires precise operation of the reflector 152 moving mechanism 158, which may be a motor, solenoid, or articulating material, like piezoelectric laminations.



FIG. 5 depicts a block representation of an example detection system 170 that is configured and operated in accordance with various embodiments. A light detection and ranging assembly 172 can be intelligently utilized by a controller 108 to detect at least the presence of known and unknown targets downrange. As shown, the assembly 172 employs one or more emitters 174 of light energy in the form of outward beams 176 that bounce off downrange targets and surfaces to create return photons 178 that are sensed by one or more assembly detectors 180. It is noted that the assembly 172 can be physically configured as either a solid-state OPA or mechanical system to generate light energy beams 172 capable of being detected with the return photons 178.


Through the return photons 178, the controller 108 can identify assorted objects positioned downrange from the assembly 172. The non-limiting embodiment of FIG. 5 illustrates how a first target 182 can be identified for size, shape, and stationary arrangement while a second target 184 is identified for size, shape, and moving direction, as conveyed by solid arrow 186. The controller 108 may further identify at least the size and shape of a third target 188 without determining if the target 188 is moving.


While identifying targets 182/184/188 can be carried out through the accumulation of return photon 178 information, such as intensity and time since emission, it is contemplated that the emitter(s) 174 employed in the assembly 172 stream light energy beams 176 in a single plane, which corresponds with a planar identification of reflected target surfaces, as identified by segmented lines 190. By utilizing different emitters 174 oriented to different downrange planes, or by moving a single emitter 174 to different downrange planes, the controller 108 can compile information about a selected range 192 of the assembly's field of view. That is, the controller 108 can translate a number of different planar return photons 178 into an image of what targets, objects, and reflecting surfaces are downrange, within the selected field of view 192, by accumulating and correlating return photon 178 information.


The light detection and ranging assembly 172 may be configured to emit light beams 176 in any orientation, such as in polygon regions, circular regions, or random vectors, but various embodiments utilize either vertically or horizontally single planes of beam 176 dispersion to identify downrange targets 182/184/188. The collection and processing of return photons 178 into an identification of downrange targets can take time, particularly the more planes 190 of return photons 178 are utilized. To save time associated with moving emitters 174, detecting large volumes of return photons 178, and processing photons 178 into downrange targets 182/184/188, the controller 108 can select a planar resolution 194, characterized as the separation between adjacent planes 190 of light beams 176.


In other words, the controller 108 can execute a particular downrange resolution 194 for separate emitted beam 176 patterns to balance the time associated with collecting return photons 178 and the density of information about a downrange target 182/184/188. As a comparison, tighter resolution 194 provides more target information, which can aid in the identification of at least the size, shape, and movement of a target, but bigger resolution 194 (larger distance between planes) can be conducted more quickly. Hence, assorted embodiments are directed to selecting an optimal light beam 176 emission resolution to balance between accuracy and latency of downrange target detection.



FIG. 6 depicts portions of an example light detection and ranging system 200 that can be employed in accordance with various embodiments. As shown, a front glass 202 portion of the system can be occluded by the presence of foreign matter 204. The presence of such foreign matter can degrade the efficiency and/or accuracy of light emission 206 and/or reception 208. It is noted that the presence of foreign matter 204 does not always impair the entirety of a system's 200 function or accuracy. However, some occluding matter 204 can alter and/or prevent accurate system 200 operation, which can be devastating for some system 200 embodiments, such as vehicles or military applications that rely on accurate and fast sensing of downrange targets 210 and surfaces.



FIG. 7 depicts a block representation of an example occlusion module 220 that may be operated in accordance with assorted embodiments to optimize light detection and ranging despite the presence of foreign matter. The module 220 can employ a controller 222, such as a microprocessor or other programmable circuitry, to translate at least sensed conditions, environmental conditions, and logged past detection activity into an occlusion strategy that prescribes at least threshold levels of occlusion, adjustments to compensate for occlusion, and identifies of the presence of occluding materials.


The module controller 222 may be aided by a mapping circuit 224 that translates current light emission and/or reception into a real-time plot of the exterior of the light detection and ranging assembly, as generally illustrated in FIG. 6. For instance, the mapping circuit 224 can translate return photons into a physical map of the front-facing glass of a light emitter, detector, and/or antennae. The ability to generate a physical map of the exterior of a light sensor allows the occlusion module 224 to determine the location of foreign matter and potential corrective activity that can be undertaken.


Some embodiments utilize one or more test patterns to identify location, size, type, and severity of a occlusion as part of a mapping scheme. During a test to map for occlusions, the controller 222 may alter phase, timing, or range of light beams to try to locate and accurately classify occlusions. Such classification may involve predicting the time in which an occlusion will remain on the front glass. For example, the controller 222 can distinguish if an occlusion will wash off over time, decrease in severity over time, or move on the front glass. The classification of the occlusion can aid the occlusion strategy in prescribing corrective and/or preventative actions that allow for continued accurate identification of downrange targets 210.


It is contemplated that a correction circuit 226 provides one or more operating adjustments, as part of the occlusion strategy, to correct for current and/or predicted future occluding materials. As a non-limiting example, the correction circuit 226 can prescribe ignoring return photons from occluded regions of a front glass, may adjust the scanning range of emitted light, may instruct a physical cleaning of the front glass, or may change how return photons are polarized to compensate for light scattered by one or more occlusions. As a result of the execution of an occlusion strategy that maps the real-time location of occluding materials and prescribes correcting actions, the presence of foreign material on the exterior of an emitter/detector/antennae does not correspond with degraded system function or requirement to take the system 200 offline until the material is removed.


It is to be understood that even though numerous characteristics of various embodiments of the present disclosure have been set forth in the foregoing description, together with details of the structure and function of various embodiments, this detailed description is illustrative only, and changes may be made in detail, especially in matters of structure and arrangements of parts within the principles of the present technology to the full extent indicated by the broad general meaning of the terms in which the appended claims are expressed. For example, the particular elements may vary depending on the particular application without departing from the spirit and scope of the present disclosure.

Claims
  • 1. A method comprising: connecting an occlusion module to an emitter positioned behind a transparent panel;sensing a first occlusion on the transparent panel with the occlusion module;mapping, with the occlusion module, portions of the transparent panel;identifying the first occlusion with the occlusion module; anddetecting a downrange target despite the presence of the occlusion.
  • 2. The method of claim 1, wherein the occlusion module maps an entirety of the transparent panel.
  • 3. The method of claim 1, wherein the occlusion module maps less than an entirety of the transparent panel.
  • 4. The method of claim 1, wherein the mapping discovers a second occlusion on the transparent panel.
  • 5. The method of claim 1, wherein the occlusion module maintains a real-time map of the transparent panel over time.
  • 6. The method of claim 5, wherein the real-time map discovers portions of the first occlusion falling off the transparent panel.
  • 7. The method of claim 5, wherein the real-time map identifies removal of the first occlusion.
  • 8. The method of claim 1, wherein the occlusion module maps the transparent panel by activating the emitter to transmit a test pattern of photons onto the transparent panel.
  • 9. The method of claim 1, wherein the occlusion module identifies an opacity of the first occlusion.
  • 10. A method comprising: connecting an occlusion module to an emitter positioned behind a transparent panel;sensing an occlusion on the transparent panel with the occlusion module; andaltering operation of the emitter, with the occlusion module, to compensate for the presence of the occlusion.
  • 11. The method of claim 10, wherein the occlusion module generates a strategy to compensate for the presence of the occlusion.
  • 12. The method of claim 11, wherein the occlusion module classifies the occlusion and executes at least one compensation action from the strategy based on the classification of the occlusion.
  • 13. The method of claim 12, wherein the occlusion module classifies the occlusion as a opaque substance that inhibits accuracy of return photons.
  • 14. The method of claim 11, wherein the strategy prescribes ignoring photons proximal the occlusion.
  • 15. The method of claim 11, wherein the strategy prescribes polarizing photons returning from a downrange target.
  • 16. The method of claim 11, wherein the strategy prescribes altering a physical location of a detector positioned behind the transparent panel.
  • 17. The method of claim 11, wherein the strategy prescribes activating multiple separate detectors in response to the occlusion to detect return photons from a downrange target.
  • 18. The method of claim 11, wherein the strategy prescribes adjusting a scanning range of a detector positioned behind the transparent panel.
  • 19. The method of claim 11, wherein the strategy prescribes disabling detection of downrange targets until the transparent panel is cleaned.
  • 20. A method comprising: connecting an occlusion module to an emitter positioned behind a transparent panel;sensing an occlusion on the transparent panel with the occlusion module;altering operation of the emitter, with the occlusion module, to compensate for the presence of the occlusion;activating the emitter to generate a light beam passing through the transparent panel; anddetecting a downrange target with a detector the light beam.
Provisional Applications (1)
Number Date Country
63215773 Jun 2021 US