Patent Application
20220155456
A conventional Light Detection and Ranging (LIDAR) system may utilize a light-emitting transmitter (e.g., a laser diode) to emit light pulses into an environment. Emitted light pulses that interact with (e.g., reflect from) objects in the environment can be received by a receiver (e.g., a photodetector) of the LIDAR system. Range information about the objects in the environment can be determined based on a time difference between an initial time when a light pulse is emitted and a subsequent time when the reflected light pulse is received.
The present disclosure generally relates to optical systems (e.g., LIDAR systems) and certain aspects of their transmitter and receiver subsystems.
In a first aspect, a light detection and ranging (LIDAR) device is provided. The LIDAR device includes a transmitter configured to transmit a light pulse into an environment of the LIDAR device via a transmit optical path. The LIDAR device also includes a detector configured to detect a first portion of the transmitted light pulse and a second portion of the transmitted light pulse, such that the detector receives at a first time the first portion of the transmitted light pulse via an internal optical path within the LIDAR device and receives at a second time the second portion of the transmitted light pulse via reflection by an object in the environment of the LIDAR device. The second time occurs after the first time. The LIDAR device also includes a controller configured to determine a distance to the object based on a difference between the second time and the first time.
In a second aspect, a method is provided. The method includes causing a transmitter of a LIDAR device to transmit a first light pulse into an environment of the LIDAR device via a transmit optical path. The method also includes receiving, by a detector of the LIDAR device, a first portion of the first light pulse at a first time via an internal optical path within the LIDAR device and a second portion of the first light pulse at a second time via reflection by an object in the environment of the LIDAR device. Yet further, the method also includes determining a distance to the object based on a difference between the second time and the first time.
In a third aspect, a method is provided. The method includes positioning a mirror with respect to a transmitter of a LIDAR device. The transmitter is configured to transmit at least one light pulse. The method also includes causing the transmitter to transmit a first light pulse so as to interact with the mirror. Positioning the mirror is performed such that the first light pulse is directed toward an internal optical path within the LIDAR device. The method also includes receiving, by a detector of the LIDAR device, the first light pulse at a first time via the internal optical path. The method also includes determining a zero point time based on the first time.
Other aspects, embodiments, and implementations will become apparent to those of ordinary skill in the art by reading the following detailed description, with reference where appropriate to the accompanying drawings.
Example methods, devices, and systems are described herein. It should be understood that the words “example” and “exemplary” are used herein to mean “serving as an example, instance, or illustration.” Any embodiment or feature described herein as being an “example” or “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments or features. Other embodiments can be utilized, and other changes can be made, without departing from the scope of the subject matter presented herein.
Thus, the example embodiments described herein are not meant to be limiting. Aspects of the present disclosure, as generally described herein, and illustrated in the figures, can be arranged, substituted, combined, separated, and designed in a wide variety of different configurations, all of which are contemplated herein.
Further, unless context suggests otherwise, the features illustrated in each of the figures may be used in combination with one another. Thus, the figures should be generally viewed as component aspects of one or more overall embodiments, with the understanding that not all illustrated features are necessary for each embodiment.
A LIDAR system may obtain spatial range information about an environment by measuring a round-trip time between a first time (e.g., a time at which a light pulse is emitted) and a second time (e.g., a time at which the light pulse is received after interacting with the environment). However, establishing an absolute time reference for the first time (e.g., the time at which the light pulse is emitted from the LIDAR) can be challenging because there can be difficult to control or poorly controlled, time-varying delays (e.g., finite RC response times) of electronic components and/or data processing components. For example, there can be delays introduced between the time when a controller instructs a laser diode to fire and when the light pulse is actually emitted from the laser diode. Accordingly, to ensure accurate and repeatable range determinations in LIDAR systems, it is desirable to establish a “best-known” first time (e.g., time zero) when the light pulse is emitted.
In some embodiments, optical feedback, such as internal system reflections, can be beneficially utilized to determine the actual firing time of the light pulse. That is, at the time of firing the light pulse, some portion of the light could be reflected, routed, or otherwise received by the LIDAR receiver. This portion of light is received almost instantaneously after being emitted from the laser diode. As such, “time zero” can be determined based on an initial signal from the receiver. Later, after the remaining portion of the light of the light pulse interacts with the environment, the second time could be defined by a subsequent signal from the receiver, indicating the round-trip time needed for light to travel out toward the environment and back to the LIDAR system. In such a scenario, the first time (e.g., time zero) could be subtracted from the second time to obtain the time delay from emission to signal reception, representing the true (or at least more-accurate) round-trip time.
In some embodiments, a LIDAR system could include a light pipe configured to “siphon” off a small amount of light from the light pulse (e.g., 0.001%-5% of the photons of the light pulse) and route (e.g., divert) them toward the receiver. The light pipe length could be relatively short (e.g., 0.1-10 cm) with respect to the distance to a given object in the environment (e.g., 1-100 m). Accordingly, the light from the light pipe could represent a near-ideal time zero reference.
In other embodiments, a LIDAR system could include a dome or window structure. In such scenarios, at least a portion of the light pulses could be reflected (directly or indirectly) from an interior surface of the dome or window. These reflections can be utilized to find the time zero reference.
It will be understood that LIDAR systems with other arrangements and/or components are possible and contemplated. For example, a LIDAR system could include one or more light-emitter devices configured to emit light toward an environment of the LIDAR system via one or more optical elements. In some embodiments, the optical elements could include a fast-axis collimation (FAC) lens and/or a shared lens. In some embodiments, the shared lens may be configured to direct light toward the environment as well as focus incident light onto one or more photodetectors of the LIDAR system. In some embodiments, the optical elements could additionally or alternatively include a planar waveguiding structure and/or a light guide manifold.
In alternative examples, a LIDAR with a rotating mirror (e.g., three- or four-sided reflective prism) could direct light pulses toward an environment in a scanning fashion. In such scenarios, at least a portion of the light from the light pulses could be reflected from the rotating mirror back toward the receiver. For example, when the light pulse interacts with a surface of the rotating mirror, a portion of the photons could be reflected back toward the receiver, either directly or by way of stray light reflections. Additionally or alternatively, when a reflective surface of the rotating mirror is perpendicular to the emission axis of the laser diode(s), at least some of the photons could be directed back toward the receiver. In such scenarios, the time zero reference could be obtained based on the portion of photons received by the receiver.
In some embodiments, a LIDAR may include a plurality of light emitters configured to emit light pulses into a plurality of optical waveguide channels in a lightguide manifold. The waveguide channels in the lightguide manifold could be configured to route the light pulses toward a plurality of output mirrors by total internal reflection. The output mirrors are configured to direct the respective light pulses out of the plane of the light guide manifold (and out of the optical waveguides) and toward an environment of the LIDAR. In such a scenario, some of the light from the light pulses may “spill” into the light guide manifold. Such light could be received by one or more detectors in the receive path. For example, the one or more detectors could be optically coupled to the light guide manifold. In such examples, the portion of light from the light pulses could be used to determine the time zero reference.
Furthermore, in some embodiments, based on various firing schedules, such a LIDAR system could emit light pulses from the plurality of light emitters at the same time or in very quick succession (e.g., firing within several nanoseconds of one another). In order to assist with disambiguating the portion of light to use for a given time zero reference, in some firing schedules, individual channels could be fired at times that are independent of other channels. That is, laser diodes could be fired at temporally distinct times so as to distinguish light received from different transmit channels allowing a zero time reference to be established from a specific transmitter to a specific receiver. For example, discrete light emitters corresponding to individual transmitter channels could be fired at distinct times once every few normal firing cycles, predetermined times, or on demand.
The optical system 100 also includes a receiver 160. In various embodiments, the optical system 100 could include a transmit lens 112 and a receive lens 164 disposed along the transmit optical path 114 and a receive optical path 166, respectively. The receiver 160 includes a detector 162 configured to detect a first portion of the transmitted light pulse and a second portion of the transmitted light pulse, such that the detector 162 receives at a first time the first portion of the transmitted light pulse via an internal optical path 130 within the optical system 100 and receives at a second time the second portion of the transmitted light pulse via reflection by an object in the environment of the optical system 100. The second time occurs after the first time. For example, the second time could be 33 ns after the first time. In such a scenario, based on the speed of light, the second portion of the transmitted light pulse can be determined to have traveled 10 m further than the first portion of the transmitted light pulse. Accordingly, an object could be determined to be about 5 m away from the optical system along the transmit optical path 114 of the transmitted light pulse.
In some embodiments, the detector 162 could include at least one of: a silicon photomultiplier (SiPM) device, a single photon avalanche photodiode (SPAD), an avalanche photodiode (APD), or a multi-pixel photon counter (MPPC). It will be understood that other types of photodetector devices are possible and contemplated.
The optical system 100 also includes a controller 150. The controller 150 includes at least one of a field-programmable gate array (FPGA) or an application-specific integrated circuit (ASIC). Additionally or alternatively, the controller 150 may include one or more processors 152 and a memory 154. The one or more processors 152 may include a general-purpose processor or a special-purpose processor (e.g., digital signal processors, etc.). The one or more processors 152 may be configured to execute computer-readable program instructions that are stored in the memory 154. As such, the one or more processors 152 may execute the program instructions to provide at least some of the functionality and operations described herein.
The memory 154 may include or take the form of one or more computer-readable storage media that may be read or accessed by the one or more processors 152. The one or more computer-readable storage media can include volatile and/or non-volatile storage components, such as optical, magnetic, organic or other types of memory or disc storage, which may be integrated in whole or in part with at least one of the one or more processors 152. In some embodiments, the memory 154 may be implemented using a single physical device (e.g., one optical, magnetic, organic or other memory or disc storage unit), while in other embodiments, the memory 154 can be implemented using two or more physical devices.
As noted, the memory 154 may include computer-readable program instructions that relate to operations of optical system 100. As such, the memory 154 may include program instructions to perform or facilitate some or all of the functionality described herein. The controller 150 is configured to carry out operations. In some embodiments, controller 150 may carry out the operations by way of the processor 152 executing instructions stored in the memory 154.
The operations could include operating various elements of optical system 100 to obtain range information about an environment of the optical system 100. For example, the controller 150 could be configured to determine a distance to an object in the environment of the optical system 100 based on a difference between the second time and the first time. The controller 150 could be configured to carry out other operations as well, such as those that relate to methods 600 and 700, as illustrated and described in relation to
In some embodiments, the optical system 100 could include a light pipe 140 within the optical system 100. In such scenarios, the internal optical path 130 could include an optical path that extends through the light pipe 140. The light pipe 140 could include, for example, an opening between the transmitter 110 and receiver 160 portions of the optical system 100. Such an opening could allow a portion of the transmitted light pulse to “short cut” through the opening so as to be received by the detector 162 before light from the reflected light pulse is received.
In some embodiments, the light pipe 140 is configured to receive a predetermined percentage of the photons in the transmitted light pulse. For example, the light pipe 140 could be positioned, sized, or otherwise selected so as to receive 0.00001%, 0.1%, 1%, 10%, or another predetermined percentage of the photons in the transmitted light pulse. Additionally or alternatively, the predetermined percentage could be less than 1 percent or less than 10 percent of the photons of the transmitted light pulse. Other predetermined percentages of the transmitted light pulse are possible and contemplated within the context of the present disclosure.
In various example embodiments, the internal optical path 130 could include reflection of a portion of the transmitted light pulse by one or more components of the optical system 100.
Additionally or alternatively, the optical system 100 could include a transparent structure 180. For example, the transparent structure 180 could include an optical window 182 and/or a dome 184 configured to be mounted on a vehicle (e.g., vehicle 500 as illustrated and described in relation to
In some embodiments, the optical system 100 could include a mirror 170. In such scenarios, the transmit optical path 114 includes reflection by the mirror 170. Furthermore, in such cases, the internal optical path 130 includes reflection of at least a portion of the transmitted light pulse by the mirror 170.
In some examples, the optical system 100 could include a light guide 142 configured to guide light by total internal reflection from an input end to an output end. In such scenarios, the transmit optical path 114 includes a first optical path that extends from the input end of the light guide 142 to the output end of the light guide 142. The internal optical path 130 includes the first optical path and also includes a second optical path that extends from the input end of the light guide 142 to the output end of the light guide 142 further to the detector 162.
In embodiments that include a light guide 142, the output end of the light guide 142 could include a mirror 170.
In reference to
In some embodiments, the FAC lens 122 could include a cylindrical lens. However, other optical elements (e.g., molded lenses) are contemplated and possible within the context of the present disclosure.
The transceiver 200 also includes a receiver 160. The receiver 160 includes a detector 162 that is optically coupled to a receive lens 164. As described elsewhere herein, the detector 162 could be a SiPM or another type of photodetector or photodetector array. The receiver 160 could be configured to receive light from an environment of the system along the receive optical path 166.
In some embodiments, the housing 210 could include an opening 202 disposed between the receiver 160 and the transmitter 110. The opening 202 could be located, shaped, sized, and/or otherwise configured to transmit a portion of the light emitted by the light emitter device 120 along an internal optical path 130 toward the receiver 160 and the detector 162.
While
In some embodiments, the light pipe might 140 may extend beyond the leakage path to explicitly capture some of the light. In other embodiments, the light pipe 140 may include one or more facets configured to collect light from the transmit optical path 114 and/or provide light to the receiver 160. It will be understood that other optical configurations are possible and contemplated. In some embodiments, the light pipe 140 might not fill the entire opening 202 between the transmitter and receiver portions of the system. In such a scenario, the light pipe 140 may be configured to utilize total internal reflection.
In such scenarios, light pulses emitted from the light emitter device 120 along the transmit optical path 114 could interact with transmit lens 112 and could be partially guided via light pipe 140 toward the receive lens 164. A portion of the light coupled into the receive lens 164 may be diverted to the detector 162. Such a portion of light could be, for instance, within a range between one part per million (0.000001) to one part per trillion (0.000000000001). For example, between 0.00001% and 5% of the photons of a given light pulse may be diverted by way of the light pipe 140 to the detector 162. Other portions of light are possible and contemplated within the context of the present disclosure.
In some embodiments, the optical system 300 could include a rotatable mirror 170. The rotatable mirror 170 could be shaped like a triangular or rectangular prism and could be configured to rotate about a rotational axis 304. The rotatable mirror 170 could include a plurality of reflective surfaces 172a, 172b, and 172c.
Additionally or alternatively, the optical system 300 could include optical windows 180a and 180b. The reflective surfaces 172a-c could be configured to reflect light pulses emitted by the optical system 100 along transmit optical path 114. For example, the light pulses could be reflected toward an environment of the optical system 300 by way of the optical windows 180a and 180b. Furthermore, reflected light pulses from the environment could be reflected from the reflective surfaces 172a-c along receive optical path 166.
In such a fashion, optical system 400 could be configured to emit light pulses into, and receive reflected light pulses from, a 360-degree region of the environment (e.g., about the z-axis). Accordingly, the optical system 400 could be configured to determine range information based on the time-of-flight of the respective reflected light pulses.
Referring to
Referring to
For example, in some embodiments, the optical system 100 could include a light emitter device 120, detectors 162a-162d, and an optical window 182. The optical system 400 could include a spacer structure 420 having a first surface 422 and a second surface 424. The spacer structure 420 could also include cavities 426a-426d extending through the spacer structure 420.
One or more light emitter devices 120 could be coupled to the second surface 424 of the spacer structure 420. The light emitter devices 120 could each include one or more light-emitting regions. As illustrated in
In some embodiments, the detectors 162a-162d could be disposed within the cavities 426a-426d. For example, as illustrated, each cavity could include one detector device. Alternatively, multiple detector devices and/or detector arrays could be disposed in a single cavity. The detectors 162a-162d could be configured to detect the light emitted by the one or more light emitter devices 120 after interaction with the external environment.
As additionally illustrated in
In some embodiments, the plurality of apertures 452a-452d could include holes drilled or lithographically etched through a material that is substantially opaque to light emitted by the light emitter devices 120. In other embodiments, the plurality of apertures 452a-452d could include optical windows that are substantially transparent to light emitted by the light emitter devices 120.
While
In some examples, a shim 470 could be disposed between the upper portion 424a of the spacer structure 420 and the mounting surface 462 of the optical window 182. The shim 470 could be selected such that a light emitter device 120 is disposed at a predetermined or desired position with respect to the at least one FAC lens 122 and/or the at least one light guide 142. For example, the shim 470 could be selected so that light emitted from the light emitter device 120 is efficiently collected by the at least one FAC lens 122 and efficiently coupled into the at least one light guide 142.
While
The optical system 400 could additionally include a circuit board 490 that could be physically coupled to the first substrate 410 by way of controlled-collapse solder balls 480. Other ways to physically and/or electrically connect the first substrate 410 to the circuit board 490 are possible and contemplated, such as, without limitation, conventional solder balls, ball-grid arrays (BGA), land-grid arrays (LGA), conductive paste, and other types of physical and electrical sockets.
In some embodiments, the reflective surfaces 467a-467d could be configured to direct light primarily in the +z direction toward an environment of the optical system 400. Additionally or alternatively, at least portion of the reflective surfaces 467a-467d could be configured to direct at least a portion of the emitted light in the -z direction (e.g., toward the respective detectors 162a-162d). In other words, a first portion of each light pulse could be provided directly to the detectors 162a-162d and a second portion of each light pulse could be directed toward an environment of the optical system 400. In such scenarios, the first time, t1, could be determined based on an arrival time of the first portion of light at the detectors 162a-162d. Furthermore, the second time, t2, could be determined based on an arrival time of a reflected portion of the second portion of light at the detectors 162a-162d. It will be understood that in some embodiments, stray light (e.g., due to direct or diffuse reflections within the optical system 400) could be utilized to determine the first time, t1.
Other ways to determine a zero point time and/or receive a temporal reference signal within the context of this disclosure are contemplated. For example, the zero point time, to, or another temporal reference signal may be determined based on direct and/or multi-path reflections of light pulses from the reflective surfaces 467a-467d, the light guide 142, the optical window 182, and/or other portions of the optical system 400.
The vehicle 500 may include one or more sensor systems 502, 504, 506, 508, and 510. In an example embodiment, one or more of the sensor systems 502, 504, 506, 508, and 510 could include the optical system 100 as illustrated and described in relation to
One or more of the sensor systems 502, 504, 506, 508, and 510 may be configured to rotate about an axis (e.g., the z-axis) perpendicular to the given plane so as to illuminate an environment around the vehicle 500 with light pulses. Based on detecting various aspects of reflected light pulses (e.g., the elapsed time of flight, polarization, intensity, etc.), information about the environment may be determined.
In an example embodiment, sensor systems 502, 504, 506, 508, and 510 may be configured to provide respective point cloud information that may relate to physical objects within the environment of the vehicle 500. While vehicle 500 and sensor systems 502, 504, 506, 508, and 510 are illustrated as including certain features, it will be understood that other types of sensor systems are contemplated within the scope of the present disclosure.
An example embodiment may include a system having a plurality of light-emitter devices. The system may include a transmit block of a LIDAR device. For example, the system may be, or may be part of, a LIDAR device of a vehicle (e.g., a car, a truck, a motorcycle, a golf cart, an aerial vehicle, a boat, etc.). Each light-emitter device of the plurality of light-emitter devices is configured to emit light pulses along a respective beam elevation angle. The respective beam elevation angles could be based on a reference angle or reference plane, as described elsewhere herein. In some embodiments, the reference plane may be based on an axis of motion of the vehicle 500.
While LIDAR systems with multiple light-emitter devices are described and illustrated herein, LIDAR systems with fewer light-emitter devices (e.g., a single light-emitter device) are also contemplated. For example, light pulses emitted by a laser diode may be controllably directed about an environment of the system. The angle of emission of the light pulses may be adjusted by a scanning device such as, for instance, a mechanical scanning mirror and/or a rotational motor. For example, the scanning devices could rotate in a reciprocating motion about a given axis and/or rotate about a vertical axis. In another embodiment, the light-emitter device may emit light pulses towards a spinning prism mirror, which may cause the light pulses to be emitted into the environment based on an angle of the prism mirror angle when interacting with each light pulse. Additionally or alternatively, scanning optics and/or other types of electro-opto-mechanical devices are possible to scan the light pulses about the environment.
In some embodiments, a single light-emitter device may emit light pulses according to a variable shot schedule and/or with variable power per shot, as described herein. That is, emission power and/or timing of each laser pulse or shot may be based on a respective elevation angle of the shot. Furthermore, the variable shot schedule could be based on providing a desired vertical spacing at a given distance from the LIDAR system or from a surface (e.g., a front bumper) of a given vehicle supporting the LIDAR system. As an example, when the light pulses from the light-emitter device are directed downwards, the power-per-shot could be decreased due to a shorter anticipated maximum distance to target. Conversely, light pulses emitted by the light-emitter device at an elevation angle above a reference plane may have a relatively higher power-per-shot so as to provide sufficient signal-to-noise to adequately detect pulses that travel longer distances.
In some embodiments, the power/energy-per-shot could be controlled for each shot in a dynamic fashion. In other embodiments, the power/energy-per-shot could be controlled for successive set of several pulses (e.g., 10 light pulses). That is, the characteristics of the light pulse train could be changed on a per-pulse basis and/or a per-several-pulse basis.
While
Block 602 includes causing a transmitter (e.g., transmitter 110) of a LIDAR device to transmit a first light pulse into an environment of the LIDAR device via a transmit optical path. The first light pulse could be, for example, an infrared light pulse emitted from a laser diode at an initial trigger time, to. Light pulses having other wavelengths are also possible and contemplated.
Block 604 includes receiving, by a detector (e.g., detector 162) of the LIDAR device, a first portion of the first light pulse at a first time, ti, via an internal optical path (e.g., internal optical path 130) within the LIDAR device and a second portion of the first light pulse at a second time, t2, via reflection by an object in the environment of the LIDAR device. In other words, a portion of the first light pulse could be reflected, routed, or otherwise redirected along the internal optical path so as to reach the detector at an earlier time than the remaining portion of the first light pulse. In some embodiments, due to the short transit path length (e.g., 10 cm, 1 cm, or less) of the internal optical path, the first portion of the first light pulse could reach the detector less than half a nanosecond (e.g., 0.33 ns) or less than 50 picoseconds (e.g., 33 ps) from its initial emission from the transmitter.
Block 606 includes determining a distance to the object based on a difference between the second time and the first time. By subtracting the first time from the second time, a transit time to and from an object in the environment may be approximated and/or determined. For example, for a first time, t1=50 ps and a second time, t2=33.38 ns, then tdiff=t2−t1=33.33 ns. Based on the speed of light (e.g., 3×108m/s), the total transit distance may be approximately 10 meters. Accordingly, accounting for the outgoing and incoming portions of the transit distance, the object distance may be determined to be about half the total transit distance, 5 meters.
In some embodiments, method 600 may also include determining a zero point time (e.g., to) based on the first time. As an example, the zero point time could represent a temporal reference point from which one or more light pulse arrival times are compared to in an effort to determine range information. It will be understood that the zero point time may represent a temporal reference point that could be modified by (e.g., added to or subtracted by), for example, an additional constant offset time. The constant offset time could correspond to an offset distance computed by subtracting the zero distance from the target distance. For example, the offset distance time could correspond to the time that light travels along the internal path length distance or another type of adjustment distance.
In some embodiments, method 600 could additionally include causing the transmitter to transmit a subsequent plurality of light pulses via the transmit optical path. Each subsequent pulse is fired according to a predetermined light pulse schedule.
In such scenarios, method 600 may further include receiving, by the detector, subsequent reflected light pulses at subsequent times via reflection by an object in the environment of the LIDAR device. Furthermore, method 600 could include determining a distance to the object based on the respective subsequent times, the predetermined light pulse schedule, and the first time. For example, t1 could be used as a time offset that is subtracted from subsequently received pulses. In such a manner, t1 need only be measured once, periodically, or sporadically. Furthermore, the predetermined light pulse schedule could include a schedule for emitting a plurality of light pulses each emitted according to a respective tdelay after to. That is, for a subsequent light pulse emitted at some time tdelay after t0, and where the reflected light pulse is received at time t3, a total transit time could be calculated by: ttransit=t3-tdelay-t1.
Block 702 includes positioning a mirror (e.g., mirror 170) with respect to a transmitter (e.g., transmitter 110) of a LIDAR device. In such scenarios, the transmitter could be configured to transmit at least one light pulse. In reference to
Block 704 includes causing the transmitter to transmit a first light pulse so as to interact with the mirror. Positioning the mirror is performed such that the first light pulse is directed toward an internal optical path (e.g., internal optical path 130) within the LIDAR device. As described elsewhere herein, the internal optical path could include, for example, a light pipe 140, a light guide 142, a mirror 170, an optical window 182, and/or a dome 184.
Block 706 includes receiving, by a detector (e.g., detector 162) of the LIDAR device, the first light pulse at a first time, ti, via the internal optical path. As described in relation to optical systems 300 and 400, the first light pulse could be emitted toward the mirror and along the internal optical path so as to provide a temporal “reference pulse” from which subsequent pulse times could be calibrated, adjusted, and/or offset. In some embodiments, carrying out block 706 (e.g., obtaining light pulses via an internal optical path) could provide benefits on several fronts. First, some angles of the rotatable mirror will not produce reference pulses because substantially all of the light from a given light pulse may be diverted into the environment. Second, utilizing a portion of a light pulse that is reflected back from outside the LIDAR device may cause objects in the scene very close to the device to cause returns that are “mixed” with the feedback pulse, making the zero distance difficult or impossible to determine.
Block 708 includes determining a zero point time (e.g., to) based on the first time. As an example, the zero point time could represent a temporal reference point from which one or more light pulse arrival times are compared to in an effort to determine range information.
In some embodiments, method 700 could additionally include repositioning the mirror so as to direct subsequent light pulses via a transmit optical path into an environment of the LIDAR device. In such scenarios, the method 700 could include causing the transmitter to transmit a subsequent plurality of light pulses via the transmit optical path.
Method 700 could also include receiving, by the detector, subsequent reflected light pulses at subsequent times via reflection by an object in the environment of the LIDAR device.
Yet further, method 700 may include determining a distance to the object based on a difference between the respective subsequent times and the zero point time. In some embodiments, the subsequent light pulses could be fired according to a predetermined light pulse schedule. In such scenarios, determining the distance to the object could be further based on the predetermined light pulse schedule.
In example embodiments, the mirror could be a rotatable mirror. For example, the rotatable mirror could have a triangular prism shape. In such scenarios, the rotatable mirror could have three reflective surfaces corresponding to each of the three facets of the triangular prism. In some embodiments, the rotatable mirror could have a rectangular prism shape. In such scenarios, the rotatable mirror could include four reflective surfaces that correspond to each of the four main facets of the rectangular prism.
Additionally, positioning and repositioning the mirror could include causing a motor to rotate the rotatable mirror about a rotational axis so as to adjust respective angles of the three or four reflective surfaces.
The particular arrangements shown in the Figures should not be viewed as limiting. It should be understood that other embodiments may include more or less of each element shown in a given Figure. Further, some of the illustrated elements may be combined or omitted. Yet further, an illustrative embodiment may include elements that are not illustrated in the Figures.
A step or block that represents a processing of information can correspond to circuitry that can be configured to perform the specific logical functions of a herein-described method or technique. Alternatively or additionally, a step or block that represents a processing of information can correspond to a module, a segment, or a portion of program code (including related data). The program code can include one or more instructions executable by a processor for implementing specific logical functions or actions in the method or technique. The program code and/or related data can be stored on any type of computer readable medium such as a storage device including a disk, hard drive, or other storage medium.
The computer readable medium can also include non-transitory computer readable media such as computer-readable media that store data for short periods of time like register memory, processor cache, and random access memory (RAM). The computer readable media can also include non-transitory computer readable media that store program code and/or data for longer periods of time. Thus, the computer readable media may include secondary or persistent long term storage, like read only memory (ROM), optical or magnetic disks, compact-disc read only memory (CD-ROM), for example. The computer readable media can also be any other volatile or non-volatile storage systems. A computer readable medium can be considered a computer readable storage medium, for example, or a tangible storage device.
While various examples and embodiments have been disclosed, other examples and embodiments will be apparent to those skilled in the art. The various disclosed examples and embodiments are for purposes of illustration and are not intended to be limiting, with the true scope being indicated by the following claims.
The specification includes the following subject-matter, expressed in the form of clauses 1-20: 1. A light detection and ranging (LIDAR) device, comprising: a transmitter configured to transmit one or more light pulses into an environment of the LIDAR device via a transmit optical path; a detector configured to detect a first portion of the one or more transmitted light pulses and a second portion of the one or more transmitted light pulses, such that the detector receives at a first time the first portion of the one or more transmitted light pulses via an internal optical path within the LIDAR device and receives at a second time the second portion of the one or more transmitted light pulses via reflection by one or more objects in the environment of the LIDAR device, wherein the second time occurs after the first time; and a controller, wherein the controller is configured to determine a distance to at least one of the objects based in part on a difference between the second time and the first time. 2. The LIDAR device of clause 1, further comprising a light pipe within the LIDAR device, wherein the internal optical path comprises an optical path that extends through the light pipe. 3. The LIDAR device of clause 2, wherein the light pipe is configured to receive a predetermined percentage of the photons in the one or more transmitted light pulses. 4. The LIDAR device of clause 3, wherein the predetermined percentage is less than 10 percent. 5. The LIDAR device of any of clauses 1-4, wherein the internal optical path comprises reflection by one or more components of the LIDAR device. 6. The LIDAR device of any of clauses 1-5, further comprising: a transparent structure, wherein the transmit optical path passes through the transparent structure, wherein the internal optical path comprises reflection by the transparent structure. 7. The LIDAR device of clause 6, wherein the transparent structure is a dome configured to be mounted on a vehicle. 8. The LIDAR device of clause 6 or 7, wherein the transparent structure comprises an optical window. 9. The LIDAR device of any of clauses 1-8, further comprising: a mirror within the LIDAR device, wherein the transmit optical path comprises reflection by the mirror, wherein the internal optical path comprises reflection by the mirror. 10. The LIDAR device of any of clauses 1-9, further comprising: a light guide configured to guide light by total internal reflection or a reflective coating from an input end to an output end, wherein the transmit optical path comprises a first optical path that extends from the input end of the light guide to the output end of the light guide, wherein the internal optical path comprises the first optical path and further comprises a second optical path that extends from the output end of the light guide to the detector. 11. The LIDAR device of clause 10, wherein the output end of the light guide comprises a mirror. 12. A method comprising: causing a transmitter of a LIDAR device to transmit a first light pulse into an environment of the LIDAR device via a transmit optical path; receiving, by a detector of the LIDAR device, a first portion of the first light pulse at a first time via an internal optical path within the LIDAR device and a second portion of the first light pulse at a second time via reflection by one or more objects in the environment of the LIDAR device; and determining a distance to at least one of the objects based in part on a difference between the second time and the first time. 13. The method of clause 12, further comprising: determining a zero point time based on the first time. 14. The method of clause 12 or 13, further comprising: causing the transmitter to transmit a subsequent plurality of light pulses via the transmit optical path, wherein each subsequent pulse is fired according to a predetermined light pulse schedule; receiving, by the detector, subsequent reflected light pulses at subsequent times via reflection by one or more objects in the environment of the LIDAR device; and determining a distance to the respective objects based on the respective subsequent times, the predetermined light pulse schedule, and the first time. 15. A method comprising: positioning a mirror with respect to a transmitter of a LIDAR device, wherein the transmitter is configured to transmit at least one light pulse; causing the transmitter to transmit a first light pulse so as to interact with the mirror, wherein positioning the mirror is performed such that the first light pulse is directed toward an internal optical path within the LIDAR device; receiving, by a detector of the LIDAR device, the first light pulse at a first time via the internal optical path; and determining a zero point time based in part on the first time. 16. The method of clause 15, further comprising: repositioning the mirror so as to direct subsequent light pulses via a transmit optical path into an environment of the LIDAR device; causing the transmitter to transmit a subsequent plurality of light pulses via the transmit optical path; receiving, by the detector, subsequent reflected light pulses at subsequent times via reflection by one or more objects in the environment of the LIDAR device; and determining a distance to at least one of the objects based on a difference between the respective subsequent times and the zero point time. 17. The method of clause 16, wherein the subsequent light pulses are fired according to a predetermined light pulse schedule, and wherein determining the distance to the object is further based on the predetermined light pulse schedule. 18. The method of any of clauses 15-17, wherein the mirror comprises a rotatable mirror. 19. The method of clause 18, wherein the rotatable mirror comprises a triangular or rectangular prism shape, wherein the rotatable mirror comprises three or four reflective surfaces. 20. The method of clause 19, wherein positioning and repositioning the mirror comprises causing a motor to rotate the rotatable mirror about a rotational axis so as to adjust respective angles of the three or four reflective surfaces.
This application claims priority to U.S. patent application No. 62/813,860, titled “Systems and Methods for Real-Time LIDAR Range Calibration,” filed Mar. 5, 2019, which is hereby incorporated by reference in its entirety.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/US20/20936 | 3/4/2020 | WO | 00 |
| Number | Date | Country | |
|---|---|---|---|
| 62813860 | Mar 2019 | US |
