This application claims priority to European Patent Application No. 18208689.2, filed on Nov. 27, 2018, which application is hereby incorporated herein by reference.
Embodiments relate to a method and apparatus for controlling the system timing within a LIDAR system.
Range and distance detection using light is known. These systems can be known as LIDAR (light detection and ranging) have many applications including consumer electronics, automotive, robotics, surveying and so on.
An example LIDAR system uses a light source, for example a vertical cavity surface emitting laser (VCSEL), to generate light pulses which are reflected from a surface and then detected at a receiver or detector, for example a photodiode or single photon avalanche diode (SPAD) array.
The time difference between the light being transmitted and received provides the distance or range value using the simple equation D=S*T, where T is the time difference, S the speed of light and D the distance from the transmitter to the reflecting object and back again.
A single photon avalanche diodes (SPAD) is a semiconductor devices capable of detecting light. A photon impinging on a detection region of a SPAD generates an electron and hole pair via the photoelectric effect. The SPAD is reverse-biased with a high voltage magnitude such that when the electron/hole carriers are generated, the electric field applied across the detection region causes the carriers to be accelerated to a relatively high velocity according to the strength and direction of the applied field. If the kinetic energy of the accelerated carriers is sufficient, additional carriers will be generated from the semiconductor lattice, which are in turn accelerated by the field, and may liberate further carriers in an exponentially increasing fashion. Thus, when a sufficiently high electric field is applied across the detection region, a single impinging photon may generate an avalanche of carriers, resulting in an output current ‘pulse’, where the current output is proportional to the number of photons detected.
The minimum voltage required to cause an avalanche of carriers, and thus allow the device to operate as a SPAD, is known as the breakdown voltage. If the voltage applied is too low, i.e. below the breakdown voltage, then the device does not produce any output. However if the voltage applied is too high, then it is possible that the electric field generated may be sufficient to cause a carrier avalanche even when there are no photons impinging on the SPAD, resulting in a false output current. This false output is known as a “dark current”.
Embodiments relate to a method and apparatus for controlling the system timing within a LIDAR system. Particular embodiments relate to a method and apparatus for controlling the system timing within a LIDAR system comprising single photon avalanche diodes as receiver diodes.
According to first aspect an apparatus for controlling pixel scanning within a range detector comprises at least one light source configured to provide a spatially controllable point light source. A detector comprising at least one light sensor is configured to receive a reflected spatially controllable point light source. A controller is configured to control the at least one light source. The controller is configured to control the at least one light source to generate a first series of light source pulses, associated with a first spatial direction and control the at least one light source to generate a second series of light source pulses associated with a second spatial direction. The second series of light source pulses are started during the first series of light source pulses.
The controller may be configured to start the second series of light source pulses a determined time period after the start of the first series of light source pulses, wherein the determined time period may be shorter than a time period of the first series of light source pulses.
The first series of light pulses may be associated with a first row of light sensor elements and the second series of light pulses are associated with a second row of light sensor elements.
The first series of light pulses may be associated with a first row first light sensor element of the first row of light sensor elements and the second series of light pulses may be associated with a second row first light sensor element of the second row of light sensor elements.
The controller may be further configured to: control the at least one light source to generate a third series of light source pulses, associated with a third spatial direction, the third spatial direction may be associated with a third row of light sensor elements, wherein the third series of light source pulses may be substantially simultaneously operated with the first series of light source pulses.
The controller may be further configured to control the at least one light source to at least one of spatially dither the at least one light source and randomly select a spatial direction during at least one of the first and second series of light pulses.
The controller may be further configured to control the at least one light source to form at least one of a z-raster pattern with the at least one light source; a snake-raster pattern with the at least one light source; a x-raster pattern with the at least one light source; a random or pseudo-random pattern with the at least one light source; and a skip-n raster pattern with the at least one light source.
According to a second aspect a method for controlling pixel scanning within a range detector comprises providing a spatially controllable point light source and controlling the spatially controllable point light source. Controlling the spatially controllable light source comprises generating a first series of light source pulses associated with a first spatial direction and generating a second series of light source pulses associated with a second spatial direction. The second series of light source pulses are started during the first series of light source pulses.
Generating a second series of light source pulses associated with a second spatial direction may comprise starting the second series of light source pulses a determined time period after the start of the first series of light source pulses, wherein the determined time period may be shorter than a time period of the first series of light source pulses.
The method may further comprise: receiving a reflected spatially controllable point light source at a detector comprising at least one light sensor, wherein the first series of light pulses may be received by a first row of elements of the light sensor and the second series of light pulses may be received by a second row of elements of the light sensor.
The first series of light pulses may be received by a first row first element of the light sensor and the second series of light pulses may be associated with a second row first element of the light sensor.
Controlling the spatially controllable light source may comprise further generating a third series of light source pulses, associated with a third spatial direction, wherein the third series of light source pulses may be substantially simultaneously operated with the first series of light source pulses, wherein the third series of light pulses may be received by a third row of elements of the light sensor.
Controlling the spatially controllable point light source may perform at least one of: spatially dithering the at least one light source; and randomly selecting a spatial direction during at least one of the first and second series of light pulses.
Controlling the spatially controllable point light source may comprise controlling the at least one light source to form at least one of: a z-raster pattern with the at least one light source; a snake-raster pattern with the at least one light source; a x-raster pattern with the at least one light source; a random or pseudo-random pattern with the at least one light source; and a skip n raster pattern with the at least one light source.
According to a third aspect there is provided an apparatus for controlling pixel scanning within a range detector, the apparatus comprising: means for providing a spatially controllable point light source; and means for controlling the spatially controllable point light source, wherein the means for controlling the spatially controllable light source comprises: means for generating a first series of light source pulses, associated with a first spatial direction; means for generating a second series of light source pulses associated with a second spatial direction, wherein the second series of light source pulses are started during the first series of light source pulses.
The means for generating a second series of light source pulses associated with a second spatial direction may comprise means for starting the second series of light source pulses a determined time period after the start of the first series of light source pulses, wherein the determined time period may be shorter than a time period of the first series of light source pulses.
The apparatus may further comprise: means for receiving a reflected spatially controllable point light source at a detector comprising at least one light sensor, wherein the first series of light pulses may be received by a first row of elements of the light sensor and the second series of light pulses may be received by a second row of elements of the light sensor.
The first series of light pulses may be received by a first row first element of the light sensor and the second series of light pulses may be associated with a second row first element of the light sensor.
The means for controlling the spatially controllable light source may further comprise means for generating a third series of light source pulses, associated with a third spatial direction, wherein the third series of light source pulses may be substantially simultaneously operated with the first series of light source pulses, wherein the third series of light pulses may be received by a third row of elements of the light sensor.
The means for controlling the spatially controllable point light source may perform at least one of: spatially dithering the at least one light source; and randomly selecting a spatial direction during at least one of the first and second series of light pulses.
The means for controlling the spatially controllable point light source may comprise means for controlling the at least one light source to form at least one of: a z-raster pattern with the at least one light source; a snake-raster pattern with the at least one light source; a x-raster pattern with the at least one light source; a random or pseudo-random pattern with the at least one light source; and a skip n raster pattern with the at least one light source.
The concept as described in further detail according to some embodiments is the provision of an improved performance LIDAR system by defining a staggered dot or blade timing configuration controlling the transmitter and receiver. The concept as discussed in further detail involves at least partially overlapping detector timing ranges.
With respect to
The system 100 may comprise a detector 105, which may comprise or be coupled to various optics configured to focus the returning light to a specific photosensitive region or area within the detector. The detector may be considered to be a receiver of the light used in the distance detection. Furthermore in some embodiments the detector comprises or is associated with a mechanical or optical beam director (which in some embodiments is the same one as used by the light source 103) configured to direct the returning light according towards a specific photosensitive region or area within the detector. In some embodiments the detector 105 comprises a photosensitive region, for example an array of single photon avalanche diodes configured to convert the received light into electronic signals suitable for outputting.
Furthermore the system may comprise a timing generator (or controller) 113. In some embodiments the detector 105 and light source 103 may be controlled using a timing generator 113. The timing generator 113 can be configured to generate various timing or control pulses to control the light source, for example to control when and where the light is to be transmitted. The timing generator 113 may further be configured to further control the detector, to activate some regions as being photosensitive or active and some other regions as being inactive.
Furthermore the system may comprise a distance measurement/distance mapping unit 115. The distance measurement/mapping unit 115 can in some embodiments be configured to receive timing control information from the timing generator 113 and from the detector 105 (and in some embodiments the light source 103) and determine the distance between the system 100 and the surface 102 based on the time taken for the light to travel from the light source 103 to the surface 104 and from the surface 104 to the detector 106. The distance measurement/mapping unit 115 may for example be configured to generate a histogram of detected events (against time) and from the histogram determine a distance. In some embodiments the distance measurement/distance mapping unit 115 is configured to determine distances for more than one point or area and therefore determine a distance map.
In some embodiments the system 100 may further comprise a suitable application 111 configured to be interfaced with the timing generator 113 and distance measurement/distance mapping unit 115. For example the application may be an automotive brake decision unit, automotive navigation unit, computer vision unit or otherwise. The application 111 may for example receive the distance map or distance values and perform a decision or determination to control further apparatus based on the distance information. In some further embodiments the application 111 may furthermore be configured to control the timing generator to change the distance measurement parameters.
In some embodiments the timing generator 113, distance measurement/mapping 115 and application 101 may be implemented within a computer (running suitable software stored on at least one memory and on at least one processor), a mobile device, or alternatively a specific device utilizing, for example, FPGAs (field programmable gate arrays) or ASICs (application specific integrated circuits).
With respect to
A second example configuration is a line sensor/blade scan configuration 211. The blade scan configuration 211 typically comprises a (linear) array of transmitting elements, for example an array of VCSELs or other controllable light source elements. The light from the transmitting elements are then passed to a 1D scanning mirror or rotational unit 217 which then outputs via a suitable optical element 219. The optical element receives the reflected light and passes the reflected light via to the 1D mirror or rotational unit 217 to the receiver 215. The receiver 215 typically comprises an array of SPAD elements (for example a linear array of SPAD elements) or a linear photosensitive array. In such a manner a ‘blade’ or line of light may be generated and then received generating an image line. These lines may then be stepped by changing the direction of the 1D scanning mirror or rotational unit 217 to scan an area 218 (line 214 by line). In some embodiments the blade scan configuration 211 may be implemented by series of offset linear arrays or transmitting elements and a static mirror.
A third type of operation is a flash configuration wherein the transmitter (which may comprise one or more light sources) generates a single flash which may be output via a suitable optical element (or in some situations an optical window) 229 and the received light received via a further optical element 228 (or the same optical element 229 as the transmission path) at an image sensor 225 comprising an array of sensitive areas 226. The flash configuration thus is able to generate a single image 224 generated by a single exposure.
The differences between the configurations shown with respect to
One of the aspects which slow the frame rate of a single dot/single point configuration is the manner in which light source/pixels are individually activated. A typical time pattern for operating the pixels is shown in
The first pixel 311 is therefore shown being activated for a TOF range time 313 following a laser pulse 302 and then deactivated or in a not-sensitive time 317 for a series of following integration time periods. Within the TOF range time period 313 the reflected light may be detected as indicated by the event detection arrows 315. Furthermore during this period 313 pixel 2 321 and pixel 3 331 are not sensitive.
The second pixel 321 is shown being activated for a TOF range time 323 which immediately follows the second laser pulse 304 and also follows the end of the first pixel 311 TOF range time 313. Within this TOF range time 323 is shown detected events 325. The second pixel is shown being deactivated or in a not-sensitive time 327 which is the same period as the first pixel 311 TOF range time 313 and in the period after the TOF range time 323.
The third pixel 331 is shown being activated for a TOF range time 333 which immediately follows the third laser pulse 306 and also follows the end of the first pixel 311 TOF range time 313 and the second pixel 323 TOF range time 323. Within this TOF range time 333 is shown detected events 335. The second pixel is shown being deactivated or in a not-sensitive time 337 which is the same period as the first pixel 311 TOF range time 313 and the second pixel 321 TOF range time 323.
As shown therefore each pixel is activated sequentially and requires a separate Tint period 341 (typically in the order of 2 μs).
This is then shown replicated in the scanning timing diagram of
Thus in such a system the frame period is limited by the Tshot or Tint time period.
The following examples therefore show embodiments wherein the frame period is not limited by the Tshot or Tint time period. The concept as discussed earlier is one in which the timing ranges for the pixels are configured to be at least partially overlapping. This may be implemented for example by the use of a staggered offset or staggered dot timing system wherein rather than activating pixels independently and sequentially the pixels are activated according to a staggered offset pattern per channel.
With respect to
Thus the system shows a first laser pulse 503 associated with a first pixel, pixel 1, a second laser pulse 505 associated with a second pixel, pixel 2, a third laser pulse 507 associated with a third pixel, pixel 3 and so on to a Y'th laser pulse associated with a Y'th pixel. The system then repeats such that there is furthermore a further cycle first laser pulse 553 associated with the first pixel, pixel 1, a further cycle second laser pulse 555 associated with the second pixel, pixel 2, a further cycle third laser pulse 557 associated with the third pixel, pixel 3 and so on to a further cycle Y'th laser pulse associated with the Y'th pixel. This can be repeated for the desired number of ranging cycles.
The first pixel, pixel 1, as shown by timing line 511, may be configured such that it is active following the first laser pulse 503. Within this active time any return events 515 associated with the first laser pulse 503 can be detected within the TOF range 513 which continues up to the further cycle first laser pulse 553 which starts a further TOF range period until a determined number of ranging cycles is completed.
Furthermore for the second pixel, pixel 2, as shown by timing line 521, may be configured such that it is active following the second laser pulse 505. Within this active time any return events 525 associated with the second laser pulse 505 can be detected within the TOF range 523 which continues up to the further cycle second laser pulse 555 which starts a further TOF range period until a determined number of ranging cycles is completed. In some embodiments the second pixel is deactivated (shown by the cross hatched area 512) until the second laser pulse occurs.
For the third pixel, pixel 3, as shown by timing line 531, may be configured such that it is active following the third laser pulse 507. Within this active time any return events 535 associated with the third laser pulse 505 can be detected within the TOF range 533 which continues up to the further cycle third laser pulse 557 which starts a further TOF range period until a determined number of ranging cycles is completed. In some embodiments the third pixel is deactivated (shown by the cross hatched area 522) until the third laser pulse occurs.
In implementing the timing of the laser (light source) pulses such embodiments may be able to implement an integration time (Tint) for Y pulses in the region of (Y−1)×(time of light range period) (which may be approximately 2 μs).
With respect to
Additionally as soon as the row 1 pixel 1 histogram is read out the next row, row 2 615 can be activated and pixel 1 may be sampled, row 2 pixel 2 can then be activated a stagger delay after this and so on.
In such a manner row 2 615 can be active while row 1 613 is active (as shown in
In some embodiments where there is no possibility of overlap between rows then rows can be run substantially simultaneously (with a stagger delay between them). For example in the example shown in
As soon as the row 1 pixel 1 histogram is read out then in a manner similar to
In such a manner the frame rate can be further improved as also shown in
This may be repeated for further histograms, so as shown in
A further histogram line 831 is shown which shows at the start 803 time is at the a pixel . . . row X histogram generation 832 and the pixel . . . row X histogram read 833 occurs. After this histogram read is the pixel . . . row 1 histogram generation period 835. At the end of the pixel . . . row 1 histogram generation (in other words after a defined number of ranging cycles using the pixel . . . from row 1) then the pixel . . . row 1 histogram read 837 occurs. After this the pixel . . . row 2 histogram generation period 839 is started.
A final histogram line 841 is shown which starts 803 at the start of the pixel Y row X histogram generation period 842. At the end of the pixel Y row X histogram generation (in other words after a defined number of ranging cycles using the pixel Y from row X) then the pixel Y row X histogram read 843 occurs. After this the pixel Y row 1 histogram generation period 845 is started.
With respect to
The middle part 911 of
The lower part 921 of
Thus the sampling of the histogram associated with pixel 1 is started 923 using a number (in this example situation 4) of samples. A stagger delay period after pixel 1 is started then pixel 2 925 is started and so on until the last pixel, pixel N, 927 is started. After all of the pixels are finished then the frame is completed as shown by the frame time 924 where the frame time 924 is shorter than the frame time 904.
In some embodiments a spatial dithering/randomization may be employed to switch from pixel to pixel in order in order to allow a higher power per point and longer integration per receive pixel as spatial dithering/randomization moves the light out of the eye field of view.
Some patterns associated with moving from pixel to pixel using the stagger delay operation is shown furthermore with example and with respect to
The lower part of
Row 2 1103 is looped Y times 1106 and after the Y'th loop is completed, a scan line return 1108 is implemented before a third row, row 3 1105, is scanned in the same direction as row 2.
Row 3 1105 is looped Y times 1110 and after the Y'th loop is completed, a scan line return 1112 is implemented for the next row scan and so on.
The patterns shown in
This cycle is repeated for a second row, row 2 1203, is scanned in the same manner as row 1 (in other words in a first direction and then back again and then repeated for Y times 1204 before then implementing a scan line return 1214).
This is again repeated for a third row, row 3 1205, and further rows.
The lower part of
After the last loop has been completed then the next pair of rows is scanned in the same manner.
This raster pattern attempts to increase the spatial distance between neighboring pixels.
In some embodiments the pattern may be formed from groups of more than two rows.
The pattern shown in
This cycle is repeated for a second row, row 2 1303, is scanned in the same manner as row 1 (and then repeated for Y times 1314 before then implementing a scan line return 1304).
This is again repeated for a third row, row 3 1305, and further rows.
This approach similarly increases the spatial distance between neighboring pixels.
Although a skip 1 pattern is shown other skip patterns may be implemented.
The above examples show various spatial patterns, however any suitable spatial pattern can be implemented where the spatial pattern may be deterministic, pseudo-random or random.
The apparatus and method described above may be implemented in any device or apparatus which utilizes single photon avalanche detectors. For example, the apparatus and method described above may be implemented in a LIDAR system. It should be understood that this non-limiting implementation is only exemplary, and the apparatus and method may be implemented in any manner of other light-detecting applications.
It should be appreciated that the above described arrangements may be implemented at least partially by an integrated circuit, a chip set, one or more dies packaged together or in different packages, discrete circuitry or any combination of these options.
Various embodiments with different variations have been described here above. It should be noted that those skilled in the art may combine various elements of these various embodiments and variations.
Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the scope of the present invention. Accordingly, the foregoing description is by way of example only and is not intended to be limiting. The present invention is limited only as defined in the following claims and the equivalents thereto.
Number | Date | Country | Kind |
---|---|---|---|
18208689 | Nov 2018 | EP | regional |
Number | Name | Date | Kind |
---|---|---|---|
5206697 | Schwartz | Apr 1993 | A |
7944548 | Eaton | May 2011 | B2 |
8432304 | Dutton | Apr 2013 | B2 |
9091754 | d'Aligny | Jul 2015 | B2 |
20050122593 | Johnson | Jun 2005 | A1 |
20060238742 | Hunt et al. | Oct 2006 | A1 |
20080032066 | Stiblert | Feb 2008 | A1 |
20090122295 | Eaton | May 2009 | A1 |
20110222074 | Svensson | Sep 2011 | A1 |
20120154187 | Dutton | Jun 2012 | A1 |
20130050676 | d'Aligny | Feb 2013 | A1 |
20140084050 | Calvarese | Mar 2014 | A1 |
20140231679 | Kremeyer | Aug 2014 | A1 |
20160003946 | Gilliland | Jan 2016 | A1 |
20170075206 | McAndrew | Mar 2017 | A1 |
20170095155 | Nakajima | Apr 2017 | A1 |
20180081038 | Medina | Mar 2018 | A1 |
20200166751 | Gotoh | May 2020 | A1 |
Number | Date | Country |
---|---|---|
3217190 | Sep 2017 | EP |
2018176115 | Oct 2018 | WO |
Entry |
---|
European Search Opinion for EP10208689 (Year: 2019). |
Number | Date | Country | |
---|---|---|---|
20200166612 A1 | May 2020 | US |