The present disclosure relates to a distance measuring device that generates a distance image from section images of sections divided from a target space to be imaged in accordance with distances.
Active distance measuring devices, such as time-of-flight (ToF) systems are typically known. This distance measuring device projects laser beams repeatedly with a predetermined pulse width and receives reflected light which corresponds to the projected laser beam after hitting and reflected by an object, thereby measuring a distance based on the round-trip time of the laser beams (i.e., a phase difference of the laser beams related to the outward and return trip).
Such a type of distance measuring device may be interfered with by reflected light of a laser beam irradiated from another distance measuring device, and may thus be unable to measure a distance properly when used with other distance measuring devices.
In order to solve this problem, Japanese Unexamined Patent Publication No. 2020-153799 provides a light emission period and a non-light emission period and distance measurement is performed by calculation of subtracting a pixel signal in the non-light emission period from a pixel signal in the light emission period. In addition, the lengths of the light emission period and the non-light emission period are modulated to reduce the influence of interference light from another distance measuring device.
The configuration according to Japanese Unexamined Patent Publication No. 2020-153799 requires a long interval of light emission, which lowers the frame rate.
The present disclosure was made in view of the problem. It is an objective of the present disclosure to provide a distance measuring device that reduces the influence of interference light without lowering the frame rate.
A distance measuring device according to an aspect of the present disclosure includes: a light source configured to project pulsed light toward a target space; a light receiver configured to receive light reflected by an object in the target space; a distance measurement controller configured to select, for distance measurement, one of distance measurement sections set for the target space in accordance with distances, and control a time of projection by the light source and a time of light reception by the light receiver in accordance with the one of the distance measurement sections selected; and a distance image generator configured to generate one of section images corresponding to the one of the distance measurement sections selected by the distance measurement controller from a signal output from the light receiver, and combine the section images corresponding to the distance measurement sections to generate a distance image, the distance measurement controller including a random number generator configured to generate random number data for selecting one of the distance measurement sections randomly.
The present disclosure provides a distance measuring device capable of reducing the influence of interference light without lowering the frame rate.
A distance measuring device according to an aspect of the present disclosure includes: a light source configured to project pulsed light toward a target space; a light receiver configured to receive light reflected by an object in the target space; a distance measurement controller configured to select, for distance measurement, one of distance measurement sections set for the target space in accordance with distances, and control a time of projection by the light source and a time of light reception by the light receiver in accordance with the one of the distance measurement sections selected; and a distance image generator configured to generate one of section images corresponding to the one of the distance measurement sections selected by the distance measurement controller from a signal output from the light receiver, and combine the section images corresponding to the distance measurement sections to generate a distance image, the distance measurement controller including a random number generator configured to generate random number data for selecting one of the distance measurement sections randomly.
With this configuration, the distance measurement controller can randomly select, for distance measurement, one of the distance measurement sections set for the target space in accordance with the distances. Accordingly, for example, even if there is a laser beam emitted from another distance measuring device, the influence of its reflected light can be dispersed to the distance measurement sections, which can greatly lower the probability that the reflected light is mixed into a section image of a specific one of the distance measurement sections. In addition, the distance measurement sections for distance measurement are simply selected at random, which causes neither a long interval of light emission nor a long frame period. This configuration can reduce the influence of interference light without lowering the frame rate.
The random number generator may generate the random number data so that all the distance measurement sections are selected once in each of frames.
This configuration allows reliable obtainment of the section images of all the distance measurement sections in one frame period.
The distance measurement controller may be configured to randomly delay the time of projection by the light source and the time of light reception by the light receiver in the one of the distance measurement sections, using random number data generated by the random number generator.
This configuration can further reduce the influence of interference light.
The random delay may be set not to extend a period of time for generating the section image.
This configuration can further reduce the influence of interference light without lowering the frame rate.
The distance image generator may include an interference determiner configured to determine the presence or absence of influence of interference light other than the pulsed light projected from the light source. If the interference determiner determines the presence of influence of interference light, the random number generator may generate the random number data.
This configuration can reduce the influence of interference light, if any, by randomly selecting one of the distance measurement sections for distance measurement.
The interference determiner may determine the presence of influence of interference light upon detection of a signal with a value greater than or equal to a predetermined threshold in a section image as of when the light receiver has received light in a non-emitting state in which the light source projects no pulsed light.
This configuration allows reliable detection of the influence of interference light, if any.
The distance image generator may further include a storage configured to store the section images corresponding to the distance measurement sections for frames. The distance image generator corrects one of the section images influenced by interference light, using the section images of the corresponding distance measurement section in previous and subsequent ones of the frames stored in the storage.
This configuration allows correction of a section image which is influenced by the interference light.
A distance measuring system according to an aspect of the present disclosure includes: two or more distance measuring devices, each being the distance measuring device according to the aspect described above; and a random number assignment controller configured to control an operation of the random number generator included in the distance measurement controller of each of the distance measuring devices.
This configuration can address the problem that random selections of the distance measurement sections by the distance measuring devices fall in the same pattern and that the influence of interference light increases.
The random number assignment controller may give a seed of a pseudo random number to the random number generator and change the seed in time series.
Now, embodiments will be described in detail with reference to the drawings. Unnecessarily detailed description may be omitted. For example, detailed description of already well-known matters or repeated description of substantially the same configurations may be omitted. This is to reduce unnecessary redundancy of the following description and to facilitate the understanding by those skilled in the art.
The accompanying drawings and the following description are provided for sufficient understanding of the present disclosure by those skilled in the art, and are not intended to limit the subject matter of the claims.
The light source 11 projects pulsed light toward a target space. The light receiver 12 receives the light reflected by an object in the target space. The distance measurement controller controls the pulsed light projection by the light source 11 and the light reception by the light receiver 12. The distance measurement controller 20 sets distance measurement sections (i.e., sub-ranges or also simply referred to as “sections”) for the target space in accordance with the distances. The distance measurement controller 20 then select, for distance measurement, one of the distance measurement sections, and controls the time when the light source 11 projects pulsed light and the time when the light receiver 12 performs light reception (i.e., light exposure), in accordance with the selected distance measurement section. The distance image generator 30 generates one of section images, which corresponds to the distance measurement section selected by the distance measurement controller 20, from a signal output from the light receiver 12. The distance image generator 30 then combines the section images corresponding to the distance measurement sections to generate a distance image indicating distance values.
The light source 11 is a laser diode, for example, and outputs a pulsed laser beam. Besides the laser diode, the light source 11 may be a light emitting diode (LED), a vertical-cavity surface-emitting laser (VCSEL), or a halogen lamp, for example. The pulsed light projected by the light source 11 preferably has a single wavelength, a relatively short pulse width, and a relatively high peak intensity. In addition, the wavelength of the pulsed light falls within a wavelength range of near-infrared which is less visible to human eyes and not easily influenced by ambient light. The light source 11 may include a light projecting optical system, such as a lens, that projects pulsed light to a target space.
The light receiver 12 includes an image sensor 13 with pixels and a pixel signal output unit 14. Avalanche photodiodes are arranged on the pixels of the image sensor 13, for example. Other light detecting elements may be arranged on the pixels. The pixels are switchable between light exposure for receiving reflected light, and non-light exposure for receiving no reflected light. In the light exposure, the light receiver 12 outputs a pixel signal according to the reflected light received by the pixel. The light receiver 12 may include a light receiving optical system, such as a lens, that collects the reflected light on the light receiving surface of the image sensor 13.
When controlling the light emission by the light source 11, the distance measurement controller 20 controls the time when the light source 11 outputs light, the pulse width of the light output from the light source 11, and other factors. When controlling the light reception by the light receiver 12, the distance measurement controller 20 controls the operation times of transistors in the pixels, thereby controlling the light exposure times, the exposure periods, and other factors for the pixels of the image sensor 13. The light exposure times and the exposure periods may be the same among all pixels or may be different from pixel to pixel.
The distance measurement controller 20 includes a distance measurement section determiner 21, a time generator 22, and a random number generator 23. The distance measurement section determiner 21 selects, for distance measurement, one of distance measurement sections set for the target space in accordance with the distances. The time generator 22 controls the time when the light source 11 projects pulsed light and the time when the light receiver 12 performs light reception (i.e., light exposure), in accordance with the selected distance measurement section. The random number generator 23 generates random number data to allow the distance measurement section determiner 21 to select the distance measurement sections randomly.
The distance image generator 30 includes a section image storage 31 and a distance image output unit 32. The section image storage 31 obtains section images indicating reflected light in the distance measurement sections from the pixel signals output from the light receiver 12. The obtained section images for frames are, for example, stored in the section image storage 31. Each frame is the period of the distance measurement in all the distance measurement sections set for the target space. One frame corresponds to one distance image. The distance image output unit 32 combines section images obtained in one frame to generate and output a distance image.
As shown in
On the other hand, as shown in
Note that c is the speed of light.
While being generated once in one measurement period in
As can be seen from
As described above, according to this embodiment, the distance measurement controller 20 can randomly select, for distance measurement, one of the distance measurement sections set for the target space in accordance with the distances. Accordingly, for example, even if there is a laser beam emitted from another distance measuring device, the influence of its reflected light can be dispersed to the distance measurement sections, which can greatly lower the probability that the reflected light is mixed into a section image of a specific one of the distance measurement sections. In addition, the distance measurement sections for distance measurement are simply selected at random, which causes neither a long interval of light emission nor a long frame period. This configuration can reduce the influence of interference light without lowering the frame rate.
(Variation)
In order to reduce the influence of interference light, the start time of the light emission pulse may be delayed randomly. For this operation, the random number data generated by the random number generator 23 may be used.
The sub-range period TsN is as follows.
T
sN
=T
p
×N
p [Math 2]
TP is the average pulse period, while NP is the number of pulses.
Here, the maximum amount TLD-ran of the delay in the light emission allowable in one distance measurement section is as follows.
TES is a light exposure width, and TCN is a count width. In order to maintain the frame rate, the maximum amount TLD-ran of the delay in the light emission needs to be positive. Note that the light exposure width T E s can also be expressed as follows.
The allowable number NLD-ran of the patterns of the random delay in the start time of the light emission is expressed by the following equation, where ΔTLD-ran is a random delay step width of the start time of light emission.
In the equation described above, “1” means that the patterns include even the case where there is no delay.
The equation described above can be modified as follows, using Maths 1 to 4.
Specifically, in this variation, the distance measurement controller 20 is configured to randomly delay the time of projection by the light source 11 and the time of light reception by the light receiver 12 in the one of the distance measurement sections, using the random number data generated by the random number generator 23. This configuration can further reduce the influence of interference light. The random delay is set not to extend a period for generating the section image. This configuration can further reduce the influence of interference light without lowering the frame rate.
If a similar signal is detected in a past frame, the interference determiner 41 determines that there is influence of interference light. The interference determiner 41 then determines whether or not the distance measurement sections have already been selected in a random order as shown in the first embodiment (S15). If not selected randomly, the distance measurement sections start being selected randomly (S16), and the process returns to S11. On the other hand, if the distance measurement sections are already selected randomly, a pixel with the possibility of interference is specified from the section image (S17).
After that, the distance measurement controller 20 causes the light receiver 12 to receive light in a light emitting state in which the light sources 11 emits light (S18). Accordingly, the section images of the distance measurement sections can be obtained. With the pixel possibility of interference is specified, the interference determiner 41 corrects the pixel in the section image (S19).
Assume that, imaging is then performed in the light emitting state and the section images of the distance measurement sections S1 to S5 are obtained. At this time, in the section image of the distance measurement section S1, the values (I, x, y) of the signal S1 are corrected to the values (I′, x, y). Here, the brightness value I′ may be equal to those in the previous and subsequent frames in a non-interference state or that of a background image.
As described above, according to this embodiment, the distance image generator 30A includes the interference determiner 41 configured to determine the presence or absence of influence of interference light other than the pulsed light projected from the light source 11. If the interference determiner 41 determines the presence of influence of interference light, the distance measurement controller 20 performs random selection. This configuration can reduce the influence of interference light, if any, by randomly selecting one of the distance measurement sections for distance measurement.
While the random sub-ranges are shown in this example, the start time of the light emission may be random as a variation of the first embodiment.
A distance measuring system may be formed by two or more distance measuring devices each being the distance measuring device according to the above embodiments described above.
For example, the random number generator 23 includes a linear feedback shift register to generate pseudo random number data. In this case, the random number assignment controller 53 gives a seed of a pseudo random number to the random number generator 23. The random number assignment controller 53 may change the seed of the pseudo random number in time series.
The distance measuring device according to the present disclosure can reduce the influence of interference light without lowering the frame rate, and is thus useful for improving the performance and operation speed of a ToF camera. For example, the distance measuring device is applicable for a monitoring camera system that detects and tracks an object (or a person), a system that is mounted on an automobile and detects an obstacle, and any other suitable system.
Number | Date | Country | Kind |
---|---|---|---|
2021-060606 | Mar 2021 | JP | national |
This is a continuation of International Application No. PCT/JP2022/001822 filed on Jan. 19, 2022, which claims priority to Japanese Patent Application No. 2021-060606 filed on Mar. 31, 2021. The entire disclosures of these applications are incorporated by reference herein.
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2022/001822 | Jan 2022 | US |
Child | 18466429 | US |