U.S. patent applications Ser. Nos. 14/920,246, 15/149,323, and 15/149,429 describe various configurations of distance sensors. Such distance sensors may be useful in a variety of applications, including security, gaming, control of unmanned vehicles, operation of robotic or autonomous appliances (e.g., vacuum cleaners), and other applications.
The distance sensors described in these applications include projection systems (e.g., comprising lasers, diffractive optical elements, and/or other cooperating components) which project beams of light in a wavelength that is substantially invisible to the human eye (e.g., infrared) into a field of view. The beams of light spread out to create a pattern (of dots, dashes, or other artifacts) that can be detected by an appropriate light receiving system (e.g., lens, image capturing device, and/or other components). When the pattern is incident upon an object in the field of view, the distance from the sensor to the object can be calculated based on the appearance of the pattern (e.g., the positional relationships of the dots, dashes, or other artifacts) in one or more images of the field of view, which may be captured by the sensor's light receiving system. The shape and dimensions of the object can also be determined.
For instance, the appearance of the pattern may change with the distance to the object. As an example, if the pattern comprises a pattern of dots, the dots may appear closer to each other when the object is closer to the sensor, and may appear further away from each other when the object is further away from the sensor.
In one example, a distance sensor includes a camera to capture images of a field of view, a plurality of light sources arranged around a lens of the camera, wherein each light source of the plurality of light sources is configured to project a plurality of beams of light into the field of view, and wherein the plurality of beams of light creates a pattern of projection artifacts in the field of view that is visible to a detector of the camera, a baffle attached to a first light source of the plurality of light sources, wherein the baffle is positioned to limit a fan angle of a plurality of beams of light that is projected by the first light source, and a processing system to calculate a distance from the distance sensor to an object in the field of view, based on an analysis of the images.
In another example, a method performed by a processing system of a distance sensor includes instructing a first pair of light sources of the distance sensor to project a first pattern of light into a field of view, wherein the first pattern of light is created when each light source of the first pair of light sources projects a plurality of beams of light, and wherein at least one light source of the first pair of light sources includes a first baffle to limit a fan angle of the plurality of beams of light, instructing a camera of the distance sensor to acquire a first image of the field of view, wherein the first image includes the first pattern of light, instructing a second pair of light sources of the distance sensor to project a second pattern of light into the field of view, wherein the second pattern of light is created when each light source of the second pair of light sources projects a plurality of beams of light, and wherein at least one light source of the second pair of light sources includes a second baffle to limit a fan angle of the plurality of beams of light, instructing the camera to acquire a second image of the field of view, wherein the second image includes the second pattern of light, and calculating a distance from the distance sensor to an object in the field of view, based on appearances of the first pattern of light and the second pattern of light in the first image and the second image.
In another example, a non-transitory machine-readable storage medium is encoded with instructions executable by a processor. When executed, the instructions cause the processor to perform operations including instructing a first pair of light sources of the distance sensor to project a first pattern of light into a field of view, wherein the first pattern of light is created when each light source of the first pair of light sources projects a plurality of beams of light, and wherein at least one light source of the first pair of light sources includes a first baffle to limit a fan angle of the plurality of beams of light, instructing a camera of the distance sensor to acquire a first image of the field of view, wherein the first image includes the first pattern of light, instructing a second pair of light sources of the distance sensor to project a second pattern of light into the field of view, wherein the second pattern of light is created when each light source of the second pair of light sources projects a plurality of beams of light, and wherein at least one light source of the second pair of light sources includes a second baffle to limit a fan angle of the plurality of beams of light, instructing the camera to acquire a second image of the field of view, wherein the second image includes the second pattern of light, and calculating a distance from the distance sensor to an object in the field of view, based on appearances of the first pattern of light and the second pattern of light in the first image and the second image.
The present disclosure broadly describes baffles for three-dimensional sensors having spherical fields of view. As discussed above, distance sensors such as those described in U.S. patent applications Ser. Nos. 14/920,246, 15/149,323, and 15/149,429 determine the distance to an object (and, potentially, the shape and dimensions of the object) by projecting beams of light that spread out to create a pattern (e.g., of dots, dashes, or other artifacts) in a field of view that includes the object. The beams of light may be projected from one or more laser light sources which emit light of a wavelength that is substantially invisible to the human eye, but which is visible to an appropriate detector (e.g., of the light receiving system). The three-dimensional distance to the object may then be calculated based on the appearance of the pattern to the detector.
As shown in
As such, a plurality of laser light sources can cooperate to produce a pattern that covers a hemispherical field of view, allowing the distance sensor to calculate distances within a large range. However, if the beams projected by two or more different laser light sources overlap (e.g., as may happen when any of the fan angles are greater than ninety degrees), this can distort the appearance of the pattern to the detector and make it more difficult for the detector to determine from which laser light source a given artifact of the pattern was projected. This, in turn, may complicate the calculation of the distance and lead to longer calculation times and less accurate calculations.
Examples of the present disclosure provide a baffle to limit the fan angle of a plurality of beams projected by a laser light source of a three-dimensional distance sensor. By limiting the fan angle of the plurality of beams, the baffle makes it less likely that the plurality of beams will overlap with beams projected by other laser light sources of the distance sensor. This, in turn, makes it easier for the distance sensor to determine from which laser light source a given artifact in a projected pattern was projected.
The housing 202 contains the components of the distance sensor 200 (i.e., the camera 204, the laser light sources 206, and other components not visible in
The camera 204 may comprise any type of camera that is capable of capturing an image in a field of view. For instance, the camera may comprise a red, green, blue (RGB) camera. In one example, the camera may also include a lens 208 and a detector (not shown) that is capable of detecting light of a wavelength that is substantially invisible to the human eye (e.g., an infrared detector). In one example, the lens 208 may comprise a fisheye lens. In another example, however, the lens 208 may comprise a mirror optical system.
In one example, the plurality of laser light sources 206 is arranged around the camera 204 (e.g., in a circle), so that the camera 204 is positioned in the center of the laser light sources 206, equidistant from each laser light source 206. This arrangement is illustrated clearly in
Each laser light source 206 may include a light emitting diode (LED) or other light source that is capable of emitting light in a wavelength that is substantially invisible to the human eye (e.g., infrared), but that is visible to a detector of the camera 204. Each laser light source 206 may also include a diffractive optical element that splits a beam emitted by the LED into a plurality of beams as shown in
For instance, taking a first laser light source 2061 as an example (where each laser light source 206 functions in a manner similar to the first laser light source 2061), the laser light source 2061 may project a first plurality of beams 2101-210n (hereinafter individually referred to as a “beam 210” or collectively referred to as “beams 210”) that fan out from a center point or beam 210. As discussed above, the beams 210 may fan out in multiple directions (e.g., between each pair of axes illustrated in
For the sake of simplicity, three beams 210 of the first plurality of beams 210 forming a vertical fan out are illustrated in
The “vertical” fan angle θv (i.e., the fan angle between the laser light source 2061 and the optical axis A-A′ of the camera 204, or between the x and z axes or y and z axes of
Similarly, three beams 210 of the first plurality of beams 210 forming a horizontal fan out are illustrated in
The “horizontal” fan angle θh (i.e., the fan angle around the optical axis A-A′ of the camera 204, or between the x and y axes of
In one example, one or more of the laser light sources 206 may include a baffle to limit the fan angle in one or more directions.
In one example, the baffle 300 may comprise a metal, plastic, glass, or ceramic component that may be removably attached to the laser light source 2061. As illustrated, the baffle 300 generally comprises a body 302 and a flange 304. The body 302 may attach to and rest substantially flush against the exterior surface of the laser light source 2061. The flange 304 may extend from the body 302 at an angle, so that when the baffle 300 is attached to the laser light source 2061, the flange 304 extends over a portion of the face of the laser light source 2061 from which the first plurality of beams 210 projects. As shown in
In one example, the baffle 300 may reduce the fan angle θ to sixty degrees or less. This may leave a space in the field of view, defined by an angle α between the outer boundary of the fan (e.g., third beam 210n) and a zero degree line that is parallel to the camera's optical axis, where there is no pattern coverage. That is, within the space defined by the angle α, no projection artifacts may be created when the laser light source 2061 projects the plurality of beams 210. However, the first plurality of beams 210 will not overlap with a second plurality of beams that is simultaneously projected from a second laser light source 206 of the distance sensor.
The baffle 300 is shown as extending around a portion of the laser light source's perimeter. This may reduce the fan angle θ in some directions, but not others. For instance, the baffle 300 may be positioned to reduce the vertical fan angle θv, but not the horizontal fan angle θh. As an example, the placement of the baffle may result in a horizontal fan angle θh of ninety degrees and a vertical fan angle θv of sixty degrees. However, it will be appreciated that in other examples, the baffle 300 may extend all the way around the laser light source's perimeter. This may further reduce the fan angle θ in all directions.
Although the baffle 300 creates areas in the pattern where there is no coverage (i.e., no projection artifacts in the field of view), it remains possible for the distance sensor to perform a trigonometric distance calculation with little to no loss of accuracy. This is in part because the baseline length, L (illustrated in
The method 400 may begin in step 402. In step 404, the processing system may send a first signal to a first pair of laser light sources of a distance sensor, instructing the first pair of laser light sources to project a first pattern of light into a field of view. In one example, the distance sensor includes four laser light sources, and the first pair of laser light sources comprises two laser light sources that are positioned on opposite sides of the lens of the distance sensor's camera (i.e., the laser light sources in the first pair of laser light sources are non-adjacent). For instance, using the distance sensor 200 of
As discussed above, the first pattern of light may comprise a plurality of projection artifacts that is projected into the field of view. The projection artifacts may be created by respective beams of light that are incident on objects in the distance sensor's field of view, where each laser light source of the first pair of laser light sources projects a plurality of beams that fan out from a central projection point or beam. The wavelength of the light that forms the beams (and, therefore, the projection artifacts) may be substantially invisible to the human eye, but visible to a detector of the distance sensor's camera (e.g., infrared).
Furthermore, in one example, at least one laser light source in the first pair of laser light sources includes an attached baffle to constrain a boundary of the portion of the first pattern of light that is created by the at least one laser light source. The baffle may constrain the boundary by limiting a fan angle of the beams of light that are emitted by the at least one laser light source. For instance, the baffle may resemble the baffle 300 illustrated in
As shown in
By contrast,
As shown in
Referring back to
In step 408, the processing system may send a third signal to a second pair of laser light sources of the distance sensor to project a second pattern of light into a field of view. In the example in which the distance sensor includes four laser light sources, the second pair of laser light sources may comprise two laser light sources that are positioned on opposite sides of the lens of the distance sensor's camera (i.e., the laser light sources in the second pair of laser light sources are non-adjacent). For instance, using the distance sensor 200 of FIGS. 2A-2B as an example, if the first pair of laser light sources referenced above comprise laser light sources 2061 and 2063, then the second pair of laser light sources might comprise laser light sources 2062 and 206n.
As discussed above, the second pattern of light, like the first pattern of light, may comprise a plurality of projection artifacts that is projected into the field of view. The projection artifacts may be created by respective beams of light that are incident on objects in the distance sensor's field of view, where each laser light source of the second pair of laser light sources projects a plurality of beams that fan out from a central projection point or beam. The wavelength of the light that forms the beams (and, therefore, the projection artifacts) may be substantially invisible to the human eye, but visible to a detector of the distance sensor's camera (e.g., infrared).
Furthermore, in one example, at least one laser light source in the second pair of laser light sources includes an attached baffle to constrain a boundary of the portion of the second pattern of light that is created by the at least one laser light source. The baffle may constrain the boundary by limiting a fan angle of the beams of light that are emitted by the at least one laser light source. For instance, the baffle may resemble the baffle 300 illustrated in
In one example, the processing system does not send the third signal to the second pair of laser light sources until after the camera has captured the first image. This ensures that the first pair of laser light sources and the second pair of laser light sources do not project the first and second patterns of light simultaneously. In other words, the first pair of laser light sources and the second pair of laser light sources project their respective patterns of light in sequence, on after the other. Thus, at any time, only half of the hemispherical field of view may be covered by a projection pattern. Put another way, the first pattern of light covers (up to) a first half of the distance sensor's hemispherical field of view, while the second pattern of light covers (up to) a different, second half of the field of view. This further avoids the potential for beam overlap.
In step 410, the processing system may send a fourth signal to the camera of the distance sensor instructing the camera to capture a second image of the field of view, including the second pattern of light projected by the second pair of laser light sources.
In step 412, the processing system may calculate the distance from the distance sensor to an object in the camera's field of view, using the first and second images captured in steps 406 and 410. In particular, the distance is calculated based on the appearances of the first pattern of light and the second pattern of light in the first image and the second image, respectively.
The method 400 may end in step 414.
It should be noted that although not explicitly specified, some of the blocks, functions, or operations of the method 400 described above may include storing, displaying and/or outputting for a particular application. In other words, any data, records, fields, and/or intermediate results discussed in the method 400 can be stored, displayed, and/or outputted to another device depending on the particular application. Furthermore, blocks, functions, or operations in
As depicted in
Although one processor element is shown, it should be noted that the electronic device 700 may employ a plurality of processor elements. Furthermore, although one electronic device 700 is shown in the figure, if the method(s) as discussed above is implemented in a distributed or parallel manner for a particular illustrative example, i.e., the blocks of the above method(s) or the entire method(s) are implemented across multiple or parallel electronic devices, then the electronic device 700 of this figure is intended to represent each of those multiple electronic devices.
It should be noted that the present disclosure can be implemented by machine readable instructions and/or in a combination of machine readable instructions and hardware, e.g., using application specific integrated circuits (ASIC), a programmable logic array (PLA), including a field-programmable gate array (FPGA), or a state machine deployed on a hardware device, a general purpose computer or any other hardware equivalents, e.g., computer readable instructions pertaining to the method(s) discussed above can be used to configure a hardware processor to perform the blocks, functions and/or operations of the above disclosed method(s).
In one example, instructions and data for the present module or process 705 for calculating the distance from a sensor to an object, e.g., machine readable instructions can be loaded into memory 704 and executed by hardware processor element 702 to implement the blocks, functions or operations as discussed above in connection with the method 400. Furthermore, when a hardware processor executes instructions to perform “operations”, this could include the hardware processor performing the operations directly and/or facilitating, directing, or cooperating with another hardware device or component, e.g., a co-processor and the like, to perform the operations.
The processor executing the machine readable instructions relating to the above described method(s) can be perceived as a programmed processor or a specialized processor. As such, the present module 705 for calculating the distance from a sensor to an object of the present disclosure can be stored on a tangible or physical (broadly non-transitory) computer-readable storage device or medium, e.g., volatile memory, non-volatile memory, ROM memory, RAM memory, magnetic or optical drive, device or diskette and the like. More specifically, the computer-readable storage device may comprise any physical devices that provide the ability to store information such as data and/or instructions to be accessed by a processor or an electronic device such as a computer or a controller of a safety sensor system.
It will be appreciated that variants of the above-disclosed and other features and functions, or alternatives thereof, may be combined into many other different systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, or variations therein may be subsequently made which are also intended to be encompassed by the following claims.
This application claims the priority of U.S. Provisional Patent Application Ser. No. 62/715,482, filed Aug. 7, 2018, which is herein incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
4914460 | Caimi et al. | Apr 1990 | A |
5699444 | Palm | Dec 1997 | A |
5730702 | Tanaka et al. | Mar 1998 | A |
5870136 | Fuchs et al. | Feb 1999 | A |
5980454 | Broome | Nov 1999 | A |
6038415 | Nishi et al. | Mar 2000 | A |
6442476 | Poropat | Aug 2002 | B1 |
6668082 | Davison et al. | Dec 2003 | B1 |
6937350 | Shirley | Aug 2005 | B2 |
7191056 | Costello et al. | Mar 2007 | B2 |
7193645 | Aagaard et al. | Mar 2007 | B1 |
7375803 | Bamji | May 2008 | B1 |
7589825 | Orchard et al. | Sep 2009 | B2 |
9098909 | Nomura | Aug 2015 | B2 |
9488757 | Mukawa | Nov 2016 | B2 |
9536339 | Worley et al. | Jan 2017 | B1 |
9686539 | Zuliani et al. | Jun 2017 | B1 |
9888225 | Znamensky et al. | Feb 2018 | B2 |
9986208 | Chao et al. | May 2018 | B2 |
20030071891 | Geng | Apr 2003 | A1 |
20040167744 | Lin et al. | Aug 2004 | A1 |
20040246473 | Hermary | Dec 2004 | A1 |
20060044546 | Lewin et al. | Mar 2006 | A1 |
20060055942 | Krattiger | Mar 2006 | A1 |
20060290781 | Hama | Dec 2006 | A1 |
20070091174 | Kochi et al. | Apr 2007 | A1 |
20070165243 | Kang et al. | Jul 2007 | A1 |
20070206099 | Matsuo | Sep 2007 | A1 |
20100007719 | Frey et al. | Jan 2010 | A1 |
20100149315 | Qu et al. | Jun 2010 | A1 |
20100223706 | Becker et al. | Sep 2010 | A1 |
20100238416 | Kuwata | Sep 2010 | A1 |
20110037849 | Niclass et al. | Feb 2011 | A1 |
20110188054 | Petronius et al. | Aug 2011 | A1 |
20120051588 | Mceldowney | Mar 2012 | A1 |
20120056982 | Katz et al. | Mar 2012 | A1 |
20120062758 | Devine et al. | Mar 2012 | A1 |
20120113252 | Yang et al. | May 2012 | A1 |
20120219699 | Pettersson | Aug 2012 | A1 |
20120225718 | Zhang | Sep 2012 | A1 |
20120236317 | Nomura | Sep 2012 | A1 |
20130076865 | Tateno et al. | Mar 2013 | A1 |
20130088575 | Park et al. | Apr 2013 | A1 |
20130155417 | Ohsawa | Jun 2013 | A1 |
20130242090 | Yoshikawa | Sep 2013 | A1 |
20130307933 | Znamensky et al. | Nov 2013 | A1 |
20130314688 | Likholyot | Nov 2013 | A1 |
20140000020 | Bareket | Jan 2014 | A1 |
20140009571 | Geng | Jan 2014 | A1 |
20140016113 | Holt et al. | Jan 2014 | A1 |
20140036096 | Sterngren | Feb 2014 | A1 |
20140071239 | Yokota | Mar 2014 | A1 |
20140085429 | Hérbert | Mar 2014 | A1 |
20140125813 | Holz | May 2014 | A1 |
20140207326 | Murphy | Jul 2014 | A1 |
20140241614 | Lee | Aug 2014 | A1 |
20140275986 | Vertikov | Sep 2014 | A1 |
20140320605 | Johnson | Oct 2014 | A1 |
20150009301 | Ribnick et al. | Jan 2015 | A1 |
20150012244 | Oki | Jan 2015 | A1 |
20150062558 | Koppal et al. | Mar 2015 | A1 |
20150077764 | Braker et al. | Mar 2015 | A1 |
20150131054 | Wuellner et al. | May 2015 | A1 |
20150016003 | Terry et al. | Jun 2015 | A1 |
20150171236 | Murray | Jun 2015 | A1 |
20150248796 | Iyer et al. | Sep 2015 | A1 |
20150268399 | Futterer | Sep 2015 | A1 |
20150288956 | Mallet et al. | Oct 2015 | A1 |
20150323321 | Oumi | Nov 2015 | A1 |
20150336013 | Stenzier et al. | Nov 2015 | A1 |
20150381907 | Boetliger et al. | Dec 2015 | A1 |
20160022374 | Haider | Jan 2016 | A1 |
20160041266 | Smits | Feb 2016 | A1 |
20160117561 | Miyazawa | Apr 2016 | A1 |
20160128553 | Geng | May 2016 | A1 |
20160157725 | Munoz | Jun 2016 | A1 |
20160178915 | Mor et al. | Jun 2016 | A1 |
20160249810 | Darty et al. | Sep 2016 | A1 |
20160261854 | Ryu | Sep 2016 | A1 |
20160267682 | Yamashita | Sep 2016 | A1 |
20160288330 | Konolige | Oct 2016 | A1 |
20160327385 | Kimura | Nov 2016 | A1 |
20160328854 | Kimura | Nov 2016 | A1 |
20160334939 | Dawson et al. | Nov 2016 | A1 |
20160350594 | McDonald | Dec 2016 | A1 |
20160379368 | Sakas et al. | Dec 2016 | A1 |
20170098305 | Gossow | Apr 2017 | A1 |
20170102461 | Tezuka et al. | Apr 2017 | A1 |
20170221226 | Shen et al. | Aug 2017 | A1 |
20170270689 | Messely et al. | Sep 2017 | A1 |
20170284799 | Wexler et al. | Oct 2017 | A1 |
20170307544 | Nagata | Oct 2017 | A1 |
20170347086 | Watanabe | Nov 2017 | A1 |
20180010903 | Takao et al. | Jan 2018 | A1 |
20180011194 | Masuda et al. | Jan 2018 | A1 |
20180073863 | Watanabe | Mar 2018 | A1 |
20180080761 | Takao et al. | Mar 2018 | A1 |
20180143018 | Kimura | May 2018 | A1 |
20180156609 | Kimura | Jun 2018 | A1 |
20180227566 | Price et al. | Aug 2018 | A1 |
20180249142 | Hicks et al. | Aug 2018 | A1 |
20180324405 | Thirion | Nov 2018 | A1 |
20180329038 | Lin et al. | Nov 2018 | A1 |
20180357871 | Siminoff | Dec 2018 | A1 |
20190064359 | Yang | Feb 2019 | A1 |
20190107387 | Kimura | Apr 2019 | A1 |
20190108743 | Kimura | Apr 2019 | A1 |
20190122057 | Kimura | Apr 2019 | A1 |
20190295270 | Kimura | Sep 2019 | A1 |
20190297241 | Kimura | Sep 2019 | A1 |
20190377088 | Kimura | Dec 2019 | A1 |
20200003556 | Kimura | Jan 2020 | A1 |
20200182974 | Kimura | Jun 2020 | A1 |
20200236315 | Kimura | Jul 2020 | A1 |
20210190483 | Ilg | Jun 2021 | A1 |
Number | Date | Country |
---|---|---|
101794065 | Aug 2010 | CN |
103196385 | Jul 2013 | CN |
103559735 | Feb 2014 | CN |
104160243 | Nov 2014 | CN |
104515514 | Apr 2015 | CN |
0358628 | Mar 1990 | EP |
H045112 | Feb 1992 | JP |
H0961126 | Mar 1997 | JP |
2006-313116 | Nov 2006 | JP |
2007-10346 | Jan 2007 | JP |
2007-187581 | Jul 2007 | JP |
2007-315864 | Dec 2007 | JP |
2010-091855 | Apr 2010 | JP |
2010-101683 | May 2010 | JP |
4485365 | Jun 2010 | JP |
2010-256182 | Nov 2010 | JP |
2012-047500 | Mar 2012 | JP |
2014-020978 | Feb 2014 | JP |
2014-511590 | May 2014 | JP |
2014-122789 | Jul 2014 | JP |
6038415 | Dec 2016 | JP |
6241793 | Dec 2017 | JP |
10-2013-0000356 | Jan 2013 | KR |
10-2013-0037152 | Apr 2013 | KR |
10-2015-0101749 | Sep 2015 | KR |
10-2016-0020323 | Feb 2016 | KR |
10-2017-0005649 | Jan 2017 | KR |
10-2017-0054221 | May 2017 | KR |
10-2017-0094968 | Aug 2017 | KR |
I320480 | Feb 2010 | TW |
I451129 | Apr 2012 | TW |
WO 2012081506 | Jun 2012 | WO |
WO2013145164 | Oct 2013 | WO |
WO 20140106843 | Jul 2014 | WO |
WO 2014131064 | Aug 2014 | WO |
WO 2015166915 | Nov 2015 | WO |
Entry |
---|
International Search Report and Written Opinion mailed in corresponding PCT/US2019/043702, dated Nov. 14, 2019, 13 pages. |
Number | Date | Country | |
---|---|---|---|
20200051268 A1 | Feb 2020 | US |
Number | Date | Country | |
---|---|---|---|
62715482 | Aug 2018 | US |