The present disclosure relates to an imaging apparatus having multiple imaging optical systems and a distance measuring apparatus that measures the distance to a target object based on parallax in images captured by multiple imaging optical systems.
Polynocular distance measuring apparatuses are known that capture images of a target object for measurement with an imaging apparatus having multiple imaging optical systems and measure the distance to the target object by making use of the parallax between the captured images. Such polynocular distance measuring apparatuses are utilized in driving assist systems for automobiles, three-dimensional shape measuring systems, and the like.
In a polynocular distance measuring apparatus for monitoring the front view of an automobile, multiple monocular imaging apparatuses are usually installed on the inner side of the windshield such that their optical axes are parallel to each other. Japanese Unexamined Patent Application Publication No. 2013-112314 discloses an example of a polynocular distance measuring apparatus of this type.
In applications for monitoring the rear view and the surroundings of an automobile, in contrast, an ultrawide-angle monocular imaging apparatus is used for the purpose of aiding in visibility. Japanese Unexamined Patent Application Publication No. 2013-109268 discloses an example of such an ultrawide-angle monocular imaging apparatus.
In a situation where a polynocular distance measuring apparatus is used when it rains, for example, a sufficient distance measuring performance may not be obtained due to adhesion of water droplets between lenses.
One non-limiting and exemplary embodiment provides an imaging apparatus that makes it difficult for any adhering water droplet, such as a raindrop, to stand between lenses.
In one general aspect, the techniques disclosed here feature an imaging apparatus for capturing an image of a target object, including: lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object; imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions; and a light-transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object, in which optical axes of the lens optical systems are parallel to each other.
The imaging apparatus according to an aspect of the present disclosure makes it difficult for an adhering water droplet such as a raindrop to stand on its surface and reduces the possibility of temporary reduction in image capturing performance.
Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
In implementation of a polynocular distance measuring apparatus for monitoring the rear view or surroundings of a vehicle with combination of the aforementioned techniques, an arrangement in which multiple ultrawide-angle monocular imaging apparatuses are arrayed close to each other may be conceivable because the distance to the target object is assumed to be several meters or less. In general, the surface of the topmost lens of an ultrawide-angle taking lens is shaped to be convex on the object side. Thus, a water droplet tends to stand between the topmost lens of one monocular imaging apparatus and the topmost lens of the adjacent monocular imaging apparatus. A water droplet standing between adjacent lenses in a polynocular distance measuring apparatus can lead to an insufficient distance measurement performance.
Embodiments of the present disclosure will be generally described as follows.
According to an aspect of the present disclosure, an imaging apparatus for capturing an image of a target object includes: lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object; imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions; and a light-transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object, in which optical axes of the lens optical systems are parallel to each other. With the imaging apparatus according to this aspect of the present disclosure, the dome shape of the cover makes it difficult for any water droplet adhering to the cover to stand there.
In an embodiment, the lens of each of the lens optical systems may be a concave meniscus lens.
In an embodiment, the cover may cover an entire exposed portion of the lens optical systems on the target object side.
In an embodiment, the cover may be made of glass.
In an embodiment, the lens of each of the lens optical systems may be made of resin.
In an embodiment, each of the lens optical systems may have an angle of view of 120° or more in at least one direction.
In an embodiment, the cover may be water repellent.
In an embodiment, |f0|>50 fx may be satisfied, where f0 represents a focal length of the cover and fx represents the focal length of each of the lens optical systems.
In an embodiment, each of the lens optical systems may include n (n being an integer greater than 0) single lenses including the lens, and a k-th (k is an integer greater than 0 and equal to or less than n) single lens from a target-object-side end of each of the lens optical systems may be integrally formed with a k-th single lens from a target-object-side end of another lens optical system. The single lenses included in each of the lens optical systems may have the same shapes. The single lenses included in each of the lens optical systems may have different shapes. The k-th single lens from the target-object-side end of each of the lens optical systems may be fused with the k-th single lens from the target-object-side end of another lens optical system. The k-th single lens from the target-object-side end of each of the lens optical systems may be fixedly attached to the k-th single lens from the target-object-side end of another lens optical system.
In an embodiment, all single lenses included in each of the lens optical systems may be integrally formed with the single lenses of another lens optical system that are located at corresponding positions.
In an embodiment, the imaging regions may be provided in a single image sensor.
In an embodiment, the imaging regions may be respectively provided in a plurality of image sensors.
In an embodiment, the imaging apparatus may further include body tubes each housing the lens of each of the lens optical systems, in which a minimum distance between adjacent body tubes may be 15 mm or less.
In an embodiment, an angle between the optical axis of each of the lens optical systems and a normal to a tangent line at an end of an effective diameter of the cover across which light from the target object passes through may be 75 degrees or less.
In an embodiment, the lens optical systems may be arranged in one direction, and a cross section of the cover that is perpendicular to the one direction may have an arch shape. The cover may have a dome shape.
According to another aspect of the present disclosure, a distance measuring apparatus includes the imaging apparatus described in any of the above embodiments and a computation circuit, in which in operation, the computation circuit measures a distance to a target object based on a parallax of the target object in images obtained in imaging regions of the imaging apparatus. The computation circuit may measure the distance to the target object by using a baseline length between two lens optical systems, a focal length of each of the lens optical systems and the parallax of the target object in two images obtained in the two imaging regions of the imaging apparatus.
In an embodiment, the distance measuring apparatus may further include an output device that outputs information corresponding to the distance measured by the computation circuit.
The embodiments will now be described more specifically. In the description that follows, the same or like components are denoted with the same reference characters. In the description that follows, a signal or information representing an image may be referred to just as an “image”.
The imaging apparatus A also includes a casing B that houses and maintains the aforementioned components, and a circuit board P. On the casing B, a light-transmissive, dome-shaped cover L0 is disposed that covers the entire exposed portion of a first lens L1 positioned on the top of each of the first lens optical system La and the second lens optical system Lb. The cover L0 has a curved portion which is convex on the target object side (the upper side in
The first lens optical system La and the second lens optical system Lb have the identical structure and light gathering characteristics. The lens optical systems La, Lb each include the first lens L1, a stop S, and a second lens L2, which are held by a lens holder H. When the lens optical systems are ultrawide, the topmost first lens L1 is a concave meniscus lens that is convex on the object side as shown in
The first image sensor Na has an imaging region Ia and the second image sensor Nb has an imaging region Ib. The imaging region Ia is disposed so as to face the bottom surface of the first lens optical system La (the exposed surface of the lowermost lens in
Consider now a case where the cover L0 shown in
In contrast, by disposing the light-transmissive dome-shaped cover L0 so as to cover the exposed portion of the first lens L1 positioned on top of each of the first lens optical system La and the second lens optical system Lb as well as the entire portion between the two first lenses L1 as illustrated in
Next, an arrangement for applying the imaging apparatus described above to a distance measuring apparatus will be described.
Light from the target object for distance measurement (not shown) passes through the cover L0 and then forms an image in the imaging region Ia of the first image sensor Na and the imaging region Ib of the second image sensor Nb via the first lens optical system La and the second lens optical system Lb. The first image sensor Na and the second image sensor Nb generate and output a first image signal and a second image signal respectively. The computation circuit C applies calibrating correction such as coordinate and distortion corrections to the first and second image signals, thereby converting the first and second image signals into images adapted for parallax calculation based on pattern matching. Then, pattern matching is conducted between the two images. Specifically, focusing on a minute region of a predetermined number of pixels in the first image, an evaluation function is calculated while moving a minute region of the same size in the second image by one pixel at a time in the baseline direction (the horizontal direction in
Since in this embodiment the presence of the cover L0 which has a dome shape reduces the possibility of an unwanted object such as a water droplet or dust showing up in a captured image, situations in which accurate distance measurement cannot be performed can be reduced.
While this embodiment was described in the context of a structure with two lens optical systems, a structure with three or more lens optical systems arranged two-dimensionally is also possible. With two lens optical systems, an accurate distance measurement cannot be obtained when there is no light-dark contrast in a direction parallel to the baseline in an image because only one baseline direction exists. Also, as mentioned above, since the topmost lens of an ultrawide-angle lens is usually a concave meniscus lens that is convex on the object side as shown in
A structure with four lens optical systems La, Lb, Lc, Ld arrayed as shown in
With a structure having lens optical systems arranged two-dimensionally, distance measurement can be performed with the field of view shared among the multiple lens optical systems, so measurement over the entire view field of the angle of view provided by each lens optical system is possible. For instance, focusing on the pair of lens optical systems La and Lb in
Such an arrangement enables accurate distance measurement over a wide range. For example, when each lens optical system has an angle of view of 180°, distance measurement over the field of view area of a hemisphere is possible.
Specific methods for calculating a distance from multiple ultrawide-angle images as described above are disclosed by Japanese Patent Application No. 2013-258380 and a specification of U.S. patent application Ser. No. 14/555,643, for instance, the entire contents of which are incorporated herein.
The cover L0 in this embodiment will be described in more detail.
The cover L0 can be designed to have extremely small lens effect. As used herein, “extremely small lens effect” means that |f0|>50 fx is satisfied, where f0 represents the focal length of the light-transmissive cover L0, and fx represents the focal length of each of lens optical systems La and Lb, for example. Since the optical axis of each lens optical system is eccentric to the center axis of the cover L0, if the cover L0 has lens effect, asymmetry of optical characteristics, such as distortion, between the positive side and the negative side of the angle of view in each lens optical system would be large. Such asymmetry of optical characteristics can lead to reduced accuracy of distance measurement. In contrast, when the cover L0 has extremely small lens effect, optical characteristics such as distortion is more symmetric between the positive side and the negative side of the angle of view, preventing a reduction in distance measurement accuracy. It is noted that depending on the characteristics of lens optical systems, it can be desirable to intentionally impart lens function to the cover L0. In such a case, the focal length f0 of the cover L0 may be designed to be 50 fx or less.
The cover L0 may be made of glass. In a case where the imaging apparatus or the distance measuring apparatus according to this embodiment is installed on a vehicle, such as an automobile, for monitoring the rear view or the surroundings, it is usually installed outside the vehicle interior.
When the cover L0 is made of glass, the topmost lenses of the first lens optical system La and the second lens optical system Lb may be made of resin. For a lens optical system for monitoring the rear side or the surroundings of a vehicle, the topmost lens is typically composed of glass for protection against scratches. However, fabricating the cover L0 with glass permits the topmost lenses of the first lens optical system La and the second lens optical system Lb to be formed of resin. As glass lenses are generally more expensive than resin lenses, adopting resin lenses for the topmost lenses of the first lens optical system La and the second lens optical system Lb can keep the costs of the imaging apparatus A low.
Embodiment 2 differs from Embodiment 1 in that two imaging regions Ia and Ib are provided in a single image sensor. Detailed description of matters similar to Embodiment 1 is omitted and the difference will be mainly discussed.
By thus combining the image sensors corresponding to the first lens optical system La and the second lens optical system Lb into a single image sensor, relative inclination of the two imaging surfaces can be decreased compared to when separate image sensors are used. This can suppress reduction in the accuracy of distance measurement compared to the structure of Embodiment 1.
Although
Embodiment 3 differs from Embodiments 1 and 2 in that at least one lens included in each of lens optical systems is formed integrally with a corresponding lens of another lens optical system. In other words, assuming that each of multiple lens optical systems is composed of a combination of n (n being an integer greater than 0) single lenses including the topmost first lens L1, in this embodiment, the k-th (k is an integer greater than 0 and equal to or less than n) single lens from the target object side of each lens optical system is integrally formed with the k-th single lens from the target object side of another lens optical system.
While in Embodiment 1 the individual single lenses constituting each lens optical system are separate lenses, integral formation of the second lenses of the lens optical systems as in Embodiment 3 can keep the costs of the imaging apparatus A low.
In addition to the structure with integral formation of the second lenses of the lens optical systems, the first lenses of the lens optical systems may also be integrally formed into a compound-eye lens L1c as illustrated in
In a case where each lens optical system is formed from a combination of three or more single lenses, at least one pair of single lenses may be integrally formed. Also, when three or more lens optical systems are used, multiple single lenses located at the same position counted from the target object side may be integrally formed.
While the foregoing embodiments described the topmost lens (the surface closest to the target object) of each lens optical system as being a concave meniscus lens, a lens other than a concave meniscus lens may be used if each lens optical system is not ultrawide-angle. Additionally, the cover L0 does not necessarily have to cover the entire exposed portion of the lens optical systems because it can prevent a water droplet from standing in rainy conditions to a certain degree as long as it covers the exposed portion of the topmost lenses of the lens optical systems and the portion between the lenses.
The imaging apparatus and distance measuring apparatus according to the present disclosure are applicable to on-vehicle camera systems, for example. In addition to on-vehicle applications, they may be applied also to image capture systems such as endoscope cameras, for example.
Number | Date | Country | Kind |
---|---|---|---|
2014-093616 | Apr 2014 | JP | national |
This application a Continuation application of U.S. patent application Ser. No. 14/693,913, filed on Apr. 23, 2015, which claims the benefit of Japanese Application No. 2014-093616, filed on Apr. 30, 2014, the entire disclosures of which Applications are incorporated by reference herein.
Number | Name | Date | Kind |
---|---|---|---|
4997265 | Nishina | Mar 1991 | A |
6507700 | Takekuma | Jan 2003 | B1 |
8256112 | Kang | Sep 2012 | B2 |
8526112 | Baba | Sep 2013 | B2 |
9876992 | Imamura | Jan 2018 | B2 |
20050165508 | Kanda | Jul 2005 | A1 |
20050200978 | Tesar | Sep 2005 | A1 |
20060209185 | Yokoi | Sep 2006 | A1 |
20080151079 | Iijima | Jun 2008 | A1 |
20080304705 | Pomerleau | Dec 2008 | A1 |
20090043155 | Fujimori | Feb 2009 | A1 |
20090174804 | Iijima et al. | Jul 2009 | A1 |
20090207246 | Inami et al. | Aug 2009 | A1 |
20090225432 | Toyoda et al. | Sep 2009 | A1 |
20110080487 | Venkataraman et al. | Apr 2011 | A1 |
20110096400 | Ando et al. | Apr 2011 | A1 |
20110261472 | Yamakawa | Oct 2011 | A1 |
20120170119 | Chu et al. | Jul 2012 | A1 |
20120243093 | Tonar et al. | Sep 2012 | A1 |
20120250153 | Kawasaki et al. | Oct 2012 | A1 |
20120250165 | Do | Oct 2012 | A1 |
20130057732 | Uemura | Mar 2013 | A1 |
20140240469 | Lee | Aug 2014 | A1 |
20140247390 | Ohsumi | Sep 2014 | A1 |
20150138336 | Ueno et al. | May 2015 | A1 |
20150172543 | Laroia | Jun 2015 | A1 |
20150248772 | Gove | Sep 2015 | A1 |
20150296108 | Hayakawa et al. | Oct 2015 | A1 |
Number | Date | Country |
---|---|---|
2000-092357 | Mar 2000 | JP |
2001-318423 | Nov 2001 | JP |
2002-344786 | Nov 2002 | JP |
2005-128273 | May 2005 | JP |
2005-143991 | Jun 2005 | JP |
2007-043225 | Feb 2007 | JP |
2008-006301 | Jan 2008 | JP |
2009-164654 | Jul 2009 | JP |
2009-211012 | Sep 2009 | JP |
2010-194099 | Sep 2010 | JP |
2011-172174 | Sep 2011 | JP |
2012-215807 | Nov 2012 | JP |
2013-109268 | Jun 2013 | JP |
2013-112314 | Jun 2013 | JP |
2013-148634 | Aug 2013 | JP |
20100095260 | Aug 2010 | KR |
101011269 | Jan 2011 | KR |
2009153953 | Dec 2009 | WO |
2014017405 | Jan 2014 | WO |
2014171513 | Oct 2014 | WO |
Entry |
---|
The Extended European Search Report dated Nov. 4, 2015 for the related European Patent Application No. 15165544.6. |
Non-Final Office Action issued in U.S. Appl. No. 14/693,913, dated Dec. 12, 2016. |
Non-Final Office Action issued in U.S. Appl. No. 14/693,913, dated May 1, 2017. |
Notice of Allowance issued in U.S. Appl. No. 14/693,913, dated Sep. 29, 2017. |
Number | Date | Country | |
---|---|---|---|
20180109763 A1 | Apr 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 14693913 | Apr 2015 | US |
Child | 15843845 | US |