The present application is a U.S. National Stage of International Application No. PCT/EP2013/050129 filed on Jan. 7, 2013, which claims the benefit of German Patent Application No. 10 2012 000 176.2 filed on Jan. 7, 2012, and German Patent Application No. 10 2012 207 931.9 filed on May 11, 2012, the entire disclosures of all of which are incorporated herein by reference.
The invention relates to a camera arrangement and to a use of such a camera arrangement.
So-called TOF cameras (time-of-flight cameras) are known, which actively illuminate a scene, for example by means of infrared light, and determine the time of flight of the light used for the illumination by means of a sensor. On the basis of this, a distance of the illuminated object from the camera is then determined. Many of these TOF cameras can suppress background light which does not come from the camera light source.
DE 10 2009 001 159 A1 discloses a camera for detecting electromagnetic radiation in a first frequency range, comprising an electro-optical crystal, an analyzer and a detector array having a multiplicity of detectors for detecting electromagnetic radiation in a second frequency range. The analyzer is arranged between the electro-optical crystal and the detector array in the beam direction of the electromagnetic radiation in the second frequency range. A multiplicity of the detectors of the detector array respectively comprise a device for demodulating the electromagnetic radiation in the second frequency range.
It is an object of the present invention to provide a camera arrangement, which is improved in comparison with the prior art, and a use of such a camera arrangement.
The object is achieved according to the invention in respect of the camera arrangement by the features specified in claim 1, and in respect of the use by the features specified in claim 9.
According to the invention, the camera arrangement comprises at least one illumination device for illuminating a plurality of fields of view, at least one object to be detected respectively lying in the fields of view. According to the invention, the camera arrangement furthermore comprises at least one objective lens for focusing a beam path which comprises at least one of the plurality of fields of view. As an alternative, according to the invention the camera arrangement comprises at least one objective lens for focusing a plurality of beam paths, which respectively comprise at least one of the plurality of fields of view. According to the invention, the camera arrangement furthermore comprises a TOF sensor, the at least one illumination device, the at least one objective lens and the TOF sensor being arranged with respect to one another, and with respect to the fields of view and the objects lying therein, in such a way that images of the objects can be imaged simultaneously or in chronological succession on the one TOF sensor.
The camera arrangement is therefore formed in such a way that two or more fields of view (FOV) can be acquired with a single TOF sensor chip. This may be done by spatial superposition or by time division multiplexed methods.
It is advantageous in this case that only a single TOF sensor chip is required in order to detect a plurality of scenes. In this way, the camera arrangement can be configured more economically in comparison with one TOF sensor chip per scene.
In one refinement of the invention, two illumination devices are provided, a field of view respectively being illuminable by means of each illumination device, an objective lens respectively being arranged between the objects and the TOF sensor, and images of the objects being imagable in an at least partially common region on the TOF sensor. In this case, the two illumination devices are in particular coupled to a control device, the illumination devices being activatable independently of one another at different times by means of the control device.
In this case, two fields of view of two scenes are imaged simultaneously on one sensor. A superposition of the two images is thereby formed on the sensor chip. In order to image both fields of view, a beam splitter may be used. Nevertheless, other arrangements are possible for achieving superposed imaging of two fields of view on the sensor chip.
The TOF camera arrangement illuminates the scene actively and suppresses background light. By switching the illumination respectively onto only one of the scenes, the unilluminated scene is blocked out and only the field of view of the scene currently being illuminated is detected.
According to one configuration of the invention, one illumination device is provided, the fields of view being illuminable by means of the illumination device, a common objective lens being arranged between the objects and the TOF sensor, and images of the objects lying in the fields of view being imagable separately in different regions on the TOF sensor.
This means that the two fields of view are imaged on different regions of the sensor chip. In this way, both fields of view can be detected simultaneously.
In another configuration, two illumination devices are provided, a field of view respectively being illuminable by means of each illumination device, a common objective lens being arranged between the objects and the TOF sensor, and a controllable mirror being arranged between the objects and the objective lens, the mirror being controllable in such a way that either a beam path of a first field of view or a beam path of a second field of view can be delivered by means of it to the objective lens, and images of the objects being imagable in a common region on the TOF sensor.
In this case, the two illumination devices are again preferably coupled to a control device, the illumination devices being activatable independently of one another at different times by means of the control device. In particular, a first illumination device can be activated at a first time when the beam path of the first field of view is imaged on the TOF sensor by means of the mirror. A second illumination device can be activated in particular at a second time when the beam path of the second field of view is imaged on the TOF sensor by means of the mirror.
The regions of view are therefore detected by aiming the camera arrangement sequentially at different scenes. Each of the scenes only needs to be illuminated when the camera field of view is currently aimed at it.
According to one refinement of the invention, the mirror is a digital mirror, in particular a micromirror (so-called MEMS—microelectromechanical systems).
The camera arrangement may, for example, be used for distance measurement, a distance from the camera arrangement to the at least one object lying in the respective field of view being determinable from a time of flight of light emitted by means of the at least one illumination device to the fields of view.
In one refinement, the camera arrangement is used in a vehicle in order to monitor the heads of a driver and a passenger with only one TOF sensor. Furthermore, gestures, expressions, eye positions, viewing directions, seat positions, head positions and/or anthropometric features of the driver and/or passenger may be monitored inside the vehicle. The gestures are in particular hand gestures.
The invention will be explained in more detail with the aid of the appended schematic figures.
The objectives lens 4.1 focuses a beam path of a first field of view 7.1, in which a first object 8.1 to be detected lies.
The objective lens 4.2 focuses a beam path of a second field of view 7.2, in which a second object 8.2 to be detected lies.
The focused beam paths from the two objective lenses 4.1, 4.2 are delivered to the beam splitter 3 from different directions, superposed on one another there and imaged onto the TOF sensor 2.
The illumination device 5.1 is arranged in order to illuminate the first field of view 7.1.
The illumination device 5.2 is arranged in order to illuminate the second field of view 7.2.
The control device 6 controls the illumination devices 5.1, 5.2, preferably in such a way that in each case only one of the fields of view 7.1, 7.2 is illuminated at a time t1, t2.
The camera arrangement 1 is formed in such a way that background light is at least predominantly suppressed, and only light coming from the illumination devices 5.1, 5.2 and reflected by the object 8.1, 8.2 is detected.
In the case of illuminating both fields of view 7.1, 7.2, the TOF sensor 2 would detect both objects 8.1, 8.2 superposed on one another, so that an image A would be formed.
In the case of illuminating only the field of view 7.1 at a time t1, an image B on which only the object 8.1 is visible is formed on the TOF sensor 2, so that the distance to this object can be determined by means of time-of-flight determination of the light.
In the case of illuminating only the field of view 7.2 at a time t2, an image C on which only the object 8.2 is visible is formed on the TOF sensor 2, so that the distance to this object can be determined by means of time-of-flight determination of the light.
The objective lens 4.1 focuses a beam path which comprises two fields of view 7.1, 7.2, a first object 8.1 to be detected lying in the field of view 7.1 and a second object 8.2 to be detected lying in the field of view 7.2.
The focused beam path is imaged onto the TOF sensor 2, but in such a way that the field of view 7.1 is imaged on a first region 2.1 of the TOF sensor 2 and the field of view 7.2 is imaged on a second region 2.2 of the TOF sensor 2.
The illumination device 5 is arranged in order to illuminate both fields of view 7.1, 7.2.
The camera arrangement 1 is formed in such a way that background light is at least predominantly suppressed, and only light coming from the illumination device 5 and reflected by the object 8.1, 8.2 is detected.
An image D, on which the two objects 8.1, 8.2 are visible in separate regions, is formed on the TOF sensor 2, so that the respective distances to these objects can be determined by means of time-of-flight determination of the light.
The mirror 9 can be controlled by the control device in such a way that it delivers either a beam path of a first field of view 7.1, in which a first object 8.1 to be detected lies, or a beam path of a second field of view 7.2, in which a second object 8.2 to be detected lies, to the objective lens 4. The latter focuses the beam path and images it onto the TOF sensor 2.
The illumination device 5.1 is arranged in order to illuminate the first field of view 7.1.
The illumination device 5.2 is arranged in order to illuminate the second field of view 7.2.
The camera arrangement 1 is formed in such a way that background light is at least predominantly suppressed, and only light coming from the illumination devices 5.1, 5.2 and reflected by the object 8.1, 8.2 is detected.
When the mirror 9 is aimed at the field of view 7.1 at a time t1, an image B on which only the object 8.1 is visible is formed on the TOF sensor 2, so that the distance to this object can be determined by means of time-of-flight determination of the light.
When the mirror 9 is aimed at the field of view 7.2 at a time t2, an image C on which only the object 8.2 is visible is formed on the TOF sensor 2, so that the distance to this image can be determined by means of time-of-flight determination of the light.
The control device 6 can preferably control the illumination devices 5.1, 5.2 in such a way that in each case only one of the fields of view 7.1, 7.2 is illuminated at a time.
Number | Date | Country | Kind |
---|---|---|---|
10 2012 000 176 | Jan 2012 | DE | national |
10 2012 207 931 | May 2012 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2013/050129 | 1/7/2013 | WO | 00 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2013/102677 | 7/11/2013 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5086411 | Dalglish | Feb 1992 | A |
6041186 | Sensui | Mar 2000 | A |
8803967 | Oggier | Aug 2014 | B2 |
20080048887 | Aoki | Feb 2008 | A1 |
20080074894 | Decoster et al. | Mar 2008 | A1 |
20100128109 | Banks | May 2010 | A1 |
20100165323 | Fiess et al. | Jul 2010 | A1 |
20100283842 | Guissin et al. | Nov 2010 | A1 |
20110109748 | Lee | May 2011 | A1 |
20110215915 | Lee | Sep 2011 | A1 |
20110228251 | Yee | Sep 2011 | A1 |
20130107016 | Federspiel | May 2013 | A1 |
20130116049 | Pellman | May 2013 | A1 |
20130148845 | Maeda | Jun 2013 | A1 |
20130220392 | Gassert | Aug 2013 | A1 |
20140078514 | Zhu | Mar 2014 | A1 |
Number | Date | Country |
---|---|---|
101044043 | Sep 2007 | CN |
101130353 | Feb 2008 | CN |
102009001159 | Sep 2010 | DE |
H1141510 | Feb 1999 | JP |
2005-070447 | Mar 2005 | JP |
2006-224856 | Aug 2006 | JP |
2008-052029 | Mar 2008 | JP |
Entry |
---|
Office Action dated Apr. 22, 2015, received in corresponding Japanese application No. 2014-549504 and English translation, 6 pages. |
International Search Report received in corresponding International Application No. PCT/EP2013/050129. |
Office Action dated Aug. 7, 2015, received in corresponding Chinese application No. 201380004870.X, and English translation, 14 pages. |
Office Action dated Oct. 3, 2017, received in corresponding Japanese application No. 2016-142964 (3 pages) and English translation (3 pages). |
Number | Date | Country | |
---|---|---|---|
20150002664 A1 | Jan 2015 | US |