Patent Application
20180167587
The present invention relates to a vehicle camera device for capturing the surroundings of a motor vehicle according to the preamble of claim 1. The invention also relates to a driver assistance device for detecting objects with such a vehicle camera device.
Driver assistance devices with one or more cameras are used for evaluating the surroundings of a motor vehicle, by way of example for evaluating lanes, traffic signs, stoplights and other road users. The cameras generally serve for image capture from the area in front of the motor vehicle in the direction of travel. Such cameras typically have an aperture angle of approximately 40-45 degrees.
Future applications such as detection of road users at junctions or stoplight detection when waiting at the front of the line require the largest possible aperture angle, also known as the horizontal image angle, to be able to detect objects in the peripheral area of the image as these are approached. In contrast, highly-automated driving, by way of example, calls for the detection of objects and road structures at a great distance as well, meaning that sufficient angular resolution is required.
From published application DE 10 2011 103 378 B3 a monitoring device is known with cameras, each of which has a plurality of image sensors, configured such that they each scan different areas of a scene with a variable object distance. The image sensors are in each case equipped with an optical device, which independently of the object distance provides the same resolution, and wherein the image sensors, which are intended for different object distances, have objects with different fixed focal lengths.
The object of the invention is to propose an improved vehicle camera device, allowing the detection of surroundings of the motor vehicle with the largest possible detection area and a sufficient angular resolution for detecting objects.
The object is achieved by a vehicle camera device with the features of claim 1 and by a driver assistance device with the features of claim 12. Advantageous or preferred embodiments of the invention are indicated by the dependent claims, the following description and the figures.
According to the invention, therefore, a vehicle camera device for capturing the surroundings of a motor vehicle is proposed. The surroundings involved are, in particular, those in front of the motor vehicle. The vehicle camera device may preferably be integrated with or connected to a driver assistance device, wherein the driver assistance device is configured in particular for detecting objects from the image data provided by the vehicle camera device. The vehicle camera device is preferably a camera to be arranged in the passenger compartment of the motor vehicle behind the windshield and aligned in the direction of travel.
In order to capture the surroundings, the vehicle camera device comprises a first and a second optronic unit. The first and the second optronic units each comprise an optical device for projection of light and at least or precisely one image sensor for detecting the light projected by the optical device. The optical devices of the first and second optronic unit are preferably configured with a fixed focal length. By way of example, the first and the second optronic unit are arranged together in a housing of the vehicle camera device. The integration of the two optronic units in the housing of the vehicle camera device achieves a compact, space-saving construction for the arrangement in the motor vehicle. The first and the second optronic units are preferably arranged in the same line of sight directly against each other, in particular alongside or on top of one another. Here, directly means at a distance running transversally to the line of sight of, by way of example, a maximum of ten centimeters, in particular a maximum of five centimeters, especially a maximum of one centimeter. Particularly preferably, the optical axes of the first and second optronic units run parallel to one another.
The first optronic unit is configured to capture a first detection area and the second optronic unit a second detection area of the surroundings. In particular, the image sensor and the optical device of the respective optronic unit together specify a horizontal and a vertical image angle, wherein the horizontal and vertical image angle span the detection area. In particular, the vehicle camera device is configured so that the first and the second detection area may be captured and processed independently of one another and/or transmitted as image data independently of one another to the driver assistance device for detecting objects.
The image angles of the first and the second optronic units are different in size. Particularly preferably, the horizontal image angle of the first and the second optronic units are different in size, so that the detection areas differ in particular in the horizontal direction. Alternatively, or optionally, the vertical image angles of the first and second optronic units are different in size, so that the detection areas differ in the vertical direction. The different-sized image angles of the detection areas allow the capture of objects in various areas of the surroundings of the motor vehicle with just one vehicle camera device.
The detection areas captured by the first and the second optronic units have an overlapping section. The overlapping section is thus an area of overlap of the first and second detection area. In particular, the same area of surroundings is imaged in the overlapping section captured by the first and second optronic units. In other words, the overlapping section of the first and second detection area is in each case an image section with the same image content. The overlapping sections captured by the first and second optronic units preferably have the same horizontal and/or vertical image angle, alternatively or optionally in each case also the same focal length.
The first optronic unit is designed such that the overlapping section captured by the first optronic unit has a different angular resolution, particularly preferably a reduced angular resolution, than in the rest of the first detection area. Thus, in the overlapping section, compared to the rest of the first detection area captured by the first optronic unit, a different angular resolution is implemented. For the different angular resolution, the structural design, by way of example, provides that the image sensor in the area capturing the overlapping section has a different, in particular lower, resolution than in the rest of the capturing area. This design has the advantage that a structurally simple and thus low-cost optical device with a constant angular resolution may be used. As an exemplary alternative, it may likewise be provided that the image sensor has a uniform pixel/cm resolution and the optical device is configured so that in the overlapping section a different angular resolution than in the rest of the first detection area is achieved.
Due to the overlap of the detection areas, a surrounding area is covered twice, so that it is possible for the object detection to evaluate just one of the two detection areas. Against this background, the different, in particular reduced, angular resolution in the overlapping section has the advantage that the calculation effort for processing the first detection area is limited to what is necessary. Capture of the rest of the first detection area, in particular with a higher angular resolution, on the other hand, allows object detection without, for example, a virtual pixel increase.
At the same time, the overlapping section has the advantage that the first and the second optronic units may be configured with different capture priorities. Thus, by way of example, it is possible to configure the first optronic unit with the largest possible detection area and thus also to capture peripheral areas, as may be necessary at a junction for detection of crossing road users or also for stoplight detection at the front of the line. Conversely, via the second optronic unit, for example a detailed capture in the overlapping section may be implemented, so that captured objects may be detected both at close range, by way of example at a distance of between 1 and 50 meters, and at long range, by way of example at a distance of between 50 and 500 meters. Consequently, with just one vehicle camera device object detection may be achieved both at different distances and in different surrounding areas of the motor vehicle.
According to a preferred development, in the overlapping section captured by the first optronic unit, an angular resolution of a maximum of 10 pixels per degree, in particular a maximum of 5 pixels per degree is implemented. Alternatively, or optionally, in each case in the rest of the first detection area an angular resolution of at least 30 pixels per degree, in particular of at least 40 pixels per degree is also implemented. In this way, the first optronic unit in the overlapping section implements a low, and, in the rest of the first detection area, a high image accuracy. In this way, only sub-areas, which are not captured by the second optronic unit, are provided with a high resolution quality for the object detection.
In a possible concrete implementation of the invention, the overlapping section captured by the first optronic unit is captured with a lower angular resolution than the overlapping section captured by the second optronic unit. In the overlapping section captured by the second optronic unit, an angular resolution of, by way of example, at least 20 pixels per degree, in particular of at least 40 pixels per degree, especially of at least 80 pixels per degree is implemented. In this way, a high image accuracy of the overlapping section is achieved by the second optronic unit.
The structural design is preferably such that the first optronic unit is configured with a larger image angle, especially with a larger horizontal and/or vertical image angle, than the second optronic unit. Consequently, the first optronic unit, compared to the second optronic unit, has a broader detection area. As a result of the larger image angle, objects close to the motor vehicle, especially to the front of the motor vehicle in the lateral and/or upper detection area of the vehicle camera device, such as for example crossing motor vehicles or stoplights in the vicinity of the motor vehicle, may be captured. By way of example, the first detection is captured by the first optronic unit with a horizontal image angle of at least 100 degrees, in particular of at least 120 degrees, especially of at least 130 degrees. Alternatively, or optionally, it is also provided that the first detection area is captured with a vertical image angle of at least 40 degrees, in particular of at least 50 degrees, especially of at least 60 degrees.
In a particularly preferred embodiment, it is provided that the overlapping section captured by the first optronic unit is a central image area and the rest of the first detection area is a marginal image area of the first detection area surrounding the central image area. The central image area is in particular a central subsection of the field of view of the vehicle camera device. The central image area and the marginal image area are preferably arranged concentrically to an optical axis of the first optronic unit. The first optronic unit is in particular configured and/or may be arranged to detect in the central image area the road traffic in front of the motor vehicle itself, such as for example vehicles ahead and in the marginal image area road traffic in the peripheral area such as for example crossing motor vehicles. With this structural design, therefore, the central image area is implemented with a different, especially reduced, image area compared to the marginal image area. Consequently, a high image accuracy is implemented by the first optronic unit in the marginal image area, so that detecting objects such as, for example, the stoplight detection described above, or crossing motor vehicles, is enabled.
In a further particularly preferred design of the invention, the second detection area corresponds to the overlapping section. In other words, with the second detection area exclusively the overlapping section corresponding with the first optronic unit is captured. Particularly preferably, the overlapping section captured by the second optronic unit corresponds to the central image area captured by the first optronic unit. In this way, it is possible for, for example, lanes, traffic signs or motor vehicles ahead at various distances in the central image area to be captured by the second optronic unit with the necessary angular resolution. This allows accurate and robust object detection.
Particularly preferably, the second optronic unit is configured with a horizontal and/or vertical image angle of at least 30 degrees and/or of a maximum of 50 degrees. The narrow image angle is an advantage in that by means of the optical device a bright second detection area is enabled and with a high image accuracy with very little or no aberrations in a low-cost manner. Consequently, object detection at close and far range is achieved in particular without the need for further image processing or correction.
A further object of the invention relates to a driver assistance device for detecting objects from the detection areas of the surroundings of the motor vehicle captured with a vehicle camera device according to the preceding description. In particular, the driver assistance device comprises the vehicle camera device or is connected with this or is integrated into the housing of the vehicle camera device. The objects to be detected preferably involve stoplights, lanes, traffic signs and/or other road users.
The driver assistance device preferably comprises an image evaluation device, wherein the vehicle camera device is connected with the image evaluation device for transmission of captured detection areas. The image evaluation device is in particular configured to evaluate an object contained in the image data transmitted by the vehicle camera device, in particular stoplights, lanes, traffic signs and/or other road users. Here it is, by way of example, possible that the image evaluation device evaluates the first and the second detection area independently of one another. In contrast, it is likewise possible that the vehicle camera device is configured so that the first and second detection area are combined to form an overall image, wherein in particular the overlapping section of the first detection area is replaced by the overlapping section of the second detection area. Where the overall image is intended to be output for display, an interpolation may take place such that the overall image appears without distortion to the viewer.
Further areas of applicability of the present invention will become apparent from the detailed description provided hereinafter. It should be understood that the detailed description and specific examples, while indicating the preferred embodiment of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
Further features, advantages and effects of the invention are indicated by the following description of preferred exemplary embodiments of the invention. Here:
The following description of the preferred embodiment(s) is merely exemplary in nature and is in no way intended to limit the invention, its application, or uses.
Corresponding parts are given the same reference numerals in all Figures.
A driver assistance system 1 described by way of example in the following and shown in
As shown schematically in
The first optronic unit 5 is configured to capture a first detection area 7 and the second optronic unit 6 a second detection area 8 of the surroundings. The optical devices of the optronic units 5, 6 are configured differently, so that the detection areas 7, 8 by way of example may be distinguished by their aspect ratio or also by distortions. The first and the second optronic units 5, 6 are configured to capture the detection areas 7, 8 with different horizontal image angles α1, α2. Not shown here, but alternatively or optionally also possible, the detection areas 7, 8 are captured by the optronic units 5, 6 with different-sized vertical image angles.
The horizontal image angle α1 of the first detection area 7 is configured to be larger than that of the second detection area 8. By way of example, the first detection area 7 is captured with a horizontal image angle α1 of at least 100 degrees. The second detection area 8 is, for example, captured with a horizontal image angle α2 of a maximum of 50 degrees. Therefore, in the first detection area 7 a larger area of surroundings is imaged than in the second detection area 8. In view of the different-sized image angle a structural design of the optronic units 5, 6 is possible which in the detection areas 7, 8 achieves object detection at various distances and in various areas of surroundings.
The first and the second detection areas 7, 8 have an overlapping section 9. The overlapping section 9 therefore concerns an area of intersection of the two detection areas 7, 8. In the overlapping section 9 of the detection areas 7, 8 in particular the same area of surroundings is imaged. Whereas the overlapping section 9 of the first detection area 7 relates merely to a sub-area of the first detection area 7, the second detection area 8 forms the overlapping section 9. Thus, the vertical and the horizontal image angle α2 of the second detection area 8 corresponds to the vertical and horizontal image angle α2 of the overlapping section 9.
In this exemplary embodiment, the overlapping section 9 captured by the first optronic unit 6 is a central image area and the rest is a marginal image area of the first detection area 7 surrounding the central image area. The first optronic unit 6 is, by way of example, configured and/or arranged to capture in the central image area the road traffic ahead, such as for example motor vehicles ahead, and in the marginal image area the road traffic in the peripheral area, such as for example motor vehicles crossing the motor vehicle 2 itself.
For detecting objects in the overlapping section 9, with this exemplary embodiment in the central image area the evaluation of just one of the overlapping sections 9 captured by the detection areas 7, 8 is necessary. Against this background, it is provided that the overlapping section 9 of the second detection area 8 is evaluated for the object detection. The evaluation of this overlapping section 9 is advantageous, since the second detection area 8 has a smaller horizontal image angle α than the first detection area 7. The narrow image angle has the advantage that through the second optronic unit 6 in the overlapping section 9 a high image accuracy with little or no distortions is enabled.
In
The first optronic unit 5 is, by way of example, configured so that an angular resolution x1 of the overlapping section 9 increases, starting from an optical axis A of the first optronic unit 5 as far as the marginal image area, in a rotationally symmetrical manner. In this exemplary embodiment, the first optronic unit 5 is configured in such a way that the angular resolution x1 of the overlapping section 9 increases exponentially, starting from the optical axis A of the first optronic unit 5 as far as the transition to the marginal image area, along the horizontal image angle α1. Possible exemplary alternatives may similarly be provided so that the angular resolution x1 increases linearly, starting from the optical axis A as far as the transition to the marginal image area, or does not experience any increase as far as the transition to the marginal image area. For example, a minimum value of the angular resolution x1 or the angular resolution x1 for the transition section 9 is five pixels per degree.
The first optronic unit 5 is also configured to capture the marginal image area with an evenly distributed angular resolution x2. By way of example, the angular resolution x2 of the marginal image area is 20 pixels per degree, so that sharp imaging of the marginal image area is implemented.
In
In
The description of the invention is merely exemplary in nature and, thus, variations that do not depart from the gist of the invention are intended to be within the scope of the invention. Such variations are not to be regarded as a departure from the spirit and scope of the invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2015 215 561.7 | Aug 2015 | DE | national |
This application claims the benefit of PCT Application PCT/DE2016/200299, filed Jun. 29, 2016, which claims priority to German Patent Application 10 2015 215 561.7, filed Aug. 14, 2015. The disclosures of the above applications are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/DE2016/200299 | Jun 2016 | US |
| Child | 15894413 | US |
