This application claims the priority of PCT International Application No. PCT/EP01/07492, filed Jun. 29, 2001 and German Application No. 100 35 223.5, filed Jul. 20, 2000, the disclosures of which are expressly incorporated by reference herein.
The invention relates to an apparatus and a method for monitoring the surroundings of an object.
It is known from British Patent GB 23 38 363 A to monitor the area behind a motor vehicle with the aid of video cameras fastened on the tail end of the vehicle, and to display the images supplied by the video cameras on a monitor in the driver's cab. In this case, the video cameras are intended to replace the rearview mirror of the vehicle and, in particular, to ensure a complete view rearwards with the exclusion of blind angles. Moreover, the individual images of the video cameras can be combined to form a panoramic image such that a larger overview of the area behind the vehicle can be displayed on only one image.
The monitoring apparatus disclosed in GB 23 38 363 A can be used as a substitute for one or more rearview mirrors, and offers the advantage, that a relatively large area to the rear can be displayed on an overall image and, further the overall image can be displayed on a monitor which is located in the driver's cab in the immediate area of view of the driver so that the driver can keep his head directed straight ahead and still have a view of the area behind.
It is a disadvantage of this arrangement that the individual images recorded by the individual cameras, which are combined to form the overall image in each case have approximately the same direction of view opposite to the forward driving direction of the vehicle, and it is therefore possible only with difficulty to estimate the distance from obstacles approaching the tail end of the vehicle, particularly because of perspective distortions.
The present invention addresses the problem of designing the monitoring of the surroundings of an object as simply as possible. The images supplied by a monitoring apparatus expediently reproduce the actual situation in a fashion which is largely free from distortions and can be detected directly.
The monitoring apparatus of the present invention includes a plurality of obstacle-detecting devices, in particular video cameras, where at least two directly neighbouring detecting devices have intersecting fields of view. The images are combined in an evaluation unit to form an overall image, the overlap area or intersection area being taken into account in the evaluation and being represented as a continuous transition between the individual displays of neighbouring detecting devices. Monitoring without gaps can be done with the aid of intersecting fields of view; blind angles and/or zones which cannot be reached between neighbouring detecting devices can be avoided.
For an optimum display, the object to be monitored is projected into the overall image and displayed on the optical display device as part of the overall image. As a result, the display device displays both the object to be monitored and the surroundings of the object which are to be monitored, and all the surrounding obstacles or foreign objects are put into an optical relationship with the object to be monitored. The monitoring person can immediately identify the relative position of the object to be monitored with reference to a foreign object on the display device. The overall image displayed on the optical display device is in this case expediently a reproduction of the actual situation which is true to scale and/or directionally acurate, and in this case, in particular, the longitudinal axis and the transverse axis of the vehicle displayed match the corresponding axes of the real vehicle.
The monitoring apparatus is expediently of self-adjusting construction, for example, in that identical pixels from the intersection region of neighbouring fields of view are identified.
It is possible to monitor both mobile objects and immobile objects. In the case of mobile objects, consideration is given, in particular, to monitoring vehicles such as passenger cars or lorries. It is possible by interconnecting a plurality of optical obstacle-detecting devices, of which two directly adjacent ones in each case have an intersecting field of view, to create an overall image. By using additional detecting devices, the overall image can be arbitrarily extended so that, if necessary, the entire area around the object—the entire area surrounding the vehicle in the case of vehicles—can be monitored, displayed on only one overall image and put into a relationship with the object to be monitored. Such an overall image represents a panoramic view such that the monitoring person, in particular the driver, can detect the overall external area around the object to be monitored, doing so with one glance.
The viewing axes of the detecting devices are advantageously directed towards the ground, as a result of which an overall image is produced which corresponds to the image from an aerial perspective, with the center of the overall image containing the object to be monitored. Particularly in the case of vehicles, this perspective can be detected quickly and simply by the monitoring person and/or the driver.
Within the overall image, the object to be monitored is expediently an artificially produced equivalent image which is projected into the overall image, for example as a simple graphic representation of the outline of the object. Particularly in the case of vehicles, the detecting devices are positioned in such a way that the lateral edges of the object are also still detected, in order to avoid blind spots and blind angles in the immediate vicinity of the object. The outer radius of the area to be monitored, at the centre of which the object to be monitored is located, is selected to be sufficiently large, particularly in the case of moving objects, in order to give the driver the possibility, at least when driving slowly, of taking evasive action or reacting by braking in the event of suddenly occurring obstacles. The obstacle-detecting devices are expediently mounted moveably on the object to be monitored so that it is possible when driving or else during standstill to pan out with increasing speed automatically or at the request of the monitoring person to a larger monitoring radius, it being possible in this case, if appropriate, to include a blind spot in the immediate near zone in relation to the object to be monitored. When use is made of cameras as detecting devices, a change in the field of view can also be carried out by zooming the camera image. The perspective of one or of a plurality of detecting devices can be set variably, for example via a joystick or similar operating elements.
Both optical systems such as cameras and scanning systems based on infrared, radar or acoustic oscillations as obstacle-detecting devices. The obstacle or the foreign object is scanned by the detecting device or detected optically and converted in the evaluation system into an overall optical image into which an image of the object to be monitored is projected.
The monitoring of the object can also be implemented as a background function by dispensing with a permanent display on the display device and the display only being activated when a triggering condition is fulfilled. For example, the background function can be activated for monitoring the vehicle during parking with the system deciding automatically, by evaluating the signals of the detection devices, whether the vehicle and the surroundings of the vehicle are displayed on the display device and/or a warning signal is to be produced.
Further advantages and expedient designs are to be gathered from the further claims, the description of the figures and the drawings.
a shows a representation of the monitoring apparatus from an aerial perspective,
b shows the overall image displayed on an optical display device,
a shows a schematic representation of the vehicle with semitrailer bent away from the vehicle,
b shows a representation, corresponding to
c shows a representation, corresponding to
a, b show a mobile detecting device with cameras which are able to be dismantled and loaded,
a shows a representation of the tail-end area of the vehicle in a side view with ultrasonic or infrared sensors, directed into the rear area, with a horizontal viewing axis parallel to the ground, and
b shows a representation, corresponding to
Identical components are provided in the following figures with identical reference symbols.
In the perspective representation according to
The cameras 4 are arranged distributed over the circumference of the vehicle 1 for the purpose of representing a 360° perspective. The cameras are fastened at approximately the same height in the upper area of the vehicle. The viewing axes of the cameras point obliquely downwards onto the ground; owing to the fact that the viewing direction of the cameras is inclined to the ground, an approximately elliptical field of view 6 is produced on the ground for each camera 4. In each case, two neighbouring cameras are aligned with one another in such a way that their fields of view 6 intersect on the ground. This produces a strip-shaped monitoring area surrounding the vehicle 1 without gaps. The intersecting surfaces in the fields of view 6 of neighbouring cameras are taken into account in the evaluation unit in such a way as to produce a sharp overall image advancing continuously from one field of view to the next. It is expedient for the viewing axes of directly neighbouring cameras 4 to lie substantially parallel to one another or to cover only a small angle, in order to ensure that neighbouring fields of view 6 have approximately the same perspective, with the result that no, or only slight, distortions are produced between neighbouring fields of view 6.
The viewing axes 5 have an angle inclined with reference to a perpendicular to the ground. The viewing axes 5 of the cameras 4 intersect at a point or penetrate a comparatively small hypothetical surface which is located over the vehicle 1 and marks an aerial perspective. This aerial perspective is indicated in
b shows the overall image, to be displayed to the driver on a monitor 7, of the vehicle 1 from the aerial perspective which is combined from the individual images shown in
In the case when, instead of cameras, use is made of alternative detecting devices, for example infrared, radar or acoustic devices with the aid of which the foreign object cannot be represented directly visually, it is possible in the evaluation unit to project into the overall image 8 artificial graphic objects which are intended to represent the foreign object.
It is necessary to determine the articulation angle α between the tractor 2 and semitrailer 3 in order to display as precise as possible a top view of the area surrounding the vehicle. In accordance with a first design, this can be carried out with the aid of an edge traction in which the side edges 10 and 11 of the tractor 2 and the semitrailer 3, respectively, which run onto one another are determined optically, and the angle β between the edges 10 and 11, which represents the complementary angle to the articulation angle α, is determined in the evaluation unit. The articulation angle α is then calculated as
α=180°β.
As represented in
As may be gathered from
The vehicle 1 represented in
As may be gathered from
a and 7b show a mobile detecting device which is designed as a camera 4 in the exemplary embodiment. In order to keep the number of requisite monitoring cameras to a minimum, it suffices when changing semitrailers in each case to fit a monitoring system only to the semitrailer currently used in each case. The mobile camera system shown in
In
a and 8b show the advantages of different arrangements and alignments of sensors 20 on the vehicle 1. In accordance with
In accordance with
Number | Date | Country | Kind |
---|---|---|---|
100 35 223 | Jul 2000 | DE | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP01/07492 | 6/29/2001 | WO | 00 | 6/17/2003 |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO02/09433 | 1/31/2002 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
5130794 | Ritchey | Jul 1992 | A |
5200818 | Neta et al. | Apr 1993 | A |
5247306 | Hardange et al. | Sep 1993 | A |
5670935 | Schofield et al. | Sep 1997 | A |
6115651 | Cruz | Sep 2000 | A |
6233004 | Tanaka et al. | May 2001 | B1 |
6373055 | Kerr | Apr 2002 | B1 |
6476731 | Miki et al. | Nov 2002 | B1 |
6515597 | Wada et al. | Feb 2003 | B1 |
20020039065 | Hsiang | Apr 2002 | A1 |
20020135573 | Kanamori | Sep 2002 | A1 |
20030030724 | Okamoto | Feb 2003 | A1 |
Number | Date | Country |
---|---|---|
4304005 | Aug 1994 | DE |
19923964 | Dec 1999 | DE |
0949818 | Oct 1999 | EP |
2338363 | Dec 1999 | GB |
59120877 | Jul 1984 | JP |