Patent Application
20200007790
The present invention relates to an operating method for a camera display system, in particular for a vehicle, to a camera display system as such, and to a vehicle, in particular a motor vehicle, a passenger car or a truck.
In the field of vehicle technology, in particular in motor vehicles, such as passenger cars and trucks, camera display systems that offer the user a reliable view of the environment of an underlying vehicle in a simple manner are increasingly used to improve comfort and safety. Here, existing mirror systems, for example side mirrors and rearview mirrors are frequently replaced by cameras and monitors. This reduces the movement effort, glance over the shoulder and the like, and also the necessity of having to concentrate on a plurality of points of view.
However, a hitherto unsolved problem in this case is the management of error events, for example, if one or more cameras of the display or parts thereof exhibit defects and a display is defective or fails.
The invention is based on the object of creating an operating method for a camera display system, a camera display system as such, and a vehicle, in which error events are manageable simply and in a reliable fashion and safety standards can be observed.
The object on which the invention is based is achieved in the case of an operating method for a camera display system according to the invention by the features of independent patent claim 1, in the case of a camera display system as such according to the invention by the features of independent patent claim 8, and in the case of a vehicle according to the invention by the features of independent patent claim 10. Advantageous developments are the subject matter of the respective dependent claims.
According to a first aspect of the present invention, an operating method for a camera display system, in particular for a vehicle, is created, wherein the camera display system is embodied with a camera system having a plurality of camera units and with a display system having one or a plurality of display units.
In the operating method according to the invention, camera units are used to capture images of an environment which are independent of one another, in particular in each case in the manner of a sequence of frames, for example, in the manner of a film. Images of the environment are displayed on a display unit, by way of image combination. Furthermore, an error status of camera units is captured. According to the invention, if an error occurs in a camera unit, the images of the environment of camera units without errors are combined into an image and displayed. In this way, it is possible to reliably use image sources which do not exhibit errors.
A particularly high degree of reliability is attained if, according to a preferred embodiment of the operating method according to the invention, the image of a camera unit having errors is overall not taken into account in a display.
However, frequently the error associated with a camera unit is not so grave that the image data generated by the faulty camera unit cannot to be used in a beneficial manner. For example, in accordance with another preferred embodiment, the image of a camera unit having an error is at least partially taken into account for the display. This assumes that the image of the camera exhibiting an error is evaluated using a corresponding evaluation method before it is used.
The camera units employed can be operated in different ways. This also depends on how the individual camera units are positioned and/or oriented in relation to one another.
For example, in another advantageous configuration of the operating method according to the invention, upon capturing images of the environment using one or more camera units, images of the environment are captured with a non-restricted or expanded field of view; in this case, the entire field of view of the respective camera unit is employed during the actual generation of images of the environment.
In addition or alternatively, in another embodiment of the operating method according to the invention, it is possible, when capturing images of the environment using camera units, for images of the environment to be captured with partially overlapping fields of view. This primarily produces somewhat of a redundancy of the image-recorded information, but there are advantages with respect to the safety aspects of the operating method, as will also be described below, because if camera units fail, corresponding overlap regions of other camera units can be used.
Display of the image information recorded by the camera units can be effected differently in a combined manner. In principle, the combined image representation in the manner of separated images is possible, for example in the form of a polyptych—as a generalization of a triptych for three images or a diptych for two images to n images. Alternatively or additionally, it is possible to produce from a plurality of initially separated images what are known as fusion images, in which mutually overlapping regions can be made to coincide by way of algorithms and calculation methods which are known per se so as to produce a common overlaying total image from a plurality of initially separate images of the environment and to display it.
For example, according to another development of the method according to the invention, in the error-free case upon display, images of camera units can be displayed in combination in the manner of a fusion image or in the manner of a polyptych with a number of frames, in particular with restricted field of view, preferably when overlapping fields of view of camera units and/or captured images.
Alternatively or additionally, in the case of an error upon display, images of camera units without errors can be displayed in combination in the manner of a fusion image or in the manner of a polyptych with a correspondingly reduced number of frames, in particular with non-restricted or expanded field of view.
The operating method according to the invention generally reflects the structure and configuration of the camera display system to be operated.
For example, in another development of the operating method according to the invention, in the case of an underlying vehicle, a left external mirror camera can be used as a first camera unit, a right external mirror camera can be used as a second camera unit, and a centrally arranged third camera unit, in particular in the manner of a stereo camera unit having a first and left camera and a second and right camera, and/or a reversing camera unit can be used as an auxiliary camera, in particular in the manner of a fisheye camera and/or in each case with a field of view which is oriented substantially counter to a main driving direction X of the underlying vehicle, as a camera system.
The safety level of the operating method according to the invention can also be useful with respect to the actuation of the display units.
For example, in another development of the operating method according to the invention, in the case of the presence of a plurality of display units, an error status of display units is captured and, upon occurrence of an error in a display unit, a display unit without errors is used for displaying the images, possibly by changing the display unit used, wherein, upon occurrence of an error in all display units, the generation and the outputting of an—in particular acoustic—warning signal is caused or performed, in particular by way of an audio system of the underlying vehicle.
It can furthermore be advantageous if, in accordance with another advantageous development of the operating method according to the invention, in an underlying vehicle, a rearview mirror display is used as a first display unit, a central console display is used as a second display unit, and/or a dashboard display is used as a third display unit as the display system.
Here, generally what is known as a rearview mirror display can be used as a primary display unit, because—in particular in the motor vehicle sector—this matches the viewing habits of a driver.
In accordance with a further aspect of the present invention, a camera display system—in particular for a vehicle—is also proposed.
The camera display system according to the invention is configured with a camera system having a plurality of camera units, with a display system having one or having a plurality of display units, and with a capturing and control unit, which is connected or connectable to the camera system and to the display system via at least one capturing and control line and is adapted to perform the operating method according to the invention.
In an exemplary embodiment of the camera display system according to the invention, the camera system has a left external mirror camera as a first camera unit, a right external mirror camera as a second camera unit, and a centrally arranged third camera unit, in particular in the manner of a stereo camera unit having a first and left camera and a second and right camera, and/or a reversing camera unit can be used as an auxiliary camera, in particular in the manner of a fisheye camera, and/or in each case with a field of view which is oriented substantially counter to a main driving direction X of the underlying vehicle.
Alternatively or additionally, in the camera display system according to the invention, the display system has a rearview mirror display as a first display unit, a central console display as a second display unit, and/or a dashboard display as a third display unit.
In accordance with a further aspect of the present invention, a vehicle, in particular a motor vehicle, a passenger car, or a truck, is also proposed. The vehicle according to the invention is embodied with a camera display system configured according to the invention.
Other objects, details, advantages and novel features of the present invention will become apparent from the following detailed description of one or more preferred embodiments when considered in conjunction with the accompanying drawings.
With reference to
The illustrated features and further properties can be isolated from one another in any desired form and combined as desired, without departing from the core of the invention.
The schematic illustration of
In accordance with
In the embodiment in accordance with
All camera units and cameras 1 to 6 are operatively connected to the capturing and control unit via a first capturing and control line 31 so as to be controlled or regulated.
The display system 20 consists of a first display unit 21 in the manner of a rearview mirror display or in the manner of a rearview mirror monitor in the spatial region of a rearview mirror which is typically provided in the vehicle 100, a second display unit 22 in the manner of a central console display or in the manner of a central console monitor in the region of a central console 107 of the vehicle 100, and a third display unit 23 in the manner of a dashboard display or in the manner of a dashboard monitor, which is arranged on the side of a steering wheel 105 of the vehicle 100 that faces away from the driver.
The first to third display units 21, 22, and 23 of the display system 20 are operatively connected to the capturing and control unit 30 via a second capturing and control line 32 so as to be controlled or regulated.
The capturing and control unit 30 is configured and set up according to the invention to perform an embodiment of the operating method according to the invention and in particular to ensure that, if an error occurs in one of the camera units 1 to 6, images of the environment of the camera units 1 to 6 are combined into an image without an error and displayed on at least one of the display units 21 to 23.
It is possible in this way that even in the case of a partial or complete failure of one or more of the camera units 1 to 6, a display of images of the environment that is relevant for the reliability of the operation of the vehicle on at least one of the display units 21 to 23 of the display system 20 is possible.
Illustrated here are an embodiment of the camera display system 40 according to the invention and the display system thereof, display units 21 to 23, and the camera system 10 thereof having camera units 1 and 3 to 6.
Furthermore, a capturing and control unit 30 is provided and operatively connected to the display system 20 and the camera system 10 and the components thereof. The corresponding first and second capturing and control lines 31 and 32 are not illustrated explicitly here. As an alternative to such lines, wireless connections are also feasible.
A respective
In the situations illustrated by
In
In the situation according to
If both the left external mirror camera 1 and the central camera 5 fail, according to
In the embodiment according to
In the embodiment according to
In accordance with an embodiment of the operating method according to the invention, if an error occurs in the region of the first display 21, a switch is performed to the second display unit 22 and/or to the third display unit 23.
If all display units one 20 to 23 exhibits an error, optionally an acoustic and/or haptic warning signal may be output that indicates this situation.
These and further features and properties of the present invention will be further explained on the basis of the following statements:
The present invention in particular relates to a motor vehicle 100, which is provided with a plurality of cameras 1 to 6 and is equipped with a computer device 30 for processing the images.
In addition, a method for operating a camera system 10 in a motor vehicle 100 is stated.
The present invention in particular proposes a degradation concept for camera display systems 40.
The degradation concept is to come into force under the following premises:
(a) In the case of an image failure or the loss of large image portions or if soiling is too great, the disturbance is recognized in time by way of the entire operative chain, for example using watchdog software.
(b) The architecture of the electrical system permits alternative signal travel paths.
In order to clarify the full scope of the invention, the concept will now be illustrated on the basis of the cases which have already been described.
Case 1: A failure of a camera 4 of the stereo camera arrangement 5 in the fused image according to
Case 2: A failure of a camera 1 of the sides in the fused image in accordance with
Case 3: A failure of two cameras in the fused image in accordance with
Case 4: A failure of a side camera 1 in the triptych in accordance with
Case 5: A failure of the rear camera 5 in the triptych in accordance with
Case 6: A failure of the two side cameras 1 and 2 in the triptych in accordance with
Case 7: A failure of a side camera 1 and a stereo camera 5 in the triptych in accordance with
Case 8: A failure of all cameras or of the display in accordance with
Case 9: A failure of the primary display 21, in particular in accordance with
(a) The central information display (CID) is immediately used for display. The head unit is to switch with prio 1 a panel similar to the parking panel and be superimposed on all other contents so that the customer is still able to drive to the repair shop.
(b) If the CID is not available or already has prio 1 notifications, the freely programmable combination display of the driver should be filled as per the format and only with the content of the rearward display. The display of the speed and of the transmission is then effected via the HUD.
Among others, the following advantages arise:
A breakdown is avoided or delayed for a long time over several defects, because at least two out of three devices remain intact for indirect view (in accordance with ECE-R46) and effect display.
The journey to the repair shop can always be made possible, because even after the failure of all CMS cameras and at least one screen, the surround-view cameras, for example within the meaning of a reversing camera 6, continue to make the same field of view possible, even though at lower resolution. Consequently, this multistage degradation concept practically always makes possible the journey to the repair shop, even though a plurality of faults would have already forced a vehicle having mirrors to make an emergency stop (both mirrors off).
The foregoing disclosure has been set forth merely to illustrate the invention and is not intended to be limiting. Since modifications of the disclosed embodiments incorporating the spirit and substance of the invention may occur to persons skilled in the art, the invention should be construed to include everything within the scope of the appended claims and equivalents thereof.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10 2017 204 168.4 | Mar 2017 | DE | national |
This application is a continuation of PCT International Application No. PCT/EP2018/055451, filed Mar. 6, 2018, which claims priority under 35 U.S.C. § 119 from German Patent Application No. 10 2017 204 168.4, filed Mar. 14, 2017, the entire disclosures of which are herein expressly incorporated by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/EP2018/055451 | Mar 2018 | US |
| Child | 16570236 | US |
