The invention relates to a method of displaying ego-vehicle surroundings within an ego-vehicle. Further, the invention relates to an apparatus for a vehicle adapted to carry out such a method.
A vehicle may include a driver assistance system that displays a vehicle surroundings for a vehicle passenger inside the vehicle in a display device, such as a screen. Such a driver assistance system may also be referred to as a surround-view-system and usually comprises one or more vehicle cameras which are mounted on the vehicle and have different viewing areas or allow different viewing angles on the vehicle surroundings.
For such a surround-view-system, representing the surroundings as good as possible is desirable. The vehicle cameras mounted on the outside of the vehicle are able to provide information of the surroundings. Thereby, it may be desirable to display objects and/or infrastructure components in the vehicle surroundings to enable the driver of the vehicle to see them.
However, an individual field-of-view of the one or more vehicle cameras may be obscured by the vehicle itself, for example by a part of its body etc. Consequently, if an object or infrastructure components in the vehicle surroundings are obscured by the vehicle car itself, displaying them is not possible resulting in a blind spot.
Therefore, there may be a need to provide a possibility for improved representation of an ego-vehicle surroundings in an ego-vehicle.
The subject-matter of the independent claims provides a possibility for improved representation of an ego-vehicle surroundings in an ego-vehicle. Advantageous embodiments and further developments of the invention are indicated in the dependent claims, the description and the accompanying drawings.
A first aspect provides a method of displaying or representing an ego-vehicle surroundings within an ego-vehicle. The method comprises the following steps:
The above method may be computer-implemented, and in particular may be carried out by an apparatus or a system, preferably a surround-view-system, as described below with respect to a second aspect. There may be two or more cameras mounted outside the ego-vehicle so as to have different viewing areas or allow different viewing angles on the ego-vehicle surroundings. As used herein, continuously capturing the ego-vehicle surroundings may comprise continuously acquiring images using the one or more cameras and storing them in one or more camera data sets, so as to preserve previous image data and/or previous frame data from the one or more cameras. The method may be initiated by turning the ego-vehicle on and/or by turning the surround-view-system on. The electrical charging base may be adapted to supply an electrical system of the ego-vehicle with electrical energy without contact, e.g. inductively, for example to charge an energy storage device of the ego-vehicle. For this purpose, the ego-vehicle may comprise an onboard counterpart for the electrical charging base, such as an onboard electrical charging device, of the ego-vehicle. The electrical charging base and/or the onboard counterpart may be comprise a pad. It may comprise one or more electrical conductive surfaces.
The provided method allows for improved representing the ego-vehicle surroundings within the ego-vehicle, and in particular to represent one or more objections and/or infrastructure components in the ego-vehicle surroundings, such as an electrical charging base, even when one or more field-of-views of the surround-view-system is obscured by the ego-vehicle itself. The provided method may allow to improve aligning the electrical charging base with the onboard counterpart, such as an onboard electrical charging device, of the ego-vehicle. This may improve or increase efficiency of ego-vehicle maneuver, and a respective target area, such as the electrical charging base, located within the blind spot may be reached with higher precision and/or faster. Further, there is no need for an additional sensing device adapted to detect an electrical charging base.
According to an embodiment, the method may further comprise displaying, within the ego-vehicle, the synthetic view replacing the blind spot with including a virtual representative of the obscured electrical charging base. Thus, aligning the electrical charging base with the onboard counterpart may be further improved, as an estimated current position of one or both thereof may be displayed within the ego-vehicle.
In an embodiment, the method may further comprise displaying, within the ego-vehicle, a virtual representative of at least a part of the ego-vehicle itself and a virtual representative of at least a part of an onboard electrical charging device of the ego-vehicle. Thus, aligning the electrical charging base with the onboard counterpart of the ego-vehicle may be further improved, as an estimated current position of one or both thereof may be displayed within the ego-vehicle.
According to an embodiment, the step of generating the synthetic view may further comprise constructing a historical ground plane view using at least one previous view captured by the camera and stored in the camera data set. Thus, there may be a realistic display or representation of the ego-vehicle surroundings, as the synthetic view is based on one or more previously captured images.
In an embodiment, the step of generating the synthetic view may further comprise rendering a blind spot ground plane. Thus, replacing the blind spot may be further improved by using quite realistic views or images, respectively.
According to an embodiment, the method may further comprise generating one or more overlay points, the overlay points or overlap points associated with the electrical charging base and/or with the onboard counterpart of the ego-vehicle. Thus, aligning the electrical charging base with the onboard counterpart of the ego-vehicle may be further improved, as an estimated current absolute position of one or both thereof and/or a relative position between both may be displayed within the ego-vehicle.
In an embodiment, the method may further comprise rendering an overlay or overlap of the electrical charging base and/or the onboard counterpart of the ego-vehicle on top of a body of the ego-vehicle, and in particular on a virtual representative thereof to be displayed. Thus, aligning the electrical charging base with the onboard counterpart of the ego-vehicle may be further improved, as an estimated current position of one or both thereof may be displayed within the ego-vehicle, as the current absolute position or the relative position may be determined more feasible.
According to an embodiment, the method may further comprise determining a proportion of an overlap between the electrical charging base included in the synthetic view and an onboard electrical charging device of the ego-vehicle, the physical electrical charging device of the ego-vehicle not being visible from inside the ego-vehicle.
In an embodiment, the method may further comprise displaying, within the ego-vehicle, a value, preferably represented by at least one of a percentage value, a ratio value or a graphical diagram, associated with the determined proportion of the overlap. Thus, the alignment may be determined even more precisely.
According to an embodiment, the method may further comprise estimating a charging duration of an onboard energy storage of the ego-vehicle based on the determined proportion of the overlap. For example, a higher degree of alignment, which can mean a higher degree of overlap, may provide a higher energy transmission between the electrical charging base and the onboard counterpart. Likewise, a lower degree of alignment, which can mean a lower degree of overlap, may provide a lower energy transmission between the electrical charging base and the onboard counterpart. On this basis, the charging duration, indicated as a time value, can be estimated. The estimated charging duration may be displayed within the ego-vehicle using, for example, a percentage value, a ratio value or a graphical diagram.
In an embodiment, the method may further comprise estimating a charging efficiency based on the determined proportion of the overlap. The efficiency may be proportional to the degree of alignment, so that the estimation can be performed on this basis. The efficiency may be displayed within the ego-vehicle using, for example, a percentage value, a ratio value or a graphical diagram.
A second aspect provides an apparatus or system for displaying ego-vehicle surroundings within an ego-vehicle, comprising:
Optionally, the apparatus or system may comprise one or more communication interfaces to obtain onboard vehicle information, such as ego-vehicle motion information, e.g. also from other onboard systems. It may optionally comprise a memory for storing a computer program comprising instructions, which when executed by a processor may carry out the method of the first aspect.
In the following, exemplarily embodiments of the invention will be explained in more detail with reference to the accompanying figures.
The figures are merely schematic representations and serve only to illustrate the invention. Identical or equivalent elements are consistently provided with the same reference signs.
For this purpose, system 100 comprises a display device 110 arranged in the interior of vehicle 1, e.g. in form of a screen capable for visually representing an image I. Furthermore, system 100 has a data processing means 120, which interacts with display device 110, with at least one processor and a memory device 130. In addition, system 100 has a plurality of vehicle cameras 140F, 140R, 140LL, 140LR mounted at different positions of vehicle 1 and having different field-of-views or view areas 141F, 141R, 141LL, 141LR. In particular, camera 140F is arranged at front, camera 140R is arranged at rear, camera 140LL is arranged lateral left and camera 140LR is arranged lateral right. Field-of-views or viewing areas 141F, 141R, 141LL, 141LR may be detected as the respective camera image I_F, I_R, I_LL, I_LR and be reproduced directly in display device 110 and/or possibly stored (at least temporarily) in memory device 130 as one or more one camera data sets. For representation of the vehicle surroundings, one or more of camera images I_F, I_R, I_LL, I_LR may be taken or combined by data processing means 120 to form or generate a view of the vehicle surroundings to be displayed in display device 110.
Vehicle 1 further comprises an onboard electrical charging device 200, which may be arranged in an area of an underbody, under the bonnet, under the trunk etc. of vehicle 1. It may be adapted to interact with an electrical charging base 300 located in or on the ground or near the ground in the vehicle surroundings for providing wireless charging, e.g. for charging an energy storage. Optionally, vehicle 1 may comprise an onboard energy storage (not shown), e.g. a battery, which may be adapted to be electrically charged by electrical charging base 300 via onboard electrical charging device 200. Both, electrical charging base 300 and onboard electrical charging device 200 may be adapted to charge without direct contact and/or to charge wireless, wherein a contact may be given. For this purpose, electrical charging base 300 and onboard electrical charging device 200 may comprise one or more electrical conductive surfaces, pins, or the like. It is noted, however, that it may be needed to align electrical charging base 300 and onboard electrical charging device 200 in order to electrically charge vehicle 1. Alignment may also be referred to as an overlay or overlap of said components in the vehicle vertical direction, which may be transverse or perpendicular to the x-y plane.
Still referring to
Still referring to
One or more of cameras 140F, 140R, 140LL, and 140LR may continuously capture the surroundings and store it in at least one camera data set. On basis of the captures and/or the camera data set, it may be automatically detected, within the captured images and/or frames of the ego-vehicle surroundings, whether or not electrical charging base 300 is present. Of course, detecting may also be performed manually by the vehicle passenger.
Further, from onboard data of vehicle 1 or by processing the captured images and/or frames to obtain odometry data or the like, vehicle motion information may be obtained. These vehicle motion information may comprise one or more of a direction in which the vehicle is oriented, a vehicle speed, a remaining distance towards electrical charging base 300, or the like.
Further, if a part of vehicle 1 causes the above-discussed blind spot to electrical charging base 300 by obscuring one or more field-of-views of cameras 140F, 140R, 140LL, 140LR, a synthetic view may be generated. The synthetic view may be adapted to replace the blind spot in display device 110. To generate the synthetic view at least one previous view, such as a captured image and/or frame, of the vehicle surroundings stored in the camera data set is used as a basis. For example, a historical view of ground plane G may be constructed using the previously stored camera data. Using the above vehicle motion information, the view may be motion-compensated and/or rendered. Further, the blind spot may be rendered on basis of some or all of said data. In display device 110, the generated synthetic view may be displayed which still shows electrical charging base 300 as this was included in the previously captured views, i.e. the previous image(s) and/or frame(s). As vehicle 1 continues to move, the synthetic view is further updated using one or more previous synthetic views, e.g. images and/or frames, as a basis. This means that the electrical charging base 300 remains visible in display device 110 even though it has not been able to be captured by cameras 140F, 140R, 140LL, 140LR for several images and/or frames.
Further, one or more overlay and/or overlap points between electrical charging base 300 and onboard electrical charging device 200 may be generated, determined, or the like. These one or more points may be rendered on a virtual representative of at least a part of vehicle 1 itself and a virtual representative of at least a part of onboard electrical charging device 200 of vehicle 1 and/or a virtual representative of the obscured electrical charging base 300. As a result, display device 110 may show the virtual representatives moving relative to each other.
Once electrical charging base 300 and onboard electrical charging device 200 are at least partially overlap, a proportion, such as a percentage, of alignment, i.e. a matching area, may be estimated and optionally displayed. This may be displayed figurative and/or graphically etc.
On this basis, an expected charging time and/or an efficiency of charging may be estimated and optionally shown to the vehicle passenger.
Number | Date | Country | Kind |
---|---|---|---|
19198696.7 | Sep 2019 | EP | regional |
This application claims priority to PCT Application PCT/EP2020/069953, filed Jul. 15, 2020, which claims priority to European Application 19198696.7, filed Sep. 20, 2019. The disclosures of the above applications are incorporated herein by reference.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2020/069953 | 7/15/2020 | WO |