The present disclosure relates to a six-division around view monitoring system for assisted driving and method thereof; and more particularly to a six-division around view monitoring system using a plurality of cameras to generate six divisions of around view and method thereof.
With the advancement of technology, the performance of automobiles has also been continuously improved. How to improve the safety of driving is receiving considerable attention. An important factor for causing traffic accidents is that there are many dead corners during driving vehicles, which may result in traffic accidents easily. Especially during the process of parking the vehicles, it is easy to collide due to the dead corners since the distance between the vehicle and its surrounding vehicles or obstacles is relatively close.
However, traditional around view monitoring (AVM) system uses an image stitching method to present the front view image, the rear view image, the left view image and the right view image of the vehicle in a 2D stitching manner, which assists the driver to know the situation around the vehicle to avoid harming objects around the vehicle. This presentation (2D-AVM) makes the AVM system limited to small vehicles running at low speeds.
Hence, how to provide a six-division around view monitoring system for assisted driving at various speeds capable of solving the above-mentioned problems has become an important topic for the person skilled in the art.
In view of the above-mentioned problems, a six-division around view monitoring system for assisted driving and method thereof are provided in the present disclosure, which can effectively allow drivers to clearly view images around vehicles to avoid traffic accidents.
It is one objective of the present disclosure to provide a six-division around view monitoring system for assisted driving.
According to one exemplary embodiment of the present disclosure, a six-division around view monitoring system for assisted driving is provided. The system includes a plurality of image sensing components, a data processing device and a display device. The plurality of image sensing components are respectively located at a front side, a rear side, a left side, and a right side of the vehicle, for respectively obtaining a front view image, a rear view image, a left view image and a right view image by capturing various angles of views around a vehicle. The data processing device is coupled to the plurality of image sensing components, for receiving the front view image, the rear view image, the left view image and the right view image, for dividing the left view image into a left-front view image and a left-rear view image according to a first ratio, and for dividing the right view image into a right-front view image and a right-rear view image according to a second ratio. The display device is coupled to the data processing device, for displaying the front view image, the rear view image, the left-front view image, the left-rear view image, the right-front view image and the right-rear view image on a single picture to form a six-division around view image.
In one example, each of the plurality of image sensing components is a fisheye lens.
In one example, the data processing device further includes a camera installation correction module for determining a camera installation position and a camera installation angle according to horizontal reference lines and radiation vertical reference lines in a calibration plate.
In one example, the data processing device further includes a fisheye image correction module for causing radiation vertical reference lines in each picture to be presented in a straight line.
In one example, the data processing device further includes a fisheye image correction module for determining the first ratio, the second ratio and lengths of the left-front view image, the left-rear view image, the right-front view image and the right-rear view image according to radiation vertical reference lines in a calibration plate.
In one example, the data processing device further includes a fisheye image correction module for performing a first angle of rotation of the left view image and a second angle of rotation of the right view image according to radiation vertical reference lines in a calibration plate.
In one example, the data processing device further includes a six-division image generation module for determining relevant parameters of a lookup table required to generate a static six-division image, and for generating a static six-division image.
In one example, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a left side mirror and a second distance from the left side mirror to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to a right side mirror and a fourth distance from the right side mirror to the rear edge of the vehicle.
In one example, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a drive and a second distance from the driver to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to the driver and a fourth distance from the driver to the rear edge of the vehicle.
It is one objective of the present disclosure to provide a method for using a plurality of cameras to generate six divisions of around view.
According to one exemplary embodiment of the present disclosure, a method for using a plurality of cameras to generate six divisions of around view is provided. The plurality of cameras is located at a front side, a rear side, a left side, and a right side of a vehicle. The method includes the following steps: using the plurality of cameras to respectively obtain a front view image, a rear view image, a left view image and a right view image by capturing various angles of views around the vehicle; receiving the front view image, the rear view image, the left view image and the right view image; dividing the left view image into a left-front view image and a left-rear view image according to a first ratio, and dividing the right view image into a right-front view image and a right-rear view image according to a second ratio; and displaying the front view image, the rear view image, the left-front view image, the left-rear view image, the right-front view image and the right-rear view image on a single picture to form a six-division around view image.
In one example, each of the plurality of cameras is a fisheye lens.
In one example, the method further includes the following step: determining a camera installation position and a camera installation angle according to horizontal reference lines and radiation vertical reference lines in a calibration plate.
In one example, the method further includes the following step: causing radiation vertical reference lines in each picture to be presented in a straight line.
In one example, the method further includes the following step: determining the first ratio, the second ratio and lengths of the left-front view image, the left-rear view image, the right-front view image and the right-rear view image according to radiation vertical reference lines in a calibration plate.
In one example, the method further includes the following step: performing a first angle of rotation of the left view image and a second angle of rotation of the right view image according to radiation vertical reference lines in a calibration plate.
In one example, the method further includes the following step: determining relevant parameters of a lookup table required to generate a static six-division image, and generating a static six-division image.
In one example, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a left side mirror and a second distance from the left side mirror to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to a right side mirror and a fourth distance from the right side mirror to the rear edge of the vehicle.
In one example, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a drive and a second distance from the driver to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to the driver and a fourth distance from the driver to the rear edge of the vehicle.
These and other objectives of the present disclosure will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
Certain terms are used throughout the following descriptions and claims to refer to particular system components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not differ in functionality. In the following discussion and in the claims, the terms “include”, “including”, “comprise”, and “comprising” are used in an open-ended fashion, and thus should be interpreted to mean “including, but not limited to . . . ” The terms “couple” and “coupled” are intended to mean either an indirect or a direct electrical connection. Thus, if a first device couples to a second device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
The figures are only illustrations of an example, wherein the units or procedure shown in the figures are not necessarily essential for implementing the present disclosure. Those skilled in the art will understand that the units in the device in the example can be arranged in the device in the examples as described, or can be alternatively located in one or more devices different from that in the examples. The units in the examples described can be combined into one module or further divided into a plurality of sub-units.
Please refer to
As shown in
Basically, the installation positions of the four cameras (front, rear, left and right) in actual installation will be determined according to the following three conditions.
A1.1
Please refer to
A1.2
Please refer to
A1.3
Please refer to
Step A2
The fisheye image correction module 122 of the present disclosure completes the left and right images by using the radiation vertical reference lines in the calibration plate, and determines the lengths of the left-front view image, the left-rear view image, the right-front view image and the right-rear view image. This Step A2 includes the following two sub-steps:
A2.1
The fisheye image correction module 122 is used for performing a fisheye image correction. Please refer to
A2.2
The fisheye image correction module 122 is used for determining the lengths of the left-front view image, the left-rear view image, the right-front view image and the right-rear view image.
Please refer to
Be noted that, in one embodiment of the present disclosure, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a left side mirror and a second distance from the left side mirror to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to a right side mirror and a fourth distance from the right side mirror to the rear edge of the vehicle. In another embodiment of the present disclosure, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a drive and a second distance from the driver to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to the driver and a fourth distance from the driver to the rear edge of the vehicle.
Step A3
The six-division image generation module 123 is used for determining relevant parameters of a lookup table required to generate a static six-division image and for generating a static six-division image. Through the above two steps, the six-division image generation module 123 may determine the following two important parameters: the parameters of the fisheye correction, and the lengths of the left-front view image, the left-rear view image, the right-front view image and the right-rear view image. The relevant parameters of the lookup table of the image may be generated based on the above important parameters, and the result of the first stage static six-division image can be generated. The detailed description of this step is as follows.
A3.1
A lookup table that determines fisheye correction.
Please refer to
By using the same method (as shown in
A six-division around view monitoring system for assist driving is provided in the present disclosure, which can effectively enable drivers to clearly view the images around the vehicle to avoid occurrence of traffic accidents. In addition, a six-division around view monitoring system with 6 or 8 or more lenses on the market can save more cost.
Please refer to
In one example, each of the plurality of cameras is a fisheye lens.
In one example, the method further includes the following step: determining a camera installation position and a camera installation angle according to horizontal reference lines and radiation vertical reference lines in a calibration plate.
In one example, the method further includes the following step: causing radiation vertical reference lines in each picture to be presented in a straight line.
In one example, the method further includes the following step: determining the first ratio, the second ratio and lengths of the left-front view image, the left-rear view image, the right-front view image and the right-rear view image according to radiation vertical reference lines in a calibration plate.
In one example, the method further includes the following step: performing a first angle of rotation of the left view image and a second angle of rotation of the right view image according to radiation vertical reference lines in a calibration plate.
In one example, the method further includes the following step: determining relevant parameters of a lookup table required to generate a static six-division image, and generating a static six-division image.
In one example, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a left side mirror and a second distance from the left side mirror to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to a right side mirror and a fourth distance from the right side mirror to the rear edge of the vehicle.
In one example, the first ratio of the left-front view image to the left-rear view image is determined by a first distance from a front edge of the vehicle to a drive and a second distance from the driver to a rear edge of the vehicle, and the second ratio of the right-front view image to the right-rear view image is determined by a third distance from the front edge of the vehicle to the driver and a fourth distance from the driver to the rear edge of the vehicle.
Reference in the specification to “one example” or “an example” means that a particular feature, structure, or characteristic described in connection with the example is included in at least an implementation. The appearances of the phrase “in one example” in various places in the specification are not necessarily all referring to the same example. Thus, although examples have been described in language specific to structural features and/or methodological acts, it is to be understood that claimed subject matter may not be limited to the specific features or acts described. Rather, the specific features and acts are disclosed as sample forms of implementing the claimed subject matter.
The above are only preferred examples of the present disclosure is not intended to limit the present disclosure within the spirit and principles of the present disclosure, any changes made, equivalent replacement, or improvement in the protection of the present disclosure should contain within the range.
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the meters and bounds of the appended claims.
Number | Date | Country | Kind |
---|---|---|---|
201711477653.9 | Dec 2017 | CN | national |