1. Field of the Invention
The present invention relates to a collision prevention warning method and device, and in particular to a collision prevention warning method and device capable of tracking a moving object.
2. The Prior Arts
Nowadays, vehicles used as transport means has played an important and indispensable role in our daily life. However, in the crowded urban area, traffic accidents happen quite often. The causes of traffic accidents are many, and that are mainly due to environmental factor or human factor. In order to reduce the traffic accidents effectively, various vehicle driving safety warning technology have been developed to prevent collision of the driving vehicles, to raise driving safety.
For the driving safety warning devices, the most frequently utilized device is the GPS positioning system to detect the relative distance between an obstacle and the driving vehicle. However, the GPS is restricted by the environmental factor, for example, a vehicle is driving in a region studded with shielding objects, then the GPS can not detect the obstacle, so for the drivers, its application is limited. Other devices such as distance measuring sensor, image sensor can also be utilized. The distance measuring sensor is used to detect obstacle in a single direction; while the image sensor is used in wide area vision detection, to assist the driver to have a complete grasp of the relative distance between the driving vehicle and the obstacle, to reduce traffic accidents.
Moreover, in order to raise the accuracy of the estimated relative distance between a driving vehicle and an obstacle, a Kalman Filter Algorithm is proposed to estimate the relative distance between a driving vehicle and an obstacle, and the collision time. Yet, this algorithm is only applicable to an obstacle moving linearly, it can not predict the collision coming from objects of various directions to the driving vehicle, so its applicability is rather limited.
Therefore, presently, the design and performance of the driving safety warning method and device is not quite satisfactory, and it has much room for improvements.
In view of the problems and shortcomings of the prior art, the present invention provides a collision prevention warning method and device capable of tracking a moving object, to overcome the drawbacks and shortcomings of the prior art.
A major objective of the present invention is to provide a collision prevention warning method and device capable of tracking a moving object. It is capable of classifying obstacles into categories based on length and width of the obstacle, to track the moving conditions of the obstacle, and raise the accuracy of estimated collision time.
A secondary objective of the present invention is to provide a collision prevention warning method and device capable of tracking a moving object. Wherein, a Extended Kalman Filter Algorithm is used to track the movement of an obstacle, and filter out the noise generated during sensing. In this approach, it is applicable to an obstacle moving non-linearly, to reduce effectively the unstable jittering of the collision time estimated through using the Kalman Filter Algorithm of the prior art, hereby raising its reliability in application.
In order to achieve the above objective, the present invention provides a collision prevention warning method and device capable of tracking a moving object, that is installed on a vehicle, comprising the following steps. Firstly, capturing a plurality of continuous images, to identify at least an obstacle in these continuous images, and to obtain the image pixel characteristic parameters and the geometric characteristic parameters such as width and length of the obstacle. Then, utilize a binary tree sorter, to sort the obstacles into various categories speedily, to find at least a moving obstacle based on the categories of the obstacle. Since the moving obstacle can move linearly or non-linearly, therefore, the continuous relative positions of the moving obstacle and the vehicle are detected first, to estimate out the first collision region of the vehicle. Then, calculate the speed, direction, and position of the moving obstacle based on the continuous relative positions and through using an Extended Kalman Filter Algorithm, to obtain a second collision region of the moving obstacle. Finally, obtain a collision point based on the first collision region and the second collision region, to determine if the first collision region and the second collision region at least partially overlap each other. In case the answer is positive, calculate to obtain a collision time, and output an alarm signal to warn the driver in time; otherwise, repeat the step of capturing a plurality of continuous images.
In addition, the present invention provides a collision prevention warning device, installed on a vehicle, including: at least two image capturing units, a vehicle body signal sensor unit, an image processing module, a central processor(CPU), and an alarm unit. Wherein, the at least two image capturing units fetch a plurality of images in a front region of 180 degrees, to obtain near field images and far field image to enlarge the detection scope. The image processing module is connected electrically to the two image capturing units, to identify the relative positions of the vehicle and at least an obstacle in the images, and to obtain the geometric characteristic parameter such as length and width of the obstacle and the image pixel characteristic parameter. Then, use a binary tree sorter to sort the obstacles and among them at least a moving obstacle into various categories. The vehicle body signal sensor unit is used to sense the dynamic signal of the vehicle. The central processor is connected electrically to the vehicle body signal sensor unit and the image processing unit, and it utilizes the moving obstacle and the dynamic signal of the vehicle to calculate the relative positions of the moving obstacle and the vehicle, so as to estimate and obtain the first collision region of the vehicle. Then, it utilizes the Extended Kalman Filter Algorithm to obtain a second collision region of the moving obstacle, and then it estimates and obtains a collision point based on the first collision region and the second collision region. When the first collision region and the second region at least partially overlap, the central processor calculates a collision time, and outputs a control signal. The alarm unit is connected electrically to the central processor, to receive the control signal and output a corresponding alarm signal, to warn the driver in time of the impending collision.
Further scope of the applicability of the present invention will become apparent from the detailed descriptions given hereinafter. However, it should be understood that the detailed descriptions and specific examples, while indicating preferred embodiments of the present invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the present invention will become apparent to those skilled in the art from this detailed descriptions.
The related drawings in connection with the detailed descriptions of the present invention to be made later are described briefly as follows, in which:
The purpose, construction, features, functions and advantages of the present invention can be appreciated and understood more thoroughly through the following detailed description with reference to the attached drawings.
The present invention provides a reliable collision prevention warning method and device capable of tracking moving objects, that is able to provide more accurate alarm signal to the driver, informing him of the collision point and collision time, so that the driver may have a complete grasp of the relative position and direction of the driving vehicle and the obstacle, to prevent collisions and avoid traffic accidents.
Refer to
In the descriptions mentioned above, in addition to the two image capturing units 12 used to capturing images of the obstacle, it can also used in cooperation with at least a distance measuring sensor 22, that is installed on the vehicle and connected electrically to the central processor 18, to detect on time the relative positions of the moving obstacle and the vehicle. The distance measuring sensor 22 can be a radar sensor, an optical radar sensor, a super sonic sensor, or an infrared sensor.
To further understand the collision prevention warning method of the present invention. Refer to
Wherein, f is the focal length of the image capturing unit (such as the distance from the image plane to center of the lens); x, y are the pixel position of the image plane, namely the origin of the image plane. The origin is a center point of the image plane, such as 720*480 image, while (x,y) is the center point (360,240) of the image plane; X,Y,Z are the universal coordinates of the obstacle relative to the image capturing unit; and h is the installation height of the image capturing unit.
Through the processing of the image processing module 16, geometric characteristic parameter of length and width, and the image pixel characteristic parameter of the obstacle can be obtained, such that the obstacles can be sorted into various categories, such as pedestrian, motorcycle, large passenger truck, small passenger truck, or road environment. Wherein, Histogram of oriented gradient (HOG) or Haar Feature can be used to identify obstacle characteristic, and in cooperation with sorters, such as Support Vector Machine (SVM) sorter or Artificial Neural Network (ANN) sorter, to accurately sort the obstacles into categories such as pedestrian or motorcycle. Or the geometric characteristics of image width and height are used in cooperation with LDA characteristic space transformation to sort the obstacles into categories such as large passenger truck and small passenger truck. Subsequently, as shown in step S14, based on the category of the obstacle and the continuous moving images of the obstacle, the image processing module 16 finds and obtains at least a moving obstacle, namely the tracked moving object of the present invention.
Then, as shown in step S16, detect the continuous relative positions of the moving obstacle (such as a person) and the vehicle, to estimate and obtain the first collision region. Wherein, upon identifying the continuous images by the image processing module 16, it detects the continuous relative positions of the moving obstacle and the vehicle. Or, the integrated image capturing unit 12 and the distance measuring sensor 22 are used to detect the continuous relative positions of the moving obstacle and the vehicle. However, regardless of which way is used for detection, the first collision region of the vehicle can be estimated based on the continuous relative positions of the moving obstacle and the vehicle.
Since the moving obstacle 24 is not restricted to move linearly, in order to estimate more accurately the moving conditions of the obstacle, as shown in step S18, based on the continuous relative positions, the central processor 18 detects the relative distance and relative angle of the moving obstacle and vehicle, then estimate speed, direction, and position through using an Extended Kalman Filter Algorithm, and then obtain the second collision region of the moving obstacle. Wherein, the Extended Kalman Filter Algorithm includes the following equations:
Wherein, xpi is the position of the moving obstacle in x axis, ypi is the position of the moving obstacle in y axis, vi is the speed of the moving obstacle, φi is the direction of the moving obstacle, Δt is the input sampling time of the continuous relative positions of the moving obstacle and the vehicle, A is the status transformation model of the moving obstacle, {circumflex over (x)}i−1 is the estimated vector of the previous status, and {circumflex over (x)}k− is the present observation vector.
Subsequently, as shown in step S20, estimate a collision point based on the first collision region and the second collision region. As shown in
and after calculations, the distance between the position (B) of the vehicle 26 and collision point (C), and the distance between the position (A) of the moving obstacle 24 and collision point (C) can be obtained. Subsequently, as shown in step S22, the central processor 18 determines if the first collision region and the second collision region at least partially overlap each other. In case the answer is negative, repeat the step S10. Otherwise, it is quite possible that collision is going to happen in a few seconds. So, it executes the next step S24, namely, to estimate a collision time and issue an alarm signal, so that the driver may have a complete grasp in time of the relative positions and directions of the driving vehicle 26 and the moving obstacle 24, to prevent the accident from happening. Wherein, for the approach of estimating the collision time, refer to
Wherein, VA is the speed of the moving obstacle, ADM is the distance between the moving obstacle and the collision point, eA is the estimated error of the width of the moving obstacle, α is the error coefficient of the two image capturing unit capturing these continuous images, objw is width of the moving obstacle identified by the image capturing unit.
The longitudinal collision time (tBDM) of the vehicle 26 relative to the collision point (C) can be obtained through the following equation:
Wherein, VB is the speed of the vehicle, eB is an error range of speed of said vehicle, BDM is the distance between the vehicle position and the collision point.
Wherein, the longitudinal collision time refers to the time tADM required by the moving obstacle to reach the collision point (C) based on the speed of the moving obstacle and its distance ADM to the collision point (C), and the time tBDM required by the driving vehicle to reach the collision point (C) based on the speed of the vehicle and its distance BDM to the collision point (C). In case tADM and tBDM coincide, then that is the longitudinal collision time of the vehicle and the moving obstacle.
The determination of the lateral collision time refers to the scenario that, a lateral collision accident could first occur before the driving vehicle 26 and the moving obstacle 24 reaches the collision point, due to the overly large size in length or width of the moving obstacle (such as the large-sized container truck or the concatenated truck), such that the lateral collision time (tLSM) of the driving vehicle 26 and the moving obstacle 24 must be taken into consideration, and that can be obtained through the following equation:
Wherein, D is the straight line distance between the vehicle and the moving obstacle; the two inner angles ∠A , ∠B and the collision angle ∠C can be obtained based on the first collision region, the second collision region, and the collision point, and β is the error coefficient for the detected continuous relative positions of the moving obstacle and the vehicle. When tLSM is less than a preset value, that is the lateral collision time of the vehicle and the moving obstacle.
Therefore, upon obtaining the collision point and the collision time, the central processor 18 outputs a control signal to an alarm unit 20. Then, the alarm unit 20 will output an alarm signal to warn the driver of the impending collision. Wherein, the alarm unit 20 can be a displayer, capable of displaying the overlapped images of the first collision region and the second collision region, and collision time. Or alternatively, the displayer can incorporate an audio system, to inform the driver in both video and audio ways of the information related to the impending collision.
Finally, refer to
Summing up the above, in the present invention, the characteristics such as length and width are used to sort the obstacles into various categories, to track the movement of the obstacles, to raise the accuracy of the estimated collision time, and to improve the shortcomings of the prior art that, it can only identifies the static or moving obstacles, but is not able to handle the error of estimated collision point and collision time caused by the sizes of the driving vehicle and the moving obstacle.
Further, though in the prior art, the Kalman Filter Algorithm is used to track the movement of the obstacle, but that is limited to estimate the linear movement of an object. However, in fact, the moving obstacles move mostly in a non-linear way. Therefore, in the present invention, an Extended Kalman Filter Algorithm is used to track movement of the obstacle, that includes linear and non-linear movements of the obstacles. In addition, it can filter out the noise generated during sensing, and reduce effectively the unstable uttering of the collision time estimated through using the Kalman Filter Algorithm of the prior art, hereby raising its reliability in application.
The above detailed description of the preferred embodiment is intended to describe more clearly the characteristics and spirit of the present invention. However, the preferred embodiments disclosed above are not intended to be any restrictions to the scope of the present invention. Conversely, its purpose is to include the various changes and equivalent arrangements which are within the scope of the appended claims.