Patent Grant
11238730
The present invention relates to a traffic violation processing systems and more particularly, the present invention is directed to a system and method for detecting and recording traffic law violation events and storing one or more digitized images and other available data, such as speed, location, time, etc, to provide evidentiary records for traffic violation enforcement purposes.
Traffic law violators are known to be a major cause for traffic automotive accidents, which are a major cause of loss of life and property. It is estimated that over ten million people are involved in traffic accidents annually worldwide and that of this number, about three million people are severely injured and about four hundred thousand are killed. A report “The Economic Cost of Motor Vehicle Crashes 1994” by Lawrence J. Blincoe published by the United States National Highway Traffic Safety Administration estimates that motor vehicle crashes in the U.S. in 1994 caused about 5.2 million nonfatal injuries, 40,000 fatal injuries and generated a total economic cost of about $150 billion.
Various attempts have been made to improve traffic law enforcement. An example of a laser based system, is disclosed in U.S. Pat. No. 7,164,118 (hereinafter U.S. '118), by Anderson et al. U.S. '118 discloses a method of detecting presence of an object and the distance between the system and an object using a laser mounted on an industrial vehicle. The transmitter emits linear beams of electromagnetic radiation with a transmitted radiation pattern within a defined spatial zone. A camera collects an image of the defined spatial zone. A data processor detects a presence of an object in the collected image based on an observed illumination radiation pattern on an object formed by at least one of the linear beams. A distance estimator estimates a distance between the object and the optical device.
There are also prior art systems using imaging devices to image the scene in an angle 360° horizontally around a vehicle. Such a system is disclosed in US patent application 2004/0075544 (hereinafter U.S. '544), by Janssen Holger. U.S. '544 uses two optical sensors that act as a pair of stereo cameras. The sensors are coupled with fisheye lenses, which have a very wide-angle of 220°. Thus, a large portion of the surroundings of the motor vehicle may be detected but the very wide-angle lenses provide images with a large extend of distortion, and U.S. '544 does not disclose if the distortion is corrected. In U.S. '544 all sensors emit the sensed information to a single controller. U.S. '544 suffers from a tradeoff between covering large field of view and achieving detailed images of distant objects. Employing very high resolution cameras incurs a significantly high added expense. The same is true for other known 360° degree systems.
It would be desirable to provide an automated traffic violation monitoring system and method for tracking, identifying and recording traffic violations in a 360° field of view around the system. It would also be desirable to provide such a system and method that achieves detailed images of distant objects without the added bandwidth and expenses of very high resolution cameras. It would also be desirable to provide such a system and method that uses GPS location technology to provide comprehensive violation data as evidentiary records for traffic violation enforcement. It would also be desirable to provide a side-ways looking system to improve traffic violation detection and provide improved evidentiary records of traffic violations. Side looking cameras improve position estimation along the longitude axes which provides a more accurate assessment of the distance between vehicles. In addition, side looking cameras improve the ability and efficiency of tracking a vehicle moving between various fields of view, while maintaining a positive identification of the vehicle and an improved ability to assess a traffic violation such as passing on the wrong side.
Thus, there is a need for and it would be advantageous to have a system including multiple cameras mounted on a law enforcement vehicle or concealed therein, having side looking cameras, for automatically detecting and recording in real time traffic law violation events in a manner so as to provide evidentiary records for traffic violation enforcement purposes.
The term “Field Of View” (FOV) in general is the angular extent of a given scene, delineated by the angle of a three dimensional cone that is imaged onto an image sensor of a camera, the camera being the vertex of the three dimensional cone. The FOV of a camera is determined by the focal length of the lens: the longer the focal length, the narrower the field of view. The terms “Field Of View” of a camera and “viewing zone” of a camera are used herein interchangeably and are used herein to refer to the horizontal angular extent of a given scene, as imaged on to the image sensor of the camera. It is assumed that the dimensions of the detector are adapted to the camera FOV. The term “wide angle camera” in this documents refers to cameras with a FOV that is relatively wider then those of “narrow angle camera”
The term “an angle 360° around a vehicle” as used herein refers to the combined viewing zone as viewed by all wide FOV cameras. The combined viewing zone as viewed by all wide FOV cameras is not necessarily continuous, and there can be “blind” gaps between the viewing zones of two adjacent wide FOV cameras.
The term “primary relative directions” is used within the scope of this application to refer to the relative directions of forwards, backwards, to the left and to the right.
According to the present invention there is provided a system for detecting and recording real-time law violations, the system including: (a) an array of cameras providing a plurality of images of a substantially 360° field of view around a law enforcement unit; (b) a recording unit for recording the plurality of images from the array of cameras; and (c) an analyzing unit for analyzing the plurality of images so as to detect a law violation event.
According to further features in preferred embodiments of the invention described below, the array of cameras includes: (i) at least 4 wide angled cameras positioned to view primary relative directions and provide a substantially 360° field of view for detecting an object within the field of view; and (ii) at least one narrow angled camera operable to rotate in order to provide a plurality of close up images of at least one identification feature of the detected object, where the detected object is a vehicle or person and the identification feature is a license place, face, vehicle model and vehicle color.
According to still further features in the described preferred embodiments the system further includes (d) a permanent storage unit for permanently storing a plurality of images identified by the analyzing unit as representing a law violation event.
According to still further features in the described preferred embodiments the law enforcement unit is a permanently fixed unit, a vehicular unit or a transportable unit. According to still further features in the described preferred embodiments the recording unit is further configured to record data, for use as evidentiary material such as current speed of the law enforcement unit, the geographical location, current date and current time.
According to still further features in the described preferred embodiments the system further includes (e) a reporting unit, which is operable to report the detected law violation, and can be either a local citation issuing unit or a remote citation issuing unit.
According to still further features in the described preferred embodiments the wide angled cameras are fixedly mounted on the law enforcement unit or fixedly mounted in the law enforcement unit.
According to another embodiment there is provided a method for recognition of a law violation including the steps of: (a) acquiring a plurality of images; (b) recognizing a law violation by comparing a set of features from the plurality of images with a set of predefined rules for a law violation; and (c) issuing a citation.
According to further features in preferred embodiments of the invention described below, the method includes a further step of (d) storing a set of identification features of a law violating object from the plurality of images for identification of said violating object. According to still further features in the described preferred embodiments the law violating object is a vehicle. According to still further features in the described preferred embodiments the law violating object is a person. According to still further features in the described preferred embodiments the set of identification features can be a license plate, a vehicle model, a vehicle color or a face.
According to still further features in the described preferred embodiments the law violation can be: an illegal changing of lanes such as crossing a solid line or changing lanes without prior indication of a turn signal. According to still further features in the described preferred embodiments the citation can be issued by a local citation unit or a remote citation unit.
According to the present invention there is provided a mechanism including: (a) at least one wide-angled camera for providing a plurality of images; (b) a processor for processing the plurality of images so as to determine a region of interest; and (c) at least one narrow angled camera operationally coupled to the processor operable to rotate in order to provide a plurality of higher quality images of the determined region of interest. According to further features of the described embodiment the wide angle camera is further configured to provide a wide angled image for every narrow angled image at substantially the same time, with a potential time delay of, but not limited to, 20 milliseconds.
The present invention discloses an improved system and method for detecting in real time traffic law violation events, preferably in an angle 360° around the host vehicle.
The traffic law violation detection and recording system and methods detect target vehicles in a series of image frames obtained from one or more cameras and records video and relevant data to provide evidentiary records for traffic violation event. The recorded video of a traffic law violation event typically includes several seconds before the traffic law violation event and a few seconds after the conclusion of the traffic law violation event. The relevant data may include the host vehicle speed, geographical location, time, close-up image of ID object, or any other relevant data.
The traffic law violation detection and recording system includes a multiple number of cameras, each with a wide angle lens, that combine to encompass the scene around the vehicle. Each wide angle camera FOV is, preferably, tangential to the FOV of the next neighboring wide angle camera, but may have some overlap with the FOV of the next neighboring wide angle camera or may have a blind gap with the FOV of the next neighboring wide angle camera. The traffic law violation detection and recording system further includes at least one and preferably two narrow angle cameras to record close-up images of one or more identification (ID) features of a detected traffic violation vehicle. The ID objects can be the detected vehicle, the license plate of the detected vehicle, the driver of the detected vehicle and/or any other evidentiary object. The narrow angle cameras can typically move in the PAN direction or PAN and TILT directions, such that they can be quickly aimed to acquire a close-up image of a selected. ID object.
According to the present invention there is provided a method for detecting and recording in real time a traffic law violation event, by a traffic law violation detection and recording system mounted on a host vehicle, according to embodiments of the present invention. When the traffic law violation detection and recording system is operated, the system starts monitoring the scene in an angle 360° horizontally around the host vehicle using N wide angle cameras. Typically, the system also acquires available relevant data, such as the speed of the host vehicle, the geographical location of the host vehicle, the time and day and other available relevant data. The system continuously records video image frames from N cameras into a temporary memory, keeping video back for a predetermined amount of time, dependent on the memory size and predefined buffer size selection.
Upon the entering of a target vehicle (or any other object such as, but not limited to, a person) into a zone viewed by a wide angle camera, the target vehicle is detected automatically by system processor. The behavior of the target vehicle is then analyzed either automatically by system processor, or manually by the operator of the system. The system also detects identifying objects of the target such as the target vehicle, the license plate of the target vehicle, the driver of the target vehicle etc. A narrow angle camera is then directed to each detected identification object and the acquired image frames from the narrow angle camera are then recorded in a temporary memory. When a traffic law violation event is detected, all the recorded video, images of identification objects, ID objects images, and other relevant data is saved to document the detected traffic violation event including video that was kept in temporary memory, for future use, for example, for issuing and handling a citation or as evidence for the occurrence of traffic violation event. The system or another system may then issue a traffic citation based on the traffic violation event data obtained and recorded.
In an optional embodiment, optical recognition software can be used to convert the image of the license plate into an equivalent alpha-numeric digital format. The license plate number can then be automatically checked for outstanding violations such as unpaid parking tickets or that the car has been reported as stolen. In this manner, the law enforcement vehicle servers as a mobile unit for additional vehicle related violations, not only current traffic violations.
The present invention will become fully understood from the detailed description given herein below and the accompanying drawings, which are given by way of illustration and example only and thus not limitative of the present invention.
The present invention is of a system mounted on, or inside, a host vehicle, typically a law enforcement vehicle, and methods for detecting in real time traffic law violators around the host vehicle and recording evidence of traffic low violations. The traffic law violation detection and recording system includes multiple wide angle cameras that combine to encompass the scene around the host vehicle, and at least one narrow angle camera to record close-up images of one or more identification (ID) objects of a detected traffic violation vehicle. The traffic law violation detection and recording system and methods detect target vehicles in a series of image frames obtained from one or more cameras and records video and or relevant data to provide evidentiary records for traffic violation event.
The principles and operation of a system and method for detecting in real time traffic law violators around the host vehicle, in a series of images obtained from a series of cameras mounted on a host law enforcement vehicle to provide evidentiary records for traffic violation event, according to the present invention, may be better understood with reference to the drawings and the accompanying description.
Before explaining embodiments of the invention in detail, it is to be understood that the invention is not limited in its application to the details of design and the arrangement of the components set forth in the following description or illustrated in the drawings. The invention is capable of other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
By way of introduction, a principal intention of the present invention is to provide a system and method for detecting in real time traffic law violators, preferably in an angle 360° around the host vehicle. The traffic law violation detection and recording system includes a multiple number of cameras, each with a wide angle lens, that combine to encompass the scene around the vehicle. Each wide angle camera FOV is, preferably, tangential to the FOV of the next neighboring wide angle camera, but may have some overlap with the FOV of the next neighboring wide angle camera or may have a blind gap with the FOV of the next neighboring wide angle camera. The traffic law violation detection and recording system may further include one and preferably two narrow angle cameras to record close-up images of one or more identification (ID) objects of a detected traffic violation vehicle. The ID objects can be the detected vehicle, the license plate of the detected vehicle, the driver of the detected vehicle and/or any other evidentiary object. A region in an image frame containing one or more ID objects is referred to as a region of interest (ROI). A narrow angle camera operable to rotate substantially 360° so as to narrowly focus on the ID objects The traffic law violation event detection and recording system and methods detect target vehicles in a series of image frames obtained from one or more cameras and records video and relevant data to provide evidentiary records for traffic violation event. The relevant data may include images of ID object, the host vehicle speed, geographical location, time or any other relevant data. The detection of a traffic law violating target vehicle can be performed automatically by the processor of the traffic law violation detection and recording system, and/or manually, by a system operator.
Implementation of the method and system of the present invention involves performing or completing selected tasks or steps manually, automatically, or a combination thereof. Moreover, according to actual instrumentation and equipment of preferred embodiments of the method and system of the present invention, several selected steps could be implemented by hardware or by software on any operating system of any firmware or a combination thereof. For example, as hardware, selected steps of the invention could be implemented as a chip or a circuit. As software, selected steps of the invention could be implemented as a plurality of software instructions being executed by a computer using any suitable operating system. In any case, selected steps of the method and system of the invention could be described as being performed by a data processor, such as a computing platform for executing a plurality of instructions.
Referring now to the drawings,
Referring now to
In embodiments of the present invention, traffic law violation detection and recording system 100 automatically detects traffic law violation events using analyzer 122. Analyzer 122 automatically detects vehicles as they enter the FOV. In embodiments of the present invention, cameras control 126 aims narrow cameras 60 towards ROI of detected vehicles. In embodiments of the present invention, traffic law violation detection and recording system 100 automatically analyzes images of ROI to identify the traffic law violator, using analyzer 124.
Processor 120 either issues a citation using citation issuing unit 150 or provides the collected data to another processing unit or operator to take action against the traffic law violator.
Methods according to different embodiments of the present invention analyze in real time image frames 51, using processor 120 to detect target vehicles or pedestrians in image frames 51 and analyze the behavior of the detected target vehicles or pedestrians to see if a traffic law is violated. Processor 120 is a general purpose microprocessor, a processor implemented using digital signal processing (DSP) or an application specific integrated circuit (ASIC) or a combination of the different technologies.
It should be noted that a one time calibration procedure is performed when the cameras 50 and 60 are installed on vehicle 10. From a one time calibration procedure, the position of each camera in host vehicle 10 and the azimuth each camera optical axis relative to the longitudinal axis of vehicle 10 is measured and stored in processor 120.
Multiple Camera Configurations Examples
Referring now to
Referring now to
Placing N cameras in a concentric configuration is often not practical on a law enforcement host vehicle 10. Often, system 100 is installed on a concealed law enforcement vehicle 10 and in other cases on a regular vehicle. In such, cases, at least a portion of cameras 50 and 60 are placed inside vehicle 10. Cameras 50a and 60a are typically placed behind the windshield (typically near the rear view mirror), cameras 50d and 60b are typically placed behind the rear window, camera 50b is typically placed behind the rear right window and camera 50c is typically placed behind the rear left window. Hence, the cameras are often placed in a non-concentric configuration.
Reference is now made to
Reference is now made to
It should be noted the FOV angles of the various cameras 50, are given by way of example only. Specifically, referring back to
It is noted that dedicated right and left looking cameras allow the detection system to track the progress of a vehicle from a position behind the host vehicle, around to the side and finally in front of the host vehicle. The traffic violation detection system can assess that the same vehicle passed from the back to the front of the host vehicle, as there is provided an unbroken line of sight with the offending vehicle. This is not true for systems with only forward and backward looking cameras. In addition, having a right and left looking camera improves the accuracy of determining the relative distance between vehicles, a process that is severely impaired when lacking side looking cameras.
Reference is now made to
While cameras 50 are typically affixed to host vehicle 10 and all parameters are fixed and known (from a one time calibration procedure), cameras 60 can typically move in the PAN (θ) and TILT directions, such that they can be quickly aimed to acquire a close-up image of the selected ROI. Employing various optical techniques to replace or enhance the currently described system is envisioned. Such optical techniques can include, in a non-limiting example, a mobile array of mirrors. Cameras 60 have typically a very narrow FOV and a large PAN moving range typically enables to acquire a close-up image of all or most of the FOV of a corresponding wide angle camera 50. Potentially cameras 60 are only configured to PAN but not TILT. Camera 60a is able to acquire a close-up image of all or almost all of the FOV of camera 50a. Camera 60b is able to acquire a close-up image of all or almost all of the FOV of camera 50b.
Cameras 50 are typically operationally coupled to cameras 60 as so camera 50 grabs an image at substantially the same time as the corresponding camera 60 grabs an image. Combining a close-up image taken by camera 60 with a wide field of view image taken by camera 50 at substantially the same time, resembles a wide field of view image with very high resolution at a small ROI.
Camera 50a has a FOV of 53° Camera 50a resolution acquires images having 768 columns, which enables reading of the license plate number from a distance of 1-7 meters away.
Camera 60a has a FOV of 7.4° and can move horizontally ±18° (θ=18°). Camera 60a resolution acquires images having 768 columns, which enables identifying in license plate from a distance of 7-50 meters away.
Thereby, in system 100 of this example, a license plate can be read within a range of 1-50 meters away from cameras 50a and 60a.
Methods of the Present Invention
Referring back to
Upon the entering of a target vehicle 30 and/or a pedestrian and/or any other object (hereinafter referred to as “object 30”) into a zone 52 viewed by a camera 50, object 30 is detected automatically by system processor 120 (step 240). The behavior of object 30 is then respectively analyzed either automatically by system processor 120 (step 244), or manually by the operator of system 100 (step 246) if not analyzed automatically in step 240. If no traffic law violation is detected, system 100 proceeds monitoring the scene around host vehicle 10. While monitoring a detected object 30, system 100 proceeds with the following steps of method 200:
Step 250: identifying ID objects in an image frame 54 containing object 30, detected in step 240.
Referring back to
Upon the entering of a target vehicle 30 and/or a pedestrian and/or any other object (hereinafter refer to as “object 30”) into a zone 52 viewed by a camera 50, object 30 is detected automatically by system processor 120 (step 340). The behavior of object 30 is then respectively analyzed either automatically by system processor 120 (step 344), or manually by the operator of system 100 (step 346), if not analyzed automatically in step 340. If no traffic law violation is detected, system 100 proceeds monitoring the scene around host vehicle 10. System 100 proceeds with the following steps of method 300:
Step 348: A traffic law violation event is detected.
For the sake of clarity, it should be noted that traffic law violation detection and recording system 100 may include any number of wide angle cameras 50 and any number of narrow angle cameras 60. It should further be noted that adjacent viewing zones 52 may be overlapping, tangential or separated by a gap. For the sake of clarity, it should be noted that traffic law violation detection and recording system 100 may be mounted on any vehicle, not necessarily on a law enforcing vehicle. Various other permanent and transportable law enforcement units are envisioned.
Tracking of a detected object 30 can be done automatically by system processor 120. When a monitored object 30 departs from an image frame 54 provided by a camera 50 and enters image frame 54 of the next neighboring camera 50, monitoring of detected object 30 will then proceed using the second image sensor 50.
Traffic law violation detection and recording system 100 may further include a control unit, including a control panel, to enable an operator to operate system 100. An operator will be able to power up and down system 100. An operator may be able to have a button for each or selected traffic laws to classify a detected traffic law violation event. An operator may be able to notify a remote center on a detection of a traffic law violation event. The control unit may include any other feature, such as buttons, lights, switches and the like, for any other functional feature of system 100.
In embodiments of the present invention, traffic law violation detection and recording system 100 includes cameras with zoom-in capabilities, thereby the capabilities of a wide angle camera 50 and the capabilities of a narrow angle camera 60 are integrated in the current embodiments into a single camera.
In embodiments of the present invention, traffic law violation detection and recording system 100 includes wide angle cameras 50 having very high resolution thereby no narrow angle cameras 60 are required. Referring back to
Traffic violation detection and recording system 100 employs algorithms known in the art for the detection of traffic violations using image processing. Additional, innovative algorithms are detailed below.
Traffic Violation Rules
Illegal Lane Change Detection
Traffic violation detection and recording system 100 detects and tracks vehicles using front and/or back looking cameras 50 by means of image processing. The system also detects road surface markings that may not be crossed (such as a solid line) according to the country laws in front and/or back looking cameras 50 by means of image processing. For the purposes of this document, the term “solid line” refers to any type of road marking which denotes the illegality of a vehicle crossing such line.
Let I be an image received from a front or back looking camera 50. Let x1 be the horizontal coordinate of the leftmost pixel that was detected as being part of detected vehicle in image I. Let x2 be the horizontal coordinate of the rightmost pixel that was detected as being part of detected vehicle in image I. Let y be the vertical coordinate of the lowest pixel that was detected as being part of detected vehicle in image I. Let x be the horizontal coordinate at which a detected road surface marking that may not be crossed passes through raw y of image I. An automatic detection of traffic law violation is declared when the relation between x, x1, x2 is: x1<x<x2.
Changing Lane without Turning on the Turn Signals
Traffic violation detection and recording system 100 detects and tracks vehicles using front and/or back looking cameras 50 by means of image processing. For each tracked vehicle, the system also detects blinking lights at the area of the detected vehicle in a sequence of images. In a case where blinking lights are detected at time t, then s(t)=1. Otherwise s(t)=0. System 100 also detects and tracks lane separation markings using front and/or back looking cameras 50 by means of image processing.
Let I(t) be an image received from a front or back looking camera 50 at time t. Let x1 (t) be the horizontal coordinate of the leftmost pixel that was detected as being part of detected vehicle in image I(t). Let x2(t) be the horizontal coordinate of the rightmost pixel that was detected as being part of detected vehicle in image I(t). Let y(t) be the vertical coordinate of the lowest pixel that was detected as being part of detected vehicle in image I(t). Let x(t) be the horizontal coordinate at which a detected lane separation marking passes through raw y(t) of image I(t).
For each detected vehicle, the system stores in memory x1(t), x2(t), x(t) and s(t) for every t in the past several seconds.
An automatic detection of traffic law violation is declared when system 100 finds t0, t1, such that t0>t1 and one of the following relations is true:
1) x1(t0)<x(t0)<x2(t0) and x2(t1)<x(t1) and s(t)=1 for every t s.t. t0>=t>=t1.
2) x1(t0)<x(t0)<x2(t0) and x1(t1)>x(t1) and s(t)=1 for every t s.t. t0>=t>=t1.
3) x2(t0)<x(t0) and x1(t1)>x(t1) and s(t)=1 for every t s.t. t0>=t>=t1.
4) x1(t0)>x(t0) and x2(t1)<x(t1) and s(t)=1 for every t s.t. t0>=t>=t1.
Passing a Second Vehicle on the Wrong Side
Method a: Traffic violation detection and recording system 100 searches for target vehicle in images from backward looking wide angle camera 50 that views the area behind the host vehicle. When a target vehicle 30 is detected, system 100 temporarily stores recorded identification features of target vehicle 30, and tracks target vehicle 30 or part thereof on subsequence images from the same camera. If the vehicle tracking indicates that part of the vehicle or the entire vehicle moves towards the right side of host vehicle 10, then in the next few seconds, and for no more than 10 seconds, the system searches in images from the right-pointing camera 60 for objects with identification features that exist in the target vehicle. When such features are found, the system tracks the target vehicle or part thereof in subsequence images that are received from the right-pointing camera. If the vehicle tracking indicates that the target vehicle moves forward relative to host vehicle 10, until parts of the target vehicle 30 are going out of the field of view of right looking camera 60 towards the front of the target vehicle (e.g. if right-looking camera is mounted in normal orientation, and no image-flipping or mirroring is done, then the target vehicle will go out of the left side of the images), then in the next few seconds, and for no more than 10 seconds, the system searches in images from the forward-pointing camera 60 for objects with identification features that exist in the target vehicle. When such features are found, then an automatic detection of traffic law violation is declared. A citation can be issued locally by citation issuing unit 150 or a message can be sent to a remote citation issuing unit.
Method b: Traffic violation detection and recording system 100 searches for a target vehicle 30 in images recorded by right-pointing camera 50. If a target vehicle is detected in the edge of FOV that is closer to the back side of host vehicle 10, then target vehicle 30 is tracked in subsequence images. If in a sequence of images the tracked target vehicle moves constantly towards the side of the image that is closer to the front of the host vehicle (e.g. if right-looking camera is mounted in normal orientation, and no image-flipping or mirroring is done, then this is the left side of the image), and system 100 calculates that the back part of the target vehicle is in front of a predefined position of the host vehicle, then an automatic detection of traffic law violation is declared. A citation can be issued locally by citation issuing unit 150 or a message can be sent to a remote citation issuing unit.
Method c: When an image is received from right-pointing camera 60, system 100 searches the edge of the FOV that is closer to the back side of the host vehicle for image features (e.g. feature points, feature lines, etc.) of a vehicle. In subsequent images the system tracks the image features that move towards the side of the field of view of the camera that is closer to the front of the host vehicle 10 (e.g. if right-looking camera is mounted in normal orientation, and no image-flipping or mirroring is done, then this is the left side of the image). If several of the tracked image features reach the edge of the FOV of the camera that is closer to the front of host vehicle 10, then an automatic detection of traffic law violation is declared. A citation can be issued locally by citation issuing unit 150 or a message can be sent to a remote citation issuing unit.
The description of methods a, b and c are suitable for detection of vehicles that are passing from the right. Where the local rules forbids passing from the left, the same methods can be used for detection of vehicles that are passing from the left using the appropriate cameras.
Tailgating Host Vehicle
Traffic violation detection and recording system 100 detects and tracks target vehicle 30 in images from the camera that views the area behind the host vehicle. For every image, the systems calculates the speed of host vehicle 10 at the time that the image was recorded (e.g. by inputs from the vehicle systems, or by GPS data, or by other means) and the minimum distance L that a following target vehicle 30 must legally keep from the host vehicle 10 at that speed according to local traffic laws. For every image in which the target vehicle is apparent, the system measures (by means of image processing and/or other distance sensors) the distance D between the back of host vehicle 10 and the front of target vehicle 30. System 100 calculates a margin value E that incorporates the maximum accuracy error in the calculation of L, the maximum accuracy error in the calculation of D, and additional margin as required. If L−E>D then an automatic detection of traffic law violation is declared.
The foregoing is considered as illustrative only of the principles of the invention. Further, since numerous modifications and changes will readily occur to those skilled in the art, it is not desired to limit the invention to the exact design and operation shown and described, and accordingly, all suitable modifications and equivalents may be resorted to, falling within the scope of the invention.
While the invention has been described with respect to a limited number of embodiments, it will be appreciated that many variations, modifications and other applications of the invention may be made.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5948038 | Daly et al. | Sep 1999 | A |
| 6914541 | Zierden | Jul 2005 | B1 |
| 7164118 | Anderson et al. | Jan 2007 | B2 |
| 7362215 | Janssen | Apr 2008 | B2 |
| 20040252193 | Higgins | Dec 2004 | A1 |
| 20060047371 | Janssen | Mar 2006 | A1 |
| 20060269104 | Ciolli | Nov 2006 | A1 |
| 20060269105 | Langlinais | Nov 2006 | A1 |
| 20070200933 | Watanabe et al. | Aug 2007 | A1 |
| 20080048886 | Brown et al. | Feb 2008 | A1 |
| 20080122597 | Englander | May 2008 | A1 |
| 20080165018 | Breed | Jul 2008 | A1 |
| 20100128127 | Ciolli | May 2010 | A1 |
| 20100149334 | Wirsz | Jun 2010 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20200265714 A1 | Aug 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12748416 | Mar 2010 | US |
| Child | 16862606 | US |
