Patent Grant
7764197
1. Field of the Invention
The present invention relates generally to detection, identification, and classification of metallic objects, and more particularly, to a system and method for using ferromagnetic loops to identify and classify vehicles.
2. Background of the Invention
A typical automatic toll collection system for a highway involves the use of a toll collection station or toll booth positioned between each lane of traffic. Vehicles driving on the highway must pass through a toll lane alongside the toll collection station.
The passage of vehicles by the toll collection stations is monitored with a combination of loop detectors, treadles, or other such devices capable of detecting passing vehicles. These devices provide vehicle classification information after the vehicle has passed a payment point. Although these devices can be used for audit purposes, they do not address the potential for error when an attendant makes a mistake, nor do they address the ability to properly classify all transactions.
In early toll collection systems, attendants were employed to manually collect fares from the operators of vehicles and to regulate the amount of tolls. Utilizing attendants to collect fares involves numerous problems including, but not limited to, the elements of human error, inefficiencies, traffic delays resulting from manually collected tolls, employment costs of toll attendants, and embezzlement or theft of collected toll revenues. As a result, devices have been developed to automatically operate toll collection systems without the need for toll attendants. In these systems, the toll fees paid can be based on a combination of the number of axles on a vehicle as well as a set price per vehicle.
However, known tolling systems designed to operate without a toll booth attendant intervention are typically based on several heterogeneous components that are not optimized to work together.
One example of a toll system that can collect tolls of different toll rates from different classes or categories of vehicles without user intervention is described in the '937 application. The '937 application discloses an intelligent vehicle identification system (IVIS) that includes one or more inductive loops. The inductive loops disclosed in the '937 application includes signature loops, wheel assembly loops, intelligent queue loops, wheel axle loops, gate loops, vehicle separation loops, and enforcement loops.
The '972 application discloses additional designs, configurations, installation, and other characteristics associated with the loops previously disclosed in the '937 application. In other words, a ferromagnetic loop in accordance with the teaching of the '972 application can be adapted to be utilized as one or more of the loops disclosed in the '937 application. Of course, the ferromagnetic loops of the '972 application have applications beyond those in the toll road context and those disclosed in the '937 application. For example, the ferromagnetic loops of the '937 application can be adapted to serve various purposes including traffic law enforcement, traffic surveys, traffic management, detection of concealed metallic objects, treasure hunting, and the like.
The present CIP application provides additional description to the '972 application, and claims additional aspects of the invention disclosed in the '972 application.
A ferromagnetic loop of the present invention has many applications. For example, it can be used to detect metallic objects, sensing moving vehicles, and classifying vehicles for toll road applications. A preferred embodiment of the ferromagnetic loop is characterized by a continuous wire. Preferably, the continuous wire is shaped in a serpentine manner. Preferably, the continuous wire is shaped in the serpentine manner on a plane having a footprint. The footprint has an axis. A frequency associated with the ferromagnetic loop is affected when there is a relative motion between the ferromagnetic loop and a metallic object along the axis of the footprint. For example, the frequency fluctuates when the object moves along the axis above the ferromagnetic loop. Similarly, the frequency can fluctuate if the ferromagnetic loop moves in a direction along the axis above the object.
The footprint can take one of several shapes. For example, the footprint can be one of a triangle, a rectangle, a square, a circle, an ellipse, a rhombus, a parallelogram, and the like. Preferably, the continuous wire forms multiple contiguous polygons within the footprint. Preferably, each of the multiple contiguous polygons can assume one of several shapes. For example, each of the contiguous polygons can be one of a rectangle, a square, a rhombus, a parallelogram, and the like. Preferably, there are at least three contiguous polygons within the footprint. The contiguous polygons may be parallel, perpendicular, or at an angle with respect to the axis of footprint.
Each of the multiple contiguous polygons is associated with a spacing dimension. The spacing dimension may be constant for all the contiguous polygons. Alternatively, there may be different spacing dimensions among the polygons. For example, the spacing dimensions of the contiguous polygons may demonstrate a gradient characteristic as shown in loop 4900 in
In a specific implementation for vehicle detection applications, the present invention provides a ferromagnetic loop that is installed on a travel path for detection of vehicles moving in a direction along the travel path. In the specific implementation as shown in
In one embodiment, each of polygon width dimensions 2718 is substantially equal to footprint width dimension 2708 and a sum of all the polygon length dimensions 2716 is substantially equal to footprint length dimension 2706. In a different embodiment, any of polygon length dimensions 2716 is as long as any other polygon length dimensions 2716. In still a different embodiment, one or more of polygon length dimensions 2716 is longer than at least one other polygon length dimension 2716. In other words, the spacing dimension 2716 between any two contiguous polygons may be the same or vary.
In a different preferred embodiment of the ferromagnetic loop shown in
In another embodiment shown in
The present invention further provides methods for installing a ferromagnetic loop for detection of vehicles. A preferred method includes the step of providing a web of grooves on a traveling lane. The web of grooves is characterized by multiple contiguous polygons. The method further includes the step of laying a continuous wire in a serpentine manner within the web of grooves. The method also includes the step of securing the continuous wire within the web of grooves using a bonding agent. Preferably, the method can further include the step of laying the continuous wire at least two turns in at least one groove of the web of grooves. Preferably, the at least two turns are laid side-by-side within the at least one groove. Preferably, the web of grooves has a spacing between any two parallel grooves. The spacing may be from about three inches to about eight inches. Furthermore, the web of grooves may have a gradient spacing between the parallel grooves. The gradient spacing can range from between about three inches and about eight inches.
The present invention further includes a method for preparing a ferromagnetic loop. The method includes the step of pre-forming a continuous wire shaped in a serpentine manner to form multiple contiguous polygons. The method also includes the step of attaching one or more fasteners along the continuous wire to maintain the multiple contiguous polygons. The fasteners are adapted to maintain the multiple contiguous polygons. The method can further include the step of providing at least two turns of the continuous wire to form at least one of the multiple contiguous polygons. The at least two turns of the continuous wire are preferably arranged side-by-side.
a-81d show a series of images of vehicle images recorded using a vision tracking system according to one embodiment of the present invention.
a-82d display the results of motion analysis collected for moving vehicle 8102 of
It is noted the present invention can be adapted for a large number of different applications. For example, the profile information generated by a classification loop array using the present invention can be used in traffic management and analysis, traffic law enforcement, and toll collection.
Classification loop array 110 comprises at least one signature loop and at least one wheel assembly loop. Briefly, the signature loop is adapted to indicate changes in electromagnetic field which can be processed to produce initial signature information as it detects the presence of vehicle 120 over it. The initial signature information represents changes of inductance which can be interpreted to identify, among other characteristics of vehicle 120, a speed of the vehicle, an axle separation of the vehicle, and a chassis height of the vehicle. The wheel assembly loop is adapted to indicate changes in electromagnetic field which can be processed to produce wheel assembly information as it detects the presence of vehicle 120 over it. The wheel assembly information represents changes of inductance which can be interpreted to identify, among other attributes of vehicle 120, the axle count and the axle separation with increased accuracy and details. Specifically, the wheel assembly loop can detect, among other things, the separation between two successive wheels of vehicle 120 that is traveling in direction 130. The initial signature information and the wheel assembly information, collectively, are also known as profile information of the vehicle.
Device 150 is in communication with classification loop array 110. As discussed below, device 150 can be one of many different devices that can be used in conjunction with classification loop array 110. Although device 150 is shown in
In a traffic management and analysis application, classification loop array 110 can be arranged such that it can be used to sense movement of vehicle 120 along path 100 in direction 130. For example, path 100 can be a specific stretch of a highway. In this application, device 150 can be, for example, a computer adapted to perform statistical analysis based on data collected by classification loop array 110. Device 150 can, for example, use the data collected by classification loop array 110 to determine the types of vehicles that use the highway, the number of vehicles passing that point each day, the speed of the vehicles, and so on.
In a traffic law enforcement application, classification loop array 110 can be used in conjunction with other devices. For example, device 150 can be a camera that is positioned to take a photograph of the license plate of vehicle 120 if classification loop array 110 detects a speed of vehicle 120 exceeding a speed limit. In still another example, path 100 is a restricted lane that prohibits large vehicles such as tractor trailers and device 150 is a camera used to capture an image of the license plate of vehicle 120 if classification loop array 110 detects the presence of a tractor trailer in path 100.
In a toll collection application in which device 150 is a payment point (e.g., an automated toll collection mechanism), profile information associated with vehicle 120 that is collected by classification loop array 110 can be used to classify vehicle 120 before it arrives at the payment point. The classification can then be used to notify an operator of vehicle 120 about an appropriate fare associated with the classification. In this toll collection application, vehicle 120 is classified and the appropriate fare is determined before it arrives at device 150. More importantly, the classification is made without input from a toll attendant, thereby eliminating human errors associated with classification of vehicles. When vehicle 120 arrives at device 150, the appropriate fare can be collected from the operator. It is noted that device 150 can be replaced by a toll attendant even though in this application the toll attendant does not classify vehicle 120 to determine the fare. In the toll collection application of the present invention, it is preferable that vehicle 120 clears classification loop array 110 (i.e., the entire vehicle 120 must clear classification loop array 110 before vehicle 120 reaches device 150.
Preferably, classification loop array 110 has a length and a width. The width is preferably wide enough so that no vehicle can travel on toll lane 100 without being detected by classification loop array 110. The length, indicated in
In this embodiment, the signature loop (not shown in
Preferably, classification loop array 110 further comprises at least one wheel axle loop (not shown in
Intelligent vehicle identification unit 170 is in communication with classification loop array 110, intelligent queue loop 140, and device 150. In the preferred embodiment, when vehicle 120 is traveling over classification loop array 110, profile information of vehicle 120 is generated and provided to intelligent vehicle identification unit 170. As noted above, the profile information represents changes of inductance which can be interpreted to identify, among other characteristics of vehicle 120, an axle count of the vehicle, an axle spacing of the vehicle, a speed of the vehicle, and a chassis height of the vehicle.
As suggested above, the profile information includes initial signature information that is produced based at least in part on data collected by the signature loop of classification loop array 110. Preferably, the profile information also includes wheel assembly information that is produced based at least in part on data collected by the wheel assembly loop. When vehicle 120 travels over intelligent queue loop 140, subsequent signature information is produced based at least in part on data collected by intelligent queue loop 140. The profile information and the subsequent signature information are provided to intelligent vehicle identification unit 170.
If the initial signature information and the subsequent signature information indicate that the vehicle previously detected by classification loop array 110 is now at device 150, intelligent vehicle identification unit 170 notifies the operator of vehicle 120 of the appropriate fare associated with the profile information. In other words, intelligent queue loop 140 verifies that that the vehicle at device 150 is the same vehicle for which the fare was determined from classification loop array 110. This serves to detect if one or more vehicles have disturbed the queue order.
In addition to classification loop array 200, the preferred embodiment shown in
Each of front signature loop 210, rear signature loop 230, and intelligent queue loop 240 is preferably generally rectilinear or rectangular in shape. Preferably, each of these loops has two or more turns of wire. The width of each of these loops is preferably six feet. However, the width can be almost as wide as toll lane 100. In an example in which toll lane 100 is 12 feet wide, the width of each of these loops can be between about three feet and about eleven feet. Preferably, each of these loops is a square, in other words, the length of each of these loops is the same as the width. Preferably, each of these loops measures six feet by six feet.
Each of front signature loop 210, rear signature loop 230, intelligent queue loop 240, and gate loop 250 is basically an inductive loop. Each of these loops is used to detect, among other things, a presence of a vehicle over it, the vehicle's chassis height, an axle count of the vehicle, and the movement of the vehicle. Each of these loops preferably produces a flux field or an electromagnetic field that is high enough to be affected by the chassis of each vehicle that uses toll lane 100. The chassis of the vehicle creates eddy currents and disperses the flux field of the loop. This results in lowering the inductance of the loop circuit. One of skill in the art could consult Traffic Detector Handbook, Publication No. FHWA-IP-90-002, which is incorporated herein by reference in its entirety, for further information regarding inductive loops. The loop's detector (e.g., loop detector 260) processes these inductive changes in the loop circuit.
Wheel assembly loop 220 is also an inductive loop. Preferably, wheel assembly loop 220 is adapted to detect the wheel assemblies of the vehicle and to minimize the detection of the chassis of the vehicle and maximize the detection of the axles of the vehicle. Wheel assembly loop 220 is adapted to indicate changes in electromagnetic field which can be processed to produce wheel assembly information.
Intelligent queue loop 240 preferably senses the beginning of the vehicle, the end of the vehicle, the chassis height of the vehicle, and the vehicle's presence over it. Gate loop 250 is preferably adapted to detect the presence of the vehicle. The detection of the vehicle by gate loop 250 controls toll gate 252.
Each of front signature loop 210, wheel assembly loop 220, rear signature loop 230, intelligent queue loop 240, and gate loop 250 is in communication with one or more loop detector 260. Loop detector 260 preferably has a loop signal processor and discriminator unit (LSP&D) (not shown). Preferably, each of front signature loop 210, rear signature loop 230, intelligent queue loop 240, and gate loop 250 can be used to determined signature information including one or more of vehicle presence, vehicle speed, vehicle length, chassis height, and vehicle movement. The signature information, as discussed above, can be represented in an inductance vs. time plot.
Note that each of curves 910, 1010, and 1110 exhibits a similar pattern. Each of these curves shows that when the vehicle is not detected, the inductance value is in between 121000 units and 121200 units. Each of these curves also shows that when the vehicle is in the center of the signature loop, the inductance value is in between 120000 units and 120200 units. The noticeable difference between these three curves is the width of the gap between two points on the curve when the presence of the vehicle is detected. Indeed, each of these curves characterizes the same vehicle (incidentally, the vehicle is a pickup truck) moving at speeds of five miles per hour, 10 miles per hour, and 30 miles per hour, as represented by curves 910, 1010, and 1110, respectively, over the same signature loop.
Referring now to
Referring back to
Intelligent identification unit 270 is in communication with display and local interface 272 and remote access and interface 274. Intelligent identification unit 270 has access to a vehicle library comprising predefined vehicle classifications or categories, and their associated fares. The vehicle library can be modified through a graphical user interface associated with intelligent identification unit 270. Modification of the vehicle library can involve, for example, adding, deleting, and editing of vehicle categories. The modification can be performed through a computer associated with a local area network with which intelligent vehicle identification unit 270 is associated. Preferably, the modification can also be performed through a computer associated with a wide area network with which intelligent vehicle identification unit 270 is associated.
Once the information received from loop detector 260 is processed by intelligent vehicle identification unit 270, the resultant signature data of the vehicle is utilized in a comparison engine. The comparison engine employs both stored typical vehicle signatures for various distinct categories of vehicles and neural network processing to intelligently associate the exact data received with a representative vehicle signature previously defined. Also, the initial signature information is stored for later comparison with the subsequent signature information received from intelligent queue loop 240.
After processing this data against the vehicle library and through the neural network processing, the microprocessor assigns a distinct classification identifier to the vehicle and internally queues the data thus received and awaits a detection signal from intelligent queue loop 240. The vehicle library is preferably stored in a database accessible by intelligent vehicle identification unit 270.
Once the subsequent signature information is received from intelligent queue loop 240 by the microprocessor, the microprocessor performs an analysis on this signature information to see if it properly represents the next internally queued vehicle for purposes of ascertaining that the vehicle arriving at payment point 290 is the same vehicle that the system expects to be arriving at payment point 290. Under one circumstance, a vehicle, e.g., a motorcycle, could potentially pass over classification loop array 200 and then exit toll lane 100 early. In another instance, the vehicle could potentially miss passing over classification loop array 200 and move into toll lane 100 at a later point, thus missing being correctly classified by the system beforehand. Intelligent queue loop 240 is utilized in both circumstances to detect such queuing anomalies.
The microprocessor that is utilized to analyze the various loop signatures can preferably send data to another main processing device to gather data, control traffic flow, or otherwise process the data in a meaningful manner. In a toll collection embodiment of the invention, this collection processing device would be another microprocessor unit designed to assimilate various input data and toll collection device control to assist in collecting proper fare amounts for vehicles passing through the toll lane.
If a vehicle crosses intelligent queue loop 240 and is not recognized as the next classified vehicle, the microprocessor will check any other queued classified vehicles to see if the signature matches any other vehicles thus queued. If the subsequent signature information matches a later vehicle, then the microprocessor will assume that any earlier queued vehicles have exited the lane after crossing classification loop array 200 and will discard those vehicles from the queue.
If a vehicle crosses intelligent queue loop 240 and is not recognized as the next classified vehicle or as any of the vehicles subsequent in the vehicle classification queue, the microprocessor will then make the assumption that the vehicle entered toll lane 100 late and that it was not properly classified. A new vehicle classification record will then be inserted into the queue at that point and marked such that the system does not reliably know what type of vehicle is currently at the head of the queue.
If a vehicle entered toll lane 100 late, thus causing an anomaly in the proper queuing of vehicles, an appropriate message will be sent from the microprocessor to the main processing device so that the main processing device can make an appropriate decision based on the type of anomaly that occurred in queuing and present the toll attendant with the appropriate information for making an informed decision on how to handle the errant vehicle, if the toll lane is a manual collection lane. The collection-processing device must make a decision on the expected toll based on rules established by the authority (default fare) if the main processing device is utilized to automatically operate a toll collection lane without the use of a toll attendant.
Other than the previously specified anomaly situation in queuing, the microprocessor will normally pass information regarding the next queued vehicle to the toll collection processing device. The processing device receives this classification identifier from the inductive loop control microprocessor and cross-references the classification identifier against a cross-reference database of identifiers and toll classifications as defined by the tolling authority. This cross-reference action is used to assign a particular authority classification and, thus, an appropriate fare amount expected for the vehicle.
Since many vehicles with distinct classification identifiers are of the same general type as it pertains to the local tolling authority's fare structure, this cross-reference action serves to reduce the number of distinct vehicle classifications to just those distinct classifications and associated fare amounts as defined by the tolling authority. For example, a particular tolling authority might assign the same general classification to a motorcycle and a passenger car even though these two vehicles would generate two distinct classification identifiers or profile information.
Once the collection processing device has received and cross-referenced the vehicle data internally, it will communicate the appropriate classification and fare expected for the vehicle to the toll attendant if the lane is operating in a manual operational mode. If the toll lane is operating in an automatic mode, the data will be used to communicate to any attached automatic toll collection equipment the expected fare amount that the vehicle operator must present to gain passage through toll lane 100.
In order to provide the cross-reference database utilized in the toll collection processing device, a user program is provided with the corresponding toll management system. This program allows the toll authority to select each vehicle type that is distinctly identified by the loop system microprocessor program and match it with one of the predefined or predetermined classifications set up by the authority, which subsequently defines the amount of the fare expected for that vehicle type.
The user program can preferably be adapted to employ the use of digital photographs for each type of vehicle to further illustrate the exact type of vehicle (or vehicles) which would fall under each category of vehicles classified by the loop system microprocessor for visual reference. The authority personnel would then create the cross-reference table by matching up each loop microprocessor classification with the corresponding authority classification.
Additionally, for vehicles with too many axles to be classified by the authority's base classification system, the cross-reference table also allows the user to define the additional number of axles to add to the base classification axle count to determine the total fare for such vehicles.
As the user completes the cross-reference process utilizing the user program for such purposes, the data is saved to the plaza system database and subsequently distributed to each toll lane processing computer for subsequent use in cross-referencing subsequent vehicles for automatic classification purposes.
Preferably, intelligent identification unit 270 includes management software tools. The software tools enable every transaction (e.g., each vehicle's passing through the toll lane) to have a complete audit trail. Tracking each transaction increases the accuracy of the revenue collection process.
The system shown in
As disclosed above, the capability to charge different toll fees for different vehicle types at payment point 290 without a toll attendant is possible with the present invention.
For convenience, a system of the present invention as shown in
The IVIS, as implemented in
In
Each of the wheel assembly loops 320 and 322 is designed to detect primarily tires and wheel assemblies of a vehicle. The small concentrated field width of each of the wheel assembly loops 320 and 322 is obtained by controlling the spacing between the wire turns. Preferably, the spacing ranges between four and seven inches. The wheel assembly loops are designed in accordance with the range of ground clearance present in the vehicle population. Preferably, the single wire that is used to form each wheel assembly loop is looped at least twice, thus creating two overlapping layers of wire for each wheel assembly loop.
Design of wheel assembly loops 320 and 322 depends on a number of factors. The factors include characteristics of vehicles anticipated for the toll lane at which the loop is to be installed. The characteristics include number of axles, distance between axles, speed of vehicle through the toll lane, height of chassis from top of roadway, and other attributes of vehicles detectable by inductive loops.
Vehicle separation loops 340 and 342 are designed to be used to gain additional information on the target vehicle. For example, vehicle separator loops 340 and 342 can determine the beginning and end of a vehicle by analyzing the percent in change of inductance. Also, the magnitude of the percent change in inductance is proportional to the chassis size and distance from the vehicle separation loops 340 and 342. In addition, vehicle separation loops 340 and 342 can be used to, as it's name suggests, “separate” each vehicle one from another.
The use of vehicle separation loops 340 and 342 provides vehicle presence, vehicle speed, and chassis length information. A special signal discriminator is preferably provided with the two processed signals received from vehicle separation loops 340 and 342. Preferably, the signal discriminator processes this information and compares the vehicle speed, chassis length, axles, and chassis height information being collected from vehicle separation loops 340 and 342. The signal discriminator considers several factors during this process. For example, the percent in the change of inductance is used to sense the beginning of a vehicle and the end of a vehicle. Also, the magnitude of the percent change in inductance is proportional to the bottom chassis height and distance from each of the loops. For example, a motorcycle being followed closely by a car or truck would have a significant difference in the percent of inductance change. The movements or speed of the vehicle is also measured on each of these loops. The movements or speed of the vehicle is determined as a function of percent change of inductance over time. These two factors are used to calculate the speed of the vehicle. When the vehicle is not moving or static the percent change in inductance becomes constant.
These constant values for the percent change of inductance appear as flat horizontal lines when displayed on an inductance vs. time plot in which the Y-axis represents the percent change in inductance and the X-axis represents time. A single vehicle or a vehicle towing another vehicle will normally maintain the same speed. When two vehicles are following each other in close proximity, the vehicles typically have somewhat different speeds or start and stop independently of each other. The signal discriminator measures these differences to separate the vehicles. Also the length of the vehicle chassis is calculated to determine if it is a single vehicle.
Again, this processor is unique since it performs this function independently, provides outputs and transfers the information within the IVIS. This information can be used to provide volume counts. This process can be used in tolling or other applications to replace light curtains, optical scanners, video detectors, and microwave detectors.
A single vehicle or a vehicle towing another vehicle will normally maintain the same speed. When two vehicles are following each other in close proximity, the vehicles typically have different speeds. Vehicle separation loops 340 and 342 measure these differences to separate the vehicles. Also, the length of the vehicle chassis is calculated to verify the existence of one or multiple vehicles. Accordingly, vehicle separation loops 340 and 342 can be used in the tolling application to replace light curtains, optical scanners, video detection, and microwave detectors that are currently in use.
The loop signal processor and discriminator (LSP&D) unit preferably has two or more channels of detection that compares the information processed on a continuous basis to determine when a vehicle ends and when a new vehicle starts. The end of the vehicle is used to end the collection of the transaction information. The LSP&D has the ability to determine the beginning of a vehicle, the end of a vehicle and distinguish when two vehicles are traveling in close proximity to each other and/or a vehicle is towing another vehicle. The LSP&D processes information from two loops and compares the information to determine if the information represents a single vehicle or multiple vehicles. When the end of the vehicle is determined the processor can set a timer based on the speed of the vehicle.
In a different arrangement in which loop 342 is an enforcement loop, as the timer completes its countdown, violation enforcement camera 370, which is in communication with enforcement loop 342, receives the signal output to take a picture.
Enforcement loop 342 is designed to work with camera 370 as part of a violation enforcement system. If a vehicle leaves separation loop 340 before the fare is collected at payment point 390, camera 370 takes a photograph of the vehicle when the vehicle triggers enforcement loop 342. Preferably, camera 370, enforcement loop 342, vehicle separation loop 340, and payment point 390 are located such that the photograph would clearly show the license plate of the vehicle.
Intelligent vehicle identification unit 270 in one embodiment of the present invention may be an assembly of electronic equipment and software that can control other equipment, store vehicle information, and distribute vehicle information to other devices or remote locations using an integrated remote access. Intelligent vehicle identification unit 270 can be adapted to assemble collected data from classification loop array 300 and one or more of vehicle separation loops 340 and 342 to create a composite signature information for the vehicle. One exemplary composite signature is shown in
This collective body of profile information can include tire information, axle count, axle spacing, chassis height, chassis length, and vehicle speed. The vehicle record is associated with a vehicle type or combination vehicle type (i.e., motorcycle, car, car with trailer) from a database or vehicle library of available signatures. The database is accessible to intelligent vehicle identification unit 270. The vehicle type is then placed into a toll category, defined by the toll authority, to generate the proper fare for the vehicle. This is then used to drive the toll system, prompting the toll attendant when using a manual embodiment, or notifying the driver of the vehicle when using an automated embodiment, of the proper fare which is due.
Again, the vehicle types and categories are definable by the toll authority. Each vehicle type is placed in a category using the graphical user interface associated with intelligent vehicle identification unit 270. The graphical interface includes a library of vehicle types or vehicle combinations using captured digital images of the local vehicle population. The user interface may be a local interface, e.g., local interface 272. The user interface may also be a remote interface, e.g., remote interface 274. The visual interface allows the assignment of the magnetic and/or inductive composites of the vehicle records into different categories by selecting from a menu of captured images. The graphical user interface is a display of digital images of different vehicle categories that are used to represent groups of vehicle types. A group of these categories make up a vehicle library. New vehicle types can be added to the intelligent vehicle identification unit by incorporating the captured image and vehicle signature into the vehicle library. Exemplary screenshots of the vehicle library are shown as
An intelligent vehicle queuing system of the present invention can be used to insure proper matching of designated toll amounts to each vehicle. The queuing system profiles the approaching vehicle at payment point 390 and compares the data with the profile information held in queue by intelligent vehicle identification unit 270. If the profile is found to be an incorrect match, intelligent vehicle identification unit 270 attempts to properly match the indicated profile with other vehicles waiting in queue, thus insuring that the profiled vehicle is properly associated with the system's indicated amount of fare.
The offset of the left member and the right member of each of these bi-symmetrical offset wheel assembly loops is designed to capture left wheel information and right wheel information at two different instances in time. A more accurate average speed, axle separation, and other axle information can be calculated based on data collected by these bi-symmetrical offset wheel assembly loops 510 and 530.
As indicated in
One or more of additional loops 540 and 542 can be adapted to work with camera 570 and payment point 590. A photograph of a vehicle can be captured for violation enforcement purposes if an appropriate fare is not received at payment point 590 when the vehicle is detected by additional loops 540 and 542.
Area 1620, which comprises fields 1622 through 1632, can be used to display specifics of the transaction. For example, field 1622 is used to indicate that lane 1500 is Lane No. 3 of the particular toll plaza. Field 1624 can be used to indicate which shift of workers is on duty. Fields 1626, 1628 can be used to display the time and date on which the transaction occurs. Field 1630 can be used, for example, to indicate the status of a toll gate or other status of the toll lane. Field 1632 can be used to indicate which, if any, toll attendant is on duty. This information can be used to increase accountability among toll attendants.
In some embodiments, field 1640 can be used to manually operate a toll gate by a toll attendant. In an embodiment in which a toll attendant is staffed at toll lane 1500, field 1650 can be adapted to close the transaction after the toll attendant verifies that the toll has been paid. Field 1660 can be adapted, for example, to be pressed by the toll attendant in a situation in which classification made by the IVIS is verified by the toll attendant. Finally, a toll attendant or an operator of the vehicle can press a field 1670 to obtain a receipt.
In
Overview of the '972 Application [Patent, do we Incorporated by Reference the '972 Patent so we can Properly Refer to it in these Paragraphs?]
Among other things, the present CIP application discloses additional design and configurations of loops that can be adapted for use in conjunction with the IVIS disclosed in the '937 application. The present CIP application further provides methods for installing the loops. The loops associated with the present CIP application are referred to hereinafter as ferromagnetic loops. It is noted that the present invention is not limited to vehicles identification and classification although the preferred embodiments disclosed herein relate to such purposes.
In a specific implementation for vehicle detection applications, the present invention provides a ferromagnetic loop that is installed on a travel path for detection of vehicles moving in a direction along the travel path. In the specific implementation as shown in
In one preferred embodiment, each polygon width dimension 2718 is substantially equal to footprint width dimension 2708 and a sum of all polygon length dimensions 2716 is substantially equal to footprint length dimension 2706. In one embodiment, all polygon length dimensions 2716 are equally long. In a different embodiment, at least one of polygon length dimensions 2716 is longer than at least one other polygon length dimension 2716. In other words, the spacing dimension between any two contiguous polygons may be the same or vary. For toll road implementation purposes, footprint length dimension 2706 can range from about 10 inches to about 56 inches. Footprint width dimension 2708 can range from about 24 inches to about 144 inches. Preferably, polygon length dimension 2716 ranges from about three inches to about eight inches. Preferably, polygon width dimension 2718 ranges from about 24 inches to about 144 inches.
A ferromagnetic loop of the present invention such as loop 2700 can be adapted to collect a large variety of information associated with vehicles that move over it. Specifically, the ferromagnetic loop can, among other things, detect the spacing or the distance between two successive wheel assemblies of a vehicle, count the total number of wheel assemblies associated with the vehicle, calculate the vehicle speed, and determine a category of the vehicle based on the characteristics of the vehicle. The ferromagnetic loop is designed to maximize the detection of the wheel assemblies while minimizing the detection of the vehicle chassis. As a result of its enhanced capabilities for detection of wheel assemblies, the ferromagnetic loop can be adapted for use in, among other applications, traffic law enforcement, toll road operations, vehicle classification for data collection, and traffic management. One unique characteristics of the ferromagnetic loop of the invention is that one single loop can be used to replace the combination of piezo electric or resistive axle sensors, road tube, treadles, and multiple figure-of-eight or dipole axle loops that are currently used to detect wheels and axles.
Review of Various Wheel Sizes
As shown in Table 1 below, the range for vehicle wheel diameters as found in random traffic can range from about 12 inches to about 44 inches in diameter. Typical length of a tire bearing surface or the length of contact area of a vehicle tire with the road can range between about 6 inches and about 12.5 inches.
Table 1 below summarizes selected categories of vehicles and their associated dimensions.
Review of Existing Inductive Loop Technology
During the development of the ferromagnetic loops of the present invention, the inventors conducted a series of tests to evaluate inductive response that are obtainable by existing loop designs. For example, the inventors evaluated the performance of the inductive loops disclosed in U.S. Pat. No. 5,614,894 issued to Daniel Stanczyk on Mar. 25, 1997 (hereinafter “the Stanczyk patent”). In addition, the inventors evaluated the performance of the loop designs disclosed in WIPO Publication Nos. WO 00/58926 and WO 00/58927 (both published on Oct. 5, 2000) (hereinafter “the Lees applications”). The results of these tests and evaluations are described below.
In each of the tests conducted, the same loop detector was used to measure the results. In other words, no operating changes was made to the loop detector from test to test. Thus, the only variable that existed during the tests was the design of each of the loops being tested. The objective was to understand the technology disclosed in the Stanczyk patent and the Lees applications. Specifically, the limitations of these known technologies for detecting and counting vehicle wheels in random traffic were evaluated.
To illustrate the effectiveness of the loop designs disclosed in the Stanczyk patent and the Lees applications, and to demonstrate advantages of the present invention, the inductance changes obtained from each technology were plotted using the same loop detector. Each of the graphs or plots disclosed herein represents the changes in the loop circuits as a plot of frequency on the Y axis and time on the X axis. In other words, each of these graphs illustrates the effect of a vehicle traveling over a loop in a traveling lane.
The Stanczyk Patent
The Stanczyk patent discloses inductive loops having a rectilinear shape. Loops 2910, 2920, and 2930 shown in
Loop 2910, which has a wider width dimension 2916, can detect the wheels from the left and right sides of a vehicle traveling on roadway 2902 in direction 2904. Loops 2920 and 2930 (each having a narrower width 2926) are designed to detect separately the left wheels and the right wheels of the vehicle. The Stanczyk design uses an ideal loop length 2908 of 0.3 meter (11.81 inches) for heavy vehicles and 0.15 meter (5.91 inches) for light vehicles. Each of these loop length dimensions is shorter than the bearing surface length of the vehicle wheels to be detected. This design provides a short travel time as wheels move through the inductive field of the loop, and it limits the sample size available for the wheel detection. Dimension 2908 affects the field height of the loop circuit. If dimension 2908 of this loop design is increased to a size larger than the diameter of the wheels it is designed to detect the field height of the loop detection is also increased. This is a limitation to the Stanczyk patent because when length dimension 2908 is increased, a stronger detection of the vehicle chassis is resulted, which inhibits the detection of wheels.
Therefore, the loop disclosed in the Stancyzk patent is limited by its geometric design since its performance is dependent on the bearing surface of the wheel of the vehicles being detected. In random traffic, vehicles have wheels that range from 12 inches to 40 inches in diameter with bearing surface widths ranging from six to 12.75 inches. To properly detect all the different vehicle wheel sizes in random traffic, multiple rectilinear loops of the Stancyzk patent would be required in the roadway. In other words, multiple loops each with a different length dimensions 2908 would be required to provide wheel detection for all vehicles that exist in random traffic. Using the technology disclosed in the Stancyzk patent, a single loop size will not work on both large wheeled trucks and smaller wheeled vehicles. For example, when a loop that has a specific length dimension 2908, which is designed to detect a tire bearing surface of 12 inches, the loop cannot be used to detect tires with a bearing surface of 7.5 inches long.
Similarly, plot 2944 shown in
Plot 2948 shown in
Accordingly, the rectilinear design of the Stanczyk patent has geometric constraints that limit the size of sample or sensing area. This limits the sample length of the each wheel and prevents the ability to accurately measure the speed of the vehicle. When the length of the loop is increased, the field height increases and eddy currents also increase making this design not practical to calculate wheel speed on a single loop. As indicated in the Abstract and in at least Col. 2, lines 61-64, the Stanczyk patent specifically teaches that the length of the loop must be smaller than the diameter of the wheel. The preferred length of the loop tends to be limited to the bearing length of the tire, or the tire bearing lengths tend to be longer than the loop length, to provide distinct wheel detection.
In addition, the rectangular design of the Stanczyk patent uses multiple turns of wire around the perimeter, and the design is limited to a length that is shorter than the diameter of the wheel it is detecting. As the length of the loop is made small, the loop would detect smaller vehicles but not larger ones.
In contrast to the Stanczyk patent, as explained below, the ferromagnetic loop of the present invention offers greater flexibility in size and shape of the loop geometry and provides a longer travel area for the wheel paths. As explained below, a single ferromagnetic loop of the present invention is capable of detecting different size wheels found in random traffic. Significantly, the length of a ferromagnetic loop of the present invention can be greater than the diameter of the wheel being detected. Thus, it is possible to use a single ferromagnetic loop of the present invention to detect the entire population of wheels in random traffic. The loop can also detect the difference between single-tire and dual-tire assemblies. Also, the longer loop sample time associated with the ferromagnetic loop provides the ability to calculate speed using just a single loop.
The Lees Applications
The figure-of-eight loop design (also referred to hereinafter as the dipole loop design) disclosed in the Lees applications has a central winding, with the two outer segments in the direction of travel having a length shorter than about 23.6 inches (or about 60 cm), and preferably about 17.7 inches (or about 45 cm).
A figure-of-eight loop similar to loop 3010 with dimensions 10 feet wide by 18 inches long (i.e., each front segment 3011 and rear segment 3012 is nine inches long), built and installed in accordance with the Lees applications, was used for evaluation purposes by the inventors. Plot 3042 shown in
For the dipole (figure-of-eight shape) loop with the dimensions of 10 feet by 18 inches, the test results indicated that it is not suitable for detection of small-wheeled vehicles. The wheels are not clearly defined in plots generated by this loop because the chassis of vehicles with small wheels lowers the frequency of the loop circuit.
As further explained below, the ferromagnetic loop of the present invention is different from the loops disclosed in the Lees applications since the geometry allows the loop's length to be longer than the diameter of the wheel to be detected. Furthermore, a single loop design can detect the different wheel sizes. It should be noted that the design of the present invention also has the ability to detect dual wheels. The amplitude of the front wheel can be compared to the rear wheel to determine the presence of dual tires on the rear axle using the ferromagnetic design of the present invention.
Plot 3048 shown in
For the smaller dipole loop with the dimensions of nine inches by five feet, the test results revealed that this loop design has a low field height with a stronger field in the center of the loop. Thus, the ability to detect wheels on vehicles was biased to small vehicle wheels, which are normally found on cars and small trailers. Accordingly, this loop design does not detect the wheels of vehicles with larger diameters, such as those found in pickup trucks, small trucks, and other larger vehicles.
For the larger dipole loop with the dimensions of 18 inches by five feet, the test results revealed that this loop design has a slightly higher field height with a stronger field in the center of the loop. The detection of wheels on small vehicles (e.g., cars) was not very clear, however, because the higher field found in this loop design was influenced by the chassis of the vehicle. This influence caused the frequency of the loop circuit to be lowered. The wheels were not clearly defined since the chassis effect and the wheel effect tend to cancel each other out. However, this design does provide better detection of vehicles that have larger wheels and more ground clearance.
Thus, the “coil within a coil” design (i.e., a smaller loop with dimension 3067 located within a larger loop with dimension 3068) as referenced in the Lees applications relies on two separate loop sizes to detect smaller and larger wheels. The use of four loops per lane is designed to detect the entire vehicle population, but the arrangement is dependent on both the nine and 18 inches long dipole loop design to detect the different sizes of the wheels found in the vehicle population. Also, these designs have a smaller dimension in the direction of travel than the wheel diameters. This provides a short signal sample rate from the wheels.
In contrast, and as explained below, the ferromagnetic loop of the present invention requires only a single loop to detect all the different wheel sizes that exist in random traffic. The ferromagnetic loop design also has the ability to provide wheel detection and vehicle speed on the same loop.
Ferromagnetic Loops of the Present Invention
Various configurations and designs of the ferromagnetic loops disclosed herein can be used for difference purposes. One exemplary purpose of the preferred embodiments of the invention, as described below, is to detect, identify, and classify vehicles. In the preferred embodiments, the ferromagnetic loop is adapted to communicate with a signal-processing device (e.g., a loop detector) to generate an electromagnetic field in a traveling path of a vehicle, measure the changes in frequency and inductance associated with the vehicle passing over the ferromagnetic loop, and output the results. The results can be used to determine, among other things, various characteristics of the vehicle including, for example, number of axles, distances between axles, and speed.
A preferred embodiment of the ferromagnetic loop has a unique loop geometry that provides a flux field. The loop circuit and geometry creates a flux field that responds to the ferromagnetic loop effect of wheel assemblies on vehicles. This ferromagnetic effect results in an inductance increase and frequency increase that can be detected by a loop signal-processing device (e.g., loop detector 260 shown in
Key elements of the ferromagnetic loops of the invention include the magnetic strength of the flux field height and length. The shallow installation of the wire and wire orientation of the coil in permanent and temporary installations is very important for optimal performance of the ferromagnetic loop design. The flux field created by the loop circuit is concentrated and low to the road surface to maximize the ferromagnetic effect of the wheel assemblies and minimize the eddy currents created by vehicle chassis.
The increase in inductance is detected by the ferromagnetic loop and the information can be used to count wheel assemblies. The ferromagnetic effect occurs when a ferrous object is inserted into the field of an inductor and reduces the reluctance of the flux path and therefore, increases the net inductance and frequency. This loop design and geometry responds to the wheel assemblies in this manner.
The geometry of the loop wire turnings can be oriented in different directions relative to the direction that vehicles travel in order to vary the response of the loop sensor to the vehicle wheels. The geometry and orientation of the loop wires can be designed to minimize ground resistance. For example, as the presence of reinforcing steel (a ferrous material) affects the magnetic field of the loop, the orientation of the lines of flux created by the loop geometry can be changed to minimize the environmental influences of the reinforcing steel. This is reflected in the wire turnings that are diagonal to the travel direction of the vehicle and diagonal to the typical orientation of reinforcing steel used in pavement design. This is an important design feature since it can help to reduce the magnetic influence that reinforcing steel has on the lines of flux created by the loop and improve the loops circuit response to wheels assemblies.
The ferromagnetic loops as disclosed herein provides a number of improvements over existing inductive loops. For example, the ferromagnetic loops can be made to have various unique geometric shapes and coil spacing (of the wire used in the wire turnings) to obtain a desirable flux field. Preferred embodiments of the ferromagnetic loops of the invention include the following characteristics:
A unique design of molded loops that incorporates a locking mechanism or an anchor to secure the loops in permanent installations.
A design of a single loop that has the ability to detect vehicle wheel assemblies and provide the distinction between single tire assemblies, dual tire assemblies, and grouped axles.
A design that is capable of providing wheel speed, vehicle speed, axle spacing, number of axles, and vehicle classification with a single loop.
A unique sensor arrangement and sensor spacing using two ferromagnetic loops that pairs two axle vehicles together by providing loop detections on both loops at the same time or in extremely close proximity of each other therefore greatly simplifying the vehicle classification process in congested traffic.
In this embodiment, each of loops 3110 and 3120 has wire turnings that are oriented in a diagonal manner relative to direction 3104. Note that each of polygonal axis 3111 and polygonal axis 3121 forms angle A with direction 3104. In other words, the contiguous polygons confined with a footprint of the loop form angle A with the direction. Angle A can range between zero and 90 degrees. Specifically, angle A can be, for example, 30 degrees, 45 degrees, or 60 degrees. The diagonal orientation of the wire turnings helps null or minimize the environmental influences that reinforcing steel has on the lines of flux (to the extent that the reinforcing steel are present and embedded within path 3102).
Note that gradient diagonal loop 3110 and regular diagonal ferromagnetic loop 3120 have different loop configurations. Regular diagonal loop 3120 has uniform spacing dimensions 3124 between wire turnings. In other words, the parallel diagonal lines within the footprint of loop 3120 have the same distance from each other. This uniform loop spacing provides detection in random traffic but can be designed for detection of specific wheel sizes. For example, the spacing can be one that which is optimum to detect the presence of a tractor-trailer in a traffic lane in which tractor-trailers are prohibited. Gradient diagonal loop 3110 is characterized by varying spacing dimension 3114, which are represented by different widths of spacing between the parallel diagonal lines within the footprint of loop 3110. The different spacing used in loop 3110 improves the loop circuit field by increasing the sensing range from small to large wheels on a single ferromagnetic loop design. The shorter or narrow sections detect small wheel assemblies and the longer or wider sections detect larger wheels. The gradient loop configuration is suitable for detecting a wide range of vehicle categories. Preferably, spacing dimensions 3114 and 3124 ranges between about three inches and about eight inches.
Loops 3110 and 3120 are associated with lead-ins 3112 and 3122, respectively. Lead-ins 3112 and 3122 are in communication with one or more loop detector, a device previously disclosed in the '937 application (e.g., detector 260 shown in
In the specific embodiment shown in
The ferromagnetic loop is designed to detect primarily the wheel assemblies by providing an increase in the frequency and inductance of the loop circuit thereby maximizing the ferromagnetic effect. The design provides detection of the entire range of wheel sizes illustrated in
The ferromagnetic effect of the present invention is illustrated in frequency vs. time plots shown in
Plot 3300 shown in
Plot 3310 shown in
Plot 3400 shown in
In plots shown in
Plot 3500 shown in
Plot 3600 shown in
Plot 3700 shown in
Plot 3800 shown in
The wire turnings in this ferromagnetic design can also be oriented parallel or perpendicular to the travel direction of traffic. The perpendicular orientation is illustrated in the typical ferromagnetic loop geometry shown in
As shown in
The preferred method of installation involves installing the wire within one inch of the road surface. In other words, depth 4108 is preferably about one inch. It is also preferable to install the wire turnings parallel to the road surface (i.e., wire turnings 4102 and 4104 are side-by-side as shown in
The number of wire turnings can be increased in the gradient in order to increase the detection response of smaller or larger wheels by increasing the number of wire turns in a particular spacing. This increases the field of flux at the appropriate level. This is illustrated in
Plot 4310 shown in
Plot 4320 shown in
Plot 4330 shown in
Plot 4340 shown in
Referring back to
The longer loop length can be used to detect grouped axles. Vehicles having two or more axles with a spacing shorter than the loop length can be easily detected on a single loop. The detection of grouped axles results in distinct patterns of detection that is directly related to the axle spacing of the group of axles. The pattern includes such parameters as the number of peaks, amplitude of the peaks, lengths of the peaks, and speed of the wheels.
Plot 4410 shown in
Plot 4420 shown in
Plot 4430 shown in
Plot 4440 shown in
Plot 4450 shown in
This loop design provides good increases in the frequency of the loop circuit when wheels of vehicles travel through the field of the loop even when the length of the loop is made longer than a group of wheels. This unique single loop design provides good wheel detection for the population of vehicles from motorcycles to tractor-trailers. This design can be wide enough to provide detection of both the left and right wheels of a vehicle on a single loop. This efficient design only requires one loop per lane for wheel detection of the entire wheel population. Examples of the different wheel sizes found in random traffic include, for example: motorcycles, 12 to 23 inches in diameter; automobiles, 23 to 26 inches in diameter; pickup or SUV, 26 to 29 inches in diameter; small trucks, 30 to 32 inches in diameter; and large trucks, 40 to 44 inches in diameter.
Both loop geometries, i.e., the gradient spacing and the equal spacing designs, can be installed using one continuous wire in two adjacent segments. This provides detection of the left and right wheel paths in a roadway. This design can be used on wider roadways. The use of two segments reduces the amount of wire in the middle section of the loop. This design provides a wider detection area without dramatically increasing the amount of wire being used. The advantage of not increasing the amount of wire is that adding additional wire does not decrease the loop sensitivity. This is illustrated in
Plots shown in
Plot 4510 shown in
Plot 4520 shown in
Plot 4530 shown in
Plot 4540 shown in
Plot 4550 shown in
Plot 4560 shown in
Plot 4570 shown in
Plot 4580 shown in
Plot 4590 shown in
Another unique feature of this design is its ability to increase the length of the loop without dramatically changing the field height. This is very beneficial in supplying a longer sample length time from the loop. The other benefit of having a longer loop length is it provides wheel speed information. The travel path length of the loop is longer than the diameter of the wheels it is detecting. The additional field length provides improved wheel data samples by providing a longer sample length. These longer samples allow more information about each wheel to be processed.
The geometry of the ferromagnetic design can also be used to calculate the speed of the vehicle. The speed can be measured using the length of the sample time as the wheel assembly travels from the leading edge of the loop to the trailing edge of the loop. The sample time is used by the signal analyzer to calculate the speed and provides an accuracy level of plus or minus about four milliseconds. Also, the size and type of wheel assembly can be determined using this loop geometry. The size of the wheel diameter and/or a dual-wheel assembly is reflected in the increased amplitude of the change in the frequency of the loop circuit. All these factors contribute to the area of the curve represented in the graphs for the detection of the wheel. The physical factors about the wheel assembly are represented by the slope and amplitude of the wheel detection. This also allows the processing unit to validate the detection of a wheel and discriminate between an object on a vehicle that is close to the ground but lacks the amplitude and slope to be a valid wheel assembly. This information is supplied on each wheel. In low speed applications or in congestion, this can accurately measure changes in the vehicle speed between the first axle and any of the following axles.
The width of the loop that is perpendicular to the direction of travel can be adjusted to provide the proper width for detection area. The length of the loop can be increased to increase the length of the sample time. The chassis height of the vehicle can also be detected providing the discrimination between cars, pickup, small trucks, or large trucks on a single loop.
Using the ferromagnetic loop of the present invention, it is now possible to detect wheel assemblies and measure vehicle speed using only one single loop. The loop field can be made longer when vehicle wheels travel at high speeds. This change in loop length provides good axle detection even when the loop field length is longer than the diameter of the wheels being detected. The loop length can also be longer than a group of axles. The spacing width of the coils within the loop can be varied to as small as two inches to provide a lower field height. The spacing could also be increased to 20 inches or more to detect very large vehicle wheels. Thus, different coil spacing can be used on a single loop circuit. The benefit of the geometry design is that the field density and uniform field height can be adjusted by changing the spacing. The loop circuit frequency increases when wheels travel through the detection field and this provides easy identification of the wheels.
There is another unique loop geometry design that has a bi-symmetrical off-set of the left and right leading and trailing edge of the loop. The left segment of the loop detects the wheels from the left side of a vehicle and the right segment detects wheels from the right side of a vehicle. The use of the offset provides a longer travel distance over the loop and this provides a longer sample time which is desirable particularly at high speeds. In addition, this approach doubles the length of the sample time but only slightly increases the amount of the loop wire by the length of the offset. This loop design is illustrated in
In
In
This offset loop design can also be used to calculate the speed of the vehicles. This unique single loop design detects the left wheel and right wheel of an axle assembly at different moments in time. This design provides several methods of calculating the speed on this offset wheel loop. These include loop total activation time, activation time of the left and/or right segment, sample time between left and right activation point, sample time between left and right saturation point, and sample time between left and right deactivation point. This is accomplished by having the left segment of the loop and the right segment of the loop being saturated by the left and right wheel at different moments in time. This difference of time is related to the distance in the offset between the left and right leading edge of the loop. Each wheel provides an increase in the loop circuit frequency during detection. These two increases mark the time it takes for the left and right wheel to travel the distance equal to the offset of the leading edge of the loop.
Also, the total time of the activation of the loop represents the time the vehicle wheel travels the entire length of the loop. These references can be used to calculate the speed of the vehicle (i.e., distance divided by time) on each passing pair of wheels. The axle spacing of the vehicle can also be calculated providing vehicle classification information from a single wheel loop.
Following are examples that illustrate how speed and axle spacing of a vehicle can be determined using a single offset wheel-loop shown in
In each of Example Numbers 26 through 32 below, an automobile having a known axle spacing of 8.3 feet was used. The car was driven over the loop using a speed between 10 and 60 mph. The speed of the vehicle was first determined. The axle spacing were then calculated based on the determined speed of the vehicle. The speed was calculated using the activation time between the left and right wheel. The axle spacing was calculated using the sample time between the activation of the first axle and the activation point of the second axle. The spacing was calculated using the vehicle speed measured on the first axle. It should be noted that the speed calculation was available for each passing pair of wheels. This speed information can also be used to determine if the vehicle was accelerating or decelerating as it traveled over the loop. It was also possible to use other or multiple speed points and/or use the average of these points. When this offset distance is used a valley or deactivation period appears on the graph (the frequency vs. time plot) between the left and right wheel detection. When a vehicle that has a group of axles with a spacing that is less then the distance of the offset was detected, an axle group pattern is produced on the graph.
Plot 4710 shown in
Plot 4720 shown in
Plot 4730 shown in
Plot 4740 shown in
Plot 4750 shown in
Plot 4760 shown in
Plot 4770 shown in
The slope of the frequency vs. time plot can also be used to calculate the speed of the wheel in slower speed conditions. The slope of the wheel activation (rise over time) and/or wheel deactivation (fall over time) can be calculated and compared to the predetermined values of a loop calibration table or loop calibration factor. The area under the slope of the wheel activation (rise over time) and wheel deactivation (fall over time) can also be calculated and compared to the predetermined values of a loop calibration table or loop calibration factor. These three methods are not as direct as using the left wheel to right wheel saturation points or total activation time to provide calculations for the speed of the vehicle to be measured with each pair of wheels. This sensor is unique in shape and function by providing accurate measurement of vehicle speed using only a single wheel loop. This also provides the ability to supply vehicle classification on a single loop.
The information from one offset loop can be processed to provide axle counts, axle speeds, and axle spacing information. The information is obtained from a single inductive loop and a single loop detector. This loop design makes it possible to provide vehicle classification on the basis of axle detection and axle spacing using a single loop and single channel of detection in a travel lane. The following examples illustrate the vehicle speed and axle spacing being detected on a single offset wheel loop. The speed of the vehicle was calculated and the axle spacing was calculated based on the determined speed of the vehicle. This loop had a left and right segment each 28 inches long and an offset length of 24 inches. The effective length of the loop equals 2954.55 milliseconds at one mph. The speed was calculated using the activation time between the left and right wheel. The axle spacing was determined using the sample time between the activation of the first axle and the activation point of the second axle. The spacing is calculated using the vehicle speed measured on the first axle. It should be noted that the speed calculation is available for each passing pair of wheels. This speed information can also be used to determine if a vehicle is accelerating or decelerating as it travels over the loop. It is also possible to use other sample points or multiple speed points and/or use the average of multiple samples.
In the following Example Nos. 33-38, all the vehicles were accelerating as they traveled over the offset loop.
Plot 4810 shown in
Plot 4820 shown in
Plot 4830 shown in
Plot 4840 shown in
Plot 4850 shown in
Plot 4860 shown in
With respect to the wire spacing and the orientation of the wire for the ferromagnetic loop, a number of factors should be considered. For example, the orientation of the wire turnings with respect to the path on which the wheel travels through the field affects the loop frequency change. When the wire wrappings are parallel to the direction of traffic, the field detects not only the wheels but also the chassis of the vehicles. Using larger spacing in wire turnings that are parallel to the direction of travel affect the loop's ability so that it detects wheels exclusively. However, when the large spacing is used, the chassis of smaller vehicles such as motorcycles and cars with low ground clearance can create eddy currents, which cause the frequency of the loop circuit to lower and thereby reduces detection of wheels. Accordingly, it is desirable to design the spacing of the loop based on anticipated vehicles wheels to be detected. One novel arrangement of the wire spacing is to route the wire at a 30 to 60 degrees angle to the direction of travel. This arrangement reduces the eddy currents from the chassis. As a result, the arrangement provides improved wheel detection and wheel speed information.
As discussed above, a ferromagnetic loop of the invention can be used to determine, among other things, the presence, speed, and number of axles of a vehicle. This can be accomplished as shown in
The use of more than one ferromagnetic loop in a roadway can be used to provide vehicle classification.
The use of spacings 4930 and 4940 provides sensor activation or deactivation on both wheel loops from the wheels located on the same two-axle vehicle. The wheel detections on the two wheel loops occur at the same time or within a few milliseconds. This provides wheel, wheel assembly, speed, and axle spacing information from the same vehicle during the wheel detection. This wheel information provides critical vehicle information about the vehicle speed and axle spacing that pairs the vehicle axles and greatly simplifies the vehicle classification process by providing matches for the for vehicle classification. The sensor arrangement provides the linking or pairing of front and rear wheels of a vehicle for about 80 to 85% of the vehicles in random traffic. This percentage of vehicles represent the axle spacing for cars, sport utility vehicles, vans, and pickup trucks that have axle spacing that is between the inner and outer spacing of the two wheel loops.
The addition of single rectangular or dipole loop located between the two wheel loops could be used in heavy congested traffic conditions to supply additional vehicle processing information. The rectangular or dipole loop would provide additional vehicle presents detection for axle spacing that are greater than 19 feet long.
Installation
The ferromagnetic loops and its various configurations, variations, arrangements, and arrays of loops of the present invention can be installed as a surface mount loop for temporary installation. In addition, the loops can be installed for permanent applications using a pavement saw, drill, wire, and loop sealant.
Installation Procedure for a Ferromagnetic Loop
The loop can be installed on a pavement as follows. The pavement is marked using paint to outline the locations or a web of grooves to be cut using a pavement saw. A slot is made by the saw that is between about 0.75 inches wide by about 1.5 inch deep. The loop is formed using a single conductor of preferably stranded wire AWG number 14 with high density polyethylene insulation with a jacket diameter of 130 to 140 mils. However, single or stranded conductor wire gauge of 12, 14, 16, or 18 could be used for this installation. It is recommended that the loop coils of wire are kept parallel to the roadway surface (i.e., the coils of wire are laid side-by-side). The wire is installed in the cut slot (see, e.g.,
Molded Ferromagnetic Loop and Installation Procedure
The unique design of the ferromagnetic loop can be made in a molded loop in the same variety of geometric shapes, sizes, and coil spacing as those formed using a pavement saw and wire method. Molded loop 5300 shown in
easy control of the loop depth during installation;
consistent wire turnings in the coils; and
reduction of the loop installation time.
The loop can be installed using a molded loop that can be placed in a saw cut or a web of grooves created within a pavement. For example, an outline of the loop is painted or marked on the pavement. A pavement saw is used to cut slots about 0.75 inches wide by about 1.5 inches deep. The molded loop is then placed in the slots and a loop sealant or another bonding agent is used to secure the molded loop in the saw cut.
Installing Temporary Ferromagnetic Loop
Temporary loops can be made using a combination of wire and seal tape having a woven Polypropylene mesh. The adhesive of the road tape holds the loop in place in the road way.
Plot 5510 shown in
Plot 5520 shown in
Plot 5530 shown in
Plot 5610 shown in
Plot 5620 shown in
Plot 5630 shown in
Plot 5710 shown in
Plot 5720 shown in
Together, plots 5710 and 5720 indicate that offset loop 5700 can be used to detect vehicle wheels regardless of whether coils 5704 are parallel or perpendicular (or diagonal) to the direction of travel.
The ferromagnetic loop of the present invention has many characteristics including the following.
The loop geometry associated with the present invention is unique. Preferred embodiments of the invention use wire turnings in a serpentine fashion to provide a low density magnetic field for the ferromagnetic loop. Preferably, the ferromagnetic loop provides a wire coil with multiple turns to remain parallel (side-by-side) and preferably one inch or less below the road surface.
The loop width can be larger than the diameter of the wheels being detected to provide a longer sample time of each wheel assembly.
The ferromagnetic loop design can detect and provide distinctions for single wheel assemblies on small vehicle wheels, automobiles, trucks and dual wheel assemblies on vehicles.
The loop design can be installed on a temporary basis using flexible adhesive sheets. Alternatively, the loop can be formed to contain the continuous wire. For example, the continuous wire can be encapsulated or encased in a molding process to give form to the loop circuit.
The loop circuit encapsulated or encased in a molding process can be further secured by an anchoring system. The anchoring system may consist one or more of plastic, rubber, synthetic, and other resinous product for permanent installations.
A molded loop designed specifically for temporary installations can be installed as a surface mount loop. This loop is designed to be reusable and more durable than the temporary loops made of a combination of wire and seal tape having a woven polypropylene mesh.
The permanent installations can use a shallow saw cut 0.5 to 0.75 inches wide and one inch deep to maintain close proximity of the ferromagnetic circuit to the road surface.
The permanent installations can be installed in a saw cut using a loop circuit that has been encapsulated or encased using a molding process using one or more of plastic, rubber, synthetic, and other resinous products.
The shape of the molded ferromagnetic loop design can be adapted to be secured by a mechanical anchor in the saw cut.
The loop design has the ability to discriminate between a single wheel assembly and a dual wheel assembly.
The unique serpentine method of wire turns can utilize different length sizes of spacing to create a low dense gradient field for different wheel diameters.
Temporary loops can be made from a combination of wire and seal tape having a woven Polypropylene material with adhesive. These temporary loops can be installed for short term or temporary installations.
Vehicle classification by detecting axle counts, vehicle spacing, and axle spacing can be done using a single loop.
Vehicle classification using two loops in series can have spacing from 3 feet to 15 feet between loops.
Overview of the Present CIP Application
The foregoing disclosure of preferred embodiments of the present invention has been presented for purposes of illustration and description. Other embodiments and additional aspects on the invention have been contemplated by the inventors. In particular, aspects of the ferromagnetic loop sensor system described above can be integrated with additional features in several additional embodiments. In addition, vehicle sensors other than ferromagnetic loops can be used in conjunction with the intelligent vehicle identification system (IVIS), vehicle image capture unit (VICU), multilane vehicle information capture system (MVIC), and vehicle tracking system (VTS) of the present invention.
In one aspect, a vehicle sensor, e.g., a ferromagnetic loop sensor, is incorporated in a VICU. In one aspect, the VICU may act as a violation enforcement system (VES) for enforcing toll violations. The VICU system includes a trigger unit, a capture unit, and a lighting unit. The trigger unit is coupled to an IVIS, which detects the presence of a vehicle and sends a trigger signal to the capture unit. The capture unit takes vehicle images of the vehicle that is lit by the lighting unit that provides a lighting source incident on the vehicle. The system further includes a processing unit that processes the vehicle images and controls the exposure employed by the capture unit. The processing unit contains an application program running in the processing unit, and containing modules for vehicle image processing and exposure.
In another aspect, vehicle sensors, e.g., ferromagnetic loop sensors, are incorporated in a system that contains an MVIC unit for collecting information from MVIC subsystems. The tolling system can also include an IVIS system. Preferably, the IVIS system contains the ferromagnetic loop sensors, but other sensors may be used. The IVIS system sends to the MVIC unit vehicle information. Preferably, the information is sent at a rate of many times per second. Also included are a vehicle tracking system (VTS) that collects information about the vehicle position using vision tracking sensors, and an RF system designed for reading a transponder on a passing vehicle, as well as a vehicle image capture system (VICU) for capturing images of the passing vehicle when a camera in the VICU receives a trigger from the MVIC unit.
In a further aspect, lane straddling sensors are incorporated in a dual RF read zone system for conducting transactions with high speed vehicles traveling on a road. Preferably, the lane straddling sensors are diamond-shaped loop sensors (also termed “lane straddling sensors”). The system includes one or more gantries that contain RF read sources that each extend over at least one lane of the highway. The system creates multiple RF read zones for passing vehicles, so that vehicle transactions can be completed with a high degree of accuracy.
In another aspect of the invention, a system for IVIS vehicle sensor synchronization includes a master program that coordinates sampling periods of vehicle sensors so that adjacent sensors do not have sampling periods at the same time.
Toll Violation Enforcement System
VICU 5800 also includes a capture unit 5804, which can include a frame grabber and one or more cameras. The cameras can be digital video cameras or analogue video cameras plus a frame grabber. A preferred embodiment of the invention uses at least one digital video camera. Capture unit 5804 can be mounted either roadside or on a gantry above a traveling lane. Capture unit 5804 is configured to receive a trigger signal (or trigger) from trigger unit 5802. Upon receiving the trigger signal, capture unit 5804 can take one or more images of a passing vehicle that is detected by trigger unit 5802.
VICU 5800 preferably includes lighting unit 5806. Lighting unit 5806 can comprise a visible wavelength or infrared strobe light, or flood light. In a preferred embodiment of the invention, lighting unit 5806 employs a white strobe light. Preferably, a diffuser is arranged in front of lighting unit 5806 to make a lighting field created by the unit more uniform. When lighting unit 5806 is operational, it creates a lighting field that can illuminate a passing vehicle. In one embodiment, lighting unit 5806 is also configured to receive the triggering signal from trigger unit 5802 that can, for example, activate a strobe in lighting unit 5806.
VICU 5800 also includes processing unit 5808, which can be a standard or embedded computer system that is located locally or at a remote distance from capture unit 5804. Processing unit 5808 contains a processing program 5810 running therein. Preferably, processing program 5810 is used for processing vehicle images sent by capture unit 5804. Further, processing unit 5810 can be configured to control exposure in capture unit 5804. In preferred embodiments of the invention, unit 5808 comprises a standard desktop computer, an industrial computer, or single-board computer.
Application program 5810 is configured to run processing unit 5808. Further, application program 5810 contains several modules that can be used to process images received from capture unit 5804, as described further below with reference to
VICU 5800 further includes storage media 5812, which can be local or remote memory, and in hard disk, flash disk, CD, or DVD form. Storage media 5812 is used to store information such as vehicle images received in digital form from processing unit 5808. In general, the images received for storage can be digital data representing as-received pictures of a passing vehicle taken by capture unit 5804, or they can be digital data that has been manipulated in some manner after being received from capture unit 5804 by processing unit 5808. For example, processing unit 5808 may receive a “raw” vehicle image from capture unit 5808 and create a brightened or darkened image, an extracted image, and the like (see discussion below). All of these images can be stored as digital data in storage media 5812. In the case where storage media 5812 is located remotely, communication from processing unit 5808 to storage media 5812 can be through a wireless, cable, or satellite network. In preferred embodiments of the invention, a local hard disk, local memory, or local flash disk are used for storage media.
Plate location module 5902 is configured to find and extract a license plate area in a vehicle image (also referred to as “whole vehicle image”) received from capture unit 5804. Typically, there is a conflict between the needs to increase resolution for taking accurate images of vehicles, and the limitations in storage capacity and transmission rate of vehicle images. For example, camera resolution and original image size are increasing to the extent that image transmission and storage have become significant problems. From the point view of both transmission and storage, low image resolution (and therefore less data generated per image) is preferred. From the point of view of optical character recognition (OCR) and other processing purposes, higher image resolution image is preferred, so that accurate information regarding a vehicle in question is retained.
To solve this conflict, the present invention employs plate location module 5902. As depicted in
Capture unit 5804 transmits whole vehicle image 6002 to plate location module 5902, which processes the image to find and extract a plate area image. Module 5902 can then output plate area image 6004 at the original resolution as received in vehicle image 6002. However, the amount of data in plate area image 6004 is only a fraction of the amount of data contained in original whole vehicle image 6002, due to the relatively small size of a license plate compared to a whole vehicle. For example, a typical whole vehicle image 6002 can comprise about 1.4 megapixels (one megapixel equals one million pixels), equivalent to 4.2 Mbytes of data, where each pixel of a color image uses 3 bytes of data to represent a red-blue-green image. On the other hand, plate area image 6004 having the same resolution as vehicle image 6002 comprises only about forty thousand pixels, or about 120 Kbytes of data. In order to minimize storage space associated with collecting a high resolution plate image, such as image 6004, original image 6002 can be discarded after being transmitted to and operated on by plate location module 5902.
Capture unit 5804 is preferably configured to rapidly change between a plurality of different image resolution modes for taking pictures. Accordingly, capture unit 5804 can take pictures in rapid succession of a passing vehicle at a higher image resolution and a lower image resolution. For example, after capturing a high resolution whole vehicle image 6002, resolution resetting module 5906 can receive a signal so that capture unit 5804 can be reset to take a second whole vehicle image 6006 at a lower resolution. For example, image 6006 could comprise about 353 kilopxels, or about one quarter of that of image 6002. This lower resolution image can be used for image enhancement as described in more detail below.
Also displayed in
Images 6004 and 6006 can then be transmitted to storage media 5812 (see
As further depicted in
In an embodiment of the present invention illustrated in
Referring back to
In current systems that are used to take vehicle images for law enforcement purposes, a typical reflectorized license plate frequently appears much brighter than other parts of a vehicle. This is especially true when a lighting unit is used to illuminate a passing vehicle. Moreover, under certain circumstances, the license plate may actually appear darker than the rest of the vehicle. In general, the license plate area of an image differs in brightness compared with the rest of the vehicle. This creates an undesirable tradeoff: if the plate area has a normal intensity, the vehicle body is too dark (or light) to see vehicle details; and if the vehicle body is bright enough for resolution of vehicle details, the plate area appears overexposed (or underexposed).
In an embodiment of the present invention, the above conflict is addressed by initially controlling the exposure setting of capture unit 5804 to capture a vehicle image so that the plate area has normal brightness or intensity. As illustrated in
Image compression module 5910 (see
A lighting unit in existing conventional toll enforcement systems works as compensation lighting and is turned on only when the ambient light is low due to a time of day or poor weather conditions. However, the ambient light still varies widely over the range of conditions where the ambient light is bright enough for no use of a lighting unit. Sunlight might shine in the field of view of a camera in an unpredictable manner due to floating clouds. Additionally, sunlight incident directly on a license plate, such as during sunrise, sunset or other coincident situations, can make a plate appear extremely bright and completely overexposed. These factors render it difficult to control exposure to capture images with consistent intensity.
By employing a major light source adjusted so that a license plate is not over-exposed when the source is on, the effects of ambient light can be greatly reduced. Thus, in a preferred embodiment, to minimize the influence of ambient light, a lighting unit of the present invention uses a major lighting source that is preferably operating substantially all the time, with camera settings adjusted so that a plate image is clearly visible only when the lighting source is operational. For example, a strobe unit 6506 is continuously operational so that it is triggered to expose a vehicle every time a passing vehicle is detected.
To further reduce the effect of direct sunshine on the ability to obtain good images, in an embodiment of the present invention, multiple different predetermined capture positions of cameras are employed so that two or more images are taken for each passing vehicle. Since the intensity of direct sunshine reflected from a plate and detected in a capture unit depends highly on the sunshine angle and view angle of the capture unit, changing a capture position, which also changes the view angle of the capture unit, likely results in at least one image position not receiving directly reflected sunlight. In addition, since often at lease one capture position might be located in the shadow of a surrounding object, such as a toll plaza canopy, use of multiple capture positions greatly increases the chance of capturing at least one good image when direct sunshine is present. Thus, as a vehicle passes by, images are collected at different points in time by a capture unit camera, such that each different image reflects a different capture position. Preferably, the strobe unit and capture unit are positioned to capture a license plate image of consistent intensity every time a passing vehicle is photographed at least one predetermined capture position.
VES system 6500 may include a frame grabber (not shown) that is coupled to a lane controller interface 6508. Lane controller interface 6508 is also coupled to IVIS board 6512 that collects signals from IVIS 6503. Lane controller interface is additionally coupled to camera 6504 and strobe 6506.
In step 6602, a trigger unit detects the presence of a passing vehicle. As discussed above, trigger unit 5802 preferably includes an induction loop sensor embedded in the roadway that is configured to detect the presence of a vehicle overhead by sensing changes in inductance, but may include any other convenient means for detecting passing vehicles.
In step 6604, trigger unit 5802 send a trigger signal to capture unit 5804.
In step 6606, the trigger signal is also sent to lighting unit 5806, if unit 5806 includes a strobe light. The trigger signal can cause the strobe light to illuminate the passing vehicle.
In step 6608, capture unit 5804 takes a first image of the passing vehicle. In one embodiment of the present invention, the first image is taken at a predetermined image resolution. For example, camera 6504 can be configured to capture a first image of a passing vehicle at high resolution. Accordingly, after a vehicle is detected by trigger unit 6503, camera 6504 is automatically set for higher resolution vehicle image capture.
In step 6608, the exposure setting may also be set at a predetermined value based on, for example the type of image to be collected. If the first image is to be used to produce an extracted plate image, the capture exposure setting can be adjusted to produce optimum lighting conditions for obtaining a legible plate image.
In step 6610, the first vehicle image is transmitted to processing unit 5808 to be processed by program 5810 residing therein.
In step 6612, the image resolution of capture unit is changed from that employed in step 6608. Following the example of step 6608, if the image resolution for image capture at that step was a higher resolution, then in step 6612, the image resolution for image capture by capture unit 5804 is reduced to a lower resolution. However, in another embodiment, the image resolution for capture unit 5804 can be lower in step 6608 and relatively higher in step 6612.
In step 6614, a second vehicle image, for example, a lower resolution vehicle image, is taken. System 6500 is configured so that the first and second vehicle images can be taken with a minimum time lapse between successive images. For example, the second vehicle image can be taken at an interval ranging between about two and three hundred] milliseconds after the first vehicle image. Thus, the first and second vehicle images can represent very similar views of the passing vehicle, for example, in terms of vehicle size and angle of view.
In one embodiment of the present invention, the second vehicle image taken in step 6614 is captured at an exposures setting different from that of the first vehicle image taken in step 6608. For example, if the second vehicle image is to be used to produce and store a whole vehicle image, the exposure setting may be adjusted to be greater than that used in step 6608, if the image in step 6608 is used to produce an extracted plate image. This is because the extracted plate region typically is more highly reflective and may appear much brighter than the rest of the vehicle, and accordingly require a lower exposure setting than that to be used to capture whole vehicle information.
In one embodiment, exposure control module 5904 and resolution resetting module 5906 are set to automatically toggle between different exposure and different resolution settings. For example, in an initial state, exposure control module 5904 is set at a lower exposure time and a higher resolution in order to capture a clear license plate image. After capture unit 5804 takes an initial picture of a passing vehicle a signal is received by units 5904 and 5906, upon which the image capture exposure time for capture unit 5804 is reset to a longer time and the image resolution for capture unit 5804 is set at a lower resolution. Accordingly, a second vehicle image appropriate for whole vehicle image capture can be taken at the longer exposure time and lower resolution that are more appropriate for capturing and storing a whole vehicle image. For example, the vehicle as a whole may be typically less reflective than a plate area, requiring a longer exposure time, but less resolution is generally required to resolve the general vehicle features besides those license plate features captured in the higher resolution image. In this manner, in this embodiment, the “capture state” of capture unit 5804, where the “capture state” includes the image resolution setting and the exposure setting, can be automatically and rapidly toggled between settings appropriate for plate image capture and whole vehicle image capture.
In step 6616, the second image is transmitted to unit 5810 for processing.
In step 6618, the resolution for image capture of capture unit 5804 is reset to the predetermined resolution, for example, a higher resolution, used in step 6608. Accordingly, a subsequent passing vehicle will have a first image taken at the same predetermined resolution as the first vehicle.
In step 6620, an extracted plate image is taken from one of the first or second vehicle images, whichever is higher. Following the example where the image resolution of a first vehicle image taken in step 6608 is a higher resolution, then the plate image is extracted from the first vehicle image. As discussed above, this allows for optimal identification of plate image information by preserving a high resolution image of the plate.
In step 6622, intensity information taken from the plate region of the high resolution image (in the example of steps 6608 and 6620 of
In step 6624, the intensity information from the plate region of the high resolution image is compared to stored intensity data.
In step 6626, the settings on a capture unit, for example, unit 5804, are adjusted based on the comparison of stored intensity data and that received from the most recent high resolution plate image. For example, lighting conditions may have varied between the time when the stored intensity data was collected and the time when the intensity data from the plate region of the most recent vehicle was taken. In this manner, the exposure settings for capture of the next vehicle can be adjusted, both for the high resolution image to be used to capture an image of a highly reflective plate, and a lower resolution image, to be used to collect an image from a less reflective whole vehicle.
In step 6628, a brightened image of the lower resolution image is produced as described above with respect to
In step 6630, the brightened image is forwarded for image compression.
In step 6632, the brightened image and extracted plate image are compressed.
In step 6634, the compressed brightened whole vehicle image and plate image are stored in an appropriate storage medium.
Although the above example focuses on the processing of one original whole vehicle image taken at one image resolution and one vehicle image taken at a higher resolution (and, preferably, at a different exposure setting) for the purposes of extracting a plate image, it is contemplated that multiple low resolution and/or high resolution images of a passing vehicle can be captured and processed according to the appropriate steps outlined in
Additionally, it is contemplated that the procedures described above for embodiments of the present invention can be used in combination. For example, a capture unit might initially employ multiple capture positions to take multiple images of a passing vehicle at a first camera exposure setting. Subsequently, the plate location module processes one or more of the images taken at the first exposure setting, and sends a signal to the capture unit indicating the plate intensity data is not in a targeted range. Finally, the capture unit takes further images of the same passing vehicle at a second exposure setting adjusted based on the set of intensities received from the plate location module.
In additional embodiments, an enforcement system extracts only a plate region at an original resolution from a whole vehicle image while discarding the rest of the image rather than capturing and preserving a downsized image. This is useful in the case where system 5800 is employed only for a license plate study where other identifying vehicle information need not be preserved.
Furthermore, it is contemplated that embodiments of the present invention can be used to track and identify vehicles in areas other than tolling areas, such as parking lots, or predetermined locations on public streets. In exemplary embodiments, the system of the present invention can be triggered to capture vehicle information such as a license plate whenever a vehicle passes a point of interest. Such information could be used for law enforcement or public safety purposes.
Multilane Vehicle Information Capture
Aspects of the ferromagnetic induction loop sensor systems of the present invention can additionally be implemented in systems and processes for multilane vehicle information capture (MVIC). MVIC is an alternative approach to conventional transactions conducted with vehicles traveling along roads, where the term “road” includes multilane highways, toll plazas, bridges, tunnels, parking lots, and other vehicle traffic locations. These conventional transactions include toll collection at toll booth stations or in an open road environment using manual or RF-tag collection; vehicle identification using license plate image capture; vehicle detecting using loop sensors, and other methods of vehicle detecting. In a preferred embodiment of the present invention, a vehicle information collection process is completely automatic without use of human intervention, such as a toll attendant, for collecting tolls. In one aspect, vehicles traveling on multilane highways can be classified accurately using induction loop sensors of the invention and appropriately charged tolls to respective RF transponders placed on each vehicle. Preferably, vehicles do not have to stop or slow down in a lane to pay tolls. Preferably, vehicle information capture operates without requiring vehicles to move in a confined lane, so that, for example, during toll collection or other information capture, vehicles can straddle between lanes as typically occurs in an open road environment. Preferably, the MVIC system has the ability to capture a first type of information about a vehicle in order to determine if further information (or data) capture is required. In some embodiments, the MVIC system can send a trigger to a VICU if it determines based on initial data collection, that further vehicle data capture is needed. For example, the MVIC system has the ability to detect vehicles that do not have RF toll transponders passing through a tolling area, and to alternatively capture an image of the license plate of such vehicles. Preferably, the captured license plate information can then be used to record payment of users that are registered to pay toll based on their vehicle license plate (“pay by plate”) or to send the plate information to a toll violation enforcement system for users that are not paying by means of an RF transponder or vehicle license plate.
Embodiments of the present invention utilize multiple intelligence units or subsystems to overcome current problems that are associated with multilane vehicle information capture in an open highway environment. In general, desirable features for an multilane vehicle information capture system include the following:
There are many problems associated with conventional open road tolling (ORT) systems. One of the most significant problems involves the identification of a vehicle that is located in multiple lanes (e.g., a vehicle that straddles more than one lane). When a vehicle straddles more than one lane, the toll system may fail to capture the vehicle for purposes of paying the toll, misassociate the paying customer with the wrong vehicle, or over- or under-count vehicle axles for the purposes of data capture. Another common problem is the inability of the system to properly manage multiple transactions occurring at about the same time and involving multiple vehicles in close proximity. For example, the following scenario representing a series of transactions that are difficult to manage may occur frequently: identify a first vehicle that has a toll transponder (tag); capture payment from the toll tag; associate the captured payment with the first vehicle; simultaneously identify a second nearby vehicle that did not pay by toll tag; and capture a license plate image of the second vehicle, the latter step followed by charging of payment for those vehicles authorized to pay be license plate, or sending the plate image of non-authorized vehicles to a toll enforcement system. These problems limit usefulness of conventional open road tolling schemes.
The present invention utilizes multiple intelligence units, or subsystems, to overcome current existing problems that are associated with toll collection in an open highway environment. In a preferred embodiment, the subsystems include an intelligent vehicle identification system (IVIS), an RF system, and a vision tacking system (VTS). The MVIC system of the present invention operates to consolidate intelligence obtained from the multiple subsystems.
In the embodiment illustrated in
System 6700 includes VTS 6706 that collects information about a vehicle position when the vehicle passes through vision tracking sensors included in the VTS. This information is transmitted to MVIC central process unit 6702 for further processing.
System 6700 contains RF System 6708 that reads a properly mounted transponder in a side of the vehicle multiple times per second (e.g., about 90 to 300 times/sec) when the vehicle passes under an antenna located in system 6708. Typically, in tolling applications, where RF systems are used, an RF system reads only one time from a vehicle transponder and subsequently puts the transponder in a “sleep” mode to avoid cross-reads for that transponder from adjacent lanes. A cross-read occurs when a transponder is read by a system in a lane other than where the vehicle containing the transponder is traveling. RF system 6708 of the present invention differs in operation from this typical approach. Rather, system 6708 is configured to perform transponder reads as many times as possible, including cross-reads, late reads, and early reads. The latter two types of reads occur when a transponder is read after or before, respectively, a vehicle is in a proper area for conducting a “normal” RF read. The later reads are problematic for a conventional RF system, that may assign late reads to trailing vehicles, and early reads to leading vehicles, rather than the vehicle of interest. RF system 6708 passes the read data to MVIC unit 6702.
Lane Controller (LC) Unit 6710 of system 6700 is responsible for sending appropriate transactions to a database unit 6712. LC 6710 receives necessary information from MVIC central process unit 6702 for generating a unique transaction for each vehicle.
Database Unit (DB) 6712 is responsible for storing transaction information sent by lane controller 6710. Such information is used for revenue collection and audit purposes, as well as for generating reports and/statistics related to vehicle transactions.
System 6700 additionally includes VICU 6714 that is responsible for capturing vehicle images whenever a trigger source such as central process unit 6702, IVIS 6704, or another loop based triggering device (not shown) triggers a VICU camera. Exemplary operation of a VICU in a toll violation enforcement system is described above in detail. Preferably VICU 6714 contains at least one camera for capturing vehicle images, and is configured for storing the captured images with a proper file name associated with a vehicle transaction and sent by MVIC central process unit 6702. In exemplary embodiments, VICU 6714 additionally comprises a program running in a processing unit, such as program 5810 described above that contains individual image processing and exposure modules to ensure that a clear image of a violating vehicle and license plate are obtained.
In an open highway environment, VICU 6714 may be activated under one of several circumstances. For example, in an MVIC environment, certain vehicle travel lanes may be reserved for vehicles equipped with RF transponders to automatically record tolling transactions. Vehicles without transponders may be required to travel in other lanes that are equipped with conventional toll collection facilities. Therefore, a transponderless vehicle traveling in a reserved lane may be flagged as a potential violator, triggering VICU 6714 to capture vehicle images of the passing vehicle. Additionally, a vehicle equipped with a transponder that indicates insufficient funds within an account to pay a toll can be flagged as a potential violator. The vehicle information, for example, a license plate image, can then be used to assess a payment if the vehicle is registered for pay by plate, or it can be forwarded to a violation enforcement system.
In alternative embodiments, VICU 6714 is configured to remain active and can capture images of each passing vehicle. Accordingly, system 6700 can determine a time subsequent to a vehicle passing an MVIC site, that a transaction record associated with the vehicle passing the tolling site indicates the vehicle is a toll violator or needs to pay by license plate, if applicable. For example, it may be determined that an account associated with the vehicle's transponder did not authorize payment of the toll charge. System 6700 can then retrieve from VICU 6714 an image to assist in identification of the vehicle, which is then forwarded to a violation enforcement system of pay by plate collection system.
Summary of Operation of MVIC Components
RF System
In embodiments of the present invention, RF system 6708 is configured to obtain multiple reads from a passing vehicle. Accordingly, as described in more detail below, problems in conventional systems, such as cross lane reads (cross-reads), advanced reads, skipped reads, or late reads are not as paramount.
In an multilane open road environment, meaning that there are no barriers between multiple lanes, a car may travel outside of the center of a painted tolling lane. The car may cross between lanes, it may straddle lanes, or travel in the road shoulder. For example, when entering a zone for automatic tolling in an MVIC environment, it may enter the zone with vehicle placement at a 60 to 40 ratio (or 60-40) between two adjacent lanes, and subsequently cross under an RF antenna gantry used for reading a vehicle transponder at a 50-50, 70-30 or 90-10 ratio. Instead of reading the transponder one time and inducing a sleep mode, RF system 6708 provides overlay reading zones 6808 and 6810 so that the reading zones overlap in straddle region between adjacent lanes, enabling a user of the invention to ensure that an antenna read of the transponder occurs in straddle zone 6816 as well as in the center of a lane.
Preferably, RF system 6708 continuously reads the vehicle transponder as rapidly and frequently as possible. In a preferred embodiment, RF system 6708 employs multiple antennas 6804, 6806 on gantry 6802 to read a transponder of a passing vehicle, so that information from the multiple antenna reads can be used to determine where the vehicle is located. As is known, transponders vary in the rate that they can be read. Some perform as slowly as 96 times/sec while others perform as rapidly as 333 times/sec. In an exemplary embodiment, both RF read zones 6808, 6810 are roughly 10 feet long, such that, if a vehicle is traveling in the center of a lane at 60 mph, the vehicle moves at approximately one inch per millisecond. The read zone (120 inches) is thus traversed in about one tenth of a second, so that using a 333 times per second sample rate, roughly 30 reads can be performed as the vehicle traverses the read zone of a particular lane.
Using multiple reads of a passing vehicle, RF system 6708 can provide information to determine the vehicle position with respect to a given lane. For example, if a successful read count of a vehicle transponder of 20 to 30 times is obtained using an antenna associated with a first lane; and in a second, adjacent lane a read count of 5 is obtained; and in a third lane (not shown), nearby, 2 reads are obtained, the vehicle can be definitively located in the read zone associated with the first lane. In another scenario, if the vehicle straddles the first lane and second lane with a 70-30 ratio with respect to vehicle placement in the respective lanes, denoted by position A, 20 reads may be obtained in zone 6808 associated with the first lane, and 10 reads in zone 6810 associated with the second lane. Therefore, using only the information obtained from RF system 6708, system 6700 can determine that the vehicle is approximately located straddling the first and second lanes with a 70-30 ratio of vehicle placement. If, in another scenario, the vehicle were to exactly straddle the lanes at a 50-50 ratio, traveling through highway region 6816 at position B, the read zones associated with each lane would generate approximately the same number of reads. In the later scenario, depending on the exact configuration of RF read zones, the total number of reads generated for the vehicle transponder may be less than for travel through a lane center (for example, the total of successful reads may be 15 in the latter case, as opposed to 30 in the center lane case); however, the amount of reads is still sufficient to accurately locate the vehicle.
In contrast, current art using RF technology for toll tag reading was developed based on single lane applications. Efforts centered on obtaining information only from a read zone in a single lane, so that reading from an adjacent lane is eliminated, as well as early or late vehicle reads. This was compelled by the fact that the current technology used for toll tag reading is back scatter technology where a toll tag is polled and broadcasts its energy in all directions. The potential exist greatly for a tag to be read in an adjacent lane, because the RF radiation is reflected off vehicles and off different shapes at varying angles. When an RF backscatter system conducts a vehicle tag read, it broadcasts an RF signal from an antenna, which is then backscattered from the tag in every direction. So, attempts in the current art have predominantly involved focusing the RF radiation energy into a small region in the center of the lane in an effort to avoid reading in an adjacent lane. This focusing helps avoid reading in an adjacent lane that can cause a customer in the wrong lane to be treated as a violator, for example.
Another potential problem overcome by the present invention is the inadvertent charging of a vehicle that is read in two different lanes for both lanes. This might occur, for example due to cross-lane reads. This has further reinforced the practice in current technology to focus RF energy only in one lane, conduct a single read, put the RF tag to sleep, and avoid reading a car early, so that reads are not inadvertently conducted on a wrong car. Thus, a tag on a passing vehicle is read only one time allowing only one time to collect money. This technology works well in a stop-and-go or slow traffic speed, single lane environment. However, in a location where there are no barriers between multiple lanes of tolling all in one area, it becomes much more difficult to identify which vehicle paid a toll and where the read actually is located.
Another common industry practice to attempt to eliminate cross-lane reads is to use what is known as time division multiplexing. Such technology alternately turns on an antenna in a first lane to collect a toll, while turning off adjacent antennas. If the antenna generates a single read, it is identified with the car traveling in the first lane. However, the potential for cross-lane reads still exists. A car straddling lanes could avoid payment if an antenna of the wrong lane is activated, and a paying customer could be deemed a violator.
By conducting multiple reads, system 6708 provides the ability to minimize all the above-mentioned problems with the current art. A more precise location of a vehicle is generated, the possibility of mistaking one vehicle for another nearby based on a single read is reduced, and lane straddlers do not avoid payment.
IVIS System
In exemplary embodiments of the present invention, IVIS 6704 comprises vehicle detection sensors, e.g., inductive loop sensors as depicted in
By synchronizing information obtained from IVIS 6704 and RF system 6708, the likelihood of failing to identify a vehicle is greatly reduced. For example, using RF reading to count the number of tag reads and determining the entry point of a vehicle at an IVIS sensor, the entry time of a vehicle into an RF read zone can be calculated, so that the time when tag reads should begin and end can be accurately determined, if the vehicle has an RF tag. As described above, an IVIS system based on ferromagnetic loop sensors containing, among others, gradient sensors, can accurately determine the spacing between two axles of a vehicle. In a majority of vehicles, an RF tag is located in the front one-third of that spacing between the axles. By knowing where the RF read zone is located on the earth compared to the RF read antenna, one can then determine the approximate time that the tag reads should start and stop, as discussed further below.
Use of RF system 6708 in conjunction with IVIS system 6704 provides further advantages in identifying a vehicle in an open road multilane environment. By knowing when a vehicle transponder should enter RF read zone 6808, for example, using IVIS gradient sensor 6814, and conducting continuous reads (continuously sampling) of the RF transponder during the time when the vehicle is read zone 6808, accurate marrying of IVIS data and RF data generated by the passing vehicle assures that a correct identification is made. This also increases the likelihood of identifying vehicles that do not have an RF tag since the system can determine if no RF reads are successful during the time in which the vehicle should be in the RF read zone.
In preferred embodiments, MVIC system central processor unit 6702 gathers all information sent by the subsystems including IVIS 6704, VTS 6706, and RF system 6708. The vehicle position can be partially determined based on the vehicle and/or vehicle axle entry/exit times on IVIS gradient sensors. IVIS 6704 is also capable of calculating a speed of the vehicle based on the entry/exit times of a vehicle and/or vehicle axle on the gradient sensors. IVIS 6704 can use this speed to calculate the axle spacing of the vehicle. All this information is subsequently sent to MVIC central process unit 6702.
MVIC central process unit 6702 also receives transponder data from RF system 6708. As further depicted in
In an exemplary embodiment of the present invention depicted in
In exemplary embodiments of the present invention, system 6700 collects information including activation information obtained from lane straddling sensors, vehicle axle spacing, arrival time and departure time of the vehicle and/or vehicle axles in each lane, speed of the vehicle, and length of the vehicle all obtained from other sensors of IVIS system 6704, so that the information can be compared to determine the status of multiple vehicles occupying adjacent lanes.
For example, if RF data collected based on the amount of RF reads in adjacent lanes indicates a first vehicle is a straddler, and IVIS lane straddling diamond sensors indicate the vehicle is a straddler, and additional data such as vehicle speed, arrival and departure information, and axle spacing indicate it is a straddler, then system 6700 can determine which of a plurality of cameras of VICU 6714 to employ to record a car that did not pay by RF tag, and which of multiple vehicles in close proximity to appropriately allocate the payment of a toll. In exemplary embodiments, either RF tracking system 6708 or IVIS 6704 can be solely used to identify a straddler with a high degree of accuracy. But in a preferred embodiments, by concurrent use of any combination of RF tracking system 6708, IVIS 6704, as well as Vision tracking system 6706, MVIC system 6700 performs more accurately as a multilane vehicle identification system.
In the following sections, operation of an MVIC system according to exemplary embodiments of the present invention is discussed in further detail.
As vehicle 7002 travels through arrangement 7000, MVIC unit 6702 receives vehicle information from IVIS sensors 7008, 7010, 7012 as well as RF read zones 7014, 7016. Vehicle information such as vehicle speed, axle spacings, axle amplitudes and entry/exit times of the vehicle axles on sensors 7008, 7010 of both the lanes are forwarded to unit 6702.
MVIC central process unit 6702 also receives RF data for the vehicle (if a transponder exists in the vehicle) from RF (AVI) system 6708, using antennas 7018 over respective lanes 7004,7006. Gantry 7019 is configured to contain a plurality of an antennas. Preferably, the location of antennas 7018 on gantry 7019 is such that an antenna is placed over each travel lane. Preferably antennas 7018 in both lanes 7004, 7006 try to read the same vehicle transponder (not shown) as many times as possible, and forward the read information to MVIC unit 6702. MVIC central process unit 6702 consolidates all these data to make an accurate determination of the position of vehicle 7002.
MVIC central process unit 6702 also receives data from diamond-shaped lane straddling sensors 7020a, 7020b, 7020c that are positioned to straddle their respective lanes, as depicted in
At step 7202, if central process unit 6702 determines that vehicle entry/exit times are not reported from sensors 7008, 7010 of both travel lanes, then the process moves to step 7204, where unit 6702 makes a tentative decision that vehicle 7002 is not straddling as per determination by IVIS 6704. The process then moves to step 7222.
If entry/exit times are reported by sensors 7008, 7010 in both lanes, then the process moves to step 7206, where a difference in entry/exit times between that recorded for lane 7004 and 7006 is calculated. This time difference is then used to assess whether the data likely reflects detection of one vehicle or two vehicles. For example, at a highway speed of 60 mph, a vehicle may traverse an average car length of 15 feet in about 125-150 milliseconds. Therefore, if IVIS arrays in neighboring lanes report differences in vehicle entry times that are less than the calculated time to travel such a distance, it can be assumed that the recorded times are from the same vehicle, since two vehicles cannot occupy the same space at the same time. If a value of entry time discrepancy greater than such a calculated value is recorded, it increases the likelihood that two vehicles are present.
In step 7208, in the embodiment shown, if central process unit 6702 determines that vehicle entry/exit times reported from adjacent lanes are greater than 125 milliseconds, the process moves to step 7210 where a tentative decision is made that the data received comes from two vehicles, and vehicle 7002 is not lane straddling. The process then moves to step 7222. If a difference in entry times less than 125 milliseconds is reported, the process moves to step 7212.
In step 7212, if central process unit 6702 determines that data collected from IVIS sensors in both lanes does not correspond to a same range of vehicle speed, the process moves to step 7214, where a tentative decision is made that vehicle 7002 is not lane straddling. The process then moves to step 7222. If a same range of vehicle speed is reported form IVIS sensor data of both lanes, then the process moves to step 7216.
In step 7216, if central process unit 6702 determines that the number of vehicle axles and axle spacing recorded from IVIS data reported from both lanes does not agree, then the process moves to step 7218, where a tentative decision is made that vehicle 7002 is not lane straddling. The process then moves to step 7222. If axle number and axle spacing data collected from IVIS sensors in both lanes agrees, then the process moves to step 7220 where central process unit 6702 makes a partial decision that vehicle 7002 is lane straddling according to IVIS data.
In step 7222, central process unit 6702 retrieves RF data reported from a transponder on vehicle 7002. If central process unit 6702 determines that RF data corresponding to vehicle 7002 is not reported from both RF read zones the process moves to step 7224, where a tentative decision is made that vehicle 7002 is not lane straddling. The process then moves to step 7234. If central process unit 6702 determines that RF data corresponding to vehicle 7002 is reported from both RF read zones the process moves to step 7226.
In step 7226, unit 6702 calculates the number of RF reads obtained from each RF read zone 7014, 7016.
In step 7228, if central process unit 6702 determines that the number of RF reads received from read zone 7014 differs widely from that received from zone 7016, the process moves to step 7230. In step 7230 a tentative decision that vehicle lane straddling by vehicle 7002 did not occur is made. The process then moves to step 7234.
If central process unit 6702 determines that the number of reported transponder reads in zone 7214 is close to the corresponding number in zone 7216, the process moves to step 7232. Because the number of reported reads in neighboring lanes is close, it is determined that vehicle 7002 is lane straddling as determined by system 6708. The process then moves to step 7234.
Referring now to
As evident from
Referring again to
In step 7236, if it is determined that activation occurred from other sensors in addition to middle sensor 7020b, then the process moves to step 7238 where a determination is made that vehicle 7002 was not straddling lanes. If only sensor 7020b reported activation, then the process move to step 7240 where vehicle 7002 is tentatively deemed to be straddling lanes 7004, 7006 based on lane straddling sensor data. Based on the above approach, the MVIC system makes a final determination as to whether vehicle straddling has occurred. Depending on the agreement or lack of agreement between the tentative determinations of straddling from data received from “subsystems” (the subsystems comprise in the case of
In step 7504, central process unit 6702 determines if more than one sensor reports activation. If not, the process moves to step 7506 where a determination that only one vehicle is present and is straddling lanes, as illustrated for vehicle 7302 in
In step 7508 central process unit 6702 determines if more than two sensors report activation. If not, the process moves to step 7510.
In the steps to follow, three different scenarios where only two sensors are activated can be distinguished. In a first scenario illustrated in
In step 7510, central process unit 6702 determines whether the two sensors activated are adjacent. If not, then the process moves to step 7512 where it is determined that two vehicles are present and each is straddling a lane, as illustrated in
If adjacent sensors area activated, then the process moves to step 7514. In step 7514, unit 6702 checks other IVIS sensor data and RF data reported for the same transaction or time period from arrangement 7000. Using the other IVIS sensor and RF data, a determination is made as to whether the two adjacent lane straddling activation reports represent a single vehicle traveling entirely within a lane, as in
If three lane straddling sensors report activation, the process moves to step 7516, where a tentative determination is made that two vehicles are present. The process then moves to step 7518 to confirm the determination using other IVIS and RF data.
RF Read Zone Prediction Technique
Other embodiments of the present invention employ accurate synchronization of data gathered from different subsystems, such as IVIS 6704, VTS 6706, and RF system 6708, to track and identify vehicles in an MVIC environment.
In step 7902, a point at which a vehicle transponder enters an RF read zone is determined. Referring to
In step 7904, a distance between an entry point of a vehicle over a first IVIS reference point 7010 and the entry point of the RF read zone is determined. In the example illustrated in
In step 7906, an entry time TI of a vehicle feature of interest over an IVIS reference point in is recorded by IVIS system 6704. TI can correspond, for example, to a front edge of vehicle 8002 crossing over a first edge of sensor 7012 shown in
In step 7908, a speed VS of vehicle 8002 is measured by IVIS array 7012, as described above.
In step 7910, a vehicle length and axle spacing for vehicle 8002 are measured by a loop sensor, such as sensor 7012.
In an exemplary embodiment, based on overall vehicle size and axle separation, in step 7912 a projected horizontal distance L2 between the front axle and transponder of vehicle 8002 is calculated by central process unit 6702. Historically, for a majority of vehicles, an RF tag is located in a front one-third of a spacing between the axles. Thus, distance L2 represents an estimate of a projected horizontal between distance tag 8004 and front axle 8006, based in part on measurement of axle separation.
In step 7914, a distance L=L1+L2 is calculated, which represents the distance vehicle 8002 travels from the time the vehicle feature of interest passes an IVIS reference point as in step 7906, and when vehicle transponder 8004 enters RF zone 7014. In an exemplary embodiment, the vehicle feature of interest is front axle 8006, and IVIS reference point is sensor 7010 at point C, which detects the front axle presence as it passes over point C. Thus, after axle 8006 passes over point C, it travels a distance L1 to reach a point over point A′, and continues distance L2 before transponder 8004 is positioned over A′ at the point of entry into RF read zone 7014.
In step 7916, unit 6702 calculates an expected time of entry TE, for vehicle transponder 8004 to enter zone 7014, TE=TI+L/VS. Thus, system 6700 measures an initial vehicle entry time TI as detected by a loop sensor of IVIS array 8010, as well as speed and axle spacing, and computes an estimated time TE when RF antenna 7018 can begin reading transponder 8004, based on a preconfigured MVIC system distance L1 and estimated vehicle-based distance L2. Similarly, with knowledge of the distance A-B, based on the geometry of read zone 7014, an exit time TX can be calculated.
Referring again also to
In step 7920, unit 6702 records a time TRE in which a first read of transponder 7904 is received.
In step 7922, antennas 7018 conduct continuous reads, such that multiple RF reads of transponder 7904 are recorded as vehicle 7902 travels through RF read zone 7014.
In step 7924, central process unit 6702 records a time TRX that a last RF read of transponder 7904 is recorded before no further successful reads are received.
In step 7926, central process unit 6702 compares calculated RF read zone entry time TE to actual recorded time TRE. Preferably, a comparison between calculated and recorded exit times, TX and TRX, is also made.
In step 7928, based on comparison of predicted entry and exit times of vehicle transponder 8004 in zone 7014, central process unit 6702 makes a determination as to whether the vehicle detected by IVIS array 8010 corresponds to the RF tag read subsequently.
Because multiple RF reads are conducted, a “time window” in which vehicle 8002 enters, passes through, and exits read zone 7014 is created and can be preserved in a transaction record. The precision of this window can be maximized by maximizing the rate at which RF reads are conducted. Thus, if a vehicle passing through a 10 foot long RF read zone at 100 feet/second (˜65 mph) is read at a rate of 50 times per second, or every 20 milliseconds, it can be expected to be read approximately 5 times within the 100 milliseconds it takes to traverse the read zone. However, a slight variation in capturing a reflected signal from the transponder might cause an actual number of reads to be 4 or 6, leading to some uncertainty in actual entry and exit times. However, if the vehicle is read at a rate of 330 times per second (once every 3 milliseconds) the three millisecond precision provides for the vehicle to be recorded about 33 times, within the RF read zone. A slight variation in the number of reads, from 32 to 34 reads, for example, results in much less uncertainty as to actual vehicle entry and exit times in the RF read zone.
In other embodiments, vehicle data collected from a VTS, such as VTS 6706, can be synchronized with an RF read zone system, either in conjunction with the IVIS system described above, or in place of the IVIS system. This data can result in a VTS-based RF read zone prediction. For example, a time can be recorded in which a vehicle appears in an image captured by a VTS mounted near the RF read zone. The time and relative position of the vehicle in the image with respect to the RF read zone can then be used to establish whether a vehicle toll tag measured in the RF read zone is associated with the vehicle in question.
In a further exemplary embodiment of the present invention, VTS 6706 is used in conjunction with IVIS 6704 to provide accurate tracking of a vehicle in an MVIC environment. In
In another embodiment illustrated in
In step 9004, images of passing vehicles are captured by the camera unit. Preferably, the images are captured continuously at a predetermined frame rate.
In step 9006, the captured images are stabilized by compensating for pixel movement caused by camera movement due to gantry vibration during capture of the images.
In step 9008, a monitoring zone within the images is established. The monitoring zone can comprise all or part of each image.
In step 9010, moving objects are identified by analyzing the series of captured and stabilized images within the monitoring zone.
In step 9012, a segmentation process is applied to pixels, such that all pixels identified as belonging to the same object are grouped together.
In step 9014, a trajectory is extracted based on a relative movement of a segmented object between predetermined captured images.
In step 9016, a predicted trajectory is obtained for an object during further movement within the monitoring zone.
In step 9018, vehicle trajectory information is reported to a central process unit, for example unit 6702, in order to assist in vehicle tracking.
In
Such position-time trajectory output information can be combined with IVIS straddle sensor information to determine whether a vehicle is a straddler or not. For example, cameras of VTS 6706 can be mounted in close proximity to an IVIS sensor. Vehicle images of a vehicle traveling in a lane of interest can be collected by system 6706, forwarded to central process unit 6702, time stamped, and stored in a record with vehicle information collected at the same time from corresponding IVIS sensors. Examination of a trajectory of the vehicle can help make a determination as to whether it is straddling, changing lanes, and so forth.
Recently, new technologies for automatic tolling of vehicles have emerged, such as pay by plate, where an authorized vehicle can be assessed a toll by capture of its license plate image, and “sticker” tag technology, where a toll is assessed by RF communication between a reader and a small RF tag on a vehicle. In both technologies, a vehicle passing a tolling region is assessed a toll without providing information to the vehicle driver as to the tolling transaction. For example, sticker tags installed on a vehicle have an embedded RF chip that is able to broadcast a serial number or other indicator that allows an RF system reading the sticker tag to deduct money from an account associated with the sticker tag. Such sticker tags tend to be too small, however, to provide an alerting signal to the driver when an RF system reads the tag and charges a toll. In other words, the sticker tag is a silent tag, by which it is meant that the silent tag is unable to provide the driver with relevant information concerning the account that the silent tag is linked to. Similarly, a pay by plate user after passing through a region where a license plate image is captured (also termed “read”) and a toll assessed to an account associated with that license plate, is not alerted as to any information concerning that account.
Because of the inability of technologies such as sticker tags and pay by plate to provide direct feedback to a vehicle user during or after a toll transaction, a vehicle user, such as a sticker tag user, may in the first instance be assessed a toll without being aware. In addition, whether aware of tolling transactions taking place or not, the driver (user) may have no knowledge of the state of an account balance used to pay the automatically assessed toll. The balance may be low or insufficient to pay a toll, in which case the driver may be assessed a violation without being aware until sometime later. Furthermore, a driver aware that an account is being depleted during travel through automatic toll points, may nevertheless have to wait until a phone call or internet transaction, or other means of account verification can be performed before determining the state of the account balance.
In one embodiment of the present invention, driver alert module 9102 is triggered to provide a driver with a simplified account status signal to a driver. Preferably, driver alert module 9102 includes one or more light-emitting devices located in a roadway that, when activated by a trigger, present a visible sign to a passing driver. For example, another module (or “system”) can act as a tolling module, where a vehicle toll account is read as the vehicle is encountered by the tolling module when it passes by. Referring again to
In one embodiment of the invention, illustrated in
In one embodiment, visible light source 9208 can include a variety of signals (not shown), each representative of a different account status. For example, in one arrangement, light source 9208 includes individual blue, yellow and green light elements, each light indicative of a different account status. The blue light, for example, can indicate insufficient funds to pay for the tolling transaction just attempted by RF system 9206. Depending on the exact nature of the toll account, the blue light may additionally be indicative that a violation is being reported, or it may indicate to the driver that funds must be replenished within a certain time in order that a violation not be assessed. Yellow can indicate that the toll tag account is low, and should be replenished. Green can indicate that the toll tag contains a sufficient balance that no action need be taken in the near future.
However, other configurations of alerting lights are possible. In other embodiments of the invention, a single type of alert signal is sent to a driver after passing through a zone where an RF toll transaction takes place. For example, a single yellow light can be activated to alert a driver of insufficient or low funds in the account associated with the driver's toll tag, or a single blue light could be used to indicate insufficient funds in the toll tag account.
Thus, system 9102 provides a convenient way to alert a driver as to an account status so that the driver can be apprised in real time, and be enabled, for example, to take corrective action when necessary and possibly prevent imminent toll violations from being enforced, or prevent continued violations from occurring. Furthermore, a driver receiving a green signal, for example, is provided with reassurance during a trip, so that time consuming action need not be taken to check account balances to ensure that a vehicle can properly be operated on an automatic toll road.
In embodiments of the invention, system 9102 employs specific criteria to set account balance boundaries that delineate the different account status regions. For example, the green/yellow account balance boundary might be set based on average vehicle travel patterns that determine how much more toll charges a driver is likely to incur within a set period of time.
In another embodiment of the invention, illustrated in
In other embodiments, a visual systems such as VICU 6714, or vision tracking system 6706 can be used to capture license plate information and assess a toll for a pay by plate vehicle, as well as initiate a violation report, if necessary. In these latter embodiments, lighting sources that are triggered by the visual system are chosen to be located within a travel lane and spaced about 20-120 feet (in the direction of vehicle travel) from a license plate capture camera or other device that acts as a tolling point.
In embodiments where only a single lighting source is employed in a vehicle alert system, the separation distance between the lighting source and a tolling point can be set based on select criteria. For example, average vehicle speed and/or average vehicle spacing in the vicinity of the tolling point can be used to determine the appropriate separation distance.
In further embodiments of the invention, the techniques described above with respect to
In other embodiments of the invention, system 9102 can be used in conjunction with any combination of other systems (also termed “modules”) such as RF system 6708, IVIS 6704, Vision tracking system 6706, and VICU 6714, where at least one of the other modules provides a means for identifying a vehicle or vehicle toll account and assessing a toll associated with that account. Accordingly, a driver of an identified vehicle can be alerted that a toll is being assessed, or simply that information associated with the vehicle has been recorded. Vehicle identification using Tandem RF read zones
In some AVI systems that employ RF read technology, a read-only system is employed. This involves simply reading an identifier from a toll transponder, which can then be used by a processing unit in an AVI system to charge an account associated with the identifier, analogous to charging an account associated with a credit card number. In a transaction carried on with a passing vehicle, a vehicle tag is read once as it passes through an RF read zone, and a toll charged to the account associated with the tag.
More typically, AVI technology employs read/write technology, in which information can also be written by an RF antenna to a toll tag on a passing vehicle. In the latter case, an RF system first interacts with the toll tag to determine information such as a transponder number, a transponder ID, a current balance on the toll tag, and various other data that is contained on the transponder. Based on this information, the system makes a decision as to whether a payment valid and write information back to the transponder. The information typically includes an updated account balance for the toll tag. Finally, the system may read the information again to verify that all the previous transactions took place as planned.
However, conventional AVI systems conduct the above-described multiple transactions in a fairly inefficient manner for vehicles traveling at high roadway speeds. Originally such systems were designed for stop and go transactions in single lanes, and not intended to operate in a high speed MVIC environment. The conventional technology involves reading an RF tag once while the vehicle is within a single lane, and writing back to the tag once for read/write systems. However, when a vehicle passes from one zone of reading and writing in a first lane and into an adjacent lane, it enters a different zone of reading and writing. Therefore, a toll transaction started while the vehicle travels through the first zone may be interrupted before completion. If another transaction is subsequently started in the second zone corresponding to the new travel lane, it may also lack sufficient time to complete before the vehicle leaves the read zone area. Therefore, revenue is lost and a transaction is not fully captured.
In addition, if a read or write process fails, at typical highway vehicle speeds, there is typically not sufficient time to conduct a second attempt at reading or writing before a vehicle leaves a reading zone. Also, the potential exists with conventional AVI technology for an antenna that is used for a first travel lane to inadvertently transact with a vehicle transponder in an adjacent lane or in a straddling region of the lane, and mis-associate the transponder with a vehicle passing through the first lane (cross-lane read). This can occur because an RF read signal bounced off a vehicle transponder in the adjacent lane reflects off the vehicle in the first lane, causing the transponder of the adjacent vehicle to be interpreted as residing in the first vehicle. Therefore, the system could collect revenue from the transponder of the adjacent lane vehicle while charging the vehicle for violation, since it was not read by the antenna in its lane. Also, the potential exists to charge a vehicle transponder in two adjacent lanes if an RF read zone is sufficiently over-lapping.
It is common practice in conventional AVI systems to reduce cross-lane reads using time division multiplexing for adjacent RF zones, so that antennas are cycled off and on in a pattern that provides for no adjacent antennas to be on simultaneously. However, this practice increases the likelihood that a vehicle tag passing at high speed and changing lanes will fail to be read at all.
System 8400 of the present invention overcomes the above problems by providing two large powerful RF read zones 8404, 8406. As depicted in
In a preferred embodiment, a vehicle toll tag (not shown) is read while passing through zone 8406. System 8400 is configured so that a successful read can take place if the vehicle tag passes through only lane 8418, only lane 8420, or a combination of the two lanes while traversing zone 8406. For example, continuous reads can be conducted at a rate of about 300 times per second, or every three milliseconds, resulting in about 75 reads for a vehicle traveling at 60 mph through the center of a 20 ft read zone. Thus, system 8400 has sufficient time to conduct multiple reads of each passing vehicle, even if a vehicle is straddling the lanes or passing between lanes, where the amount of successful reads may be reduced by about 50%.
In an exemplary embodiment of the present invention, system 8400 is configured to conduct read/write transactions with a vehicle containing a read/write RF toll tag.
In step 8504, system 8400 updates the account balance for the vehicle toll tag. The updated balance reflects a toll deducted from the present account balance based on a predetermined toll value to be assessed against the vehicle.
In step 8506 information is written back to the toll tag that includes the updated account balance.
In step 8508, the toll tag is re-read by system 8400 to determine whether the toll transaction was properly recorded and the account balance accurately updated.
In step 8510, system 8400 conducts multiple RF reads of the vehicle as it moves through secondary RF read zone 8404. In a preferred embodiment, the multiple reads are conducted primarily to track the vehicle position as it passes through zone 8402. In this manner, the vehicle can be properly identified so that system 8400 properly associates the vehicle with the RF transponder transactions that occurred in steps 8502-8508. This also helps the system distinguish the paying vehicle from a vehicle passing nearby that does not have a transponder. Preferably, as the vehicle moves through zone 8404, lane straddling sensors 8416a-8416c are used to provide additional vehicle tracking data. In an exemplary embodiment, a vision tracking system (VTS) described above, is used to capture vehicle images when the vehicle passes through zone 8404. The lane straddling sensor data, RF data, and VTS data can be passed to an MVIC controller in order to correctly associate the paying vehicle and any non paying vehicle with the captured vehicle images and to classify vehicles, detect vehicle speed, and vehicle movement. When a vehicle that does not have a valid toll tag (non-paying vehicle) is identified, further vehicle information of that vehicle can be gathered and processed, for purposes of general data collection, statistics, or enforcement. For example, a license plate image of a vehicle not paying via RF toll tag can be captured and used to determine whether the non-paying vehicle is a registered pay by plate vehicle, in which case an appropriate toll can be assessed by the latter method. If the non-paying vehicle is not registered to pay by means other than RF toll tag, a violation report can be forwarded to an appropriate violation enforcement system.
In another embodiment of the present invention, system 8400 is employed to conduct transactions with a read only vehicle toll tag. In this case, the read-only toll tag can be read initially as the vehicle enters zone 8406 to extract information such as an account number to charge a toll. The toll tag can be read multiple times to ensure a correct transaction.
A benefit of the system of the present invention is that the tandem RF read zones afford a greater possibility to complete a series of transactions with a read/write transponder. If, for example, there is a difficulty in finally writing back to the transponder and verifying that the correct amounts associated with a toll transaction are properly received from the transponder, while the vehicle is in zone 8406, system 8400 can package the information from the transactions conducted in zone 8406 and send the information to the transponders of zone 8404 so that any unfinished transactions can be completed. In other words, the system continues the transaction series with the vehicle transponder at a point where it was unable to complete it using RF read zone 8406. In the example shown in
Although
In another embodiment of the present invention, a dual read zone system is employed for RF read/write toll tags used in vehicles traveling in a closed toll road system. In this case, at the entry point, information on time, date, and vehicle location is written to the transponder, while at the exit point, this information is read out to determine the distance traveled on the toll road, so that a distance-based toll can be assessed.
In another embodiment of the present invention, RF read zones 8404 and 8406 are created using mutually different RF technologies. In this embodiment, read zone 8404 is capable of communicating with RF devices, such as transponders of a first RF technology type. Read zone 8406 is capable of communicating with RF transponders of a second RF technology type. In general, the first and second RF technology types can differ such that RF tags of either technology type can only be read or written to by one of read zones 8404, 8406. For example, the RF read zone technology associated with read zone 8404 may be unique to a vendor selling a particular RF toll tag, so that only those vehicles having the vendor's toll tags can be read in read zone 8404. Similarly, read zone 8406 may correspond to a second vendor's unique RF technology also configured to only interact with toll tags sold by the second vendor. This configuration of a tandem RF read zone system is useful when vehicles using RF tags of differing technologies are permitted to concurrently use a common roadway as a tolling road. Accordingly, in this embodiment, a vehicle having one of two differing RF toll tags can be read when passing through system 8400, either within read zone 8404 or read zone 8406. The dual gantry arrangement of
In further exemplary embodiments of the present invention, each RF technology type of a multiple RF read zone system is associated with a dual RF read zone that operates as described above to allow reading, writing, and vehicle tracking through tandem read zones. Thus, in an embodiment used for two different RF read technologies, four RF read zones are created in tandem, two of which are used for a first RF technology and the other two used for a second technology. Accordingly, vehicles having RF toll tags corresponding to either one of the two RF technologies employed in the four zone system, can be read, written to, and tracked while passing through the system.
Synchronization of Loop Based Sensors
In a further aspect of the present invention, a system for controlling loop based sensors in a multilane environment comprises a master program that controls the sampling periods of loop based sensors. A common problem that occurs using inductive loop technology in multiple lanes, either in a multilane open road environment or a toll plaza or toll ramp environment, is overlap of adjacent sensor fields during operation. If a first lane and second, adjacent lane both have loop detectors, where the loop detectors of the first and second lane are located next to each other, the probability exists that at various times the loop detectors will be on at the same time and overlap frequencies. When the adjacent loops are on simultaneously, a mutual change of induction within each loop is likely to be induced, such that one or both of the loops may be interpret the change to indicate a vehicle presence, even in the absence of a vehicle. In addition, if a vehicle is present, the change in inductance induced by mutual overlap could confuse an inductive loop that the vehicle passes over into miscounting the number of vehicle axles and misclassifying the vehicle.
In a preferred embodiment of the present invention, individual loop detector controllers are configured to control sampling periods of loop sensors (or sensors) within individual lanes such that the sampling periods of loop sensors within one lane are coordinated with the sampling periods of loop sensors within adjacent lanes. Preferably, like sensors in a sensor array in a first lane are placed adjacent to like sensors of sensors in adjacent lanes, as illustrated in
Referring to
In order to synchronize an entire toll plaza regardless of its quantity of IVIS sensors, so that a checkerboard pattern of sensor sampling is maintained, a synchronization signal is sent to all IVIS detectors. Preferably, the master program communicates with IVIS detectors over an Ethernet, serial or a dedicated communications line. Preferably, a signal is sent at one time to all IVIS detectors with instructions to begin a primary sample period instantly or at a predetermined time. In an exemplary embodiment, this synchronization signal is sent to every sensor on a predetermined time schedule. For example, a synchronization signal could be sent every 10 to 15 seconds or every 30 seconds, depending on an amount of drift in crystals used for clock timing within the detectors.
In another embodiment, if clock speed of detectors used in an IVIS system are extremely accurate and have no drift, only a single synchronization signal is sent. Thus, a single synchronization upon start up of all lanes is sent.
In still another embodiment of the invention, all detector boards corresponding to the IVIS detectors are synchronized according to the phase of a common power source used to power all the IVIS detectors.
The foregoing disclosure of preferred embodiments of the present invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many variations and modifications of the embodiments described herein will be apparent to one of ordinary skill in the art in light of the above disclosure. For example, with respect to the structure or operation of an MVIC system, use of any combination of the systems 6704, 6706, 6708, 6710, and 6714 is believed within the scope of the invention. Furthermore, use of the aforementioned systems, in particular systems 6704, 6706, 6708, and 6714 to collect and manage vehicle information other than for tolling purposes is within the scope of this invention. For example, image capture, vision tracking, and vehicle classification performed by the aforementioned systems can be used for the purposes of data collection or law enforcement purposes. The scope of the invention is to be defined only by the claims appended hereto, and by their equivalents.
Further, in describing representative embodiments of the present invention, the specification may have presented the method and/or process of the present invention as a particular sequence of steps. However, to the extent that the method or process does not rely on the particular order of steps set forth herein, the method or process should not be limited to the particular sequence of steps described. As one of ordinary skill in the art would appreciate, other sequences of steps may be possible. Therefore, the particular order of the steps set forth in the specification should not be construed as limitations on the claims. In addition, the claims directed to the method and/or process of the present invention should not be limited to the performance of their steps in the order written, and one skilled in the art can readily appreciate that the sequences may be varied and still remain within the spirit and scope of the present invention.
This application claims benefit of U.S. Provisional Application Nos. 60/574,996, 60/574,997, 60/574,998, and 60/574,999, all filed May 28, 2004, which are herein incorporated by reference in their entirety. This application is a continuation of Ser. No. 11/138,542, filed May 27, 2005, now U.S. Pat. No. 7,324,015, which is a continuation-in-part (“CIP”) application that claims the benefit of U.S. patent application Ser. No. 10/953,858, filed Sep. 30, 2004 (“the '858 application”), now U.S. Pat. No. 7,071,840, which is a continuation of U.S. patent application Ser. No. 10/206,972, Jul. 30, 2002 now U.S. Pat. No. 6,864,804, which is a CIP application of U.S. patent application Ser. No. 10/098,131, filed Mar. 15, 2002 (“the '131 application”), now abandoned which is a CIP application of U.S. patent application Ser. No. 09/977,937 (“the '937 application”), now U.S. Pat. No. 7,136,828, filed Oct. 17, 2001. The above patent and all the above applications are incorporated herein by reference in their entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 2646215 | Stovall et al. | Jul 1953 | A |
| 2769165 | Bower | Oct 1956 | A |
| 2908895 | Cooper | Oct 1959 | A |
| 3018469 | Grant et al. | Jan 1962 | A |
| 3070293 | Rosapepe | Dec 1962 | A |
| 3090941 | Breese | May 1963 | A |
| 3705976 | Platzman | Dec 1972 | A |
| 3927389 | Neeloff | Dec 1975 | A |
| 3984764 | Koerner | Oct 1976 | A |
| 4239415 | Blikken | Dec 1980 | A |
| 4256128 | Chiappetti | Mar 1981 | A |
| 4503961 | Chittleborough | Mar 1985 | A |
| 4524698 | Tourtellier et al. | Jun 1985 | A |
| 4635661 | Uematsu et al. | Jan 1987 | A |
| 4718563 | Ellgass | Jan 1988 | A |
| 4838406 | Levasseur | Jun 1989 | A |
| 5040658 | Levasseur | Aug 1991 | A |
| 5128669 | Dadds et al. | Jul 1992 | A |
| 5164732 | Brockelsby et al. | Nov 1992 | A |
| 5173692 | Shapiro et al. | Dec 1992 | A |
| 5278555 | Hoekman | Jan 1994 | A |
| 5339081 | Jefferis et al. | Aug 1994 | A |
| 5485006 | Allen et al. | Jan 1996 | A |
| 5614894 | Stanczyk | Mar 1997 | A |
| 5617086 | Klashinsky et al. | Apr 1997 | A |
| 5687499 | Brnjac | Nov 1997 | A |
| 5717390 | Hasselbring | Feb 1998 | A |
| 5764163 | Waldman et al. | Jun 1998 | A |
| 5777565 | Hayashi et al. | Jul 1998 | A |
| 5801943 | Nasburg | Sep 1998 | A |
| 5805082 | Hassett | Sep 1998 | A |
| 5829569 | Cheng et al. | Nov 1998 | A |
| 5864306 | Dwyer et al. | Jan 1999 | A |
| 5900825 | Pressel et al. | May 1999 | A |
| 5948038 | Daly et al. | Sep 1999 | A |
| 6040785 | Park et al. | Mar 2000 | A |
| 6042008 | Ando et al. | Mar 2000 | A |
| 6109568 | Gilbert et al. | Aug 2000 | A |
| 6121898 | Moetteli | Sep 2000 | A |
| 6140941 | Dwyer et al. | Oct 2000 | A |
| 6171182 | Geib et al. | Jan 2001 | B1 |
| 6198987 | Park et al. | Mar 2001 | B1 |
| 6204778 | Bergan et al. | Mar 2001 | B1 |
| 6264545 | Magee et al. | Jul 2001 | B1 |
| 6318537 | Jones et al. | Nov 2001 | B1 |
| 6337640 | Lees et al. | Jan 2002 | B2 |
| 6342845 | Hilliard et al. | Jan 2002 | B1 |
| 6345228 | Lees | Feb 2002 | B1 |
| 6378818 | Padiak et al. | Apr 2002 | B1 |
| 6380868 | Hilliard et al. | Apr 2002 | B1 |
| RE37822 | Anthonyson | Aug 2002 | E |
| 6483443 | Lees et al. | Nov 2002 | B1 |
| 6490443 | Freeny, Jr. | Dec 2002 | B1 |
| 6653946 | Hassett | Nov 2003 | B1 |
| 6744383 | Alfred et al. | Jun 2004 | B1 |
| 6752254 | Allen et al. | Jun 2004 | B1 |
| 6764163 | Anderson et al. | Jul 2004 | B2 |
| 6864804 | Allen et al. | Mar 2005 | B1 |
| 6865518 | Bertrand et al. | Mar 2005 | B2 |
| 7015827 | Allen et al. | Mar 2006 | B2 |
| 7071840 | Allen et al. | Jul 2006 | B2 |
| 7136828 | Allen et al. | Nov 2006 | B1 |
| 7324015 | Allen et al. | Jan 2008 | B1 |
| 7339495 | Kavner | Mar 2008 | B2 |
| 7379916 | Mizrah | May 2008 | B1 |
| 20020104013 | Ghazarian | Aug 2002 | A1 |
| 20020140577 | Kavner | Oct 2002 | A1 |
| 20030001755 | Tiernay et al. | Jan 2003 | A1 |
| 20030011492 | Owen et al. | Jan 2003 | A1 |
| 20040174274 | Seabury et al. | Sep 2004 | A1 |
| 20050102873 | Poot | May 2005 | A1 |
| 20050110659 | Lu et al. | May 2005 | A1 |
| Number | Date | Country |
|---|---|---|
| 38 34 122 | Apr 1990 | DE |
| 577328 | Jan 1994 | EP |
| 0 881 612 | Dec 1998 | EP |
| 11-264868 | Sep 1999 | JP |
| 2001-331899 | Nov 2001 | JP |
| 2002242134 | Aug 2002 | JP |
| WO 0058926 | Oct 2000 | WO |
| WO 0058927 | Oct 2000 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20080143555 A1 | Jun 2008 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60574996 | May 2004 | US | |
| 06574997 | May 2004 | US | |
| 60574998 | May 2004 | US | |
| 60574999 | May 2004 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 11138542 | May 2005 | US |
| Child | 12020661 | US | |
| Parent | 10206972 | Jul 2002 | US |
| Child | 10953858 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 10953858 | Sep 2004 | US |
| Child | 11138542 | US | |
| Parent | 10098131 | Mar 2002 | US |
| Child | 10206972 | US | |
| Parent | 09977937 | Oct 2001 | US |
| Child | 10098131 | US |
