Not Applicable.
The present application is related to a method for vehicle identification and specification recall, and in particular, to a method for recalling a vehicle identification number (VIN) and vehicle identifying data based on a recognition of vehicle license plate data and jurisdiction identification, and the subsequent use of the VIN and vehicle identifying data to specifically identify the vehicle make, model, year, and factory options in order to recall vehicle-specific specifications and configuration data from a database.
Vehicle license plate recognition (LPR) image-processing technology is commonly utilized to capture identifying information from an image of a vehicle license plate. The technology is often used in a variety of security and traffic control or monitoring applications. A typical LPR system includes at least one imaging sensor for acquiring images of a vehicle, an image processing system for evaluating the acquired images to identify visible license plates, and a character recognition algorithm to extract relevant alpha-numerical data from the identified license plate image. The LPR system may further include an illumination system for use when ambient light is insufficient to illuminate the vehicle and license plate surfaces, and a network connection for exchanging data with one or more remote systems. The image processing system may be implemented as a hardware or software component associated with the imaging sensor, or may function as an independent processing system in communication with the imaging sensor.
In an automotive service environment, LPR may be utilized to assist a service center in identifying a customer or vehicle during an initial check-in or inspection. For example, as a customer drives a vehicle into a service lane to drop off the vehicle for service, an LPR system may capture the vehicle license plate data automatically, and convey identifying information to a service lane attendant station, enabling a vehicle service advisor to recall customer data quickly and efficiently.
In the event an LPR system is unable to adequately resolve the vehicle license plate data, incorrectly identifies one or more characters in the license plate image, or fails to identify the correct jurisdiction for the license plate data, the automated process for recalling customer data can break down, failing to recall any relevant information from the associated systems, or recalling incorrect information which is not associated with the specific vehicle or customer present at the service center. If the LPR system fails to recall any relevant information, the service advisor or technician can quickly recognize the situation, and obtain the missing information by other means. If however, the LPR system recalls incorrect information which is not associated with the specific vehicle or customer present, the error may be overlooked, leading to a cascade of problems ranging from incorrect vehicle identification, incorrect customer identification, recall of incorrect vehicle specifications, failure to identify relevant vehicle service history or outstanding manufacturer recall programs, etc.
Accordingly, it would be beneficial to improve an LPR system to improve the accuracy rate for the identification of vehicle license plate data, jurisdiction identification, and the recall of relevant information. Additional advantages may be realized by providing additional procedures to automate further steps in a vehicle service or inspection procedure based on the accurately recalled relevant vehicle information.
Briefly stated, the present disclosure sets forth a procedure for acquiring and utilizing vehicle license plate data during a vehicle service or inspection process. Initially, a vehicle enters into the detection region for an imaging sensor associated with a LPR system, triggering the acquisition of one or more images of the vehicle. The images are communicated to the LPR system, and evaluated to identify visible license plate features. The LPR system processes the identified license plate features to generate a packet of information which includes license plate characters and a license plate jurisdiction, such as a state, government branch, or country. The packet of information is communicated to a data archive system containing records associating specific vehicle identification numbers (VIN)s and other vehicle identifying features with license plate data, which returns a specific VIN and/or other vehicle identifying features corresponding to the license plate data contained in the communicated packet if a match is found within the stored records. A compilation of the identified and retrieved data, which may include the original image data, identified license plate characters, and a returned VIN and/or vehicle identifying feature data, is then communicated to a vehicle service system or inspection system, where it may be utilized in a vehicle service procedure or inspection process, such as by incorporation into an inspection report or record, or by subsequent evaluation of the returned data as an index to retrieve customer-specific records from an associated customer record database or vehicle-specific data from an associated vehicle record database.
In a further embodiment of the present disclosure, one or more additional imaging sensors are associated with the LPR system, and are configured to enable acquisition of images of both the front and rear license plate locations on a vehicle passing through the detection regions associated with the imaging sensors. The images from each imaging sensor are communicated to the LPR system, and evaluated to identify visible features for both front and rear license plates on the vehicle, if present. When both front and rear license plate features are identified, the LPR system evaluates the identified features with a front to rear cross-checking procedure to verify redundant information and to ensure the accuracy of the feature evaluation and associated optical character recognition. If the front to rear cross-checking procedure fails to confirm that identical features were found on both the front and rear license plates, the LPR system provides a suitable warning to an operator that the correct license plate information may not have been acquired for the specific vehicle. Optionally, the LPR system may provide the operator with an opportunity to review the identified front and rear license plate features, and to manually select which plate features to utilize for further processing.
In a further embodiment of the present disclosure, the LPR system is provided with a reference procedure for selecting, filtering, or ranking of license plate jurisdictional information. Acquired vehicle images are communicated to the LPR system, and evaluated to identify visible license plate features such as alpha-numeric characters, symbols, and colors. An evaluation of the visible license plate features determines if the alpha-numeric characters conform to rules or templates associated with license plate configurations for one or more jurisdictions. If required, jurisdictional-specific character substitution rules are applied. If the LPR system is unable to identify a specific jurisdiction from the visible license plate features, the LPR system is configured to utilize the reference procedure to establish a default jurisdiction, a ranked set of potential jurisdictions, or a set of excluded jurisdictions for inclusion in the packet of information communicated to the data archive system containing records associating specific vehicle identification numbers (VIN)s and other vehicle identifying features with license plate data. In response, the data archive system utilizes the communicated jurisdictional data to narrow the search for a specific license plate and corresponding VIN contained within the stored records by either focusing the search to only license plates within a default jurisdiction, to license plates contained in potential jurisdictions in a ranked order, or by eliminating any license plate records associated with each excluded jurisdiction from the search results.
In yet another embodiment, the LPR system is provided with a reference table for ranking license plate jurisdictional information based on the geographic proximity of potential jurisdictions to the geographic location of the vehicle service or inspection lane in which the LPR system is installed.
In an alternative embodiment, the LPR system is provided with a reference table for ranking license plate jurisdictional information based on the frequency with which license plates from different jurisdictions are observed at the geographic location of the vehicle service or inspection lane in which the LPR system is installed. This reference table may be static or dynamic, varying in accordance with changes in the observed frequency over a period of time.
In a further alternative embodiment, the LPR system is provided with a method for selecting a subset of license plate jurisdiction from a set of possible jurisdiction by filtering the set to exclude jurisdictions for which the identified alpha-numeric characters of the license plate do not conform to jurisdiction-specific acceptable sequences or templates.
The foregoing features, and advantages set forth in the present disclosure as well as presently preferred embodiments will become more apparent from the reading of the following description in connection with the accompanying drawings.
In the accompanying drawings which form part of the specification:
Corresponding reference numerals indicate corresponding parts throughout the several figures of the drawings. It is to be understood that the drawings are for illustrating the concepts set forth in the present disclosure and are not to scale.
Before any embodiments of the invention are explained in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of components set forth in the following description or illustrated in the drawings.
The following detailed description illustrates the invention by way of example and not by way of limitation. The description enables one skilled in the art to make and use the present disclosure, and describes several embodiments, adaptations, variations, alternatives, and uses of the present disclosure, including what is presently believed to be the best mode of carrying out the present disclosure.
Turning to the figures, and to
The LPR system 12 processes the identified license plate features to generate a packet of information 20a which includes representations of identified license plate alpha-numeric characters, symbols, and if possible, an identified license plate jurisdiction, such as a state, government branch, or country. The packet of information 20a is communicated (Box 120) via a communication link, such as the internet 15, either directly by the LPR system 12, or via a vehicle service or inspection system 14, to a data archive system 16 containing records associating specific vehicle identification numbers (VIN)s and other vehicle identifying features with license plate data. The data archive system 16 checks for a license plate match (Box 125) within the stored records and, if a match is found (Box 130), returns a responsive data packet 20b containing a specific VIN and any available vehicle identifying features. If no match is found, an appropriate no-match status response is provided (Box 135).
A compilation of the identified and retrieved data, which may include the original image data, identified license plate characters and symbols, and a returned VIN, as well as any available vehicle identifying data such as, but not limited to, vehicle make, model and sub-model names, model year, drive configuration, vehicle dimensions, and OEM tire fitment information, is then communicated to a vehicle service system or inspection system 14 (if not received directly thereby), where it may be utilized in a vehicle service procedure or inspection process (Box 140), either by incorporation into an inspection report or record (Box 170), or by subsequent evaluation of the returned VIN as an index to retrieve customer-specific data from an associated customer record database (Box 150) or vehicle-specific data from an associated vehicle record database (Box 160).
In a further embodiment of the present disclosure, illustrated in
Alternatively, two or more cameras 10 are configured to each enable acquisition of images of a common license plate location on a vehicle V passing through the detection region associated with the imaging sensors or cameras 10. The two or more cameras 10 may be disposed at different distances to the detection region, or aligned along different optical axis. The images from each imaging sensor or camera 10 are communicated to the LPR system 12, and evaluated to identify visible features for the license plate on the vehicle V. When the license plate features are identified, the LPR system 12 further evaluates the identified features using a cross-checking or comparison procedure to verify redundant information from each image, and to ensure the accuracy of the feature evaluation and associated optical character recognition. If the cross-checking or comparison procedure confirms observation of identical features on each license plate image, the LPR system 12 verifies the identified features for use in a vehicle identification number lookup. If, however, the cross-checking or comparison procedure fails to confirm a finding of identical features on each license plate image, such as due to excessive glare or shadow, the LPR system 12 provides a suitable warning to an operator that the correct license plate information may not have been acquired for the vehicle V. Optionally, the LPR system 12 may provide the operator with an opportunity to review the identified license plate images, and to manually select which license plate image to utilize for further processing and vehicle identification number lookup.
In a further embodiment of the present disclosure, each imaging sensor or camera 10 associated with the LPR system 12 is configured to acquire a sequence of images of a vehicle V, or portion thereof, passing through the associated detection region. The sequence of images are communicated to the LPR system 12, and are individually evaluated to identify visible features of a license plate if present. When license plate features are identified in two or more of the images, the LPR system 12 is configured to either select a “best” image for further evaluation (i.e., one in which the identified license plate features are most clearly visible, or which conform most closely to predetermined standards for size, contrast, color, viewing angle, etc.), or to implement a comparison procedure to verify redundant information identified on the observed license plate through the sequence of images. Redundant information verifies the accuracy of the feature evaluation and associated optical character recognition carried out by the LPR system 12. If the verification procedure confirms an observation of identical features on multiple images of the license plate, the LPR system 12 selects the identified features for use in a vehicle identification number lookup. If, however, the verification procedure fails to confirm that identical features were found in multiple images of the license plate, the LPR system 12 provides a suitable warning to an operator that the correct license plate information may not have been acquired for the vehicle V. Optionally, the LPR system may provide the operator with an opportunity to review the identified license plate features, and to manually select which license plate features to utilize for further processing and vehicle identification number lookup.
One of the inherent difficulties with automated license plate recognition is the identification of a jurisdiction associated with the license plate, such as a state, country, county, or government entity. A primary sequence of alpha-numeric characters and symbols on a license plate may be duplicated across multiple jurisdictions. Identification of the specific jurisdiction associated with an observed sequence of alpha-numeric characters and symbols is often required to be made by interpreting small abbreviations located at the periphery of the license plate, or the observed combination of character fonts, colors, contrast, and background images. It is not uncommon for the peripheral abbreviations to be hidden or partially obscured by surrounding license plate brackets, frames, or holders which secure the license plate to the vehicle V, or to be rendered illegible in the acquired images due to inadequate illumination, low contrast, off-axis viewing, blur caused by vehicle motion, or low image resolution.
In a further embodiment of the present disclosure, the LPR system 12 is provided with a procedure for selecting a jurisdictional designation to associate with the primary sequence of alpha-numeric characters identified from a license plate image from which no specific jurisdictional data can be identified, and to apply jurisdiction-specific and/or error-correcting character substitution rules to the sequence of primary alpha-numeric characters once a specific jurisdiction is selected.
As seen in
For situations where the LPR system 12 is unable to identify a specific jurisdiction from the visible license plate features (Box 200), the LPR system 12 is configured to select a designated jurisdiction to associate with the identified license plate features (Box 210). Several different options are available for selecting the designated jurisdiction, and the specific option chosen or implemented in the LPR system 12 may be based on operator choice or a system setup configuration. For example, an operator can manually designate a chosen jurisdiction (Box 220), or a default jurisdiction may be designated (Box 230) corresponding to the current geographical location of the LPR system (i.e. the state in which the automotive service shop or inspection station is located). Alternatively, an ordered set of jurisdictions, for example, based on a geographic proximity to the geographic location of the LPR system (Box 240) or other criteria (Box 250) such as frequency of occurrence, may be provided. The ordered sets (Box 240, 250) may optionally be filtered, prioritized, or ranked to ensure that a primary jurisdiction is evaluated first, and may be static or dynamic, varying in accordance with changes in the priority or ranking.
In one embodiment, the primary sequence of alpha-numeric characters and symbols identified from the license plate image is evaluated against a set of jurisdiction-specific character arrangement rules, templates, or filters and/or error-correcting rules to prevent the selection of any designated jurisdiction (Box 210) for which the arrangement of the identified primary sequence of alpha-numeric characters represents an invalid license plate designation.
At least one selected jurisdiction is then combined with the identified license plate features and communicated to the data archive (120) as previously described to attempt to identify a corresponding vehicle identification number (VIN) associated with license plate data. The data archive system utilizes the communicated jurisdictional data to narrow the search for a specific license plate matching the identified alpha-numeric features and symbols within the specifically identified jurisdictions (Box 260). If a match is found, the data archive system returns a corresponding VIN contained within the stored records (Box 130), and the process continues as shown in
While the aforementioned embodiments have been presented in the context of acquiring and utilizing vehicle license plate data during a vehicle service or inspection process, and hence have been associated with a vehicle service or inspection system, a further embodiment of the present disclosure illustrated in
It is recognized and understood that information for matching vehicle license plate data with specific VIN data and vehicle identifying features stored in a data archive may not be complete or fully accurate. For example, if the records are not updated regularly, a record linking a particular license plate to a particular VIN may not accurately reflect a recent vehicle sale transaction wherein the license plate was transferred to a new vehicle. If the license plate data is entered into the system, the VIN associated with the sold vehicle will be recalled, leading to potential downstream errors or incorrect actions by the vehicle service system or service show which relies upon the recalled information.
In a further method of the present disclosure, the previously described method shown in
In the event a match between the license plate information in the data packet 20a and a VIN is found (Box 125), but fails to meet the secondary selection criteria (Box 260), the process may return an indication that no conforming match was found (Box 135), and terminate the procedure.
Optionally, if no conforming match is found (Box 135), either in response to the initial query (Box 125) or to the secondary selection criteria (Box 260), the procedure may apply error-correction or character substitution logic to the character sequence representing the license plate (Box 270), and repeat the process to see if a suitable match can be made (Box 125). This cycle may be repeated until all available error-correction or character substitution logic options have been exhausted, or may be limited to a predetermined number of cycles before returning an indication of no match found (Box 135).
The present disclosure can be embodied in-part in the form of computer-implemented processes and apparatuses for practicing those processes. The present disclosure can also be embodied in-part in the form of computer program code containing instructions embodied in tangible media, or another computer readable non-transitory storage medium, wherein, when the computer program code is loaded into, and executed by, an electronic device such as a computer, micro-processor or logic circuit, the device becomes an apparatus for practicing the present disclosure.
The present disclosure can also be embodied in-part in the form of computer program code, for example, whether stored in a non-transitory storage medium, loaded into and/or executed by a computer, or transmitted over some transmission medium, wherein, when the computer program code is loaded into and executed by a computer, the computer becomes an apparatus for practicing the present disclosure. When implemented in a general-purpose microprocessor, the computer program code segments configure the microprocessor to create specific logic circuits.
As various changes could be made in the above constructions without departing from the scope of the disclosure, it is intended that all matter contained in the above description or shown in the accompanying drawings shall be interpreted as illustrative and not in a limiting sense.
The present application is related to, and claims priority from, U.S. Provisional Patent Application Ser. No. 62/343,579 filed on May 31, 2016, and which is herein incorporated by reference. The present application is further related to, and claims priority from, U.S. Provisional Application Ser. No. 62/254,828 filed on Nov. 13, 2015, and which is herein incorporated by reference.
Number | Date | Country | |
---|---|---|---|
62254828 | Nov 2015 | US | |
62343579 | May 2016 | US |