Patent Application
20180117945
The present invention relates to systems, entities, and methods for remote passport and security documents marking. More specifically, the present invention relates to marking of passports as an exemplary security document with corresponding stamps, labels, visa, and the like.
It is common in most countries that individuals are checked at border checkpoints when entering or exiting the country. Various rules and laws regulate whether individuals are permitted entry or whether entry (or exit) is denied. A common means is the issuance of visas that the individual grant access to a country for a given limited period (e.g. 30 or 90 days, etc.) or with no limitations. Usually, the individual presents his/her passport at the border checkpoint when entering the country and an official checks the visa status. If entry can be permitted, a physical stamp or label is applied to the passport that indicates entry (possibly in conjunction with an entry location and date) or represents the visa itself. Upon leaving the country a further mark is applied to the passport, so that the passport can be checked for determining whether an individual is permitted to stay in some country, whether a permissible time has expired, or whether a number of permissible (re)entries to a country is exhausted.
The drawback with stamps and labels, or in general a mark, applied to passports and other security documents is that the location and quality of the mark in the document may vary to a great extent. Specifically, a stamp (rubber stamp) may be applied with poor quality so that legibility of the mark is adversely affected or the mark interferes with already existing marks so that their respective legibility is affected. Furthermore, the position of corresponding marks (e.g. entry stamp and exit stamp) may not be well-defined so that officials have to browse the entire passport so as to look for an entry stamp and so as to look for a suitable location of an exit stamp. This takes time and the officer at the checkpoint is only able to process a limited number of individuals per given time. Furthermore, security documents such as passports, have only a limited space available for marks, so that inefficient use of the available space may require the issuance of a new passport before a further visa can be applied.
At the same time, electronic systems for issuing and authenticating security documents, such as passports, identity cards, visa, driving licences, and the like, are common practice in most countries all over the world today. Such systems usually comprise central data repositories that are connected by means of well protected, closed protocols and data links to the equipment and terminals in the field. The field equipment usually comprises data terminals, scanners, printers, and the like.
Usually, authorized personnel employ such systems at, for example, border checkpoints (immigration), authority office premises, airports, and mobile checkpoints as part of common police patrols. Specifically, authorized personnel may check a security document from an owner in the field by querying personal data taken from the security document by means of accessing the mentioned special central data repositories. The system may provide an analysis result to a terminal in the field so that the personnel can take appropriate action, e.g. letting the checked person pass a security checkpoint, arresting the checked person, providing the checked person with a certificated, applying a stamp or mark to the presented security document. For example, an officer can query the system whether a presented passport and visa is genuine and correspondingly retrieve information whether or not a mark to the passport should be applied and the individual can pass the checkpoint and enter the country.
The publication U.S. Pat. No. 7,314,162 discloses a method and system for reporting identity document usage by storing in a database and reporting to an identity document owner instances in which that person's driver's license, passport or other government-issued identification documents are presented as a form of ID, thereby facilitating early notification of identity theft.
Further, the publication U.S. Pat. No. 7,503,488 discloses a method of assessing the risk of fraud before issuing a driver's license to an applicant on the basis of the relative incidence of fraud historically associated with the particular combination of collateral identification documents (e.g. birth certificate, passport, student ID card, etc.) presented by the applicant in their application for the driver's license.
It is therefore an object of the present invention to provide a system for remote passport and security document marking that makes efficient use of existing infrastructure, i.e. equipment in the field, central data processing and repositories, and networks connecting the same. It is specifically and object of the present invention to provide a solution to the problematic and unsatisfactory application of marks to passports and security documents.
The above mentioned problems and drawbacks of the conventional concepts are solved by the subject-matter of the independent claims. Further preferred embodiments are described in the dependent claims.
According to an embodiment of the present invention, a system is provided a system for remote security document marking comprising an interface adapted to receive, from field equipment and via a network, graphical data of a scanned image of a security document; a data storage adapted to store a data record comprising said received image data and additional data in relation to an owner of the scanned security document; a graphical data processing module adapted to superimpose an image of a mark onto the image of the security document and adapted to generate further graphical data of the scanned image of the security document with the mark; and an access module adapted to provide access to said further graphical data.
According to an embodiment of the present invention, a method is provided a method for remote security document marking comprising a step of receiving, from field equipment and via a network, graphical data of a scanned image of a security document; a step of storing a data record comprising said received image data and additional data in relation to an owner of the scanned security document; a step of superimposing an image of a mark onto the image of the security document and of generating further graphical data of the scanned image of the security document with the mark; and a step of providing access to said further graphical data.
Generally, in the embodiments the network can be either wired or wireless or a combination thereof. Further, the data may be accompanied by data of voice, biometric, or biological analysis such as blood sample, DNA or observation profile, etc. The analytics module may be further adapted to match a data record against historical data in the repository or data about the data (metadata).
Embodiments of the present invention, which are presented for better understanding the inventive concepts but which are not to be seen as limiting the invention, will now be described with reference to the Figures in which:
More specifically, the individual will present the security document to the officer 19, who, in turn may employ the scanner 12 for scanning the security document or parts thereof. Usually, the scanner 12 will employ data-processing techniques for extracting information concerning the individual (or the owner of the presented security document), such as a name, a date of birth, and/or a security document number either in biographic or biometric format such as RFID content, etc. In general, any of the following data items may represent so-called additional data concerning the individual/owner/holder of the security document: surname, given name, date and place of birth, country of citizenship, place and country of residence, document number, document type identification, document issue date, document issue place, biometric data of the owner, image data or graphical data concerning the face, fingerprints, or other physical characteristics of the document owner, and the like.
Once the scanner 12 has generated such information concerning the individual, this information can be forwarded via a secure link to some kind of central repository (not shown). This repository is likely to be a server and or resources of a datacenter, private network and/or cloud infrastructure that are arranged and able to analyze the received information with regard to authentication. For example, the repository may store data concerning whether or not the individual has the right to enter a given country. Assuming that the shown checkpoint 30 is located before a departure gate or electronically connected securely (wired or wireless) to the airport, the repository may store data indicating whether or not the individual has rightfully entered the country and is now leaving the country within a permissible visa duration. For example, the repository may inform the officer 19 via the display terminal 11 that the individual who presented his/her passport at the checkpoint 30 has stayed longer in the country then permitted by his/her respective visa. The officer 19 may accordingly operate a barrier 13 so as to allow arresting of the individual. Naturally, the officer 19 may also operate the barrier 13 so as to let the individual pass if a response from the repository 120 indicates that everything is in order.
In general, the conventional electronic systems for security document analysis usually employ distributed equipment field 1 and some kind of central resources located at one or more central locations for data storage and analysis. The link may be implemented by a dedicated special signal line, or maybe some kind of secure communication over existing communication networks, such as the Internet (e.g. VPN connection, tunnels, etc.). These conventional systems suffer from the drawback that it is difficult to add or change the components of the field equipment 10.
As shown, the passport 40 has further applied marks in the form of a label 43, and stamps 44, 45, and 46. As already mentioned, the application of stamps and labels may suffer from various drawbacks. In particular, a label 43 may be applied in the way so that it covers part of an earlier applied stamp 44. In this way, legibility of the stamp 44 may be severely affected. Similarly, a stamp 45 may be applied in an incorrect fashion so that only a part thereof appears on the passport 40. A further but not final example is stamp 46 that was applied with poor quality so that also legibility is severely affected. The latter may be the result of too little ink or application pressure employed when applying stamp 46 to passport 40. Moreover, stamp 46 is again applied in a fashion so that legibility of other passport marks may be severely affected.
The system 20 does not rely on or even require specialized and proprietary data formats but, rather, is able to accept and process graphical image data received via any type of network, such as the Internet, intranet, mobile devices and other means of networking such as satellites. As a consequence, any suitable scanning equipment can be employed for scanning a security document and generating the respective image data. Said scanning equipment may thus include scanners 12 of dedicated field equipment 10 already existing and employed by the corresponding body/authority. For example, the field equipment 10 can be third-party equipment provided to the body/authority in connection with a specialized central repository as discussed and explained in greater detail in conjunction with
The embodiments of the present invention consider graphical data processing so as to superimpose image of a mark onto the image of the security document. In line with the present embodiment, the system 20 comprises a graphical data processing module 23 that retrieves the graphical data of the scanned image of the security document from the data storage 22. The graphical processing module 23 is adapted to superimpose an image 49 of a mark onto the image of the security document. Further, the graphical data processing module 23 is adapted to generate so-called further graphical data of the scanned image of the security document with the mark. This further graphical data may be stored back the data storage 22 or to another, dedicated data storage. In other words, a virtual marking of the security document is obtained. The system 20 further comprises an access module 24 adapted to provide access to the further graphical data which may be stored in the data storage 22 or in another, dedicated data storage. By means of the access module 24 officers or other authorized personnel may request inspection 112 of the virtual security document.
Generally, the embodiments of the present invention allow for an application of a mark to a security document with a well-defined and controlled quality following likewise well-defined rules and requirements. Specifically, the mark can be superimposed to image of the security document at a suitable position employing suitable colors and or contrast variations. As a consequence, the further graphical data provides an image of a security document with a marking that is applied to the correct position at a well-defined given quality, which, in turn, may solve the mentioned problems in connection with poor reproduction quality, poor legibility, effective use of the space available, effective use of inspection time, and the like.
The above embodiment of the present invention may further provide the advantage that the equipment used in the field 1 can be more independent from any centralized entity that is responsible generally for analyzing data concerned with security documents. The system 20 according to this embodiment may integrate in any existing field equipment so that the basic functionalities, such as scanning, printing, displaying information, and mechanical operation such as opening a gate, and the like, can be employed for working together with the system 20. In particular, the use of the image data of the scanned security document allows for the use of virtually any suitable scanning equipment in the field and the use of conventional communication network infrastructure.
In this embodiment, the interface 21′ is implemented as an application server that may provide privately owned cloud-based operational control of a reader, scanner, printer and/or integrated reader/scanner/printer, whichever may be installed in the field. The application server 21′ may provide other administrative functions, thereby relieving the burden of integrating any scanner/reader/printer into existing third-party electronic systems. The data storage 22′ can be implemented as a data collection module that is adapted to collect and store in a database all desired data. The type of data that can be stored may be limited or restricted by national legislation (e.g. privacy laws). However the stored data can be in form of data records that can be associated with each use or selected uses of a security document or value item (passport).
A data record may include any of the following: (i) image data of scan of the security document by the a reader/scanner or integrated device, including multiple scans at multiple wavelengths of electromagnetic radiation, ultrasound scans (e.g. of liquids as part of the security document or value items), x-ray scans, laser scans, etc.; (ii) security document identification such as a passport number, image(s) or other identification of the passport and its contents, including position within a given passport of any prior official (e.g. visa) stamps in that given passport; (iii) biometric and/or biographic data of the document's or item's holder or owner, such as fingerprints, eye scans, facial scans, body scans, infrared heat sensor data, audiovisual recordings, etc.; (iv) date, time and location of each use or selected uses of the document/item, including for example whenever a passport is scanned at a passport scanning facility such as a border crossing (checkpoint), transportation hub such as at airports, ship docks and train stations, or at banks, hotels, etc., or whenever a value item is scanned at a scanning facility; (v) sound, image or video recordings of interactions between document/item holders and officials (personnel) at a passport scanning facility or other recordings related to use of the document/item, associated media metadata (e.g. number of frames recorded, frequency signatures of voice or other recorded data) and metrics calculated from such media metadata (e.g. which can be encrypted and employed to complement existing anti-tampering technologies); (vi) video data showing persons using the passport or other value item; (vii) travel information associated with the value item holder or owner, e.g. arrival and/or destination information, such as an airline flight no. associated with a passport being scanned at an airport or other passport scanning facility; (viii) medical information (e.g. health status, prior exposure to communicable diseases, medical reports, etc., associated with a passport holder, individual (e.g. refugee) present at an official data collection facility, or value item owner; (ix) related documentation, such as a scan of customs forms, scans of secondary identification documents, notes by officials involved, etc. (x) identity of the responsible officer involved with handling a passport or other value item, such as where the officer is identified by fingerprint using the corresponding equipment, if installed, or other biometric for example; and (xi) RFID contents where a RFID chip is installed in a passport, label or sticker (e.g. affixed to an object) or value item and scanned at the (passport) scanning facility. The database may also store information related to visa, national entry, national exit, custom form, passport stamps or other official stamps for use in centrally (i.e. remotely) controlling a scanner, reader, printer and/or integrated device, whichever may be installed.
The server 20′ may optionally comprise an analytics module 23A adapted to analyze the data records stored in the data storage 22 and to generate a corresponding analysis result. For example, the received image data 111 is analyzed for identity or security features, as such features are common elements of modern security documents. Specifically, the analytics module 23A may look at such identity or security items in connection with the additional data that is stored with the corresponding data record. For example, the identity item may lead to identification of a specific individual who is holder of a visa. The additional data may then, following this example, indicate a permissible region or period where and when the individual may reside. If an inconsistency is found by the analytics module 23, a corresponding flag can be launched toward access module 24′. In turn, the access module 24′ may generate and launch a notification based on the analysis result taken in the analytics module 23A. By means of the notification, an officer in the field 1 can be notified of the analysis result remotely taken in the server entity 20′.
The analytics module 23A may be specifically configured to analyze the data stored in the database to determine, in real-time, potentially irregular use of a passport or other value item, such as where an entry into or exit from a country is being attempted by a passport holder without a corresponding preceding exit or entry, or where a value item holder is exhibiting notable behavioral patterns such as nervousness. In general, such analysis may be referred to as plausibility checks and/or checking any incoming information that is associated to an event (e.g. attempted border crossing) with the conformity to one or more predetermined rules. For example, a rule may define that a given individual needs to have entered a country, and to have been accordingly registered, before an attempt to leave the country is observed. In one embodiment, the analytics module 23A is adapted to make a determination whether or not a mark is superimposed by the graphical processing module 23′. Further, the analytics module 23A may be adapted to make a determination of a location within the security document the mark image is superimposed.
Furthermore, the analytics module 23A may also monitor external databases 220, e.g. of INTERPOL, Europol, national criminal record databases, and other databases to identify individuals of interest who are attempting to use a passport at a passport scanning facility or other value item at a scanning facility. The analytics module 23′ may further monitor length-of-stay restrictions to issue an alert if a passport holder has an “overstay” (e.g. has not exited a country by the expiry date of their visa) or has an “understay” (e.g. has not stayed a sufficient amount of time in a country to qualify for a specifiable immigration status).
Besides the access module 24′ an alert module 24A can be implemented as a dedicated alert module that is arranged to alert the responsible officer or other official when the document/item (e.g. passport or other value item) scanned by the officer has been flagged by the analytics module 23A as being associated with irregular use or otherwise problematic. Alerts can also be generated when tampering or other physical damage to the server entity 20′ or a module thereof is detected. For this purpose a sensor 25 may be provided (e.g. temperature, pressure, vibration, location, etc.) that is configured to detect tampering. Alerts, or, more generally, notification may be provided via a secure communications module (described below), and/or by email, text and/or voice message (e.g. to a mobile telephone), etc. to the responsible officer or other official. Alerts may be provided to any official agency worldwide, as permitted by law, for the purposes of proactive security.
A firewall module 26 may be provided that is adapted to protect the server entity 20′ from external, Internet-based attacks. The firewall module may also comprise the above mentioned sensors 25 that are suitable to monitor for physical tampering, intrusion or other damage to the special-purpose hardware components. In this way, it may be referred to the module 26 as a firewall and anti-tamper module.
A secure communications module 27 may be provided for encryption of communications between the server entity 20′ and electronic systems of participating national governments, agencies thereof, commercial enterprises, or other customers, i.e. the field equipment, using encryption techniques consistent with customer preferences and legal requirements. The secure communications module 27 may thus facilitate communications between the server entity 20′ and the client computers, including scanners, readers, printers and/or integrated devices, at, for example, passport scanning facilities. The secure communications module 27 may be operable to communicate with client computers within each country via a country-specific VPN (Virtual Private Network). In some embodiments, a separate VPN for each (passport) scanning facility can be employed. Country-specific communications facilitate the transfer of information between countries (within the limits of both countries' laws) via the server entity, despite incompatibility between respective passport-related electronic systems of different countries.
More generally, the secure communications module 27 may be adapted to facilitate the transfer of information between subscribing customers despite incompatibilities between their respective systems by receiving data from a first subscribing customer in accordance with a first communication protocol and then transmitting data from the server entity to a second subscribing customer in accordance with a second communication protocol wherein the first and second communication protocols are not necessarily compatible with each other. Any number of modules of the server entity 20′ may be integrated into a customized “black-box unit”, and any given module may be commercialized as a stand-alone unit suitable for integrating with existing third-party electronic systems.
According to the present embodiment, the memory resources 212 store code that instruct the processing resources 211 during operation to implement a graphical data processing module adapted to superimpose an image of a mark onto the image of the security document and adapted to generate further graphical data of the scanned image of the security document with the mark, and an access module adapted to provide access to said further graphical data.
In a step S53 (SUPERIMPOSE MARK), the system performs graphical data processing for superimposing an image of a mark onto the image of the security document and adapted to generate further graphical data of the scanned image of the security document with the mark In a step S54 (PROVIDE ACCESS), access to the generated further graphical data is provided.
A method embodiment may further include a step of analyzing the received image data so as to make a determination whether or not, and possibly where, a mark is to be superimposed onto the image of the scanned security document. Specifically, the already mentioned mechanisms (plausibility, rule conformity, and the like) may be employed to find any possible irregularities. If no irregularities are found or the presented security document (e.g. passport) use is otherwise not objectionable, a mark as “virtual” (i.e. digitally stored) official stamp can be generated, which may be an entry and/or exit stamp for example, that is stored in the database module such that it is accessible to the responsible officer and subsequently to officials at other passport scanning facilities within the limits permitted by the laws of each pair of countries (i.e. the country where the data was collected and the country where it is being accessed). In some embodiments, the system may inform in real-time the responsible officer or other official who has scanned a passport where prior official (e.g. visa) stamps are located in the passport. For example, when a passport holder is exiting a country, embodiments of the present invention can inform the responsible officer the page number upon which the corresponding preceding entry stamp is located.
Although detailed embodiments have been described, these only serve to provide a better understanding of the invention defined by the independent claims, and are not to be seen as limiting.
| Number | Date | Country | Kind |
|---|---|---|---|
| 15186661.3 | Sep 2015 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2016/072259 | 9/20/2016 | WO | 00 |
