Patent Application
20090316950
Document falsification and product counterfeiting are significant problems that have been addressed in a variety of ways. One of the more successful approaches has been the use of latent or hidden images applied to or printed on objects to be protected. These images are generally not viewable without the assistance of specialized devices that render them visible.
One approach to the formation of a latent image is to optically encode the image so that, when printed, the image can be viewed only through the use of a corresponding decoding device. Such images may be used on virtually any form of printed document including legal documents, identification cards and papers, labels, currency, stamps, etc. They may also be applied to goods or packaging for goods subject to counterfeiting.
Objects to which an encoded image is applied may be authenticated by decoding the encoded image and comparing the decoded image to an expected authentication image. The authentication image may include information specific to the object being authenticated or information relating to a group of similar objects (e.g., products produced by a particular manufacturer or facility). Production and application of encoded images may be controlled so that they cannot easily be duplicated. Further, the encoded image may be configured so that tampering with the information on the document or label is readily apparent.
Authentication of documents and other objects “in the field” has typically required the use of hardware decoders such as lenticular or micro-array lenses that optically decode the encoded images. These lenses must have optical characteristics that correspond to the parameters used to encode and apply the authentication image and must be properly oriented in order for the user to decode and view the image.
Because they can only be used for encoded images with corresponding characteristics, hardware decoders are relatively inflexible tools. There are also circumstances where the use of an optical decoder to decode encoded images is impractical or undesirable. For example, authentication using an optical decoder requires immediate on-site comparison of the decoded image to the authentication image. This requires that the on-site inspector of the object being authenticated must be able to recognize differences between the decoded image and the expected authentication image. This is impractical in instances where there are many possible variations in the expected authentication image. It also may be undesirable for the on-site inspector to have access to information that may be embedded in the decoded image. Finally, real-time viewing using a typical hardware decoder does not produce a hard copy image that can be retained for future use. Any later investigation must rely on the viewer for evidence of the initial object inspection.
Many software tools have been suggested to overcome the above problems and protect the integrity and confidentiality of printed documents, packaging, and other printed materials. These tools can be integrated into existing devices or delivered in a form, such as software plug-ins, that may give broad control to adding or changing notes and form fields in the electronic document, document encryption, as well as adding digital signatures to the documents before they are printed.
Widely used protection methods for deterring digital counterfeiting and identifying data alterations include bar codes and digital watermarking. These are usually added as an image file into a document by the originating party. However, bar-code generation software is widely available and can be used by a counterfeiter to create fraudulent documents.
Digital watermarking has also been proposed as a solution, but tests have shown that it may lack the reliability necessary for consistent and widespread use. Further, implementing such technology is often expensive, with equipment costs for the necessary hardware and software sometimes canceling the cost savings achieved through electronic document distribution. The amount of information that can be protected may often be limited to just several digits or letters. These problems put a severe constraint on reliability and usage of printed documents, packaging, and other printed materials in commerce and services.
The present invention provides systems and methods for authentication of objects using encoded images. One aspect of the invention provides an image acquisition device for use in determining whether a test object is an authentic object. In this context, an authentic object is one having an authentication image applied to an authentication image area of the object. The authentication image includes indicia formed based on authentication parameters. The device comprises an image capture arrangement configured for capturing a digital image of a target area of a test object and a data processor. The data processor has an image processing portion configured for receiving and processing the digital image to produce a processing result. The processing result is established at least in part using one or more of the authentication parameters.
Another aspect of the invention provides a method for determining whether a test object is an authentic object having an authentication image applied to an authentication image area thereof. The method comprises positioning and orienting a target surface area of the test object relative to an image acquisition device. The image acquisition device has a data processor configured for processing digital images captured by the image acquisition device. The method further comprises capturing a digital image of the target surface area using the image acquisition device and processing the captured digital image using the data processor to obtain a processed image result.
Some embodiments of the authentication system may comprise a wireless capable memory card or device that allows either an image acquisition device, an attachment capable of connecting to the image acquisition device, or an authentication processor to selectively connect to wireless networks. In some embodiments, the wireless capable memory card or device is selectively connectable to a wireless network, thus enabling the transfer of data (e.g., the image) to a selected destination (e.g., a computer, a web site, etc.). In some embodiments, the wireless capable memory card or device is selectively connectable to a cellular or data network used by portable telecommunication devices, thus enabling the transfer of data (e.g., the image) to a selected destination (e.g., a computer, a web site, etc.). The system may comprise a software architecture that allows authentication software to be stored on, added to, and used by either an image acquisition device, an attachment capable of connecting to the image acquisition device, or an authentication processor for the authentication of documents.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only, and are not restrictive of the invention as claimed. The accompanying drawings constitute a part of the specification, illustrate certain embodiments of the invention and, together with the detailed description, serve to explain the principles of the invention.
The invention can be more fully understood by reading the following detailed description together with the accompanying drawings, in which like reference indicators are used to designate like elements, and in which:
The present invention provides systems and methods for authenticating documents, commercial products and other objects using authentication images that have been applied thereto. In particular, the present invention provides portable devices for use in capturing a digital image of a document or object and processing the digital image to establish or assist in establishing the authenticity of the document or object.
As used herein, the term “authentication image” means an image that is specially configured or printed so as to allow verification of the authenticity of an object to which the authentication image is applied. Authentication images may include images/indicia printed with special inks (e.g., inks visible only in particular wavelengths), or images/indicia that are constructed or printed so that certain content is not readily visible to the naked eye. For example, authentication images may be printed so as to be or include micro-printed content that is only readable under high magnification. Authentication images may also be graphically encoded, embedded or scrambled so that they cannot be viewed without decoding or unscrambling.
In the authentication methods of the invention, an image acquisition device is used to capture a digital image of a target area on an object where an authentication image is expected to be present. The captured image may then be viewed and/or processed by a processor incorporated into the image acquisition device. Alternatively or in addition, the image acquisition device may be configured to download or transmit images over a network for viewing and/or decoding. As described in the '108 application, the image acquisition device may include a lens or lens device adapted to magnify the digital image to enhance its resolution thereby allowing the capability to view micro-printing and/or to decode a captured encoded image using software-based techniques. The methods of the invention may also include illuminating the target area with light at a particular wavelength in order to capture authentication images that are visible only when so illuminated. The authentication image may be illuminated and/or magnified by the image acquisition device. In some embodiments, the image acquisition device may include a lens device that illuminates the authentication image with light at the desired wavelength. In particular embodiments, the image acquisition device may include a lens device that can be used to illuminate and/or magnify authentication images at close range. Suitable lens devices may include those described in the '194 application.
As described in the '437 application and the '249 patent, a digital image of an authentication image may be captured by an image acquisition device, downloaded or transmitted to an authentication processor, where the captured image may be viewed and/or processed to determine if the expected authentication image is present. If the authentication image is an optically, graphically or digitally encoded image, the captured image may be decoded using any of various software-based decoding techniques. Indicia and/or information may be determined from the decoded image and then used to authenticate the object or document to which the encoded image was applied.
Depending on the system, the captured image may be downloaded and processed on-site or transmitted over a network (e.g., by e-mail, other network transfer process, or by a wireless memory card) to a central processor where the image is processed and an authentication result generated. In some systems, the digital image may be captured by an on-site inspector who transmits the captured image to a separate processor (or series of processors) where the image is processed and, optionally, compared to an expected authentication image. The results may then be returned to the on-site inspector or other authorized personnel over the same or a different network. Thus, in some embodiments, the captured authentication image need never be viewed by a human being.
The authentication methods of the invention may be used to enhance the efficacy of authentication images of various types, including images formed using micro-printing techniques and optically encoded images. Optically encoded images are often formed as an authentication image embedded in a background or source image and printed on items that may be subject to alteration, falsification or counterfeiting. As used herein, the term “encoded image” or “encoded authentication image” refers to an image that is rasterized, scrambled, manipulated and/or hidden, such that when applied, embedded and/or concealed in a document or in a background field or in another image, the authentication image cannot be discerned from the base document material, background field, or the other image without the use of an optical decoding device or its digital or software equivalent. Some encoded images are hidden so that their presence is difficult to discern from a background or primary image. An encoded image may be generated from an authentication image using a particular set of characteristics that include encoding parameters. Other encoded images are easily visible but are unreadable because the image content has been systematically scrambled or otherwise manipulated.
Encoded images of particular significance to the present invention are those that are configured to be optically decoded using a lens-based decoding device. Such images take advantage of the ability of certain types of lenses (e.g., a lenticular lens) to sample image content based on their optical characteristics. For example, a lenticular lens can be used to sample and magnify image content based on the lenticule frequency of the lens. The images used are typically encoded by one of several methods that involve establishing a regularized periodic pattern having a frequency corresponding to that of the lenticular lens to be used as a decoder, then introducing distortions of the pattern that corresponds to the content of the image being encoded. These distortions may be made so small as to render the image difficult or impossible to discern from the regularized pattern with the naked eye. Encoded images of this type can be produced in an analog fashion using specialized photographic equipment as disclosed in U.S. Pat. No. 3,937,565 or digitally as is disclosed in U.S. Pat. No. 5,708,717 ('717 patent), both of which are incorporated herein by reference in their entirety.
Digitally encoded images can be embedded into a background or into other images so that the mere presence of the encoded image is difficult to discern. In some methods, a secondary image can be separately encoded then merged or embedded into the primary authentication image or the process of embedding may be accomplished in such a way that the secondary authentication image is encoded as it is embedded. With reference to
The methods by which the secondary image is embedded or merged with the primary image can be divided into two general approaches. In the first approach, a regularized periodic behavior is imposed on the primary image using a predetermined frequency. This is primarily accomplished by rasterizing the primary image at the predetermined frequency. The secondary image is then mapped to the primary image so that the regularized behavior of the primary image can be altered at locations corresponding to those in the secondary image that include image content. The alterations are small enough that they are difficult for the human eye to discern. However, when a lenticular lens having a frequency corresponding to the predetermined frequency is placed over the primary image, it will sample the primary image content in such a way that the alterations are brought out to form the latent secondary image.
In the second approach, the regularized periodic behavior is first imposed on the secondary image rather than the primary image, with alterations in that behavior occurring wherever there is content in the secondary image. The secondary image is then mapped to the primary image and the content of the primary image altered pixel by pixel based on the content of the encoded secondary image.
Another method of embedding an image is commonly used in banknotes and checks. In this method, a latent image is created by changing the direction of raster elements in the visible images at positions corresponding to the content in the hidden image. For example, vertical raster lines in the primary image may be changed to horizontal lines at the locations corresponding to the latent image. The latent image can typically be seen by tilting the banknote slightly. However, the deviations in the primary image can also be decoded using an optical decoder. This is because the raster lines of the primary image will run along the length of the lenticular line of the decoder at the positions where there is no hidden content, but will have only a cross section at the positions where there is a hidden content. This difference makes the hidden image appear much brighter than the visible when viewed through the decoder.
The common thread of all of the above graphical encoding methods and their resulting encoded images is that they involve deviations from regular periodic behavior (e.g., spatial location, tone density, raster angle). The regular periodic behavior and the deviations therefrom may be established based on the encoding methodology used and a predetermined set of encoding parameters. The deviations are made apparent through the use of a decoder having characteristics that correspond to one or more of the encoding parameters. For example, one of the encoding parameters may be the frequency of the regular periodic behavior. The decoder (whether hardware or software-based) must be configured according to that frequency. For example, in the case of a lenticular lens, the lens frequency is established so that the frequency of the regular periodic behavior is equal to the lens frequency or an even multiple of the lens frequency. The lenticular lens may then act as a content sampler/magnifier that emphasizes the deviations from the regularized behavior and assembles them into the secondary image.
A lenticular lens can be used to decode both visible encoded images whose content has been systematically scrambled and encoded images embedded into a primary image or background. As described in the in the '194 application, such lenses may also be incorporated into an illuminating lens device through which decoded authentication images may be viewed or captured. As described in the '249 patent, however, software-based decoders can also be used to decode encoded images that have been digitally created or captured. These decoders may be adapted to decode any digital version of an optically encoded image including digital encoded images that have never been printed and printed encoded images that have been scanned or transformed by other means into digital form. The digital encoded images may be latent images embedded into background or primary images or may be visible images that have been systematically scrambled or manipulated. The primary image may be a blank image with no discernible content (e.g., a gray box) or may be an actual image with discernible content.
The software for digitally decoding digital encoded images may be incorporated into a data processor associated with or incorporated into an image acquisition device. For the purpose of practicing the authentication methods of the present invention, the software may use any decoding methodology including, but not limited to, the methods described in the '249 patent. This includes (1) methods that require information on the content of the primary image, the secondary image or both the primary and secondary images; and (2) methods that do not require any foreknowledge regarding image content. Both of these method types require knowledge of the encoding parameters used to encode and embed the secondary image. Depending on the encoding methodology, the encoding parameters may be retrievable from a database. In some cases, one or more encoding parameters may be calculated from the image itself using special image analysis techniques.
The systems and devices of the invention may be configured or programmed to allow the user to select a mode of operation that could include decoding any or all of the above-described encoded images, as well as viewing or processing non-encoded indicia such as micro-printed indicia or barcodes. They may also be configured to view and process indicia printed or applied using a medium that is viewable only when illuminated by a particularly light wavelength. In many cases, the medium used is viewable only under light outside the visible spectrum (e.g., infrared or ultraviolet light).
The methods of the invention all involve the use of image capture or image acquisition devices. As used herein, the terms “image capture device” and “image acquisition device” mean any device or system used to capture or produce an image of a document or object or target portions thereof. An image acquisition device connected with a magnifying lens attachment may also be used as the image acquisition device in any of the Patents and Applications already disclosed. An image acquisition device may be adapted to magnify and record an image. Such a device may have a built in magnification feature that provides this feature. Image acquisition devices may be any portable or non-portable device. Image acquisition devices include but are not limited to scanners, digital cameras, portable phones, portable digital assistants (PDAs) and systems having a combination of an analog camera and a frame grabber, and any other device that is programmable. The image acquisition device may be a portable telecommunication device. The image acquisition device may be adapted for capturing images using light in the visible or non-visible (e.g., UV and IR) portions of the electromagnetic spectrum. The image acquisition device may scan or capture printed encoded images.
Of particular interest to the present invention are image acquisition devices that include processors that may be configured or programmed to assist in the acquisition of images for object authentication and for selectively processing such images. the images acquisition devices of the invention may include an authentication processor that is configured or programmed to process images captured by the digital acquisition device. in some embodiments, the authentication processor may be configured to process and decode a captured authentication image (i.e., a printed encoded image that has been scanned or otherwise digitally captured by the digital image acquisition device). If the authentication image is a graphically encoded image, the authentication processor may be adapted to apply one or more software-based decoding algorithms to produce a decoding result. Using such methods as optical character recognition (OCR), the authentication processor may also be adapted to extract indicia and/or information from the processed image and to compare the extracted indicia and/or information to predetermined authentication criteria.
Some systems of the invention may include one or more additional authentication processors co-located with the image acquisition device or at a location remote from the image acquisition device. In such cases, the image acquisition device may be configured for downloading or transmitting captured images to the additional authentication processor(s) for verification or additional processing.
In general, a high resolution of an image may improve the ability to decode an encoded image. It has been found that image acquisition devices having a high magnification capability are particularly well adapted for use in viewing and/or capturing higher resolution images of security printing and encoded images for review and, if appropriate, decoding. In particular, optical magnification provides higher optical dpi (dots-per-inch) resolution thereby allowing an improved ability to view lines or other structures within the encoded image, an improved quality of the decoding function and a reduced influence of image imperfections. Such magnification may be achieved using a specialized image acquisition device with a magnification capability built in, a lens based device, or through the use of a standard image acquisition device to which a magnification device has been added or attached. For example, a lens with magnification capability may be attached or built-into a specialized image acquisition device, a lens based attachment, and/or a standard image acquisition device to provide the desired magnification. In particular, a lens device such as those disclosed in the '194 Application may be used. These may be configured as an attachment for standard digital cameras. The devices can also be used to significantly increase the resolution of viewed and/or captured images. As previously noted, these devices may also be used to illuminate a target area with a desired light frequency when an image of the target area is being captured. In some embodiments, a separate illuminator may be used to illuminate the target area. Such illuminators may be operated independently of or in conjunction with a lens or other magnification device.
The method M100 begins at S105. At S110, a test object may be oriented relative to the image acquisition device. It will be understood that in many instances, the test object will remain stationary while the image acquisition device is positioned rather than the other way around. In either case, the relative positions of the object and the image acquisition device are established so as to facilitate the viewing or capture of an image of the target area. This may be accomplished by an on-site inspector, by a user and/or observer of the object, the object itself (in the case of a self-orienting object), or by a processor and/or device. As will be discussed, the image acquisition device may incorporate features that facilitate the proper relative positioning of the device and the object.
The method M100 may optionally include, at S120, illuminating the target area with light in a predetermined wavelength range. This range may be established base on the medium used to apply the authentication image to authentic objects. For example, if UV ink is used, light applied to the target area may be in a range of 150 nm to 800 nm.
It will be understood that the action of illuminating the target area may be carried out by a light source or illuminator internal to the image acquisition device or to a lens device configured for engagement by or attachment to the image acquisition device. Even if the image is to be viewed in visible light, close illumination may serve to enhance the ability of the image capturing device to resolve the image, particularly if the image is also magnified.
The light emitted from the light sources at the predetermined frequency range may reveal ink, information, or data that would otherwise have been indecipherable or invisible. The predetermined frequency range is selected based on the viewability of the authentication image when illuminated by light in the predetermined frequency range. The predetermined frequency range includes ultraviolet light frequency and an infrared light frequency. As noted above, the predetermined frequency range may be about 150 nm to about 800 nm. The predetermined frequency range may also be about 300 nm to about 450 nm. The predetermined frequency range may further be about 370 nm to about 375 nm. The light sources may emit a concentrated portion of light on a particular area of the authentication image.
The light source may include a device to diffuse light or may include a function to diffuse light. The light diffuser device may be any shape. For even distribution of light over the authentication image, the light diffuser may be shaped as a “ribbed” cone.
The wavelength of the light revealed by the light source may be broadened and/or narrowed by a light filter. The light filter may include a colored filter, a split field filter, a polarized filter or any other filter used in digital photography. The filter can function to assist in viewing and/or capturing authentication images. The light filter may be a long pass filter, short pass filter, or a band pass filter. A long pass filter functions to transmit a wide spectral band of long wavelength radiation thereby blocking short wavelength radiation. A short pass filter functions to transmit a wide spectral band of short wavelength radiation thereby blocking long wavelength radiation.
The type of light source can be varied. In many cases, the light source may be an LED, incandescent bulb, fluorescent bulb, or halogen bulb. LEDs are preferred because they are typically of small size, but still produce a substantial amount of light versus the amount of power they consume. The light source may provide constant illumination or a momentary flash timed to coincide with image acquisition. The flash device or other light source may include a filter to tailor the illumination spectrum. Power can be delivered to the light source by any electrical power source, although battery power is preferred to make the lens-based device mobile and independent of its proximity to a stationary power supply, such as an electrical outlet.
At S130, the authentication image may optionally be magnified by the image acquisition device or a lens-based device used in conjunction with the image acquisition device. The image acquisition device may include a magnifying lens with magnification capability or an attachment having lens with magnification capability. The magnifying lens may magnify the authentication image for viewing and/or capturing. The magnifying lens may allow an image to be viewed and/or captured from 6 to 10 microns. In some embodiments, the lens may be a 10-60× lens. The lens may be interchangeable and may interact with a zoom lens or regular lens of the image acquisition device. The lens may interact with the flash of an image acquisition device. Further, the lens may interact with the image acquisition device to increase or decrease the magnification of the authentication image. The magnification of the lens may be manual or automatic. Additionally, the lens may be a physical lens or an electronic/digital lens.
At S140, a digital image of the test object is captured using the image acquisition device. The captured digital image may include all or a portion of the object as long as it includes a target area where the authentication image would be applied on an authentic object. The captured digital image may be configured so that only the target area is captured or may be configured so that the target area is included in a larger view. In either case, the captured image may also include identifiable orientation marks that allow the identification and proper orientation of the target area portion of the captured digital image.
Depending on the processing capabilities of the image acquisition device, the method M100 may optionally include at S150, the selection of a particular image processing and/or authentication mode. In image acquisition devices that have the capability of processing different forms of authentication images or can interpret different types of encoded images, the user may select the processing methodology to be applied. This selection can be made at any time before or after the image is captured. In some instances, however, it may be advantageous for the selection to be made prior to image capture so that the device may be configured to assist in capturing a particular portion of the image or to capture the image at a particular orientation.
Once the image has been captured by the image acquisition device, it may be stored within the device for later processing or may be downloaded to or sent to a separate authentication processor.
At S160, the captured digital image is viewed and or processed by an authentication processor. The authentication processor may be a data processor within the image acquisition device or a separate co-located or remote processor. If separate from the image acquisition device, the authentication processor may be connected to the image acquisition device over a network. The captured digital image may be transmitted over the network in any manner such as by e-mail or other transfer process. In some embodiments, the digital image may transmitted over a wireless telephone or other telecommunications network. It can also be sent as an attachment to any form of e-mail or text or multi-media message.
As noted above, the authentication processor may also be a part of the image acquisition device. In such a case, the operations of the authentication processor may be substantially simultaneous with or subsequent to the capturing of the captured digital image.
The authentication processor may be configured to automatically carry out some or all of the remaining steps of the method M100. If necessary, the authentication processor may verify the authentication of the object using the captured image and authentication criteria, which may include an expected authentication image. Also, if the authentication image is an encoded image, the authentication processor may decode the authentication image. In such instances, the authentication processor may determine one or more of the encoding parameters used to encode the authentication image. Alternatively, the user may be requested to supply one or more encoding parameters. The number of parameters required may depend on the specific digital decoding methodology used. The encoding parameters may be obtained from data storage where they are placed at the time of encoding. This data storage may be a part of or co-located with the authentication processor or may be disposed in a separate database processor or server accessible to the authentication processor over a network. The data storage may also take the form of a magnetic stripe, laser card, smart card, processor chip, memory chip, flash memory or bar code, which can be applied or attached to or otherwise associated with an object to which an authentication image is applied. The encoding parameters may be object-specific or may be constant for a particular set of objects. In some embodiments, some or all of the encoding parameters may be received with an encoding request or determined from the content of the image.
In embodiments where the authentication processor is a part of the image acquisition device, the authentication processor may be used to decode an encoded image by any of the various decoding techniques described above to generate a decoding result. The decoding result may be displayed to the user of the image acquisition device and/or transmitted to an additional processor for comparison to expected results.
In some embodiments, the method may be adapted to determine whether the captured authentication image comprised micro-printing or rasters formed as a particular shape. Such printing devices may be identified in both encoded and non-encoded images.
The authentication processor may use object landmarks to orient the target area of the captured digital image for viewing and/or decoding. These landmarks may be based on the inherent geometry or topology of the object or may be specifically applied at the time the authentication image is applied to authentic objects. In the latter case, the presence of such landmarks could be used as an initial authentication check. It will be understood by those of ordinary skill in the art that if the digital image is captured in such a way that the object is always oriented in exactly the same way relative to the image acquisition device, there may be no need for digital orientation of the captured image. For example, if the test objects are documents that can be precisely positioned for scanning, the orientation of the target area may be sufficiently constant that orientation of the captured digital image is unnecessary.
At S170, an authentication result is established. This may involve a sequence of criteria beginning with whether an image is even present in the target area. If an image is present, it may be directly compared to an authentication image or further processed to provide a result that can be compared to an authentication image or information derivable from an authentication image. Thus, verifying the authentication of the image may comprise, inter alia, the actions of viewing the captured image an/or comparing it to an expected authentication image, decoding the authentication image, and deriving information from the captured image or a decoded version of the captured image. The method ends at S175.
In some embodiments, once the target area of the captured digital image is oriented, the authentication processor may apply a digital decoding methodology to the captured digital image to produce a decoding result. The decoding result may then be compared to authentication criteria to determine an authentication result. This may be accomplished by displaying the decoding result for visual comparison to the authentication image. In some embodiments, reference images for visual comparison may be stored on the image capturing device, or any local or remote storage media. An authentication result, or a look-up table that contains authentication results in more user-friendly form, can also be stored on the image capturing device, or any local or remote storage media. In some instances, a captured digital image may be visually compared to a reference image without any additional processing. For example, the halftoning (i.e. raster) shapes, or magnified microtext images of a captured digital image may be compared to a reference image. Alternatively, OCR or other pattern recognition software can be used to compare the decoding result to the authentication image. In instances where the authentication image contains information that is object-specific, the information content of the decoding result may be compared to information derived directly from the object rather than to the original authentication image.
Optical magnification may be used in conjunction with the digital decoding method to reduce the influence of imperfections in the captured digital image and improve the ability to sample the captured digital image. In some embodiments, the decoding methodology samples one or more lines of the captured digital image at a frequency and an angle matching the encoding frequency. For example, one or more sampled lines of the captured digital image may be combined to generate one line of a decoding result. The optical magnification of the image determines the actual pixel spacing between the sampled lines. The physical spacing of the image should match the lines spacing used during the encoding, or the line spacing of the equivalent magnifying lens. The number of pixels between the sampled lines of the magnifying lens and the encoding parameters is calculated. A physical measurement, such as picture of a calibration grid, may be used to obtain a scale factor for the magnifying lens. The physical measurement may be calculated automatically. The digital decoding methodology enhances the sampled lines of the captured digital image to remove an gaps between lines to produce a decoding result.
An authentication determination is made based on the comparison of the decoding result to the authentication criteria. This determination may be made by a human reviewer of the decoding result or may be made automatically by the authentication processor. In either, case, the authentication result may be stored and/or returned to a user or other authorized requestor(s). In embodiments where the authentication determination is made at a location remote from the inspection site, the authentication determination may be transmitted to the inspection site.
When viewing and/or capturing an image one must consider how to (a) determine the actual pixel-per-inch resolution of the captured image; and (b) compensate for the different types of geometrical distortion that can be induced by the image acquisition device. Assuming the image acquisition device maintains the same distance from the object and the zoom function is not used. For example, the image acquisition device is positioned directly on the surface of the object thereby providing a consistent capturing distance. However, if the zoom function is used or the image acquisition device fails to maintain a consistent distance pre-calculated values are difficult to use. The positions and distances of the reference points on the object and the scale factors of the image will need to be recalculated.
Numerous methods may be used to determine the actual pixel-per-inch resolution of the captured image. Two of the methods are using calibration to determine the real pixel-to-pixel resolution of the image and rescaling a decoding frequency.
Generally, images captured by a scanner have an actual DPI resolution written into the header of the scanned file. Thus, the DPI is consistent and the DPI value from the file reflects the pixel-per-inch size of the image.
When an image is viewed and/or captured using a digital camera typically a fixed value of 180 DPI (or in some rare cases 72 DPI) is written in the image file header. Thus, the DPI value from the file cannot be relied upon to reflect the real pixel-per-inch size of the viewed and/or capture object. Since, the DPI value is unreliable the distance between the halftone pattern elements cannot be calculated when using a digital camera. The digital camera can be calibrated to determine the real pixels-per-inch resolution of the viewed and/or captured image. The scale factor of the digital camera can be calculated. In particular, the fixed DPI of the viewed and/or captured images can be internally replaced with a real DPI calculated for the image acquisition device and digital camera. The scale factor calculation occurs by taking a picture of a reference pattern, whose physical dimensions are known. Alternatively or in addition, the image acquisition device or attached lens device may produce repeatable effects on captured images that may be used as a reference. For example, a magnifier may limit the captured field to a circle with a known, fixed diameter. In either case, if there are 1800 pixels covering one inch of the reference pattern then the resolution is 1800 pixels-per-inch. Next, the scale factor can be determined by dividing the reference pattern resolution by the actual resolution written into the image header file. In this example, the scale factor would be calculated as 1800/180=10. Upon calculating the scale factor, the actual resolution written in the image header file may be set up to reflect the resolution of the reference pattern. For example, 1800 DPI may be the new resolution of the image file header thereby replacing the fixed resolution value of 180 DPI.
Another method is to rescale the frequency with which an encoded image is to be decoded. The decoding frequency is calculated using the frequency line per inch of a security or encoded image and the scale factor of the image acquisition device and digital camera calculated above. The frequency line per inch of a security or encoded image is divided by the scale factor to provide the decoding frequency. For example, to determine the decoding frequency using an encoded image generated with a 200 lines per inch frequency, the 200 lines per inch frequency of the image would be divided by the scale factor of 10. The calculation would result in a decoding frequency of 200/10=20 lines per inch. Rescaling the decoding frequency generally makes it easier to mingle images from the scanner and from the camera in the same application.
Geometrical distortion must also be considered when viewing and/or capturing an encoded image. Misalignment and/or rotation can distort an object, however, both can be compensated by decoding software. The decoding software can calculate the angle of rotation in the viewed and/or captured image. Of the many methods used to calculated the rotation angle one requires using the positions of some easily located reference points on the object or looking for a maximum of a Radon transform for an image with dominant line structures. Once the rotation angle is calculated, the captured image may be held in its referent position, to avoid distortion caused by the rotation process (e.g. interpolation on the digital grid blurs the image). The encoded image decoding parameters use the adjusted rotation angle. For example, if an encoded image is embedded with 15 degrees screen angle, and it was calculated that the object in the captured image was rotated by 3 degrees the adjusted angle of 15+3=18 degrees should be used for the decoding algorithm.
In certain image acquisition devices such as cell phones and PDA's, distortion may be caused by camera optics, better known as barrel distortion. Barrel distortion occurs when you take a picture of the square that covers most of the field of view and the sides of the square are not straight. Barrel distortion can be corrected by directly applying an inverse geometrical transform to the captured image or implementing the inverse transform in the decoding algorithm, to minimize the effects of the additional image processing operations (e.g. blurring the image by interpolation on the digital grid, adding to the processing time, etc.).
Further, in cameras, a problem may occur if the focal plane of a camera is not aligned with the object plane. The physically equidistant points on the object may have different pixel distances thereby causing linear distortion. Linear distortion may be compensated for using strategically positioned reference points on the object surface to calculate parameters for the inverse transformation.
The methods of the invention may be carried out using any of various digital image acquisition devices.
The digital image acquisition device 100 may be configured to include a communications arrangement 106 and a data storage arrangement 108. The communications arrangement 106 may include one or more interfaces that allows the device 100 to download or transmit information and/or digital images to other devices over a network connection, including, but not limited to, telecommunication, wireless, Wi-Fi, cellular, and mobile phone networks. The data storage arrangement 108 may be configured for storage of information, instructions and digital image files.
The image acquisition device 100 may further include a data processor 110 configured or programmable for processing captured digital images according to the methods of the invention. The data processor 110 may include an image receiving module 112, an image processing module 114 and/or an authentication module 116. The various modules of the image acquisition device 110 may be integral with a data processing chip or other data processor in the image acquisition device 100. The image receiving module 112 may be configured for communication with and reception of digital images from the image capture arrangement 104, the communication arrangement 106 and/or the data storage 108. The image receiving module may also be configured for carrying out initial processing and or authorization verification before passing the digital image to the image processing module 114.
The image processing module 114 and the authentication module 116 may be configured or programmed to carry out the various image processing steps of the methods of the invention. They may, in particular, be programmed to identify any of various security devices such as bar codes, encoded images, digital watermarks, and images visible only in certain wavelengths. More particularly, they may be programmed to decode a graphically encoded image using any of the decoding algorithms previously described. The authentication module 116 may include or be connectable to an authentication database to provide the capability of comparing decoded images to authentication criteria. In some embodiments, the authentication module 116 may be configured to send, via the communication arrangement 106, a request for authentication information or criteria from a remote database or server.
The image processing module 114 may be configured or programmed for different processing modes as specified by the user of the image acquisition device 100. In one mode, for example, the image processing module 114 may carry out the steps necessary to locate and translate a barcode or other graphical representation. In another mode, the image processing module 114 may carry out the steps necessary to decode a graphically encoded image. The image processing module 114 may also be configured to carry out any of various image enhancement techniques. The image processing module 114 may also be configured or programmed to display via the display/user interface 102 a processing result such as a barcode translation or decoded image. The authentication module 116 may be configured to display an authentication result.
Any or all of the modules of the data processor 110 may be configured for displaying messages relating to authorization and/or image processing via the display/user interface 102.
The image processing module 114 and authentication module 116 may, in particular, be configured for selectively decoding graphically encoded images using the techniques described in the '249 patent. As described in the '249 patent, such techniques may require one or more of the parameters (e.g., line frequency) used to encode the image. Accordingly, when this mode is selected by a user, the data processor 110 may prompt the user to enter information on the encoding parameter(s). The entered information is then provided to the image processing module 114 and/or authentication module 116 for use in processing the captured digital image. It will be understood that in some cases, the encoding parameters may not be known by the user, but could be determined by a trial-and-error process or by image analysis.
In addition to capturing digital “snapshots” of an object or surface, the image acquisition device 100 may be capable of use as a video camera that displays on a screen or other user interface real-time views through a lens of the device 100. This allows the user to position the device 100 so as to best view and/or capture an area where an authentication image or device is expected to be present. Depending on the nature of the authentication image or device, this real-time view alone may be sufficient for authentication. For example, if the authentication image is an ordinary (i.e., non-encoded) image viewable only in the non-visible spectrum, the image acquisition device may be used to magnify and display the image in real-time if the image is illuminated by the proper wavelength. In some embodiments, the device 100 may be positioned by using the device's real-time display capability using visible light, then viewing the authentication area using the non-visible wavelength. If present, the authentication image would be discernible.
In instances where it is necessary to capture and process a digital image in order to decode/view an authentication image, the image capturing device 100 may be configured or programmed to display graphical elements (e.g., frame lines, grid-lines, etc.) on a display screen to assist the user in positioning the device for capturing the digital image. These graphical elements may be displayed in a fixed manner relative to the display so that the device's real-time image can be used to position the device based on visible cues. For example, the display may include the outline of a rectangular box, which can be positioned over the expected location of an encoded or otherwise hidden image. The box may be configured to assure that the captured image will contain a sufficient portion of the encoded image (if present) to allow the image to be decoded. The box or other graphical elements can also be configured to assist in establishing a specific orientation of the captured image, if necessary.
The desired configuration of the above-described graphical elements may vary depending on the nature of the security feature used in the authentication image. The image capture device 100 may accordingly be configured or programmed so that a particular set of displayed graphical elements is associated with a particular authentication mode or operation. For example, the device 100 may be configured or programmed so that when a barcode translation mode is selected, a rectangular frame is displayed via the display/user interface 102 that assists the user in positioning the device 100 over the barcode. In other modes, graphical cues may be displayed for matching with features on a document or object to be authenticated.
The image acquisition device 200 may have built-in magnification capabilities or include a magnifying attachment. The magnifying attachment can be similar to that disclosed in the '194 application. The authentication software may be used to select an appropriate decoding mode that can be used to decode an encoded image 50. The authentication software may be embedded onto the image acquisition device 200 and have the capability to receive software plug-ins that contain updated and new authentication software. In an embodiment, the authentication software may be embedded onto the authentication processor. In some embodiments, an attachment capable of connecting with the image acquisition device 200 has the authentication software embedded onto it. The decoding mode may depend on the category of the image being decoded or the object in which the image is stored. For example, the authentication software may maintain a mode for decoding barcodes, pictures, IR images, UV images, and any other image.
The selection of the decoding mode may also be used to determine a particular set of graphical elements that are displayed. These graphic elements may be help the user position and orient the image acquisition device 200 in relation to a target are where the encoded image 50 is located. In an embodiment, the selection of the barcode decoding mode may result in grid elements and a box outline being displayed.
The digital image acquisition device 200 may capture a digital image of the encoded image. The captured digital image 60 may be magnified using the image acquisition device's magnifying capabilities and/or a magnifying attachment. The authentication software may decode some or all of the image
The authentication software may decode the captured digital image automatically upon capturing. In an embodiment, the user may manually instruct the authentication software to decode the captured digital image. For example, the user may press a key on the image acquisition device that instructs the authentication software to decode the captures digital image.
The image acquisition device 200 may display the decoded image 62. The displayed result may include the hidden image embedded in the authentication image. In the illustrated example, the decoded image is a small illustration of a running fox, which is entirely invisible to the naked eye.
In some embodiments, the captured digital image is transmitted to a remote processor in raw image data form. The raw image is then modified by replacing values original to the raw image data with decoded values. In the case of bar codes, however, the original values of the raw image data are not modified, but instead the bar code content is calculated according to methods known in the art. While the remote processor modifies the values in the raw image data, the image acquisition device develops the raw image data of non-bar code images into a converted image that is stored on a memory card, the image acquisition device, or at a remote processor.
In some embodiments of the invention, the image acquisition device may be configured to capture and/or decode data in machine readable form that requires magnification to authenticate and read the article. This may includes microscopic barcodes or symbologies that require magnification to authenticate and view the image. The images of the microscopic barcodes or symbologies can be read and authenticated using either a portable or non-portable magnification system (e.g., a magnifying lens attachment). The images of the barcodes or symbologies may be applied using anti-copying techniques or by traditional imaging processes. In one preferred embodiment, the image acquisition device may be used to view the microscopic barcodes or symbologies while the authentication processor may be capable of authenticating the images using the authentication software. In another preferred embodiment, the image acquisition device by itself may view and authenticate the microscopic barcodes or symbologies using the authentication software. In another preferred embodiment, the image acquisition device with an attachment (e.g., a magnifying lens attachment) may view and authenticate the microscopic barcodes or symbologies using the authentication software.
For authentication images that require capture and processing, the data processor of a digital acquisition device of the invention may make use of specialized decoding or authentication software. The data processor may also be selectively connectable to another image acquisition device, an attachment capable of connecting to another image acquisition device, or both. In some embodiments, the data processor may communicate with a separate authentication processor located at a remote site over a computer or telecommunications network.
It will be understood that the term authentication software may encompass software that is used to decode or otherwise view an authentication image. It may also include software used to compare the decoding result to authentication criteria to establish an authentication result. In some embodiments, the authentication software will display an image representative of the decoding result. The software may alternatively, or in addition, display an authentication result.
In a preferred embodiment of the invention, the data processor has the authentication software embedded onto it. In some embodiments, the data processor has the capability to receive software from software plug-ins that contain updated or new authentication software. In one preferred embodiment of the invention, the image acquisition device 100 has the authentication software embedded onto it and has the capability to receive additional software from software plug-ins that contain updated or new authentication software. In another preferred embodiment of the invention, an attachment capable of connecting with the image acquisition device 100 has authentication software embedded onto it and has the capability to receive software from software plug-ins that contain updated or new authentication software.
The authentication software may provide multiple layers of security for brand protection and document security. The authentication software also eliminates the need to use several different verification tools. The prior art often consisted of one device for each security element present on the prior art product. This made field authentication a very cumbersome process, and severely limited the effectiveness of a multi-layered approach to the security design. The authentication software allows the verification of multiple security elements that may be present in the encoded document. The authentication software integrates with the software architecture of either the authentication processor, the image acquisition device, or an attachment capable of connecting to the image acquisition device, and provides multiple layers of document protection by integrating several security features using various user-provided or embedded software security features.
In some embodiments of the invention, a wireless capable memory card or device enables users to send images directly from the image acquisition device to wireless networks or cellular or data networks, such as the ones used by portable telecommunication devices for data transfer. In some embodiments of the invention, the wireless memory card is attachable to the image acquisition device. In one preferred embodiment, the wireless memory card is capable of storing images like a conventional SD memory card. In another preferred embodiment, the wireless memory card allows users to upload, save, and share digital images on a wireless network.
In one preferred embodiment of the invention, the wireless memory card allows for the authentication of products by wirelessly communicating between the image acquisition device and a remotely located computer device or network system loaded with authentication software.
The methods of the invention may be carried out using systems that incorporate digital image acquisition devices. With reference to
The image acquisition device 310 may be any device adapted for recording a digital image of at least a portion of the test object containing a target area in which, on authentic objects, an authentication image will have been applied. The device 310 may have a built-in magnification and illumination feature or may have an attachment 330 that provides these feature. In an particular embodiment, a lens-based device 330 attachment may be used in conjunction with a standard digital camera to illuminate, magnify and capture a digital image of an authentication image. In particular, the lens-based device 330 may illuminate and magnify an authentication image printed on the label of an object to be authenticated. The lens-based device may include a housing, at least one light source for illuminating an authentication image in a predetermined frequency range, and a lens for magnifying the authentication image. Similar lens-based devices, field microscopes or other illuminating and/or magnifying attachments may be fitted to virtually any form of portable or non-portable digital image capturing device, including various types of digital cameras, scanners, cell-phones, PDAs, etc.
The authentication processor 320 may be any data processor configured for receiving and processing digital images. The authentication processor 320 includes an image receiving module 322 adapted for selective communication with the image acquisition device 310 and for receiving captured digital images therefrom. The image receiving module 322 transfers the captured digital images to an image processing module 324. The captured digital image may also be stored in a database in the authentication processor. The image processing module 324 may be adapted for performing any preprocessing required before the captured digital image can be viewed and/or decoded. This may include identifying landmarks in the target area and orienting the captured digital image accordingly.
The authentication processor 320 also includes an authentication module 326. The authentication module 326 is configured to verify the authenticity of the object using the authentication image. The authentication module 326 may include a decoding module. The decoding module may be programmed with digital decoding software adapted for performing one or more decoding algorithms on the captured digital image to produce a decoding result. The decoding module may obtain from the encoding information database any information (e.g., the authentication image and encoding parameters) needed for decoding the captured encoded image. Some encoding information may be determined or calculated by image analysis. The decoding result may be passed to the authentication module 328, which compares the decoding result to one or more authentication criteria to establish an authentication result. The decoding result, the authentication result or both may be stored in memory, or in a local or remote database, or displayed for use by an on-site inspector or other user.
The components of the authentication system 300 may be interconnected via any suitable means including over a network. The authentication processor 320 may take the form of a portable processing device that may be carried by an individual inspector along with a handheld image acquisition device (e.g., a portable scanner or digital camera). The system 300 is configured so that the various steps in processing a digital image to authenticate an object can be distributed between the image acquisition device 310 and the authentication processor 320. In some instances, all of the processing and authentication actions may be carried out by the image acquisition device 310 and a result transmitted to the authentication processor 320. In other instances, some or all of the image processing may be done by the image acquisition device 310 and a processing result transmitted to the authentication processor 320 for determining an authentication result.
The authentication system 300 is well adapted for use in authenticating a large number of similar objects such as, for example, packaged items in a warehouse or a large number of similar documents. The authentication processor 320 may be adapted so that information relating to individual objects may be entered or derived from the captured digital image. This allows the association of the captured digital image with the particular object. This, in turn, allows the retrieval of object-specific encoding information, which may be required for decoding the captured authentication image or for determining an authentication result.
It will be understood that if the encoding information is not object-specific, a group of test objects with the same expected authentication image can be authenticated by the authentication processor 320 or the image acquisition device 310 using a single set of encoding information. This set of encoding information can be obtained from the encoding information database once and stored in the memory of the authentication processor 320 or the image acquisition device 310.
The functions of the authentication processor need not be carried out on a single processing device. They may, instead be distributed among a plurality of processors, which may be interconnected over a network. Further, the encoding information required for decoding the captured encoded images taken from test objects and the decoding and authentication results may be stored in databases that are accessible to various users over the same or a different network.
The authentication systems of the invention are highly flexible and can be used in a wide variety of authentication scenarios. In a typical scenario, an encoded authentication image is applied to the packaging of a client manufacturer's product that is subject to counterfeiting or tampering. An on-site inspector equipped with a portable inspection processor and a magnifying image acquisition device may be dispatched to a site such as a warehouse where a group of packaged products are stored. The inspector may use the image acquisition device to scan or otherwise capture a digital image of the target area of a suspect product package. Additional information such as date, time, location, product serial number, etc., may be entered by the inspector. Some of this information may alternatively be entered automatically by the inspection processor. If the inspection processor is equipped with its own decoding and authentication software, the inspector may authenticate the suspect product immediately. Alternatively or in addition, the inspection processor may be used to submit an authentication request to a remote authentication server. Authentication requests may be sent on an individual item basis. Alternatively, captured authentication images and associated product information may collected for multiple test items and submitted as part of a single authentication request. This would allow, for example, the inspection processor to be used independently of a network connection to collect authentication data from a plurality of test items, then connect to the network (e.g., by logging into an Internet website) for submitting a single batch authentication request.
Upon receiving the authentication request from the inspection processor, the authentication server validates the request, retrieves any required image encoding information from the encoding information database and processes the captured digital image. The captured image is decoded and compared to retrieved authentication criteria to determine an authentication result. The authentication result is then stored in the authentication database. A representative of the manufacturer or other authorized user is then able to access the authentication results by connecting to the authentication database. In some embodiments, this may be accomplished by logging into a security-controlled website and submitting a request for authentication results for the test objects.
In some embodiments, the authentication server may be configured for access through a web site. Authorized users can log onto the web site, upload captured or scanned images, and immediately receive an authentication result on their browser. Results can also be stored in an authentication database for future reviews.
In an exemplary embodiment, a law enforcement officer may be able to verify the authenticity of a drivers license using a portable image acquisition device. The officer may use the device for viewing and capturing an authentication image. The officer may be able to obtain an authentication result. This approach would help detect fraudulent drivers licenses which can deter individuals from producing fraudulent licenses, and prevent the sale of tobacco and alcohol to under age persons.
In some embodiments, a web-based authentication service may be implemented using standards for interface and data representation, such as SOAP and XML, to enable third parties to connect their information services and software to the authentication service. This approach would enable seamless authentication request/response flow among diverse platforms and software applications.
As discussed above, the functions of the authentication systems and the actions of the authentication methods of the invention may be carried out using a single data processor or may be distributed among multiple interconnected processors. In some embodiments, for example, the decoding and authentication functions may be carried out by different processors. Aspects of decoding functions themselves may be carried out using a single processor or a plurality of networked processors.
It will be understood that the authentication methods and systems of the invention may be used to review and/or decode magnified captured images of any form of encoded image and that the magnified captured images may be decoded using any software-based method.
It will be readily understood by those persons skilled in the art that the present invention is susceptible to broad utility and application. Many embodiments and adaptations of the present invention other than those herein described, as well as many variations, modifications and equivalent arrangements, will be apparent from or reasonably suggested by the present invention and foregoing description thereof, without departing from the substance or scope of the invention.
While the foregoing illustrates and describes exemplary embodiments of this invention, it is to be understood that the invention is not limited to the construction disclosed herein. The invention can be embodied in other specific forms without departing from its spirit or essential attributes.
This application claims the benefit of U.S. Provisional Application No. 61/074,857, filed Jun. 23, 2008, U.S. Provisional Application No. 61/152,402, filed Feb. 13, 2009, and U.S. Provisional Application No. 61/152,399, filed Feb. 13, 2009, all of which are incorporated herein by reference in their entirety. This application is directed to subject matter related to the content of U.S. application Ser. No. 11/207,437, filed Aug. 19, 2005 and U.S. application Ser. No. 11/068,350, now U.S. Pat. No. 7,512,249 ('249 patent), filed Feb. 28, 2005, which claims priority to U.S. Provisional Application No. 60/565,300, filed Apr. 26, 2004, all of which are incorporated herein by reference in their entirety. The subject matter of the application is also related to the content of U.S. application Ser. No. 11/928,194 ('194 application) filed Oct. 30, 2007 and U.S. application Ser. No. 12/029,108 ('108 application) filed Feb. 11, 2008, each of which is incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 61074857 | Jun 2008 | US | |
| 61152402 | Feb 2009 | US | |
| 61152399 | Feb 2009 | US |
