Patent Application
20230249430
The invention relates to an engraved solid piece for carrying data comprising specific information on a surface of the engraved solid piece. The invention further relates to a method for manufacturing such an engraved solid piece, and to a method for configuring a plurality of block structures of modulated features and/or base features intended to be engraved on the surface of the solid piece.
European publication EP3437849 to the present applicant discloses an embossing tool for embossing a combined embossing pattern into a packaging material, the combined embossing pattern including decoratively embossed structures and at least one embossed code. The embossing tool includes a patrix and a matrix embossing device for cooperating with each other, embossing structures of the patrix and matrix embossing device formed to produce the combined embossing pattern into the packaging material in an embossing gap. The embossing structures of the patrix and the matrix embossing device further include first embossing structures intended for making the at least one embossed code, which are inverse congruent patrix and matrix embossing structures having a polyhedral shape. The decoratively embossed structures and the at least one embossed code produced by the embossing structures are arranged such that the at least one embossed code has a reduced visibility to the human eye. In order to achieve this, embossing structures intended for making the decorative embossed structures are adjacent to code areas comprising embossing structures for making the embossed code. Decorative areas may alternate successively with code areas. Different codes may also be overlaid by each other by using different structures to emboss the codes. For example, in case an embossed cell of a first code lies at the same location as an embossed cell of a second code, the cells can be embossed as full square cells, and in case only an embossed cell of the second code is present, the cell can be embossed with an empty square. Moreover, in case only an embossed cell of the first code is present, the cell can be embossed with a full circle. Hence, it is possible to recover two overlaid codes by identifying over a delimited surface all embossed cells belonging to the first code on one hand, and all embossed cells that belong to the second code on the other hand, even when such embossed cells are used for representing the first code and the second code at the same time. In a similar manner, it is possible to overlap a surface area of an embossed code with a surface area of the decorative pattern. Shapes of embossed cells allow determining whether an embossed cell is used to define the embossed code, the decorative pattern, or both. It is only the distribution of the embossed cells that belong to the embossed code, i.e., the distribution thereof over a surface of the embossed material, allows recovering the embossed code.
International publication WO2020/002970 to the present applicant discloses an embossing method allowing modulating individual features and arranging them in a grid, whereby the modulated individual features enable to obtain surface-oriented visible optical effects with an aesthetic purpose. In this manner, the method described allows creating brilliant and high-quality results in foil material. This publication makes no mention of encoding and/or hiding information by any means, and more particularly by means of the modulated individual features. Furthermore, it does not require any particular technical means to reveal the aimed visible optical effects in light reflected from a foil material embossed according to the method of WO2020/002970.
The present invention aims to propose an alternative for carrying data comprising specific information on a surface of an engraved solid piece, in which the carried data is intermingled with an aesthetic ensemble on the surface but rendered imperceptible to the human eye.
In a first aspect, the invention provides an engraved solid piece carrying data comprising specific information on a surface of the engraved solid piece. The surface is covered by a plurality of block structures, comprising at least a first block structure. Each block structure is a spatially restricted collection of modulated features and base features, which are spread over the surface of the engraved solid piece. Each modulated feature and each base feature has respectively a three-dimensional modulated-feature profile and a three-dimensional base-feature profile. Each of the modulated-feature profiles is the result of applying a corresponding modulation to one of the three-dimensional base-feature profiles, according to a specific corresponding information. Each modulated feature further is a symbol, which is a transcription of a character of an alphabet. The alphabet is a collection of characters, which are distinct objects of well-defined elementary data. Each of the base features is an engraved elementary three-dimensional topographical element of the surface. Each of the modulated features is an engraved three-dimensional topographical element of the surface. At least a part of the data is transcribed by a code-block structure of modulated features, the code-block structure thereby constituting at least a part of a block structure corresponding to the at least one part of the data. The modulated features of the first block structure are arranged according to a first ordered map, the first ordered map comprising at least a first finite ordered set of first positions of the modulated features of a first code-block structure on the surface, the first block structure corresponding to a first part of the data, and the first ordered map further is configured to arrange the modulated features of the first block structure to constitute an aesthetic ensemble on the surface and render the respective symbols corresponding to the modulated features of the first code-block structure imperceptible to the human eye, but retrievable by means of a software-driven image-sensor/processor combination.
In a preferred embodiment, the engraved solid piece further comprises on its surface an at least one second block structure being a second spatially restricted collection of exclusively a plurality of at least one of the base features. The base features of the at least one second block structure are arranged on the solid surface according to a second map, the second map being a second finite set of positions of the base features on the surface, the second map further enabling its base features to be arranged to constitute an aesthetic ensemble on the surface.
In a further preferred embodiment the engraved solid piece:
the transfer being any one of the following:
shaping, printing, molding, crafting, pressing, and embossing onto or into the substrate, of the modulated features and/or the base features.
In a further preferred embodiment, the engraved solid piece is
the transfer being any one of the following:
printing, molding, crafting, pressing, and embossing onto the substrate, of the engraved modulated features and/or the engraved base features.
in a further preferred embodiment, the engraved solid piece further comprises a plurality of first ordered maps and second maps, wherein the plurality of first ordered maps and second maps are arranged along at least a regular grid.
In a further preferred embodiment, the engraved solid piece further comprises a plurality of first ordered maps and second maps, wherein the plurality of first ordered maps and second maps are arranged along at least a randomized grid.
In a further preferred embodiment, the engraved solid piece further comprises a plurality of first ordered maps and second maps, wherein the plurality of first maps and second maps are
In a further preferred embodiment, the engraved solid piece further comprises at least a further first ordered map, the further first ordered map being a further finite set of further positions of the modulated features on the surface, each further position being a result of a determined translation of a corresponding first position of the first ordered map, the further first ordered map being configured to define a further first block structure that is non-overlapping with the first block structure defined by the first ordered map, and either
In a further preferred embodiment, the engraved solid piece further carries a third part of data on the surface corresponding to a third map. The third map is a third finite set of positions of the modulated features on the surface, the third map being configured to define a third block structure that is non-overlapping with the first block structure defined by the first map, and any one of the following
In a second aspect, the invention provides a method for manufacturing an engraved solid piece configured for carrying data comprising specific information, on a surface of the engraved solid piece. The method comprises
engraving (S1) on the surface a plurality of block structures (BS), comprising at least a first block structure, whereby
whereby the modulated features of the first block structure are arranged according to a first ordered map, the first ordered map comprising at least a first finite ordered set of first positions of the modulated features of a first code-block structure on the surface, the first block structure corresponding to a first part of the data, and
whereby the first ordered map further is configured to arrange the modulated features of the first block structure to constitute an aesthetic ensemble on the surface and render the respective symbols corresponding to the modulated features of the first code-block structure imperceptible to the human eye, but retrievable by means of a software-driven image-sensor/processor combination.
In a further preferred embodiment, the step of engraving on the surface a plurality of block structures is executed by any one of the following:
In a third aspect, the invention provides a method for configuring a plurality of block structures of modulated features and base features intended to be engraved on a surface of a solid piece,
whereby
each modulated feature and each base feature has respectively a three-dimensional modulated-feature profile and a three-dimensional base-feature profile, which enables to engrave each of the modulated features and each of the base features,
each block structure comprises a corresponding code-block structure of transcribed data, and
each block structure is a collection of modulated features and base features, configured to be spread over a spatially restricted part of the surface.
The method comprises:
In a fourth aspect, the invention provides a method for authenticating a surface-structured product, by means of linked information associated to an identifier which is associated with the surface-structured product, the identifier being embedded into a code-block structure of a block structure of a surface of the product. The method comprises the steps of:
In a further preferred embodiment, the method for authenticating the product further comprises the steps of:
In a further preferred embodiment, the method for authenticating the product wherein:
In a further preferred embodiment, the step of analyzing further comprises:
In a further preferred embodiment, the method for authenticating the product further comprises
One particular advantage of the invention is that it enables a comparatively higher density of information for carrying data, compared for example to the prior art EP3437849 discussed herein above.
The invention will be understood better through the description of embodiments, and in reference to the drawings, in which
Same references will be used to designate same or similar features throughout all of the figures.
With Regard to the Substrate
With Regard to Transfer
With Regard to Encoding
The patent publications described in the above Background Art section disclose the use of a pattern of features for the purpose of satinizing a foil or a paper, and therewith achieving an aesthetic, decorative effect. The pattern may be a regular embossing pattern that is applied to a surface of a solid piece in the intention of embossing the features of the pattern in the foil or paper by means of the solid piece.
For the sake of convenience, in the following we will refer to a foil product when designating metal foil, polymer foil, paper, laminated paper or hybrids, cardboard, or other thin-sheet product to be embossed with thicknesses <900 μm.
More generally, in the field of embossing, and for the present invention, we refer to the map as a finite set of positions on the surface of the solid piece or the substrate, determining locations of base features and modulated features, i.e., three-dimensional structures, on the surface of the solid piece or substrate. The map may be a basis for placing the features as a block structure onto the surface of the solid piece or substrate.
A manufacture of such features on the surface of the solid piece may involve various tools and engraving methods, such as for example laser engraving, laser ablation, chemical engraving, plasma etching, stamping, milling, etc.
The solid piece may for example be embodied by a tool such as a set of a first rotating roller and a second rotating roller, where the first roller comprises one or more features as cavities in the surface of the first roller and the second roller comprises corresponding inverted congruent features as protrusion on the surface of the second roller. In such a case, the first roller may be designated as a matrix roller and the second roller as a patrix roller. Hence, when a foil product is fed in a nip between the first roller and the second roller for embossing, each cavity-shaped feature becomes penetrated by the corresponding protruding and congruent feature of the second roller, thereby modifying the structure of the foil product by modification of a normal vector of the foil product's surface.
Another embodiment of the solid piece may be an injection mold.
In an even further non-limiting embodiment, the features may be engraved directly into a customer product rather than being manufactured on a tool.
We refer herein to a surface-structured product as being a customer-oriented product, as opposed to a tool used to fabricate a surface-structured product that bears the described block structure of features.
We further define with respect to a surface bearing one or more of the base and/or modulated features, coordinate systems where the axis z is aligned to the normal of the surface of the substrate, the axis x is tangent to the surface and the axis y is the result of the cross product between x and z, such that an orthogonal space is formed. Referring to
Considerations about the Map
In a known configuration, multiple features may be aligned in a checkerboard fashion on the surface of a tool or surface-structured product, i.e., aligned alongside a two-dimensional grid, such that the multiple features compose a largely uniform area on the surface. In other words, the multiple features cover the concerned area in a constant regular manner. The set of multiple features thus aligned correspond to positions comprised in a map. More specifically, the map is defined as a finite set of positions on the surface of the solid piece of the substrate, e.g., a set of positions (x, y) where x and y are defined in the uniform two-dimensional grid, hence determining locations of features. The positions may correspond for example to the location of a geometrical center of the respective features' footprint on the surface.
In an example embodiment of the invention described herein, the features may have either one of positive polarity and negative polarity, and be called respectively positive feature and negative feature. By positive polarity is meant that an average z-component of the positive feature is greater than the z=0 of that feature, and by the negative polarity is meant that the average z component of the negative feature is smaller than the z=0 of that feature. The z=0 of any one of the features is typically defined as the z position where the (x,y)-section formed by intersecting a horizontal plane with respect to z-direction with the feature is of the largest surface. Another way of defining z=0 is that it corresponds to a base surface of the solid piece.
The map may comprise positions of positive and negative features that alternate in sequence and are arranged in a checkerboard fashion. This means that each positive feature is surrounded by four (4), directly neighboring negative features and vice versa except for those features located at a border or the perimeter of the map. In this case the block structure corresponding to the map is called “embossed-debossed”. However, in a different example embodiment, the map may comprise only positive features, and in this case the block structure corresponding to the map is called “embossed-embossed”. In a further different example embodiment, the map may comprise only negative features, and in this case the block structure corresponding to the map is called “debossed-debossed”. In an even further embodiment, the map may comprise positive and negative features that occur with one or more sequences of polarity that are more complex than explained herein above in this paragraph, or even pseudo-random.
In a preferred embodiment of this invention, the features have overall lateral sizes in the (x,y)-plane of the solid piece in a range between 5 μm to 250 μm and heights along the z-axis of the solid piece in a range between 5 μm to 250 μm. The features are meant to alter optical-reflection properties of the surface-structured product by locally modifying the normal of the surface.
In the present invention, a subset of positions in the ordered map may be used to represent digital data comprising specific information. The block structure corresponding to this subset may be defined as a code-block structure. Conversely, a code-block structure is a block structure with modulated features, the positions of which are comprised in the ordered map.
In a preferred embodiment of this invention, an engraved symbol is considered a single element of the code-block structure obtained by modulation, i.e., a transcribing of an alphabet character profile into the base feature to obtain a modulated feature.
It is to be noted that the code-block structure may not necessarily be packed as densely as the map, the density being the count of modulated features of the code-block structure per surface unit. For example, it is typical but not necessarily always the case that in the case of an “embossed-debossed” map, the code-block structure only comprises features of a single polarity. In “embossed-embossed” or “debossed-debossed” maps, it is common that the code-block structure corresponds to a subset of the map that is packed more densely than the map itself, each feature of the code-block structure modulating one or more characters into a symbol.
Referring to
Referring to
Referring to
As may be read in Table 2, the features with numbers 10, 12, 18, 23 and 25 are modulated features representing symbols for characters e, c, h, o, and s. These features have code-feature IDs and are part of the code-block structure 600. Remaining features of the code-block structure are base features and do not represent any symbols. Features outside the code-block structure 600 have a similar structural and visual appearance as those from the code-block structure 600 however comprise no modulated features among the features represented in textured circles.
A packing density of the code-block structure 600 is maximum for the map of
In a preferred embodiment of the present invention, the code-block structure itself aligns on a two-dimensional grid, such as the ones depicted in
The features comprised in the code-block structure preferably are modulated features and base features. Each modulated feature and base feature has respectively a three-dimensional modulated-feature profile and a three-dimensional base feature profile. Each of the modulated-feature profiles is the result of applying a corresponding modulation by means of a modulation to one of the three-dimensional base feature profiles, according to a specific corresponding information. In this sense, and when used to transcribe data in the code-block structure, each modulated feature is a symbol, which in turn is a transcription of a character of an alphabet. The alphabet is a collection of characters, which are distinct objects of well-defined elementary data. In other words, the modulated features are used as symbols to code data, and they are then included in the code-block structure. Thereby, at least a part of the data is transcribed by the code-block structure of modulated features. Eventually, the code-block structure constitutes a block structure corresponding to the at least one part of the data.
The modulated features, which are part of a block structure, are arranged according to an ordered map. This is a way that allows knowing where each of the modulated features may be found on the engraved solid piece, in order to reconstitute and detect the symbols used in the code-block structure and hence recover the data carried on the surface of the solid piece. In a preferred embodiment, a code-block structure of, e.g., 33 lines and 33 rows comprises within itself a small set of, e.g., 64 modulated features that represent a specific pattern, which may be a synchronization pattern. These modulated features may be specific symbols of the alphabet, however in the present example these modulated features are not used to encode the data itself. At the time of the optical read-out of the code-block structure, an image sensor acquires an image; the image is transmitted subsequently to an image processor; then, the image processor analyzes the acquired image and correlates the synchronization pattern therein with an application-specific synchronization pattern in order to determine the reference or origin for a decoding operation. The image processor is programmed such that, after it correlates the synchronization pattern, it knows where the modulated features, i.e., the symbols may be found on the engraved solid piece and begins to detect/demodulate the symbols used in the code-block structure, decodes the newly arranged information and hence recovers the information on the surface of the solid piece.
Referring now to
Referring to
In line with the present invention, the modulation of a basic feature may be made comparatively as weak as possible, as will be explained in the following. In this context, the term “weak” means that a two-dimensional integral over the entire feature of the angle difference between the normal of the modulated feature and that of the base feature on the surface-structured product, is below a certain threshold in human vision capability. The purpose is to generate a modification of the base feature such that an interaction between the impinging light and the modulated feature looks very similar to the interaction between the impinging light and a base feature in view of the human eye. In such a configuration, under most lighting conditions, the modulated features look very similar to the base features and therefore the respective symbols corresponding to the modulated features in the code-block structure of modulated features are imperceptible to the human eye. However, if an appropriate image of the code-block structure comprising modulated features is taken with a digital camera, and subsequently processed using a computerized system such as, e.g., a smartphone, a tablet, a PC, an embedded controller, it is possible to reveal the original information carried in the code-block structure of the image. In addition to the modulated features looking very similar to the base features, a number of additional factors make it even more difficult to differentiate a detection of modulated features from a detection of base features. These additional factors comprise for example:
At the same time as the individual modulated features carry information in a manner imperceptible to the human eye, a plurality of the modulated features may also be used by themselves or together with base features to create an aesthetic ensemble perceptible to the human eye. Such aesthetic ensemble may for example be a surface of the surface-structured product or solid piece that defines for example a logo, a repetitive motif, or a pictorial representation of an object.
Typically, by adding redundancy in the form of, e.g., a forward error-correcting (FEC) code, the code-block structure may be constructed in such a way that the initial information coded into the code-block structure can still be recovered if any one of the following occurs:
A further typical application of the present invention is to authenticate a product by taking a picture of the surface-structured product or its packaging, processing the picture to identify possible code-block structures and extract the information contained in such code-block structures.
Various modulation approaches may be used, resulting in corresponding more or less influence in light impinging on the modulated feature, depending on the target digital means for reading the image, e.g., a smartphone with a comparatively low-resolution camera in a relatively poor lighting condition or a high-end professional camera with perfect, directional lighting.
The following exemplifies types of modulation that are of typical use.
It is of convenience to differentiate a few typical yet general cases:
The multiplicative modulation allows height modulation or polarity flipping (positive to negative and vice-versa) of the complete base feature. Referring to
The offsetting modulation permits a height modulation of the complete base feature. It is clamped generally to zero, as it is common practice to select positive-only features or negative-only features approach.
The additive modulation, which also covers the subtraction case, allows for adding a position-dependent structure to the base feature.
Various types of modulation may also be combined by modulating more than one parameter.
This might be desired to produce a stronger effect when required, e.g., a more pronounced effect on intensity of light reflected by the so-obtained modulated feature in order to facilitate a read-out and retrieval by means of a software-driven image-sensor/processor combination.
In a typical case, given a layout of features along a uniform grid such that two neighboring positions along either one of the main axis of the grid, are separated by a value d, a hemispherical base feature of amplitude 1 and a height h are modulated by one, two or four cones of truncated height h, base width w and angle to the normal theta, placed at (d/2,0), (−d/2,0), (0,−d/2) or/and (0, 0+d/2) relative to the central position of the sphere. See
In another typical case, a single cone of inverse polarity than the hemispherical base feature but of any height h2 is placed in the center of the hemispherical base feature, i.e., at (0,0) relative to the central position of the hemispherical base feature. See
Engraved Solid Piece
As previously explained the engraved solid piece may be either a tool or a surface-structured product. In either case, the engraving is made on a material surface.
In a general embodiment, the engraved solid piece carries data comprising specific information on one of its surfaces. Hence, the surface is covered by a plurality of block structures, comprising at least a first block structure. Each block structure, including the first block structure, is a spatially restricted collection of modulated features and base features. These modulated features and base features are spread over the surface of the engraved solid piece according to a map.
Each modulated feature and each base feature has respectively a three-dimensional modulated-feature profile and a three-dimensional base-feature profile. Each of the modulated-feature profiles is the result of applying a corresponding modulation by means of a modulator to one of the three-dimensional base-feature profiles, according to a specific corresponding information. Each modulated feature corresponds to a symbol that is a transcription of a character of an alphabet. The alphabet is a collection of characters, which are distinct objects of well-defined elementary data. Each of the base features is an engraved elementary three-dimensional topographical element of the surface. Each of the modulated features is an engraved three-dimensional topographical element of the surface. At least a part of the data is transcribed by a code-block structure of modulated features, the code-block structure thereby constituting at least a part of a block structure corresponding to the at least one part of the data. The modulated features of the first block structure are arranged according to a first ordered map, the first ordered map being a first finite ordered set of first positions of the modulated features of a first code-block structure on the surface, the first code-block structure corresponding to a first part of the data, and the first ordered map is further configured to arrange the modulated features of the first block structure to constitute an aesthetic ensemble on the surface and render the respective symbols corresponding to the modulated features of the first code-block structure imperceptible to the human eye, but retrievable by means of a software-driven image-sensor/processor combination.
It is noted that while the outer package 3001 resembles a cigarette package in the example of
Above-mentioned embossing methods and surface-structured products are generally suitable to be implemented or obtained out of an online-production line, digital press, or traditional converter.
According to another aspect of the present invention, a system or a method is provided for capturing an image 3350 with a first data-processing device, for example a smartphone 2601, from a part of a surface, element or component 1700, part of a surface 1700 including a block structure 1701, analyzing the image 3350 to extract an identifier, code or other information 3351 therefrom, and matching identifier 3351 with information from a database, after sending identifier or code 3351 to another second data-processing device, for example server 3310.
More specifically, the system can include a smartphone 2601 or other data-processing device having a camera that is equipped with an image sensor and optics or another type of data-processing device that is operatively connected to a camera or image sensor, for example but not limited to personal computer (PC), tablet, Macintosh computer (MAC), handheld camera reader, smart camera, or other portable data-processing device, the smartphone 2601 configured to operate an image capture and analysis application APP1 for capturing and analyzing captures images 3350 from the camera associated with smartphone 2601 for reading codes or identifiers 3351 from the captured image 3350. For example, application APP1 can be installed and operated by user of smartphone 2601 having a graphical user interface (GUI) that in turn can use the camera application installed smartphone 2601, and can include different types of image-processing software and image-processing algorithms, for example decode algorithms, image filtering, and pattern-matching algorithms, software for geometric transformations, these algorithms allowing to identify code or identifier 3351 from image 3350. Moreover, smartphone 2601 includes a data communication interface 2660 and antenna, for example but not limited to a Bluetooth or Bluetooth LE interface, wireless local area network (WLAN) interface, global system for mobile communications (GSM) cellphone data interface, radio frequency (RF) communication, broadband cellular network interface such as but not limited to 3G, 4G, and 5G, optical data interface based for example on infrared signals, satellite-data based interface, data communication interface 2660 configured to communicate to and over a network 3300, for example the internet or an intranet. It is also possible that at least some of the connections to network 3330 is wired, for example by local area network (LAN) connections. Network 3300 is accessible by data communication interface 2660 of smartphone 2601, and is itself operably connected to a physical server, virtual server, cloud server or any other means of computation 3310 that has access to a database 3320. Database 3320 can be a physical database 3320 that can be located at server computer 3310. for example an external or internal hard drive, but can also be another remote server or a cloud-based database or network drive. Server 3310 is itself equipped with a data network interface to connect to network 3300, and having all necessary data interfaces and communication protocols for communication data from and to network 3300. Moreover, a memory space of database 3320 can store a table or data structure Twith information that is linked or otherwise in connection with identifier 3351, for example data structures and information that is associated with a specific identifier or code 3351. Not shown in
For example, table or data structure T can include information 3322 that is linked to a query key 3321, also referred to as linked data 3322, and that is related to product or system that includes part of surface 1700, for example information 3322 that includes manufacturing information of part of a surface 1700 that is associated to code 3351, including but not limited to manufacturing date, manufacturing location, version information, technical data, data links to user manuals, construction plans, maintenance plans and schedules, compatibility information, information 3322 that includes data on foodstuff that are packaged to form part of a surface 1700 including but not limited to ingredients, country of origin information, location of origin information, expiration date of the food product, information on a product class, information 3322 that includes data on marketing and consumer information related to part of a surface 1700, for example but not limited to hyperlinks or data to promotions, flyers, white papers, websites, product warnings, product classifications, coupons, audiovisual representations such as YouTube™ videos, animations, user manuals, Microsoft PowerPoint™ presentations, portable document format (PDF) documents, information 3322 that includes intellectual property information related to part of a surface 1700, for example but not limited to data on patents, designs, trademarks, copyrights, open source software information, geographic indicators, information 3322 that includes data with pharmaceutical information, for example but not limited to pharmaceutical manuals, quality and dose information, dispensing information, warning information, information 3322 can also include further identification information related to part of surface 1700, for example but not limited to owner information, serial numbers, address information, product, hardware or software version information, manufacturing history information, logistics tracking information.
Moreover, computing device 3310 can have an application software APP2 installed and operated thereon, application software APP2 managing the database 3320 and the table or data structure T, and configured to receive, process, and respond to request made by application software APP1. For example, application software APP2 can receive specific queries and requests from application software APP1 from smartphone 2601, and can process and respond to these, by sending a response 3352 back to smartphone 2601 via network 3300, for example by including data extracted from table or data structure T that is linked to the received identifier or code 3351. Application software APP2 can also be equipped with additional image processing software that allows receiving image data from smartphone 2601, for example raw, pre-processed or compressed image data. In this respect, smartphone 2601 and APP1 can send to server 3310 and application software APP2 image data that has been captured by smartphone 2601 of block structure 1701 of part of a surface 1700. For example, this can be done upon sending a request 3660 from APP2 to APP1 of the smartphone 2601. This allows application software APP2 performing additional processing on the image data, for example one that is more complex that the one performed at application software APP1. In a variant, it is also possible that APP1 of smartphone 2601 directly accesses a gateway or an application programming interface (API) to access data of table or data structure T. and that no additional application software is present at server 3310 but only an application-specific interface, but that server 3310 acts as a data provider to smartphone 2601, with APP1 accessing server 3310 for requesting data from table or data structure T. In this respect, it is possible that APP1 and APP2 are operated as one application on smartphone 2601. Moreover, data communication with the sending of information on identifier or code 3351 and the responses 3352 with additional data sent from table or data structure T can be secured by different encryption and authentication schemes that are known in the field of safe message exchanges. Moreover, software application APP2 can further include data interfaces to other external applications 3370, for example via an API, to access additional information from third parties that can relate or is otherwise linked to identifier or code 3351. For example, a track and trace application 3370 can be accessed, that can provide for logistics and manufacturing information from a third party, that can be thereafter sent back to smartphone 2601 on the GUI of the software application APP1.
The system can further include a camera 2700 for image capturing, preferably capable of providing a higher image quality than smartphone 2601 that can also be operatively connected to network 3300, for example via a network interface device 2760. Camera 2700 can be a machine vision inspection camera with appropriate optics and illumination for capturing sufficient detail of block structure 1701 of part of a surface 1700, and connected to a frame grabber or other fast data-transfer interface such as but not limited to FireWire, Universal Serial Bus (USB), Ethernet, or a wireless interface, to a computing device having a data-communication interface, for example a network interface 2760 for network 3300. Network interface device 2760 could itself be a computer such as a PC or a Macintosh computer that is operatively connected to network 3300 and to camera 2700. As an example, camera 2700 can be equipped with an application-specific optics or lenses 2750 for capturing an image 3350 of block structure 1701 of part of surface 1700, for example a macro lens, microscope lens, or other lens. Preferably, camera 2700 and optics 2750 are such that they that allow capturing an image of substantially better and more adapted image quality than camera of smartphone 2601 alone. In addition or alternatively to camera 2700, it is possible that smartphone 2601 is equipped with an additional optics 2650 that allows improving and/or adapting the image capture of block structure 1701 of part of a surface 1700, for example a specific macro lens that can be clipped, slid on, or otherwise operatively attached to smartphone 2601. Furthermore, such optics 2650 may also be used to de-warp or flatten the acquired image according to specific surface forms such as cylinders or other, well defined geometries of objects.
With respect to a specific example and application, it would be possible to mark a pharmaceutical or drug product with the non-perceptible codes or identifiers 3351 within block structure 1701, and these codes or identifiers could be used by a user or patient to see if the pharmaceutical product received matches with his electronic prescription and/or his user profile. For example, it would be possible that code or identifier 3351 is provided with block structure 1701 that is part of a blister packaging 2900 of, e.g., pharmaceutical, reduced-risk smoking, or any other blister-packed products 2902, it would be possible to link identifier 3351 to an electronic prescription or e-prescription, e-Rx for the pharmaceutical product that has been prescribed to a user. In addition, server 3310 could have access or pre-stores a profile of the user, for example via a secured access to an external application 3370, including but not limited to gender, date of birth, age, weight, pre-existing health conditions, size, body-mass-index, medication history, allergies. For example, a blister packaging for a pharmaceutical product could be sealed and covered by a lidding material that is made of metalized film or metallic film, or a laminate, as shown in
For example, a part of a surface 1700 is shown having a surface with block structure 1701 provided thereon, for example a structured surface or an embossed material, having the base features and the modulated features. For example, part of a surface 1700 could be a component for a jewelry or watch product having an etched, engraved or embossed surface for block structure 1701, an embossed packaging material, for example a lining or other packaging foil for tobacco products, packing material for food products such as chocolate or other foodstuff and perishable goods, a capsule or cartridge for an e-cigarette, a packing material for a parcel that is used for local or global shipment with a hidden code provided by block structure 1701. But part of a surface 1700 is not limited to these examples. As an example, block structure 1701 can be checkerboard pattern, for instance an n×n matrix (not shown) having the checkerboard map of base features, in other words alternating embossed bumps and sinks as the base features, but also having some of the individual checkerboard elements offset from a center position as the modulated features, for example with an xy-offset from a center position of each square-shaped element of the grid formed by the matrix to the left upper corner, left lower corner, right upper corner, and right lower corner, thereby allowing to encode information. For example the offsets are in the micrometer or sub-millimeter range, e.g., a range between 5 μm to 250 μm, and are therefore not visible to a human eye without additional optical aid, but the checkerboard pattern can be part of an aesthetic or decorative embossing, and therefore visible by a human eye as a shading or a surface texture, for example a surface structuration or part of a logo.
Next, at the server 3310, application software APP2 can be further configured to perform a step S65 upon receiving identifier or code 3351, and after querying the database or table T. This step S65 can be triggered if information from the database or table T indicates that the product or part of a surface 1700 with block structure 1701 is prone to unauthorized copying or counterfeiting. This could be the case if part of a surface 1700 is a cigarette package that is counterfeited often for gray or black markets. For example, a data entry of table T could be linked to identifier or code 3351, to indicate that the part of a surface 1700 under inspection or investigation is likely to be a counterfeited or copied product. This data entry could be examined by APP2 to trigger step S65 that sends a request back to smartphone 2601 and APP1 to capture another image from block structure 1701, but with a higher image quality, with the goal to perform a deep or forensic examination of block structure 1701. For example, this request could include, but is not limited to, the instruction for capturing a higher-resolution (HR) image, request the capturing of an image with a higher contrast or high dynamic range (HDR), the request to change the illumination to a different or stronger illumination.
Upon receiving the request at the smartphone 2601 with APP1, the GUI could prompt or otherwise inform the user of this request, for example with a GUI window informing the user with instructions to capture an image of better quality. Step S70 can then be performed where image date of an image of increased quality is captured by user, for example by the use of a separate camera 2700, or by the use of additional optics 2650 that are clipped onto smart phone 2601. Thereafter, improved image data can be sent back to server 3310 for further analysis by APP2, for example with a step S60, for deep or forensic authentication of the image data of block structure 1701. The involved image-processing algorithms of S80 may include highly complex and advanced methods, which are not real-time applications anymore due to their level of complexity. Therefore, in intermediate steps, responses 3352 may include message to the user to be patient and wait for the result.
Another step of the method is step S25, where a request for database querying and a step of sending the request to server 3310 is done by APP1 of smartphone 2601, for example via the graphical user interface by the user or automatically by the preset mode of the application, e.g., depending on the user function and depending on access rights. In this respect, the capturing of the image data 3350 with step S10 and the sending of the identifier is done separately and only upon making a request by steps S25 and S35, server 3310 will return database information, with linked data 3322 back to smartphone 2601.
Next, the filtered or calibrated image can be subjected to a grid extraction or segmentation algorithm with step S20.2. In this step, the filtered or calibrated image is subject to a data-processing step that can overlay a grid over the filtered image, which will serve as a reference coordinate system for further data processing on the image. Furthermore, the extracted grid will provide the basis for determining the feature positions on a map, which will be used in later steps S20.3, S20.4, etc. Typical grid-extraction algorithms contain Fast Fourier Transforms (FFTs) on the global scale as well as adaptive search and correlation algorithms on the local scale. The map provided in this step can be based on different types of coordinate basis.
Thereafter, the segmented image that results from step S20.2 can be subject to a (code-block) synchronization step in a step S20.3, in which the code-block synchronization pattern, marker, target, object point is identified, detected and located, so that a reference for detecting the code or identifier 3351 in the code-block structure is possible. This can be done by pattern matching or feature-detection algorithms of different kinds, for example by correlation techniques, machine learning, optical character-recognition (OCR) techniques, supervised or non-supervised training.
Next, a step S20.4 is performed where the different symbols that represent the modulated features of block structures 1701 are detected and extracted, in reference to a position or location of the code-block synchronization pattern. This can be done by matching edges, corners, interest points, blobs, region of interests with a reference-image data set of modulated features of block structures 1701. It is also possible that this step include a step of feature extraction. Moreover, it is also possible that this step S20.4 includes the use of artificial intelligence, for example, a convolutional neural network and deep learning of model data sets for detecting the features, being the modulated features of block structures 1701. This can be done by having a dataset of labelled images with all the different modulated features of the block structures 1701. It is to be noted that the output of this feature-detection step is soft information, i.e., non-binary information or probability information, in most of the cases, in order to benefit from additional coding gain in the subsequent decoding step S20.6.
Thereafter a step S20.5 is performed, where the descrambling of the information contained in the code-block structure is done according to the arrangement of the modulated features in the ordered map. This step will bring the extracted (soft-) symbol information into the linear order required by the subsequent decoding step S20.6.
Thereafter, a step S20.6 is performed where the identifier or code 3351 is decoded from the different detected (soft-) symbols. Since redundant information was added during the encoding step, the decoding is done using standard algorithms for forward error-correcting (FEC) codes and will use the linearly arranged soft-symbol information as its input together with the knowledge of the exact structure of the code. Typical FEC codes that are known for high-performance error-correction properties include, but are not limited to, Turbo codes or Polar codes, etc. In particular, Polar codes are well suited for the task at hand as they are easily constructed and benefit from suitable hardware implementations as is seen in the latest 5G data-communication standards.
According to yet another aspect, it is possible that the captured image is linked or otherwise associated with a unique and secret code or identifier, for example by using the subscriber identification module (SIM) of the smartphone 2601 for generating a code, or by using an cryptographic algorithm that can extract a code or otherwise protected information from the captured image 3350, so that the image can be authenticated at a later stage as being the originally captured image. This unique code or identifier can be sent from APP1 to APP2 with step S30 together with identifier 3350, and thereby APP2 will have authentication information for the captured image 3350, without initially having access to the captured image data 3350 itself at APP2. For example, to generate the secret code, a hash or checksum code could be generated from image data, and also be based on a time of capture and location data of capture as is usually found in the EXIF data of the image, together with another unique code that can be generated by the SIM card or any other type of token able to produce such a unique, secure information element. Once image data 3350 is sent to APP2 of the second data-processing device, it would make it possible to authenticate the received image of step S65, S70, so that the later received image for deep or forensic authentication could also be authenticated as being the image 3350 at APP2 from which the original code has been extracted. This allows the APP2 to verify whether the received image data 3350 is actually from the same image that was captured initially by step S10.
| Number | Date | Country | Kind |
|---|---|---|---|
| 20182078.4 | Jun 2020 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/IB2021/055543 | 6/23/2021 | WO |
