The present disclosure relates to a method for integrating a synthetic hologram in a visible image. More specifically, the present disclosure relates to a method for integrating a synthetic coded-aperture hologram in a halftone image with a grayscale appearance.
In many fields, especially in the luxury goods industry (for example, perfumery, jewelry or leather goods), or in the field of drugs, fighting against the imitation of branded products is an everyday concern. Many methods and devices are currently used to attempt to guarantee the authenticity of branded products.
Among such techniques, it has been provided to place, on the products to be identified, transparent chips having holograms formed thereon. Such holograms are obtained from a visible image, which can be rediscovered on reading of the hologram. The presence of the hologram is difficult to detect with the naked eye and its direct reading with no adapted reading device does not enable to identify the visible source image of the hologram.
In
Hologram 18 is formed of many pixels with a shape defined by the corresponding pixels of the images obtained by the calculation of Fourier transform 12. Hologram 18 thus has a resolution identical to that of initial image 10.
The size of dark area 24 in each pixel depends on the result of the calculation of amplitude image 14 of Fourier transform 12 of source image IMAGE_H for the pixel of same coordinates. Areas 24 of various sizes are thus provided in the hologram.
Further, the off-centering of each area 24 in the pixel along axis x depends on the value of the pixel of same coordinates of phase image 16 (φH).
It should be noted that different coded-aperture hologram definition methods are known. For example, the shape of areas 24 in pixels 22 may differ from the elliptic shape provided herein. It has in particular been provided to form rectangular areas 24, of variable size according to amplitude image 14, and more or less off-centered in the pixel according to phase image 16 (along axis x).
The beam reflected by the hologram crosses back beam splitter cube 32 and is then combined by a lens 38 having the function of applying an inverse Fourier transform to the received beams to display an image on a display device (not shown) placed at the focal point of the lens.
It should be noted that if a phase-key encryption of the hologram is provided on forming of the hologram, a wave plate similar to the phase key should be placed in the read device of
Techniques for integrating holograms in an image have been provided. Joseph Rosen and Bahram Javidi's publication entitled “Hidden images in halftone pictures”, Appl. Opt. 40, No. 20, 3346-3353, discloses such a technique.
It should be noted that half toning techniques are generally carried out with a sufficiently high resolution for the halftone not to appear to the naked eye.
Image 42 of
A reading of the image of
Disadvantages of the above-mentioned technique appear in
This integration thus negatively affects the reading of the coded hologram. Further, the above technique implies a poor grayscale contrast and significant phase coding constraints.
An embodiment provides a method overcoming all or part of the disadvantages of prior art techniques of integration of holograms in images.
More specifically, an embodiment provides a method enabling to integrate a hologram in a grayscale image with a good quality for the direct reading thereof.
Thus, an embodiment provides a method for integrating a synthetic hologram in a directly observable image of a scene, comprising the steps of: defining a first image of the scene, comprising grayscale pixels; forming first and second matrixes based on the first image, the first matrix comprising pixels of a first and of a second shade according to whether the corresponding pixel of the first image has a gray level greater than or smaller than a threshold, each element of the second matrix comprising a value equal to the gray level difference between the corresponding pixel of the first image and the corresponding pixel of the first matrix; forming a third pixel matrix by calculating the phase image of the Fourier transform of an image originating from a second source image of the hologram; forming a fourth pixel matrix, each pixel of the fourth matrix comprising a central area having its surface area determined based on the corresponding element of the second matrix and off-centered in the pixel according to the corresponding pixel of the third matrix; and performing a lithography of an opaque layer at the surface of a plate according to the pattern defined by the fourth pixel matrix, the lithography being provided to remove, from a pixel, the opaque layer inside of the central area if the equivalent pixel of the first matrix is of the first shade and to remove the opaque layer outside of the central area if the equivalent pixel of the first matrix is of the second shade.
According to an embodiment, the size of the central area of each of the pixels of the fourth matrix is calculated from the value of the corresponding pixel of a fifth pixel matrix, each pixel of the fifth matrix being obtained by calculation of the diffracted amplitude of an aperture defined in a pixel, the ratio of the aperture surface area to the pixel surface area being equal to the value of the corresponding element of the second matrix.
According to an embodiment, amplitude Ahnm of a pixel of the fifth matrix (IMAGE_GA) depends on value Inm of the corresponding element of the second matrix according to the following relation:
J1 being the first Bessel function.
According to an embodiment, the third matrix is obtained by carrying out the steps of: (a) calculating a sixth amplitude matrix obtained from the second source image of the hologram by carrying out the same steps as those enabling to obtain the fifth matrix from the second matrix; (b) combining the pixels of the sixth amplitude matrix with a random phase distribution or with a continuous component to obtain a complex value; and (c) calculating the phase image of the Fourier transform of the complex value.
According to an embodiment, the third matrix is obtained by an optimization method taking advantage of the fifth matrix.
According to an embodiment, the optimization method comprises the steps of: (a) calculating a sixth amplitude matrix obtained from the second source image of the hologram by carrying out the same steps as those enabling to obtain the fifth matrix from the second matrix; (b) combining the pixels of the sixth amplitude matrix with a random phase distribution or with a continuous component to obtain a first complex value; (c) calculating the Fourier transform of the first complex value; (d) combining the pixels of the fifth pixel matrix with the pixels of the phase image resulting from the Fourier transform of step (c) to obtain a second complex value; (e) calculating the inverse Fourier transform of the second complex value; (f) combining the pixels of the sixth amplitude matrix with the pixels of the phase image resulting from the calculation of step (e) to obtain a new first complex value; (g) repeating step (c) to calculate the Fourier transform of the new first complex value, the third matrix corresponding to the obtained phase image of this last Fourier transform.
According to an embodiment, the optimization method further comprises the repeating of steps (d) to (g), the third matrix corresponding to the phase image obtained at step (g) after several cycles of repeating of steps (d) to (g).
According to an embodiment, at least three cycles are carried out.
According to an embodiment, the off-centering of the central area in each pixel of the fourth matrix is directly proportional to the value of the corresponding pixel of the third matrix.
According to an embodiment, the gray level threshold is equal to 0.5, to within 10%, on a normalized grayscale.
According to an embodiment, the central area of each pixel of the fourth matrix is elliptic.
According to an embodiment, the aspect ratio of the elliptic central region of each pixel of the fourth matrix is equal to π/2.
According to an embodiment, the first shade of the first matrix is a minimum shade, the second shade of the first matrix is a maximum shade, the lithography being provided to remove the opaque layer inside of the central area of a pixel if the equivalent pixel of the first matrix has the first shade and to remove the opaque layer outside of the central area of a pixel if the equivalent pixel of the first matrix has the second shade.
According to an embodiment, a minimum size of the central area of the pixels of the fourth matrix is imposed.
According to an embodiment, the minimum size of the central area of the pixels of the fourth matrix corresponds to a gray level of 0.02 for dark pixel hues and of 0.98 for light pixel hues, on a normalized grayscale.
The foregoing and other features and benefits will be discussed in detail in the following non-limiting description of specific embodiments in connection with the accompanying drawings.
For clarity, the same elements have been designated with the same reference numerals in the different drawings.
These three drawings show, in three dimensions, a portion of a transparent wafer 50 having its surface defining a pixel of a synthetic coded-aperture hologram. The shown pixel has a width “a”.
In the example of
In the example shown in
The elliptic shape provided herein has the advantage of being relatively smooth for the eye when used to form pixels of an image obtained by half toning of a grayscale image. In particular, this shape is much more pleasant to the eye than the rectangular shapes of
The pixel of
According to Babinet's principle of complementary screens, the pixel of
Initial steps 60 and 62 of the method comprise selecting, on the one hand, a real grayscale image of a scene, IMAGE_G, which is desired to be seen with the naked eye once the hologram has been integrated in the image, and on the order hand, a source image of the hologram, IMAGE_H, which is desired to be integrated in the form of a synthetic coded-aperture hologram in a final visible image (IMAGE_F).
Based on grayscale image 60 (IMAGE_G), a first black-and-white image matrix (IMAGE_GB&W) 64 is determined, this image comprising pixels of a first shade, for example, black, at the level of the pixels of image 60 having a gray level smaller than a threshold α (dark pixels) and pixels of a second shade, for example, white, for the pixels of image 60 having a gray level higher than threshold α (light pixels). It should be noted that the reverse is also possible, the idea being to distinguish the pixels of image 60 having a gray level lower or higher than threshold α.
Starting from image 60, processing and calculation means are used to determine a matrix IMAGE_G′, 66, having a size identical to the resolution of image 60, IMAGE_G, where each element of the matrix contains a value proportional to the difference between the gray level of the corresponding pixel of image 60 and the gray level of the corresponding pixel of image 64 (IMAGE_GB&W). The link between images 60 and 64 and matrix 66 will be described in further detail hereafter in relation with
In practice, the detection threshold of matrix 66 is the same threshold as detection threshold α of image 64. It is preferably selected at a midscale gray level of image 60, for example, at 0.5 to within 10%, and is preferably equal to 0.5, on a normalized grayscale.
A next step 68 comprises obtaining, from matrix 66 (IMAGE_G′), an image matrix IMAGE_GA 68 of the amplitude of the holographic raster. The determination of the pixels of image 68 will be described in further detail hereinafter, in relation with
In parallel, a step 70 comprises calculating the Fourier transform of an image originating from the source image of the hologram, 62 (IMAGE_H). More specifically, the Fourier transform of an amplitude image, IMAGE_HA, obtained from source image IMAGE_H, is calculated in a way similar to that in which image 68, IMAGE_GA, has been calculated from image 66, IMAGE_G′, as will be described in further detail hereinafter. The Fourier transform calculated at step 70 provides an amplitude image AH and a phase image 72 (φH). Amplitude image AH is not used.
To improve the quality of the hologram, a random phase distribution may be added to amplitude image IMAGE_HA before the Fourier transform calculation. This phase scrambling method is known by those skilled in the art.
A step 74, implemented by calculation and processing means, comprises combining phase image φH resulting from Fourier transform 70, black-and-white image 64 (IMAGE_GB&W) and amplitude image 68 (IMAGE_GA) to obtain a final image 76 (IMAGE_F) having an appearance identical to the appearance of image 60 (IMAGE_G) and which integrates a hologram obtained from the source image of hologram 62 (IMAGE_H).
To achieve this, each pixel of final image 76 comprises a central area surrounded with a background, defined as follows:
Once final image IMAGE_F has been obtained, a lithography of an opaque layer defined at the surface of a plate according to the pattern of this image is performed.
In this curve, it can be seen that for a pixel of image IMAGE_G having a gray level G ranging between 0 and 0.5 (black pixel to medium-grey pixel), the value of G′ of an element of matrix 66 increases up to a value β.
If gray level G of a pixel of the grayscale image, IMAGE_G, ranges between 0.5 and 1 (medium-gray pixel to white pixel), the value of the equivalent element of matrix IMAGE_G′ decreases between threshold β and a zero value when the pixel is very light.
To provide an optimal coding of the holograms, a minimum threshold of the value of the elements of matrix IMAGE_G′ may be provided for totally black or totally white pixels of image IMAGE_G 60 (respectively G=0 or G=1). This enables to optimize the appearance of the final reading of the hologram, as will be seen hereafter. The minimum threshold will typically be 2% of the maximum or minimum gray levels (the minimum size of the central area of the pixels corresponding to a gray level of 0.02 for dark pixel shades and of 0.98 for light pixel shades, on a normalized grayscale).
Matrix 66 (IMAGE_G′) is used to obtain an amplitude image IMAGE_GA (68) of the wave associated with the hologram, which is used to determine the size of the central areas of the pixels of the final image (IMAGE_F).
It should be noted that, with an elliptic shape of the central area, the ellipse shape may be optimized so that the ellipse has a maximum size, in direction y, equal to the pixel side with a pixel filling rate equal to 50%. Simple geometric calculations provide the fact that an ellipse having a ratio of its large side to its small side equal to π/2 enables to obtain a pixel filling rate equal to 50% for one dimension of the ellipse, along direction y, equal to the pixel width. This ratio further provides a very smooth visual appearance.
The obtaining of amplitude image 68 requires considering the equations of diffraction of a planar wave through an aperture.
When a planar wave is incident on the aperture of
J1 being the first Bessel function. It should be noted that for an optimal coding of the phase, an elliptic shape of the aperture such that wy>wx is considered.
In a grayscale image, the surface of the dark central portion of a pixel normalized with respect to the pixel surface sets the hue perceived by the observer. Hue Inm depends on the pixel shape by relation:
To obtain the amplitude image of initial image 60 (IMAGE_G), equation (1) is directly applied to apertures having their surface area defined so that ratio Inm of the aperture surface area to the pixel surface area corresponds to the value of the corresponding element of matrix 66 (IMAGE_G′). To provide a good definition of amplitude image IMAGE_GA 68, threshold β may be set to 0.5 (the surface area of the aperture corresponding to half the pixel surface area). A relation enabling to calculate the dimensions of the central areas of the pixels of image IMAGE_F is thus obtained.
In practice, an aspect ratio of the aperture ρ=wy/wx is defined and wy is limited to a maximum value equal to 1 (normalized pixel side). The two above equations provide a relation between the value of the corresponding element Inm of matrix IMAGE_G′ and the amplitude of the wave diffracted by this pixel (Ahnm), according to ρ, which is as follows:
The above equation thus enables to link the elements of matrix IMAGE_G′, and thus the gray level of the corresponding pixel of initial image IMAGE_G, to the amplitude of the pixel of same coordinates of image IMAGE_GA, that is, to the size of the central area of the pixels of final image IMAGE_F.
Beyond this value, the pattern goes over the cell limits and the quality of the phase coding decreases. In the case of the above method, intensity Inm is limited to threshold α predefined by the curve of
It should be noted that, to simplify the programming of this transfer function, the Bessel function may be replaced with its series expansion with a good accuracy, which provides the following equation:
Thus, the pixels of the final image obtained by the method of
The method of
It should be noted that amplitude image IMAGE_HA having its Fourier transform calculated at step 70 of
The method for optimizing the phase image imposed to the final image provided herein is an iterative optimization method described in Gerchberg and Saxton's publication entitled “A pratical algorithm for the determination of the phase from image and diffraction plane pictures”, Optik, Vol. 35, 237-246.
Starting from the source image of the hologram, IMAGE_H (62), the amplitude image of this image, IMAGE_HA (80), is determined in a way similar to that in which the amplitude of holographic raster IMAGE_GA resulting from matrix IMAGE_G′ (66) has been determined.
At a next step 82, amplitude image IMAGE_HA 80 is combined with an initialization phase component φI 83 resulting either from a random phase distribution of phase scrambling type, or from a continuous phase component, to obtain a complex value (process initialization). The Fourier transform of the complex image obtained at step 82 is then calculated at a step 84.
Amplitude image A obtained by the Fourier transform of step 84 is left aside (just as amplitude image AH in
At a step 88, the inverse Fourier transform of the complex value obtained at step 86 is calculated. Amplitude image A of the obtained result is left aside. Phase image φ obtained by this inverse Fourier transform is introduced at the input of step 82 instead of the initialization phase distribution of process φI, in combination with amplitude image IMAGE_HA. Step 84 of calculation of the Fourier transform of the complex value obtained at step 82 is repeated to obtain an optimized phase image φH (step 90), due to the taking into account of image 68, IMAGE_GA. Cycle of steps 82 to 88 may be repeated several times to optimize the phase image φH obtained at step 90.
The phase image obtained at step 90 may be used directly in the method of
Carrying out the above cycle of improvement of phase image φH enables to improve the reading of the hologram integrated in the halftone image. It should be noted that the above cycle may be repeated as often as necessary so that the final phase image φH of step 90 comprises an efficient corrective of the loss of information due to the lack of use of the amplitude image of the Fourier transform of the source image of the hologram.
After a number of iterations, which number may vary as will be seen hereafter, an optimized phase image φH which is used in the method of
More specifically,
In these drawings, it should be noted that the performing of the optimization method of
Indeed, the reading performed from an image obtained by the method of
In the context of the above method, the quality of the grayscale image visualization is a desired advantage.
To simulate this blurred effect, it has been tried to artificially blur the image with a Gaussian blurring of a width of 2 and of 4 pixels.
As previously discussed, the position of the halftone patterns is defined by the value of the phase assigned to the pixel. If two successive pixels have significantly different phase values, the distance between patterns will also be significant. According to whether the halftone background is light or dark, this difference will translate as the appearing of a white or black dot.
This phenomenon is disturbing if the detection of the reconstructed image must be strictly identical to the original. Such is generally the case in data preservation.
This effect can however be decreased. To achieve this, the following methods can be mentioned:
The result of this last proposition is illustrated in
Many applications of the above method can be envisaged.
A first application relates to the analog storing of images. The provided solution allows a perennial preservation of graphic data due to a visual saving mode. The data recovery is performed with no digital decoding and does not risk the obsolescence of the read format.
This solution has the disadvantage of having a relatively long data recovery mode; a solution would thus be to keep the durability of the analog storage while using the rapidity of digital data recovery.
Take the example of an image of 1,000×1,000 pixels, coded over 256 gray levels (1 byte). Its digital weight, at the uncompressed bitmap format, is approximately 103 ko.
The idea is to code a digital version of the source image of the hologram IMAGE_H. To make the detection easier, a binary representation of the source image of the hologram IMAGE_H is selected, assuming that only 50% of the hologram surface area is exploitable. This restriction is due to the difficulty of obtaining non-noisy images in coherent optics. This results in a bit storage capacity corresponding to 50% of the number of pixels. A digital capacity of approximately 62 ko is obtained. This decrease of the file size may be obtained by storing a compressed image of original image IMAGE_G, for example in jpeg format.
The user can thus have the choice between a fast digital detection of digital images in a compressed format and a slow analog detection of source files in the native format.
It should be noted that the detection of the image in compressed format may also be used to improve the quality of the reconstructed source image, by especially helping to correct the granularity effect.
In the same field of application, a variation may also be provided to increase the surface area capacity of the analog storage medium.
In addition to the analog data, the storage medium must be able to preserve the metadata associated with visual documents. Such data are contained in the digital file background and may concern all forms of information (file name, creation date, file format, comments, etc.). Such information may be visualized in binary format (character sequence) and may accept some quality loss (form is second to content). This type of data thus effectively applies to synthetic holography storage.
Redigitizing the analog data being a long process, the halftone representation of image IMAGE_G must be imaged on an array sensor to restore the original grayscale pixel matrix. This process is carried out by a succession of image shots which then have to be put together. If the image has few details, the putting together may be complicated.
A solution may be to arrange alignment holograms within the image, as shown in
Halftone representation 104 exhibits a series of holograms 106. Each hologram 106 forms in the focal plane of a Fourier lens 108 a light spot 110 at a specific coordinate. If the probe beam is at the exact crossing of four holograms, four different light spots 110 are detected in the read plane. The positioning on the optical axis of the plate having the holograms formed thereon can thus be controlled by the detection of these light spots. The system can scan the image by positioning itself at specific locations, for which the intensity of the four spots is balanced, independently from the visual content of the image.
Another application of the method provided herein, which is no longer within the context of analog storage, is the security of ID documents, and more generally of any type of documents. It can be envisaged to code in the ID photograph a hologram enabling to guarantee that the document is authentic.
Specific embodiments of the present invention have been described. Various alterations, modifications, and improvements will readily occur to those skilled in the art. In particular, other applications of the integration of a coded-aperture hologram in a halftone image having a grayscale appearance may be provided. Further, it should be noted that known hologram scrambling methods, implying the impossibility of a direct reading of the hologram, may be provided in combination with the method described herein. In this case, the use of a phase key or of a read mask may be provided on reading of the hologram, for example, with a read device such as that in
Various embodiments with different variations have been described hereabove. It should be noted that those skilled in the art may combine various elements of these various embodiments and variations without showing any inventive step.
Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the spirit and the scope of the present invention. Accordingly, the foregoing description is by way of example only and is not intended to be limiting. The present invention is limited only as defined in the following claims and the equivalents thereto.
Number | Date | Country | Kind |
---|---|---|---|
11 60915 | Nov 2011 | FR | national |
Number | Name | Date | Kind |
---|---|---|---|
8243353 | Gutin | Aug 2012 | B1 |
20030128862 | Decker | Jul 2003 | A1 |
20050093856 | Borgsmuller et al. | May 2005 | A1 |
20060034483 | Au | Feb 2006 | A1 |
20100018955 | Martinez | Jan 2010 | A1 |
Number | Date | Country |
---|---|---|
WO 2005010684 | Feb 2005 | WO |
Entry |
---|
Brown et al, Complex Spatial Filtering with Binary Masks, Applied Optics, vol. 5, No. 6, (Jun. 1966), pp. 967-969). |
Aoki, Watermarking Technique Using Computer-Generated Holograms, Electronics and Commun., Japan, Part 3, vol. 84, No. 1, 2001, pp. 21-31. |
Rosen, et al.: “Hidden Images in Halftone Pictures,” Applied Optics, vol. 40, No. 20, Jul. 10, 2001, pp. 3346-3353. |
French Search Report of French Patent Application No. 1160915. |
Number | Date | Country | |
---|---|---|---|
20130135702 A1 | May 2013 | US |