The present invention relates to a method, according to the preamble of claim 1, for determining the properties of a moving surface. These properties are topography, spectral reflective properties, scattering properties, colour, and polarization properties.
The invention also relates to an apparatus intended to apply the method.
According to the prior art, a topographical map of a surface can be measured using a camera technique, for instance, using a stereo method, with the aid of structural light, and using various phase-shift techniques. In these methods, several images are typically taken of the same surface, in such a way that the manner of illumination the surface is different in each image. When the manner of illumination is selected in a specific way, these images taken in different ways can be used as a basis to calculate the topography of the surface, as well as to compensate for the effect of some other factors, for example, the texture or colour of the surface, on the result of the calculation. In terms of the methods, it is essential that the same points on the surface can be identified from the images taken of the surface under different kinds of illumination. This is simplest when the surface does not move, so that images illuminated in different ways can be taken temporally consecutively. Similarly, the scattering properties of the surface, for example, can be measured by taking several images of the surface, in each of which images the lighting geometry is different, and by comparing these images with each other.
When the surface is moving, it is more difficult to exploit these methods. The same point on the surface cannot be imaged twice in exactly the same geometry with the measuring geometry remaining constant. One solution is to take several images of the surface simultaneously using different colours. This technique is disclosed in, for instance, EP patent EP97114590: Method and apparatus for automatic inspection of moving surfaces. The problem with colour imaging is that the colours of the surface can distort topographic and scattering property measurements based on colour measurement. If it is wished to make the apparatus as reliable as possible, mechanical components, such as camera shutters etc., should be avoided.
The invention is intended to eliminate the defects of the prior art described above and for this purpose create an entirely new type of method and apparatus for determining the topography and optical properties of a moving surface.
The invention is based on taking at least two images, at different moments in time, of both the moving subject and of a reference area located in its immediate vicinity, in such a way that, in both of the images taken of the subject, the subject is illuminated in different ways, for example, by illuminating the subject through patterned masks, such as a sine-patterned mask, and illuminating the reference area in the images taken of the reference area in the vicinity of the subject through an unpatterned mask. The images of the reference areas illuminated through an unpatterned mask are used to locate the position in the image-formation area of the images of the areas illuminated through the patterned masks, typically using a photocell, relative to the other images. According to the invention, at least two images of the subject are taken in the image-formation area at different moments in time, in such a way that in each image the subject is illuminated in mutually differing ways, for example, through masks, or parts of a mask, of different types, images being taken of the reference area near to the subject, to the image-formation area, at a moment in time synchronized with the images of the subject, in such a way that the reference area is illuminated in these images mutually in essentially the same way, for example, through masks of the same type, and the images thus formed of the reference area are used to locate the corresponding pixels of the images taken of the subject.
More specifically, the method according to the invention is characterized by what is stated in the characterizing portion of claim 1.
The apparatus according to the invention, for its part, is characterized by what is stated in the characterizing portion of claim 9.
Considerable advantages are gained with the aid of the invention.
With the aid of the invention, an image of the reference area, illuminated through an unpatterned mask, can be used to locate the position in the image-formation area of an image of the area illuminated through a patterned mask, so that the pixels corresponding to the imaging subject illuminated through the mask at different imagining moments can be defined.
With the aid of this new invention, a new type of camera-based method can be created, which permits the precise topography of a surface to be measured from a very rapidly moving subject, without the texture or colour of the surface affecting the measurement result.
The invention can also be applied to the measurement of the colour, spectroscopic properties, glossiness, scattering properties, or polarization properties of a surface. These properties can be measured using the same measuring system as the topography of the surface.
The invention can be used for measuring the topography of, for instance, a paper or metal surface. Preferred embodiments of the invention can also be used to determine, for example, the height of a printed impression, or the height of a conductor on an electronic circuit board, on a rapidly moving production line.
By means of the new type of method according to the invention, it is possible to implement the accurate measurement of the topography of a surface from a rapidly moving subject. The advantages of the invention are thus:
The method can also be used to implement the measurement of, for instance, the colour, wavelength spectrum, or polarization properties of a moving surface.
In the following, the invention is examined with the aid of examples and with reference to the accompanying drawings.
a and 7b show a manner of calculating topography (Z co-ordinate) according to the invention, when there are 120-degree and 240-degree phase shifts, relative to the surface X, between three sine patterns projected on top of the surface.
The terminology used in the following description is used in association with reference numbers as follows:
In addition, the following basic definitions are used in connection with the invention:
According to
With the aid of images D, E, and F, the corresponding pixels of area Y in each image are determined, for example, using image correlation. The term corresponding pixel refers to the image pixel corresponding to the same location in different images. With the aid of these corresponding pixels it is also possible to also define the corresponding pixels of images A, B, and C of area X, because the position of subject X relative to the reference area Y does not change in the different images. Image Y can be used to seek corresponding pixels, because the images D, E, and F taken of it are taken using the same illumination, so that the features of the surface appear the same in each image. Corresponding pixels are not necessarily found with the same accuracy in the images A, B, and C, because in each image a different sine-pattern illumination is implemented with the aid of transparencies, and covers the features of the surface differently in each image.
In this way, an image, illuminated in three different ways, of the moving subject X is obtained with the aid of the image area Y. In an ideal case, if the speed of the subject is known sufficiently accurately, the three exposure moments can be synchronized in such a way that the sine patterns of the three different images are on the surface X in a specific desired phase shift. In that case, the topography of the surface can be calculated with the aid of these three images.
If the precise mutual phase shifts of the sine patterns of the images cannot be determined, for example, by timing technique, the mutual value of the phase shifts can also be determined computationally, when the corresponding pixels of the surface in the different images are known and when the illumination patterns are assumed to consist of same-phase sine patterns. Methods for this mathematical problem have been developed, for instance, Z. Wang: Advanced iterative algorithm for phase extraction of randomly phase-shifted interferograms, Optics letters, Jul. 15, 2004, Vol. 29, No. 14.
The topographic map can then be defined computationally with the aid of the mean phase-shift angles determined using the aforementioned method. The height difference of the area of the surface corresponding to the individual image pixels relative to the surrounding area then appears as a change in the phase of the sine pattern relative to the phase of the sine pattern of the environment.
When the line moves, it can be assumed that the surface 18 can also move in the vertical direction (Z direction) between an unknown number of moments in time t1, t2, and t3. This causes the same effect, as if the mean phase shift of the illumination would have changed between the moments in time. This phase shift cannot necessarily be determined precisely only from an image of the area illuminated through an unpatterned mask, if this small vertical movement does not cause changes in this image. By using the mathematical method disclosed by Z. Wang, in this case too the mean phase shift of the sine patterns can be determined and a topographic map of the surface can be calculated.
a and 7b shows a method of calculating the topography (Z co-ordinate), according to the invention, when there are phase shifts, between the three sine patterns, of 120 degrees and 240 degrees relative to the surface X. In the following, the calculation of the height data from three camera images is described with the aid of the markings of
The equations
a=GP sin(α)+K+Z
b=GP sin(α+2π/3)+K+Z
c=GP sin(α+4π/3)+K+Z
are obtained.
In these:
The phase angle α of the illumination pattern aimed at it can be solved for each image point of the surface from the equation group:
The height Δh of a point on the surface can be calculated from the phase angle α:
Δh=Δλ/tan β
in which
β=the angle of the direction of the illumination
λ=the interval length of the sine pattern
Δλ=αλ/(2π)
α=the phase angle of the illumination pattern
Pilot tests of the method according to the invention have been made in a laboratory. In the tests, the area X was imaged three times to form a separate camera image, in such a way that in each image the surface X was located in a different place relative to the image area seen by the camera and the sine-form illumination pattern. The corresponding pixels of the images were calculated using the correlation method, with the aid of the unpatterned area Y and the height map of area X calculated with the aid of the phase shift of the sine patterns.
Thus,
By means of the method according to the invention, it is also possible to implement a high-speed measurement of a stereo image, according to
Two light sources 19 and 20 are placed on different sides of the surface 18 being imaged and are used to illuminate, at the moments in time T1 and T2, the same area X of the surface, which is imaged using imaging optics, at the moments in time T1 and T2, in different parts of the image sensor. A third light source 21 illuminates the area Y at the same angle of illumination, at both moments in time T1 and T2. This allows the same area X to be imaged twice in different types of illumination, in such a way that the corresponding pixels of the images can be defined in the same way, with the aid of the illuminated area Y.
After this, a topographic map of the surface can be defined using the images taken from two opposite directions, with the aid of the photometric stereo method. The advantages of the method are its simple construction and the independence of the measurement from the colour of the surface, because the illumination from two directions can be made using light of the same colour.
Thus, by means of the principle according to the invention, the same arrangement can be used to measure not only the topography of the surface, but also the colour of the surface. In that case, the area X is illuminated from the same direction, but with different colours. The area Y is illuminated at all six different moments in time using the same illumination geometry and the same colour of light, so that it can be used to calculate the corresponding pixels.
By means of the method, it is possible to take two or three images, or even some other number of images. The images, illuminated in different ways, of the same subject 8 can be used, not only for measuring topography and colour, but also for other spectroscopic measurement as well as for measurement of glossiness and scattering and polarization properties of a surface, for instance. When measuring polarization properties, the images taken at different times of the area X are illuminated in different ways using polarized light. When measuring scattering properties, the images taken at different times of the area X are illuminated using light of the same colour and polarized in the same way, but from different directions. In the method, the reference area Y, illuminated in the same way, is used to synchronize these images illuminated in different ways.
The image-formation area 10 is typically a cell of one camera, but within the scope of the invention, the imaging area can also be formed of the cells of two or more cameras.
Number | Date | Country | Kind |
---|---|---|---|
20075829 | Nov 2007 | FI | national |