The present invention relates to an apparatus and a method for reducing transition artifacts in an overall image composed of sub-images whose image areas have overlap areas as occur, for example, when using several cameras for capturing an image area which is larger than the image area of an individual camera.
The technical field of application of the invention described here advantageously comprises processing X-ray image data, in particular in industrial quality control of products which is performed by means of X-radiation. An important case of application is the detection of shrink holes, porosities or other blemishes in castings such as aluminum wheels. Since the imaging area of the test pieces in this field of application is often very large, an individual test piece cannot be tested by means of individual image pickups. As is inherent to their functional principle, X-ray photographs additionally exhibit image noise, which results in that several individual photographs may be able to perform averaging of the individual photographs and to obtain a usable image.
To keep the test time as short as possible, several cameras or X-ray detectors are used for composing an overall image from several individual photographs. The individual photographs are subject to pre-processing, in particular X-ray photographs for quality control of products which is performed by means of X-radiation or computer tomography. The dimensions of the objects to be tested, i.e. of the test pieces, are becoming increasingly large so that increasingly large detector surface areas become extremely useful.
X-ray detectors exhibiting relatively large imaging surface areas are composed of individual sensors. A differentiation may be made between overlapping and disjoint sensors, overlapping sensors meaning that image areas of adjacent sensors overlap, whereas with disjoint sensors, the image areas of adjacent sensors do not intersect. Due to different sensitivities, different characteristic curves, which are caused by production tolerances, for example, the sensors of a detector exhibit different behaviors across the operating range with identical irradiation. If an overall image is composed of the individual images, gray-scale jumps, which are perceivable in the image as edges and interfere with image processing, result at the points of transition and/or overlap. This effect occurs even if the overall image was previously subjected to brightness correction.
Errors may occur in the evaluation of such an image which exhibits gray-scale jumps at the points of overlap of the individual images. Actual defects in the test piece, such as air bubbles, porosities or cracks, for example, also have gray-scale variations in the X-ray image, so that any automated evaluation of a composed overall image may possibly not distinguish between gray-scale jumps in overlap areas and actual blemishes.
DE 103 01 941 B4 describes a camera and a method for optical recording of a screen. In this context, the camera comprises a camera support with an array of camera mounts to which individual optical cameras are attached, as well as an image processing means for processing digital individual images of the array of individual optical cameras so as to generate an optical pickup of the screen in a predetermined overall resolution. In this context, the image processing means performs correction of the individual images with regard to alignment inaccuracies and/or parameter fluctuations, a correction resolution being used, for correction purposes, which is higher than the overall resolution, and a dedicated correction specification being used for correcting for each individual camera. Thus, a geometric correction of the individual images is conducted before they are combined into an overall image. The geometric correction comprises aligning the individual images both in a rotational and translational manner. Once the correction has been conducted, the corrected overall image is brought to the predetermined overall resolution by combining adjacent pixels. In this manner, utilization of favorable individual cameras enables efficient, low-cost and low-artifact imaging of a large-format screen. What is problematic in this context are the image processing times, since joining the individual images may take up a lot of time, it being possible for the process times to increase disproportionately as the number of individual images increases. What is problematic are the points of overlap of the individual images, since these may result in diagnostic errors in the testing in case of automated evaluation.
In practice, defective pixels frequently occur in sub-images. These defective pixels may be due to aging phenomena of the cameras or detectors, on the one hand, but may also be caused by hardware defects, on the other hand. Defective pixels frequently lead to artifacts in the sub-images or overall images. These artifacts make automated evaluation of the image data more difficult, since they are often interpreted as defects in or on a test piece.
According to an embodiment, an apparatus for reducing transition artifacts in an overall image composed of sub-images whose image areas include overlap areas may have: a storer for storing image data of the pixels of the sub-images; and a generator for generating the overall image on the basis of the image data of the sub-images by superposition of the image data of the pixels in the overlap areas in accordance with a weighting, each of the subareas in the overlap area including a weighting function associated with it, and the weighting functions of the sub-images being modified, in the event of a defective pixel in one of the sub-images, at the position of the defective pixel such that the defective pixel is faded out entirely and that only intact pixels of the other sub-images are used, so that any influence of an incorrectly detected pixel of a sub-image which would cause an artifact in the overall image is reduced in the overall image.
According to another embodiment, a method for reducing transition artifacts in an overall image composed of sub-images whose image areas include overlap areas may have the steps of: storing the image data of the pixels of the sub-images; and generating the overall image on the basis of the image data of the sub-images by superposition of the image data of the pixels in the overlap areas in accordance with a weighting, each of the subareas in the overlap area including a weighting function associated with it, and the weighting functions of the sub-images being modified, in the event of a defective pixel in one of the sub-images, at the position of the defective pixel such that the defective pixel is faded out entirely and that only intact pixels of the other sub-images are used, so that any influence of an incorrectly detected pixel of a sub-image which would cause an artifact in the overall image is reduced in the overall image.
Another embodiment may include a computer program having a program code for performing the method for reducing transition artifacts in an overall image composed of sub-images whose image areas include overlap areas, the method having the steps of: storing the image data of the pixels of the sub-images; and generating the overall image on the basis of the image data of the sub-images by superposition of the image data of the pixels in the overlap areas in accordance with a weighting, each of the subareas in the overlap area including a weighting function associated with it, and the weighting functions of the sub-images being modified, in the event of a defective pixel in one of the sub-images, at the position of the defective pixel such that the defective pixel is faded out entirely and that only intact pixels of the other sub-images are used, so that any influence of an incorrectly detected pixel of a sub-image which would cause an artifact in the overall image is reduced in the overall image, when the program code is executed on a computer.
The present invention provides an apparatus and a method for reducing transition artifacts in an overall image composed of sub-images whose image areas have overlap areas.
This object is achieved by an apparatus for reducing transition artifacts in an overall image composed of sub-images whose image areas have overlap areas. The apparatus comprises a means for storing image data of the pixels of the sub-images, and further includes a means for generating the overall image on the basis of the image data of the sub-images by superposition of the image data of the pixels in the overlap areas in accordance with a weighting, the weighting being configured such that any influence of a pixel of a sub-image which would cause an artifact in the overall image is reduced in the overall image.
The present invention further provides a method for reducing transition artifacts in an overall image composed of sub-images whose image areas have overlap areas. The inventive method comprises a step of storing the image data of the pixels of the sub-images, and further a step of generating the overall image on the basis of the image data of the sub-images by superposition of the image data of the pixels in the overlap areas in accordance with a weighting, the weighting being configured such that any influence of a pixel of a sub-image which would cause an artifact in the overall image is reduced in the overall image.
The present invention has the advantage that in accordance with embodiments of the present invention, for example in the merging of sub-images, by means of an area or line camera consisting of several sensors and having overlapping image areas, artifacts are reduced. For example, intensities of individual pixels are added up in a weighted manner while exploiting an overlap area so as to thereby achieve a smoothing or slower cross-fading of a potential gray-scale jump. In addition, embodiments of the present invention enable taking into account, by means of the weighting, defects in sub-images when combining the sub-images into an overall image. In embodiments, a defective pixel in a sub-image may be faded out by means of corresponding weighting, whereas a correct pixel from another sub-image may be faded in accordingly.
The weighting or weighting functions may take any forms, for example, they may comprise jumps or points of discontinuity for defective pixels. Since in embodiments, the sub-images may undergo, prior to the combination, geometric corrections such as rotations or displacements, for example, the overlap areas of the sub-images may take any form in the overall image, in particular when more than two sub-images overlap. In embodiments of the present invention, the weighting is adapted to the respective overlap areas, i.e. cross-fading may be realized while taking into account the shape of an overlap area.
Embodiments of the present invention considerably reduce the artifacts developing in the overlap areas, and therefore contribute to more reliable quality control of large-area test pieces. Since, consequently, a considerably reduced number of diagnostic errors occur in the quality control, production of such components may be performed more efficiently.
Embodiments of the present invention will be detailed subsequently referring to the appended drawings, in which:
a shows, by way of example, the overlap area of two sub-images;
b shows the curves of two exemplary weighting functions;
a shows, by way of example, three pixels, respectively, of two overlapping sub-images which are accurately aligned against one another;
b shows, by way of example, three pixels, respectively, of two sub-images which are not accurately aligned against one another; and
c shows four pixels, respectively, of two overlapping sub-images in order to generally illustrate the overlap;
a shows an embodiment of a non-rectangular overlap area; and
b shows a further embodiment of a non-rectangular overlap area.
Optionally, the apparatus 100 may further comprise a means 130 for storing the weighting. Also optionally, the apparatus 110 may additionally comprise a means for outputting 140 the overall image. The means for outputting 140 may be implemented, for example, by an output memory or a data output. The means for storing 130 is coupled to the means 120 for generating the overall image such that it may make data available to the weighting. In one embodiment of the present invention, the means 120 for generating the overall image is coupled, in turn, to the means 140 for outputting such that it may transmit the image data of the overall image.
The means 110 for storing image data may be implemented, for example, by a memory which is connected downstream from an array of cameras and stores the individual images. With regard to the inventive apparatus 100, the means 110 for storing image data acts as an input memory for the means 120 for generating the overall image, which may be implemented by an arithmetic unit, for example. Optionally, the means 120 for generating the overall image obtains the weighting from the means 130 for storing the weighting, which may, in turn, be realized as a memory which makes available coefficients for correcting the individual images. Accordingly, the means 130 for storing the weighting may be implemented as a correction memory. In principle, embodiments without the means 130 for storing and without the means 140 for outputting are also feasible. For example, a weighting could also be re-calculated or re-determined again and again by the means 120 for generating the overall image.
As is shown in
The sub-images of the individual camera modules should overlap so that the correction described herein may be performed. If, for example, M sub-images overlap, the data from the respective source images will be averaged in a weighted manner, in accordance with the following specification, in a transition area when the corresponding coordinate origin is selected for each sub-image:
wherein Wi(x,y) represents a weighting function, and pi(x,y) represents the value of the pixel in the sub-image i at the coordinates (x,y).
The value of a pixel pi(x,y) at the position (x,y) may comprise, for example, intensity information, so that the intensity of a pixel in the overall image in an overlap area is determined from a linear combination of the intensity information of the pixels of the sub-images. The weighting function Wi(x,y) in this context associates weighting factors with the individual pixels of the sub-images i, for example in dependence on the geometric position of a pixel and on the geometric position of the overlap area, in accordance with a linear specification, which in other embodiments may also be non-linear.
The weighting function may be linearly determined, for example, with an overlap of two sub-images in the horizontal direction with a width of N pixels. This embodiment is initially illustrated in
Two exemplary functions
W
1(x,y)=(x−x0)/N and
W
2(x,y)=(N−(x−x0))/N
are depicted in
In the embodiment shown in
a to 3c illustrate an offset between pixels in the overlap area, caused by previous geometric sub-image corrections, for example.
p
1=0.75·P1,1+0.25·P2,1,
wherein in this case, the weighting factors are selected randomly in order to illustrate the embodiment. For illustration purposes,
p
1=0.375·P1,1+0.375·P1,2+0.25·P2,1
would apply. In this manner, overlaps as also occur with the pixel grid of the overall image may be taken into account.
c also shows two overlapping subareas of two sub-images 301 and 302.
In accordance with
By suitably selecting the weighting functions in relation to the overlap areas, artifacts in the overall image may be greatly reduced. As was already mentioned above, the weighting function may optionally be stored, in a suitable form, in a correction memory.
The means 120 for generating the overall image, for example an arithmetic unit, generates the corrected overall-image data, or output-image data, in that the image data from the individual sub-images is multiplied by corresponding weighting factors and is subsequently added up, possibly in dependence on existing data in the correction memory.
Depending on the embodiment of the present invention, it may also occur that in a resulting image, that is in an overall image, pronounced gray-scale jumps are still recognizable following the weighted averaging, which will be possible, for example, when the overlap area of the sensors or cameras is not large enough. In such a case it is possible to fall back on an area of pixels in the individual sub-images, which area is larger than the overlap area. In such a case, a pixel of the overall image therefore is not dependent solely on the overlapping pixels of the individual sub-images, but also on pixels of the sub-images in an environment of the pixel of the overall image. Therefore, it is also possible in this context to define, in accordance with equation 2, a multi-dimensional filter function which multiplies a sufficiently large number of pixels, for example by additionally taking into account pixels located immediately before the overlap area, by a suitable weighting function so as to thereby realize a smoother transition from one sensor to another. It is feasible, in this context, that a pixel in the overall image only results in dependence on the pixels of a sub-image and their weighting factors, i.e. that said pixel is influenced only by those pixels of the sub-image which are located at the same geometric position as the pixel of the overall image.
In another embodiment, a filter function is employed in this context, too, which means that a pixel in the overall image depends on weighting factors and on those pixels of the sub-images which are located at the same geometric position as the pixel in the overall image, and on those dots in a geometric environment around the geometric position of the pixel of the overall image. The remaining input pixels are then transmitted to the overall image unchanged.
In a general case, in one embodiment of the present invention, a pixel in the overall image would depend on all pixels of the sub-images, the weighting function associating a weighting factor with each pixel in each sub-image.
For reasons of clarity, the following contemplations refer to overlap areas of only two sub-images. Generally, overlaps of any number of sub-images are feasible, it being possible for the overlap areas to take on any shape.
f
1(x)=e−(x−0,12)
and
f
2(x)=1−f1(x) (2)
might be possible.
In
During the detection of the individual sub-images, defective pixels may occur, in particular if the individual sub-images are X-ray images. This may be due to a hardware defect of the image sensor, on the one hand, but also to aging phenomena which may occur, for example, with cameras or X-ray detectors, on the other hand. For detecting such defects it is feasible, for example, that one may establish, by means of calibration images having known contents, those pixels of the sub-images which are imaged correctly, and/or those pixels of the sub-images which are defective. What might be feasible as calibration images are bright images, for example, wherein each pixel of a sub-image should appear to be white, and wherein such pixels which do not exceed a minimum of brightness may be classified as defective. A similar approach would be feasible, for example, if dark images are used, i.e. such images which are to cause only dark or black pixels, and wherein those pixels which exceed a certain degree of brightness are classified as defective.
In the following it shall be assumed that defective pixels are known.
The progressions of functions depicted in
Embodiments therefore offer the advantage that, for example, aging effects of X-ray detectors, which translate into increasing pixel defects, may be compensated for. Generally, any number of defective pixels in the overlap area may be compensated for by means of the weighting functions. In addition, embodiments offer the possibility of fading in any newly added sub-images by means of the weighting functions at a later point in time. In particular in quality control of castings by means of X-ray images it is therefore possible to cover any image areas where an increased number of defective pixels occur by additional detectors and, thus, additional sub-images. The respective weighting functions, which may take on any form, also enable fading in sub-images which were inserted at a later point in time and which cover areas with more frequent defective pixels. In the quality control of aluminum castings, for example, X-ray detectors are frequently employed. Since the castings often exhibit a dimension which would not be detectable using one single X-ray detector, several X-ray detectors are frequently used in this context.
The respective stress imposed on the detectors by the X-radiation depends on their positions and, for example, on the shapes of the test pieces. It may occur, for example, that in quality control such sensors are subject to different degrees of wear and tear. Embodiments here offer the advantage that by performing calibration processes at correspondingly regular intervals, pixel defects in detectors subject to different degrees of stress may be compensated for, it being possible in this context to adapt the respective weightings accordingly.
Further embodiments may comprise smoother fading in and/or fading out of defective dots. To this end, two further weighting functions are depicted in
The embodiment of
As was already mentioned in detail, the individual sub-images may initially be geometrically corrected, for example rotational or translational conversions as well as elongations or compressions are feasible. Depending on these geometric adaptations, the shapes of the respective overlap areas may deviate accordingly. If, therefore, the images are subject to geometric correction, in particular if this involves rotation, the overlap area will frequently no longer be rectangular. Embodiments of the present invention offer the advantage that the overlap areas of the individual sub-images may take on any shape. This may be caused by geometric corrections, on the one hand, but also by defective pixels, which are taken into account accordingly in the weighting functions, on the other hand. Generally, for a merging, as wide an overlap area as possible would be desirable. In reality, limitation to a rectangular area is often not possible.
In terms of the effective overlap areas 710,
Embodiments thus offer the advantage that any defective pixels and any overlap areas may be covered. Since any, even non-linear, weighting functions may be used, there is no limit to the shapes of the overlap areas. This is advantageous, in particular, when several sub-images overlap within an overlap area, the individual sub-images having been subjected to different geometric adaptations.
It shall be noted, in particular, that depending on the circumstances, the inventive scheme may also be implemented in software. The implementation may occur on a digital storage medium, in particular a disk or a CD with electronically readable control signals which may cooperate with a programmable computer system and/or microcontroller such that the respective method is performed. Generally, the invention thus also consists in a computer program product having a program code, stored on a machine-readable carrier, for performing the inventive method, when the computer program product runs on a computer and/or microcontroller. In other words, the invention may therefore be realized as a computer program having a program code for performing the method, when the computer program runs on a computer and/or microcontroller.
The present invention offers the advantage that in particular in the pre-processing of X-ray image data as occurs in the quality control or quality inspection of relatively large metallic components such as aluminum rims, for example, a more pronounced reduction of transition artifacts may be achieved in an overall image composed of individual sub-images. The inventive pre-processing of the image data, and the inventive composing and processing of the overlap areas thus enable improved quality control, wherein fewer false alarms occur which are due to gray jumps in the overlap areas of the sub-images.
While this invention has been described in terms of several embodiments, there are alterations, permutations, and equivalents which fall within the scope of this invention. It should also be noted that there are many alternative ways of implementing the methods and compositions of the present invention. It is therefore intended that the following appended claims be interpreted as including all such alterations, permutations and equivalents as fall within the true spirit and scope of the present invention.
Number | Date | Country | Kind |
---|---|---|---|
10 2006 039 389.9 | Aug 2006 | DE | national |
This application is a national phase entry of PCT Patent Application Serial No. PCT/EP2007/007389, filed 22 Aug. 2007, which claims priority to German Patent Application No. 10 2006 039 389.9, filed 22 Aug. 2006.
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/EP2007/007389 | 8/22/2007 | WO | 00 | 9/3/2009 |