Patent Application
20100220910
The invention relates generally to nondestructive testing (NDT) of parts and more particularly to a method and system for automatically identifying defects in NDT image data corresponding to a scanned object.
NDT is a technique of producing relevant data for an object by collecting energy emitted by or transmitted through the object, such as by penetrating radiation (gamma rays, X-rays, neutrons, charged particles, etc.) sound waves, or light (infrared, ultraviolet, visible, etc.). The manner by which energy is transmitted through or emitted by any object depends upon variations in object thickness, density, and chemical composition. The energy emergent from the object is collected by appropriate detectors to form an image or object map, which may then be realized on an image detection medium, such as a radiation sensitive detector. A radiographic detector, for example, comprises an array of elements that records the incident energy at each element position, and maps the recording onto a two-dimensional (2D) image. The 2D image is then fed to a computer workstation and interpreted by trained personnel. Non-limiting examples of NDT modalities include X-ray, CT, infrared, eddy current, ultrasound and optical.
Radiography and other NDT inspection modalities find wide application in various medical and industrial applications as a non-destructive technique for examining the internal structure of an object. Non-destructive evaluation (NDE) of industrial parts is essential for manufacturing productivity and quality control. For example, in aerospace and automotive industries, radiographic images of aluminum castings are typically inspected by an operator who identifies defects pertaining to porosities, inclusions, shrinkages, cracks, etc. in the castings. However, and as will be appreciated by those skilled in the art, owing to the structural complexity and large production volumes of these castings, the manual inspection procedure is often prone to operator fatigue and hence suffers from low inspection reliability.
A number of NDT inspection techniques such as feature-based classification, artificial neural networks and adaptive filtering have been developed to perform automatic radiographic inspections of scanned objects. These techniques are typically based on using automated defect recognition (ADR) techniques to automatically screen images, call out defects and prioritize the ones needing visual inspection. As will be appreciated by those skilled in the art, ADR techniques typically achieve more accurate defect detection than human operators and have a much higher efficiency and consistency, thereby enhancing quality control in a wide variety of applications, such as, for example, automotive parts and engine components of aircraft, ships and power generators. Techniques using ADR may typically be used to perform automatic defect detection on 2D images and/or 3D images, based on analyzing the geometry (e.g., shape, size), feature (e.g., intensity, texture, color) and other local image statistics in the radiographic image data, to locate abnormalities. For example, ADR techniques based on image features use a set of features to identify potential flaws in scanned object parts based on flaw morphology and gray level statistics. These techniques assign each pixel in the image into one of several classes based on minimizing a distance metric, wherein the parameters characterizing the distance metric are evaluated using a supervised learning scheme. However, the performance of these techniques is affected by variations caused by object structure or flaw morphology and these techniques generally require large training sets with labeled flaws to perform defect identification. Additionally, a number of NDT techniques involving 3D scanning of objects and 3D image to 2D image registration, makes the process of anomaly detection slower and inefficient.
It would therefore be desirable to develop an efficient NDT inspection technique for automatically detecting defects in the NDT image data corresponding to a scanned object. In addition, it would be desirable to develop an efficient NDT inspection technique that detects anomalies in industrial parts, produces accurate defect detection rates, increases the screening efficiency and consistency of inspection systems, efficiently utilizes system operation setup time and system training time and is robust to changes in object part geometry and misalignment of scanned object parts.
In accordance with an embodiment of the invention, an anomaly detection method for comparing a scanned object to an idealized object is provided. The anomaly detection method includes generating a three-dimensional reference model of the idealized object. The anomaly detection method further includes acquiring at least one two-dimensional inspection test image of the scanned object and determining a two-dimensional reference image from the three-dimensional reference model using multiple pose parameters estimated by a 3D-2D registration algorithm, wherein the two-dimensional reference image corresponds to the same view of the three-dimensional reference model of the idealized object as the view of the two-dimensional inspection test image of the scanned object. Finally, the anomaly detection method includes identifying one or more defects in the inspection test image via automated defect recognition technique.
In accordance with another embodiment of the invention, an inspection system is provided. The inspection system includes an imaging system configured to acquire inspection test image data corresponding to a scanned object. The inspection system further includes a computer system configured to be in signal communication with the imaging system. The computer system comprises a memory configured to store the inspection test image data corresponding to the scanned object, wherein the image data comprises at least one of an inspection test image of the scanned object and one or more reference images for the idealized object. The computer system further includes a processor configured to process the inspection test image data corresponding to the object. The processor is further configured to generate a three-dimensional reference model of the idealized object, receive the inspection test image data of the scanned object from the imaging system, determine a two-dimensional reference image from the three-dimensional reference model using multiple pose parameters estimated by a 3D-2D registration algorithm, and identify one or more defects in the inspection test image via automated defect recognition technique. The inspection system further includes a display device configured to display one or more defects in the inspection test image data corresponding to the scanned object.
These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:
The present techniques are generally directed to automated anomaly detection, possibly in conjunction with computer assisted detection and/or diagnosis (CAD) algorithms. Such analysis may be useful in a variety of imaging contexts, such as industrial inspection system, nondestructive testing and others.
The computer system 14 includes a memory 32 configured to store the X-ray inspection test image data corresponding to the scanned object 18. Further, the memory 32 may include, but is not limited to, any type and number of memory chip, magnetic storage disks, optical storage disks, mass storage devices, or any other storage device suitable for retaining information. The computer system 14 also includes one or more processors 34, 36 configured to process the X-ray inspection test image data corresponding to the scanned object.
It should be noted that embodiments of the invention are not limited to any particular processor for performing the processing tasks of the invention. The term “processor,” as that term is used herein, is intended to denote any machine capable of performing the calculations, or computations, necessary to perform the tasks of the invention. The term “processor” is intended to denote any machine that is capable of accepting a structured input and of processing the input in accordance with prescribed rules to produce an output. It should also be noted that the phrase “configured to” as used herein means that the processor is equipped with a combination of hardware and software for performing the tasks of the invention, as will be understood by those skilled in the art.
In one embodiment, and as will be described in greater detail below, the processor is further configured to generate a three-dimensional reference model of the idealized object. The processor further receives the inspection test image data of the scanned object from the imaging system and determines a two-dimensional reference image from the three-dimensional reference model using multiple pose parameters estimated by a 3D-2D registration algorithm, wherein the two-dimensional reference image corresponds to the same view of the three-dimensional reference model of the idealized object as the view of the two-dimensional inspection test image of the scanned object. Furthermore, the processor registers the three-dimensional reference model and the two-dimensional inspection test image of the scanned object and identifies one or more defects in the inspection test image via an automated defect recognition technique. Various automated defect recognition (ADR) techniques, well known to one skilled in the art, may be employed. In one ADR embodiment, the reference model consists of a 3D statistical model of both part density and part variation. Defects are found by statistically testing the 2D test image against both the registered and projected 2D reference image and labeling areas as defects that fall outside of normalcy probabilities. Further details of the automated defect recognition technique may be obtained in U.S. Pat. No. 4,896,278 entitled “AUTOMATED DEFECT RECOGNITION SYSTEM”, the entirety of which is hereby incorporated by reference herein.
The computer system 14 also includes a detector interface card 42, an input device 40 and a display device 38. The input device 40 may include, but is not limited to, a keyboard, a mouse, a pointing device, a touch sensitive screen device, a tablet, a read/write drive for a magnetic disk, a read/write drive for an optical disk, a read/write drive for any other input medium, an input port for a communication link (electrical or optical), a wireless receiver. The display device 38 may be a CRT (cathode ray tube) screen or any other suitable display device for displaying text, graphics and a graphical user interface, for example. In one embodiment, the display device is configured to display one or more defects in the X-ray inspection test image corresponding to the scanned object. The input device 40 and the display device 38 operate in combination to provide a graphical user interface, which enables a user or operator to configure and operate the radiographic inspection system 10. The detector interface card 42 provides low-level control over the image detector, buffers data read out from the image detector 24, and optionally reorders image pixels to convert from read-out order to display order. The real-time image controller 46 includes a set of image control buttons 50, a set of image control dials 48, a display 52, and an embedded application programming interface that maps the functions of the control buttons and dials 48, 50 to the computer system 14.
Additionally, in one embodiment, the two-dimensional reference image is determined by forward projection of the three-dimensional reference model. In another embodiment, the two-dimensional reference image is determined by simulation of x-ray imagine of the three-dimensional reference model.
In yet another embodiment, the two-dimensional reference image is registered to the two-dimensional inspection test image of the scanned object. The registration is performed so as to address the differences in the acquisition parameters between different imaging modalities. The process of registration, which is also referred to as image fusion, superimposition, matching or merging, maps each point in one image onto the corresponding point in the second image. As will be appreciated by those skilled in the art, any registration method may be employed to register the images with one another before comparing the images for differences or changes. This includes fully automatic registration as well as computer assisted manual registration, or any registration approach using varying degrees of manual intervention.
Finally, at step 68, one or more defects in the inspection test image are identified via automatic defect recognition technique, which may comprise statistical evaluation, image differencing from a reference image, or pattern recognition for performing two-dimensional detection.
Embodiments of the present invention disclose a modeling technique to identify anomalies in inspection test image data corresponding to a scanned object, by generating a three-dimensional reference model and using 3D-2D registration and projection algorithms to determine a two-dimensional reference image to be compared to the inspection test image and applying the standard ADR techniques. The disclosed anomaly detection approach efficiently utilizes the system operation time by eliminating the steps of aligning the objects such as metal castings to be scanned in an assembly line.
Advantageously, the three-dimensional reference modeling approach is robust to changes in object part geometry and misalignment of scanned object parts since it is built using a number of defect-free images that can automatically encode normal variations that occur due to part-to-part variations within manufacturing specifications and image-to-image variations that occur due to appearance changes and spatial misalignment. Further, the present invention increases screening efficiency and consistency of inspection systems. In addition, the disclosed statistical modeling approach for detecting defects may be applied to multiple observations corresponding to multiple images of the scanned object acquired at one or more view angles.
The various embodiments of the anomaly detection method and inspection system described above thus provide a way to achieve a convenient and efficient automatic identification of defects in NDT image data corresponding to a scanned object.
It is to be understood that not necessarily all such objects or advantages described above may be achieved in accordance with any particular embodiment. Thus, for example, those skilled in the art will recognize that the systems and techniques described herein may be embodied or carried out in a manner that achieves or optimizes one advantage or group of advantages as taught herein without necessarily achieving other objects or advantages as may be taught or suggested herein.
While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.
