The present invention relates to imaging of substrates through coatings, and more particularly relates to a camera system for infrared imaging of defects and other structural features of coated objects such as aircraft components.
Aircraft components are subject to constant degradation such as corrosion and cracking caused by environmental and operational conditions. Although the application of coatings, such as paints, reduces corrosion problems substantially, they typically cannot eliminate them entirely. Furthermore, forces experienced during flight can result in damage which a coating of paint cannot mitigate, such as stress defects and cracking. In order to ensure that aircraft are ready for flight, periodic inspections are necessary.
Inspection of aircraft components traditionally includes visual inspection. When visually inspecting aircraft components, the coating used to protect the components becomes an obstacle because it may hide structural defects or features beneath the coating. It is therefore necessary to strip the component assembly or aircraft in question of its paint before a proper visual inspection can be performed. Afterward, a new coating of paint must be applied. This process results in substantial expense in the form of labor and materials, raises environmental concerns, and requires a great amount of time. Furthermore, the visual inspection can be unreliable due to limitations of the human eye.
In addition to visual inspection, active thermography techniques have been proposed for inspection of various components. One such technique utilizes a transient heat source to heat the component, followed by detection of a transient heat signature on the surface of the component to determine the presence of anomalies or defects. However, such techniques require specialized equipment and controls to generate the necessary transient heating, and are inefficient because detection of the transient thermal signature can require a significant amount of time.
U.S. Published Patent Application No. US 2004/0026622 A1, which is incorporated herein by reference, discloses a system for imaging coated substrates which utilizes an infrared (IR) light source. The IR light shines on the object and is reflected to a focal plane array, also referred to as a detector.
U.S. application Ser. No. 10/971,217, which is incorporated herein by reference, discloses a system for detecting structural defects and features of coated substrates using a blackbody self-illumination technique.
These methods are significant improvements when compared to visual inspection. However, Depth of Field (DOF) in IR cameras is limited similar to standard optical systems. In optics, DOF is the distance in front of and behind the subject which appears to be in focus. For any given lens setting, there is only one distance at which a subject is precisely in focus. Focus falls off gradually on either side of that distance, so there is a region in which the blurring is tolerable often termed “circle of confusion”. IR cameras similarly have only one distance at which a subject is precisely in focus. This limits the ability of an observer to see the details of the bottom of a non-flat plane, such as a pit or scratch, and at the same time see the detail at the top of the scratch or pit.
The present invention has been developed in view of the foregoing.
One embodiment uses an optical detector, such as an infrared camera tailored to view substrates through a coating, to take an image at a top focal plane. Then an image is taken at a bottom focal plane within the same field of view. A series of images within this field of view is then taken between the top and bottom focal plane. Each image is recorded and stored locally or transmitted to a computer. Software that incorporates an appropriate algorithm merges the images. The algorithm selects only the focused portion of each image and combines these focused portions into one image.
An aspect of the present invention is to provide a system for imaging a substrate through a coating on the substrate comprising an infrared camera to receive infrared radiation from the substrate at different focal planes, wherein the infrared camera converts the infrared radiation to an image at each focal plane, means for combining the images at the different focal planes into a merged, image and a device for conveying the merged image
Another aspect of the present invention is to provide a method for imaging a substrate through a coating on the substrate, comprising: receiving infrared radiation from the substrate into an infrared camera, focusing the camera on a first focal plane of the substrate, recording a first image at the first focal plane, focusing the camera on a second focal plane of the substrate, recording a second image at the second focal plane, and merging the first and second images together to form a focused image.
Another aspect of the present invention is to provide a method for imaging a coating on the substrate, comprising receiving infrared radiation from the substrate into an infrared camera, adjusting the distance between the camera and the substrate to focus the camera on a first focal plane of the substrate, recording an image at the first focal plane, adjusting the distance between the camera and the substrate to focus the camera on a second focal plane of the substrate, recording an image at the second focal plane, and merging the images of the first and the second focal planes together to form a focused image.
The present invention provides improved inspection of substrates that are coated with paints, polymers and other types of coatings. Most paints and polymer coatings have a region of significantly reduced electromagnetic radiation absorption and scattering in the mid IR region as compared to the visible spectral region. This effectively opens a window of visibility where certain IR imaging cameras can see through coatings to the underlying substrates. Often spectral filters are used to further enhance the image by increasing the apparent transparency of the coating. Coatings may include one or more of the following examples: paint, a composite matrix material, primer, top coat and intermediate coats. The coated substrates can be inspected for markings or environmental and physical damage such as corrosion and cracks without removing the paint.
As shown in
In the embodiment shown
The steady state blackbody radiation from the object to be inspected may be generated by holding the object at room temperature. The entire object may be maintained at a substantially uniform temperature at or near room temperature. As used herein, the term “room temperature” means the surrounding ambient temperature found in an area such as a testing laboratory, production facility, warehouse, hanger, airstrip, aircraft cabin or ambient exterior temperature. Room temperatures are typically within a range of from about 60 to about 80° F. However, temperatures above or below such a range may exist. For example, in cold environments such as unheated hangers or warehouses in cold regions, the room temperature may be 32° F. or lower. In warm environments such as non-air-conditioned hangers and warehouses in desert or tropical regions, the “room temperature” may be well above 80° F. e.g., up to 100 or 110° F., or even higher.
Since the substrate 4 is at or near room temperature, it emits a significant amount of substantially steady state infrared (IR) blackbody thermal radiation. In contrast, the coating 2 may be substantially transparent at some of the wavelengths at which the underlying substrate 4 emits the blackbody radiation. Many organic polymers that may be used in the coating 2 are significantly IR-transmissive in certain spectral bands. The blackbody radiation of the substrate 4 can penetrate the organic coating 2 covering the substrate 4 and reveal the surface condition of the substrate 4 under the coating 2. The radiation transmitted through the coating 2 is thus used to provide images from the self-illuminated substrate 4 that reveal any defects under the coating 2. The substrate 4 to be inspected becomes observable by its own IR radiation, which is a function of the temperature of the substrate 4.
In accordance with another embodiment of the present invention, the object to be inspected is held at an elevated temperature, e.g., above room temperature, to maintain an elevated steady state blackbody radiation. Such an elevated temperature may be up to about 120° F. or higher, typically in a range of from 80 to about 110° F. The elevated temperature may be maintained by any suitable means (not shown), such as exposure to sunlight, heat gun, heat lamp, thermal blanket, hot packs, human contact and the like.
Another embodiment of the present invention shown
Reflected infrared light 9 passes through an optional second polarizer 23. The second polarizer 23 is operative to polarize the reflected light to a second selected polarity. For instance, the second polarizer 23 may be configured to polarize the reflected infrared light 9 in a direction opposite to that of first selected direction, a method known as cross-polarity. In this case, light of the polarity modulated by the first polarizer 21 will not pass through the second polarizer 23. Polarizers may not be necessary in many instances because most coatings are not polarized in any certain orientation.
The portion of the reflected infrared light 9 which was reflected off of regular areas of the substrate will retain the polarity modulated by the first polarizer 21 and therefore will not pass through the second polarizer 23. However, the portion of the reflected infrared light 9 which was reflected off of irregular areas, such as corrosion or rust, will have an altered polarity and will therefore pass through the second polarizer 23. Additionally, this optional polarization technique can reduce scattering by pigments in the coating which results in a clearer image of the substrate. Thus, only the portion of the infrared light 7 which was reflected off irregular areas of the substrate will pass through the second polarizer 23. The first polarizer 21 and second polarizer 23 may therefore operate in tandem to highlight the areas of the substrate which are irregular because they are corroded or otherwise damaged. Additionally, the polarity modulated by the first polarizer 21 may be configured to allow viewing of the substrate at various levels. This is because light of a polarity parallel to the substrate will more easily reflect off of the coating, while light of a polarity perpendicular to the substrate will more easily penetrate through the coating to the substrate beneath. Accordingly, it is possible to focus either on the surface of the substrate itself or on the surface of the coating. This methodology may be combined with the cross-polarity method described above in order to enhance particular features of the substrate at a particular level. It should be noted that although the first polarizer 21 and second polarizer 23 may be used in the fashion described and are therefore present in a potentially preferred embodiment, they are not necessary to the function of the present invention, and need not be included. Furthermore, the filter system described above need not be limited to cross-polarity at 90 degrees. Cross-polarity is described by way of example and more beneficial polarity setting may be utilized.
In accordance with an embodiment of present invention, the reflected infrared light 9 may also pass through a spectral filter 22 as shown in
The detector 8 may selectively detect radiation at certain wavelengths at which the coating is substantially transparent. In this manner, the coating does not substantially interfere with the image of the substrate 4. The detector 8 is included as part of an infrared camera 20 which detects infrared radiation (˜750 nm to ˜1 mm). The detector 8 is typically a narrow gap semiconductor, e.g. Indium Antimonide. The IR camera can be any commercially available unit capable of detection in the IR range and particularly in the mid-IR range or near-IR range. Depending on the detector, IR cameras of the present invention may utilize the mid-IR range of about 3 microns to about 5 microns and about 8 to about 12 microns or the camera may utilize the near-IR range of about 2.5 nanometers to about 750 nanometers.
Referring now to
In another embodiment, the lens focus can be changed to vary the focal plane while the remainder of the camera is stationary. In this embodiment, D2 in
I2 in
Referring now to
Again referring to
In addition to the camera 20, the spectral filter 22 may optionally be positioned in the optical path of the blackbody radiation between the substrate 4 and the detector 8. The spectral filter 22 removes portions of the blackbody radiation having wavelengths at which the coating 2 is non-transparent, e.g., wavelengths below 3.7 or 3.75 micrometers are removed, and wavelengths above 5.0 micrometers are removed.
In
Infrared cameras convert IR radiation to an analog or digital signal. As the makeup of the surface of a substrate changes so too does the IR radiation produced by the surface. IR cameras are able to detect these changes and portray them as an image. Referring to
The software used for merging the individual images may select only in-focus portions of each image and exclude the remaining out of focus portions of each image. This may be based on a multi-resolution method where the in-focus portions of each image are selected by determining the high frequency components of the image. The frequency analysis may be accomplished via wavelet or Fourier Transform.
Another method for selecting in-focus portions of different images uses a variance method where portions of the image around a single coordinate are evaluated. The image having higher variations in intensity is selected for that coordinate.
In another embodiment, the software compares each pixel with the same coordinates in the various images and selects the most in focus based on a predetermined selection rule.
Commercially available software sold under the designation Auto Multi Focus by Hirox Company may be adapted for use in accordance the present invention to collect the focused portion of each image and to merge those focused portions into a complete image. Other suitable software may be used.
In accordance with an embodiment of the present invention, the filtered image of the substrate, including the detected structural features, may be compared with a reference image. For example, a reference image may be generated from another object similar to the coated object that is known to be substantially free of defects. By comparing a substantially defect-free reference object to the coated object being inspected, manual or automated evaluations may be performed. The reference image used as the standard could be preprogrammed into a database and a comparison made between the reference image and the image created from paint under test. Acceptability criteria could be preprogrammed as well. For example, unacceptable areas could be highlighted in red and acceptable areas in green. Other colors could be selected, as well, such as gray for an area requiring more evaluation.
The f-number, also called f-ratio or f-stop, of an optical system expresses the diameter of the entrance pupil in terms of the effective focal length of the lens. It is well known in traditional photography that adjustments to the f-number impact depth of field for the image. The same is true for IR imaging. Consequently, an improved merged image will result if an f-number corresponding to a relatively narrow depth of field is selected for all images and the number of images taken at different focal planes is increased.
Transfer of the image data from the camera to a computer may be accomplished locally via a cable, serial or wireless connection. Additionally, image transfer over a wider network via the Internet is possible.
Before or after merging, the images may be conveyed to the user. Conveying can include displaying, storing or printing the images. The images may be displayed locally on a screen of the IR camera or, alternatively, may be displayed on a separate monitor, plotter or printer. Additionally, individual images may be stored locally on memory included as part of the camera 20, but typically, the images are transferred to a computer for storage prior to being merged.
The following example is intended to illustrate the various aspects of the present invention and is not intended to limit the scope of the invention.
An infrared camera was focused on an area of a substrate containing a pit which was covered by a coating. The camera was mounted on a calibrated stage to measure the depth of each photo. An organic paint type coating was applied over a corrosion pit, which was inscribed as a channel on a panel. The pit was produced on an unpainted scribe on the panel by salt fog (ASTM B117) and then the panel was painted with the organic coating. Multiple IR photos were taken at varying focal planes. Table 1 lists the depth of each photo taken. Figures corresponding to photo number 1, 5, 9, 13 and 17 are shown as
Whereas particular embodiments of this invention have been described above for purposes of illustration, it will be evident to those skilled in the art that numerous variations of the details of the present invention maybe made without departing from the invention as defined in the appended claims.
This application is a continuation-in-part of U.S. patent application Ser. No. 11/506,701 filed Aug. 18, 2006, which is a continuation-in-part of U.S. patent application Ser. No. 10/971,217 filed Oct. 22, 2004, both of which are herein incorporated by reference.
The United States Government has certain rights to this invention pursuant to the funding and/or contracts awarded by the Strategic Environmental Research and Development Program (SERDP) in accordance with the Pollution Prevention Project WP-0407. SERDP is a congressionally mandated Department of Defense (DOD), Department of Energy (DOE) and Environmental Protection Agency (EPA) program that develops and promotes innovative, cost-effective technologies.
Number | Date | Country | |
---|---|---|---|
Parent | 11506701 | Aug 2006 | US |
Child | 11742751 | US | |
Parent | 10971217 | Oct 2004 | US |
Child | 11506701 | US |