The present invention relates in general to active thermography and more particularly to an active infrared thermography system and a computer-implemented method for generating a thermal image.
Active thermography is useful for inspection and defect detection. However, use of existing active thermography systems for inspection and defect detection is both cumbersome and inefficient. It would therefore be desirable to provide an active infrared thermography system and a computer-implemented method for generating a thermal image that render inspection and defect detection more convenient and efficient.
Accordingly, in a first aspect, the present invention provides an active infrared thermography system. The active infrared thermography system includes one or more excitation sources, an infrared camera, one or more portable power sources arranged to power the one or more excitation sources and the infrared camera, and a housing. The one or more excitation sources and the one or more portable power sources are received in the housing.
In a second aspect, the present invention provides a computer-implemented method for generating a thermal image. The method includes executing on one or more processors the steps of: acquiring thermal image data on a subject; activating one or more excitation sources to radiate the subject; ending acquisition of the thermal image data on the subject when a cooling pattern is captured; determining a cooling curve of each pixel of the thermal image data; calculating a cooling coefficient of each pixel of the thermal image data; and scaling the cooling coefficient of each pixel of the thermal image data to a colour palette to produce a heat map.
Other aspects and advantages of the invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the invention.
Embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
The detailed description set forth below in connection with the appended drawings is intended as a description of presently preferred embodiments of the invention, and is not intended to represent the only forms in which the present invention may be practiced. It is to be understood that the same or equivalent functions may be accomplished by different embodiments that are intended to be encompassed within the scope of the invention.
The term “active infrared thermography” as used herein refers to intentional application of heat that results in a temperature rise in a region of interest (ROI). A thermal abnormality that appears on the ROI can then be observed when viewed with an infrared camera. Due to the additional energy that is channelled onto the ROI, the thermal contrast between the defects and its surrounding becomes larger and consequently the probability of detection (POD) is higher than that of conventional thermography. In active infrared thermography, an external stimulus is required for thermal excitation.
The term “excitation source” as used herein refers to a source of excitation energy for radiative heating. Examples of such radiative sources include, but are not limited to, infrared (IR) lamps and white or coloured light-emitting diode (LED) lamps.
The term “infrared camera” as used herein refers to a non-contact device that detects infrared energy (heat) and converts it into a visual image.
The term “portable power source” as used herein refers to a device capable of supplying electrical energy that can be easily moved around such as, for example, a ChargeTech 54 K dual alternating current (AC) battery pack.
The term “radiative power” as used herein is a measure of the rate at which energy is emitted via thermal radiation by a source.
The term “visible camera” as used herein refers to a device that create images that replicate human vision.
The term “about” as used herein refers to both numbers in a range of numerals and is also used to indicate that a value includes the standard deviation of error for the device or method being employed to determine the value. The term “about” as used herein can allow for a degree of variability in a value or range, for example, within 10%, within 5%, or within 1 % of a stated value or of a stated limit of a range.
The term “thermal image data” as used herein refers to information on heat distribution in a subject.
The term “cooling pattern” as used herein refers to information on changes in the heat distribution in the subject as the subject cools to room temperature.
The term “cooling curve” as used herein refers to a plot of temperature changes over time at a particular spot in the subject.
The term “cooling coefficient” as used herein refers to a plot of temperature changes over time at a particular spot in the subject.
The term “colour palette” as used herein refers to a range of colours.
The term “heat map” as used herein refers to a graphical representation of data where individual values contained in a matrix are represented as colors.
The term “background subtraction” as used herein refers to removing background data from data to be processed.
The term “temporal temperature profile” as used herein refers to a temperature at a particular spot in the subject at a particular point in time.
The term “Newton’s cooling model” as used herein refers to the thermal response of an object that was previously heated by an external source and cooled by the surrounding medium such as, for example, air.
The term “Gaussian sharpening filter” as used herein refers to an image processing technique that allows high frequency image information to pass through and blocks low frequency image information.
The term “convolution filter” as used herein refers to an image processing technique that blurs, sharpens, enhances or smooths an image depending on choice of the kernel used to scan across the image.
The term “visual image” as used herein refers to an image that replicates human vision.
The term “feature points” as used herein refers to common features that can be recognized in both infrared and visual images.
The term “transformation matrix” as used herein refers to a two-dimensional matrix that is used to map points in one coordinate system to another coordinate system.
The term “least square optimisation” as used herein refers to a regression analysis method used to approximate a solution of a set of equations by minimizing the sum of the squares of the residuals made in the results of every single equation.
The term “corrected heat map” as used herein refers to a graphical representation of data where individual values contained in a matrix are represented as colors, the individual values contained in the matrix having been corrected for inaccuracies.
Referring now to
The active IRT system 10 is a system by itself in that it does not require electrical cables for external connection to a wall plug. The active IRT system 10 may have a mass of between about 0.5 kilogram (kg) and about 5 kg, more preferably, between about 1 kg and about 2 kg. Advantageously, being relatively light-weight, the active IRT system 10 may be carried around, for example, by hand or in a backpack. Further advantageously, the active IRT system 10 is flexible enough to be mounted on various platforms such as, for example, a tripod with or without wheels, robotic arms, drones, etc.
Each of the one or more excitation sources 12 may have a radiative power of less than 500 watts (W), more preferably, between about 100 W and 450 W. Contrary to established belief, it has now been discovered that low power excitation sources may effectively be used for defect excitation. Use of low power (< 500 W) radiative sources such as, for example, infrared (IR) and light-emitting diode (LED) lamps, had been overlooked since the radiative power of such sources is much lower and had not therefore been expected to heat up a surface noticeably for IRT inspection. The one or more radiative or excitation sources 12 may therefore be infrared (IR) lamps, white or coloured light-emitting diode (LED) lamps, any low power radiative sources or combinations thereof.
Given that the excitation power is lower, there is a limit to how deep the heat can penetrate. The active IRT system 10 may be used to detect sub-surface defects of up to 6 millimetres (mm) in depth. Although a higher optical power generally penetrates deeper, increasing optical power is not the only way to increase penetration depth and penetration depth may be adjusted by varying wavelength, excitation or heating duration and/or distance from a sample or subject 20. Penetration depth may be increased by using a radiative source whose wavelength resonates with absorption properties of a material so that there is effective coupling of energy to the material and/or using focused lens design so that a radiated beam is more focused, instead of dispersive. The heating duration may be, for example, 10 seconds (s), 15 s, 30 s, 60 s or 90 s.
Apart from using radiative source(s) with higher power, optical power may also be increased by increasing the number of light or excitation sources 12 employed. Each of the one or more excitation sources 12 may have a mass of less than 400 grams (g), more preferably between about 200 g and about 400 g. Advantageously, when the light or excitation sources 12 used are less than 400 g, the active IRT system 10 is relatively lightweight.
Examples of suitable excitation sources 12 are shown in Table 1 below.
The infrared camera 14 may be a mid-wave infrared camera or a long-wave infrared camera and may be positioned at a distance of, for example, 20 centimetres (cm), 30 cm, 40 cm, 60 cm or 80 cm from the sample or subject 20. Depending on application requirements, the infrared camera 14 may have different specifications such as, for example, pixel resolution, thermal resolution, frame rate and interchangeable lens. Examples of suitable infrared cameras 14 are shown in Table 2 below.
The active IRT system 10 may also include a visible camera 22 powered by the one or more portable power sources 16 and received in the housing 18. Depending on application requirements, the visible camera 22 may also have different specifications such as, for example, pixel resolution, aperture and shutter speed.
The one or more portable power sources 16 may include a ChargeTech 54 K Dual alternating current (AC) battery pack.
The active IRT system 10 may further include one or more shutters 24 arranged to at least partially block off the one or more excitation sources 12.
Referring now to
In the embodiments shown in
In the embodiments shown in
Referring again to
The active IRT system 10 may be remotely controlled and/or monitored via a mobile device 38 such as, for example, a handphone, a tablet, a laptop, etc. Advantageously, this facilitates performance of active IRT inspection without physically touching the active IRT system 10.
Although exemplary values have been provided, it should be appreciated by those of ordinary skill in the art that wavelength, optical power and optical duration of the one or more excitation sources 12 and detector wavelength, thermal resolution, spatial resolution and frame rate of the thermal sensor/camera 14 are variable when determining a solution for defect inspection and detection depending on the texture and material of the sample of interest 20.
Having described various elements of the active IRT system 10, a method of operating the active IRT system 10 will now be described below with reference to
Referring now to
At step 54, one or more excitation sources 12 are activated to radiate the subject 20. The one or more excitation sources 12 may be activated after a predetermined delay. This helps ensure that background temperature is also recorded. In one or more exemplary embodiments, the one or more excitation sources 12 may be switched on with 1 to 2 seconds (s) delay after thermal video acquisition is initiated. Background subtraction may be performed using the thermal image data acquired during the predetermined delay. Advantageously, this is useful for image enhancement.
At step 56, acquisition of the thermal image data on the subject 20 is ended when a cooling pattern is captured. Accordingly, video recording continues until the cooling pattern is successfully captured. Duration of recording time may depend on excitation duration and the nature of the sample 20 to be inspected. For example, in the case of a carbon fibre specimen or sample of around 10 mm thick that has been heated up for 5 seconds, video recording may continue for 10 seconds after the one or more excitation sources 12 are switched off. Data acquisition may thus be customized and designed, following which data extraction is performed.
At step 58, a cooling curve of each pixel of the thermal image data is determined. This may involve extracting a temporal temperature profile of each pixel of the thermal image data. At the imaging plane, the temporal temperature profile of each pixel may be extracted as T[x,y]. This temporal temperature profile consists of a static process, a heating up process and a cooling down process. The step 58 of determining the cooling curve of each pixel of the thermal image data may further include offsetting a starting time of the temporal temperature profile of each pixel of the thermal image data to a start of a cooling down process. The cooling curve is further extracted by offsetting the starting time to the start of the cooling down process.
At step 60, a cooling coefficient of each pixel of the thermal image data is calculated. This may involve fitting the cooling curve of each pixel of the thermal image data to Newton’s cooling model. According to Newton’s Law of Cooling, a cooling coefficient is affected by the material that is being heated up. As such, hidden abnormalities may be detected by investigating the cooling rate on a sample surface.
Referring now to
At step 62, the cooling coefficient of each pixel of the thermal image data is scaled to a colour palette to produce a heat map. More particularly, the 2D array of the cooling rate formed is converted into a heat map by linear scaling to a colour palette, the heat map representing a final result. At least one of a Gaussian sharpening filter and a convolution filter may be applied to the heat map. The Gaussian sharpening filter allows high frequency image information to pass through and blocks low frequency image information. Advantageously, this helps to effectively sharpen the image. The convolution filter acts to blur, sharpen, enhance or smooth the image depending on choice of the kernel used to scan across the image. Accordingly, the use of such image processing algorithms further enhances the image.
Referring now to
The heat map may be fused to a visual image of the subject 20 to present a fusion image where a thermal image overlays the corresponding visual image and both visual features and thermal features can be directly seen. This is advantageous because active IRT is used to inspect subsurface defects, and hence is not sufficient to pinpoint the exact location on the sample 20 if only thermal images are presented. Furthermore, some thermal anomalies may be due to surface features such as different colour or material/emissivity. Therefore, by placing a thermal image on top of a visual image, a user may rule out false alarms.
For thermal cameras with an embedded red-green-blue (RGB) camera, creation of a fusion image is straightforward. However, most thermal cameras are not equipped with an RGB camera and the visual image is normally separately taken. Hence, the two images usually come with different orientation and resolution.
Referring now to
Referring now to
Referring again to
At step 106, the transformation matrix is applied onto the heat map to generate a corrected heat map. More particularly, the transformation matrix is applied onto the thermal image to generate an orientation and resolution corrected new thermal image.
At step 108, a transparency of the corrected heat map is increased and at step 110, the corrected heat map with increased transparency is overlaid over the visual image of the subject. The new thermal image or corrected heat map may be added with a 50% transparency before being overlaid on top of the visual image.
Referring now to
Referring now to
Referring now to
As is evident from the foregoing discussion, the present invention provides an active infrared thermography system and a computer-implemented method for generating a thermal image that render inspection and defect detection more convenient and efficient. Advantageously, because the inventors have demonstrated that it is feasible to perform active IRT inspection using a low power source, the required excitation power may be satisfied with the use of a portable power supply/bank, instead of electrical cables that connect externally to a wall plug or high-power generator. The active IRT system of the present invention is thus truly portable, that is, “cable-free”, and may be used on-site where there is no power supply. Apart from low power consumption requirements, the active IRT system of the present invention is also lightweight and wholly integrates all key components. Consequently, the active IRT system of the present invention may be mounted on a platform (e.g., drone, robotic arm) and/or carried around (e.g., tripod, backpack). The active IRT system of the present invention may also be remotely controlled and monitored and is therefore able to excuse an inspector/operator from dangerous/hazardous/inaccessible areas. Further advantageously, the active IRT inspection system of the present invention is highly customizable as the visible and IR cameras may have different specifications to cater to different application needs. The active IRT inspection system and method of the present invention may also enhance thermal images, fuse and display both visual and thermal images together on a mobile device (e.g. laptop) within seconds (<30 s). The active IRT system and method of the present invention may be applied for aircraft inspection, internal and/or external building inspection, and railway, pipeline, Deep Tunnel Sewerage System (DTSS) inspection by one inspector, a crawling robot or drone, etc.
While preferred embodiments of the invention have been described, it will be clear that the invention is not limited to the described embodiments only. Numerous modifications, changes, variations, substitutions and equivalents will be apparent to those skilled in the art without departing from the scope of the invention as described in the claims.
Further, unless the context clearly requires otherwise, throughout the description and the claims, the words “comprise”, “comprising” and the like are to be construed in an inclusive as opposed to an exclusive or exhaustive sense; that is to say, in the sense of “including, but not limited to”.
Number | Date | Country | Kind |
---|---|---|---|
10202001122U | Feb 2020 | SG | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/SG2021/050050 | 2/2/2021 | WO |