This patent application is a National Stage Entry of PCT/GB2019/052737 filed on Sep. 27, 2019, which claims priority to GB Application No. 1816014.3 filed on Oct. 1, 2018, the disclosures of which are hereby incorporated by reference herein in their entirety as part of the present application.
The disclosure relates but is not limited to a method for inspecting cargo with X-rays. The disclosure also relates but is not limited to a corresponding inspection system and a corresponding computer product or a computer program.
Inspecting cargo with X-rays may be performed by scanning the cargo by mutually displacing the cargo and a scanner including a detector, with a mutual scanning displacement, and detecting, with the scanner, radiation generated by a plurality of successive X ray pulses irradiating the cargo during the mutual scanning displacement.
In a mobile mode, mutually displacing the cargo and the scanner includes maintaining the cargo static with respect to a ground and displacing the scanner with respect to the ground during the scanning displacement.
In a pass-through or portal mode, mutually displacing the cargo and the scanner includes maintaining the scanner static with respect to a ground and displacing the cargo with respect to the ground during the scanning displacement.
In the mobile mode, even on flat grounds, the detector may have vertical and longitudinal (e.g. in a direction of the mutual scanning displacement) parasitic displacements (e.g. such as vertical displacements, rotation displacement and/or pendulum displacements) which may cause image artefacts and degrade image quality. The parasitic displacements of the detector may generate waves such that most of real straight lines may not appear as straight lines on images generated based on the inspection.
In the pass-through mode the speed of the cargo may be irregular which may cause also image artefacts and degrade image quality. Inhomogeneity of the speed may cause horizontal stretches or compressions on the image. These artefacts behave a local horizontal parasitic displacements.
Embodiments of the disclosure provide a method for inspecting cargo. The inspection of the cargo involves scanning the cargo using a scanner including a matrix of detectors including at least two rows of detectors. The scanner may also include, in some examples, a source of radiation. The scanning also involves mutually displacing the cargo and the matrix. During the scanning, zones of the cargo are irradiated by several X ray pulses and the corresponding radiation is detected by several rows. The method also includes generating an image of the cargo for each row of detectors, and determining a local mutual parasitic displacement (e.g. any local discrepancy between the expected mutual scanning displacement and the actual mutual scanning displacement) between corresponding pixels of the generated images. The method also includes generating a corrected image using one or more of the generated images without a total mutual parasitic displacement corresponding to a sum of the local mutual parasitic displacements. The mutual parasitic displacements may correspond to parasitic movements of the matrix, e.g. such as vertical displacements, rotation displacement and/or pendulum displacements when the matrix is mounted on the boom of a mobile inspection system, or to parasitic movements of the cargo, e.g. speed inhomogeneity of the cargo passing in front of the matrix.
Embodiments of the disclosure may enable improvement of the quality of an image generated based on the inspection. Embodiments of the disclosure may not involve an expensive and heavy mechanical compensation device dedicated to inhibit (e.g. reduce) parasitic movements of the matrix (e.g. when the matrix is mounted on a boom of an inspection system). Embodiments of the disclosure may not involve image processing based on prior hypotheses which may not be true or affect other parts of the images which do not require correction.
Aspects and embodiments of the disclosure are set out in the appended claims. These and other aspects and embodiments of the disclosure are also described herein.
Embodiments of the present disclosure will now be described, by way of example, with reference to the accompanying drawings, in which:
In the figures, similar elements bear identical numerical references.
Overview
Embodiments of the disclosure provide a method for inspecting cargo. The inspection of the cargo involves scanning the cargo using a scanner including a matrix of detectors including at least two rows of detectors. The scanner may also include, in some examples, a source of radiation. The scanning also involves mutually displacing the cargo and the matrix. During the scanning, zones of the cargo are irradiated by several X ray pulses and the corresponding radiation is detected by several rows. The method also includes generating an image of the cargo for each row of detectors, and determining a local mutual parasitic displacement (e.g. any local discrepancy between the expected mutual scanning displacement and the actual mutual scanning displacement) between corresponding pixels of the generated images. The method also includes generating a corrected image using one or more of the generated images without a total mutual parasitic displacement corresponding to a sum of the local mutual parasitic displacements. The mutual parasitic displacements may correspond to parasitic movements of the matrix, e.g. such as vertical displacements, rotation displacement and/or pendulum displacements when the matrix is mounted on the boom of a mobile inspection system, or to parasitic movements of the cargo, e.g. speed inhomogeneity of the cargo passing in front of the matrix.
Embodiments of the disclosure may enable improvement of the quality of an image generated based on the inspection. Embodiments of the disclosure may not involve an expensive and heavy mechanical compensation device dedicated to inhibit (e.g. reduce) parasitic movements of the matrix (e.g. when the matrix is mounted on a boom of an inspection system). Embodiments of the disclosure may not involve image processing based on prior hypotheses which may not be true or affect other parts of the images which do not require correction.
Details Description of Example Embodiments
As shown in
As illustrated in
In some examples, the scanning at S1 may include:
The radiation 13 may be generated by an X-ray source 15, which may be, in some examples, rigidly connected to the matrix 12. The source 15 may be moved with the matrix 12.
In the example illustrated in
In the example illustrated in
The matrix 12 may be mounted on the boom 14, facing the source 15 on the other side of the cargo 11.
In some examples, scanning the cargo at S1 may include scanning the cargo 11 in a mobile mode. In that case, mutually displacing the cargo 11 and the matrix 12 may include maintaining the cargo static with respect to the ground and displacing the matrix 12 with respect to the ground during the scanning displacement SD. In some examples, scanning the cargo may include mounting the matrix 12 on the boom 14 of the mobile inspection system 10. In that case, generating at S5 the corrected image may include correcting boom movements artefacts generated in the mobile mode by movements of the boom 14 on which the matrix 12 is mounted (such as parasitic displacement such as vertical displacements, rotation displacement and/or pendulum displacements).
Alternatively or additionally, scanning at S1 the cargo 11 may include scanning the cargo 11 in a pass-through mode. In that case, mutually displacing the cargo 11 and the matrix 12 may include maintaining the matrix 12 static with respect to the ground and displacing the cargo 11 with respect to the ground during the scanning displacement SD. In some examples, scanning the cargo 11 includes mounting the matrix 12 on the boom 14 of a static inspection system 10. In that case, generating at S5 the corrected image may include correcting cargo speed inhomogeneity generated in the pass-through mode (such as speed inhomogeneity of the cargo 11).
In the present specification, all of the figures are depicting the case of vertical boom movements, e.g. in the mobile mode. It should be understood that all the explanations would remain similar for speed inhomogeneity, e.g. in the pass-through mode, with reference to similar figures with horizontal parasitic displacements instead of vertical parasitic displacements.
As illustrated in
Alternatively or additionally, as illustrated in
In examples of the disclosure, a speed of the mutual scanning displacement SD is such that between two pulses Pi and Pi+1, a mutual displacement of the cargo 11 with respect to the matrix 12 may be lower than a width of a row 121-i of the matrix 12 (e.g. around 2 mm, but other dimensions are envisaged). In some examples, any zone Zi of the cargo 11 irradiated by a pulse Pi will be detected by all of the rows 121-i of the matrix 12. As illustrated in
As illustrated in
In some examples, each image includes pixels corresponding to the row 121-i of detectors 122 for each X ray pulse Pi.
In some examples, as illustrated in
In some examples, the mutual scanning displacement SD occurring between the first pulse Pi and at least one second pulse Pj (j≠i) may correspond to a case where a movement of the matrix 12 may only be a translation at a constant speed along a horizontal axis (
As illustrated in
For the sake of clarity, in
In some examples, the speed of the vertical parasitic movement PDy may be considered as a constant in the duration of the four pulses P1, P2, P3 and P4 illustrated in
It should be understood that because the speed is assumed to be a constant in the example of
The method 100 may thus further include, determining, at S3, for each zone Zi of the cargo 11 irradiated by the first X ray pulse Pi and by the at least one second X ray pulse Pj (j≠i), a local mutual parasitic displacement between the cargo 11 and the matrix 12.
It should be understood that all the different images are distorted by the parasitic displacement PD and none of the images may be considered as a reference. However, in some examples, determining at S3 the local mutual parasitic displacement may include determining local mutual displacements between corresponding pixels of the first image and the at least one second image. In some examples, an instantaneous and local displacement vector may be determined and used to correct the parasitic displacements in the images.
The following conventions will be used in the following developments:
(n−1)·Δ is a constant shift in the scanning direction (Ox), and it is known because the scanning speed is known. In some examples, (n−1)·Δ may be cancelled by shifting horizontally the image (and filling with 0 the missing rows at the extremity of the images). In some examples, In(x,y) may be replaced by a translated In(x+(n−1)Δ,y).
The slight stereoscopic effects may also be neglected, and the translated images may be such that:
In(x,y)=I1(x,y). (Eq 1′)
In(x,y) may be the image acquired with the parasitic displacements. For the first row:
I1(x,y)=I1(x+Δx(t1(x),y),y+Δy(t1(x),y)) (Eq. 2)
with:
Equation 2 may be valid for a continuous model (e.g. the image may be a function of a continuous variable). However, cargo images are functions of x and y as discrete variables, and it can be assumed that images of cargo are bandwidth limited and that the pixel size allows a reconstruction of the continuous function, e.g. using the Nyquist-Shannon theorem.
For the nth row, with the constant translation due to scanning SD being suppressed:
In(x,y)=In(x+Δx(tn(x),y),y+Δy(tn(x),y))=I1(x+Δx(tn(x),y),y+Δy(tn,y))
with:
For the sake of clarity, tn(x) may be used instead of t1(x) for I1 because the images are corrected from constant scanning displacement SD. These instants are separated by nδ/v, v being the scan speed.
Time and mean position (i.e. a position without matrix mutual movement) are proportional (x=vt, with v the scanning speed). It is thus more convenient to remove time and to express Equation 2 as follow
In(x,y)=I1(x+Δnx(x,y),y+Δny(x,y)) (Eq. 3)
The following development will describe how a local displacement vector between any pair of images may be determined.
As illustrated in
Δpx(x,y)−Δqx(x,y), and
Δpy(x,y)−Δqy(x,y).
With the assumption of constant speed of matrix movements between two rows 121-i and 121-i+1, an instantaneous displacement field IF may be determined by dividing the above displacement field by p-q, as illustrated in
As illustrated in
In some examples, the above instantaneous displacement field IF may be used to determine an image distortion as described below.
As illustrated in
x′(x,y)=x+∫0xδx(u,y)du and y′(x,y)=y+∫0xδy(u,y)du (Eq. 4)
The formulas in Eq. 4 describe a mapping between the coordinates of an acquired image (x and y) and an actual position (x′ and y′). The mapping may be performed horizontally, line by line, because the instantaneous displacements δx(x,y) and δy(x,y) are calculated between adjacent rows.
In
In Equation 4 above, the lower limit of the integral (sum) is zero, but it should be understood that the lower limit could be any value, xo, i.e. from an X ray pulse associated with a start of the scan of the cargo. In such a case the equations are:
x′(x,y)=x+∫x
In Equation 4 above, the upper limit of the integral (sum) may be associated with the row which may be chosen as a reference. The total displacement of each point of the image from its position without any displacement needs to be determined. It is thus assumed that the reference row may correspond to a rest position of the matrix. The reference row may be associated with an X ray pulse associated with an end of the scan of the cargo.
Most of the theoretical developments above have been made with continuous models. The more practical discrete equivalent of equations will be
Xij and yij are integers (because i and j are pixel coordinates) while xij′,yij′ are not integers (in a general case, the parasitic displacement in space of a detector is not a multiple of the row width).
In some examples, grey levels for integer paired values of x′ and y′ are determined because they correspond to a coordinate of a pixel. There are several numerical ways to determine grey levels for integer paired values of x′ and y′, e.g. using morphing. The principle is schematically illustrated in
In the simplest case where matrix movements can be approximated by a vertical translation (δx=0 and δy only depending on x):
xij′=i and yij′=j+Σi′=1i′=i(δy)i′ (Eq. 5)+
As illustrated in
In some examples, calculating the corrected image may be performed by translating each column of a quantity D equal to:
D=−Σi′=1i′=i(δy)i′.
As explained above, the result for D above corrects boom movements which are mainly vertical translation movements (e.g. effects of rotation are considered very small)
In a general case in x and y:
Therefore the p images may be corrected following the equations:
In(x,y)=In(x−Dx(x,y),y−Dy(x,y))
The last calculation may not be performed for all of the images, as the corrected images may be assumed to be the similar.
As explained in further detail below in relation to
In the example illustrated by
In the example illustrated by
In some examples, determining at S3 the local mutual parasitic displacement may include using at least one of: an image cross-correlation technique and an energy minimization technique.
Cross-correlation of images is known to the man skilled in the art for determining the displacement field in a sequence of images. The cross-correlation technique will now be briefly described.
A Fourier transform may be used to find the displacement vector locally. If Ip and Iq are two images corresponding to rows p and q, Fp and Fq may be the 2D Fourier transforms.
A normalized cross power spectrum R may be calculated such that:
If Iq and Ip are the same image shifted by (δx, δy), the cross power spectrum is:
In order to get the cross-correlation, the inverse Fourier transform of the cross power spectrum which is now a Dirac delta function localized in (δx, δy) may be determined. Finding (δx, δy) may require calculation of R, and the maximum of the Fourier transform of R may be localized.
For determining a displacement field, the above method may be applied for each pixel (x,y) on a small square window (n×n pixels) centered on the pixel, and the result may be considered as the local displacement (δx(x,y), δy(x,y)). The obtained local displacement may be divided by (q-p) to get the local instantaneous displacement.
Energy minimization is also known to the man skilled in the art. The energy minimization technique will now be briefly described.
A convex or pseudo-convex function with the instantaneous displacement vectors as variables is built, and the minimum of the function is determined. The usual basic term of such a function is a “conformity term”. Always considering Ip and Iq (p>q) as above, this first basic term is such that:
EC((δx)ij,(δy)ij)=Σij(Ip(i−(p−q)·(δx)ij,j−(p−q)·(δy)ij)−Iq(x,y))2 (Eq. 7)
For the sake of clarity, the discrete form of the function has been used in Eq. 7. The “conformity term” above may be the square of the difference between a shifted image (term Ip) and a target image (term Iq). The algorithm consists in determining the values of (δx)ij and (δy)ij which minimize Ec. The determined values correspond to values of displacements which make image Ip look as similar as possible as image Iq.
Other terms of regularization may be added to Eq. 7 in order to stabilize obtained results:
ET((δx)ij,(δy)ij)=Ec((δx)ij,(δy)ij)+α(Σij(∇2(δx)ij+Σij(∇2(δy)ij)) (Eq. 8)
Here the gradients are calculated as difference of δx and δy between two adjacent pixels. The coefficient α (positive) expresses the balance between the two terms of ET. The higher α, the smoother the transformation. The displacements to be determined are not integers, and warping/interpolating algorithms may be used to compute the term Ec.
With the constant speed assumption as mentioned above, a function integrating all possible pairs of images may be such that:
Gradient descent techniques may be used to minimize ET.
In the examples illustrated in
The system 10 may further include other types of detectors, such as optional gamma and/or neutrons detectors, e.g., adapted to detect the presence of radioactive gamma and/or neutrons emitting materials within the cargo 11, e.g., simultaneously to the X-ray inspection.
Number | Date | Country | Kind |
---|---|---|---|
1816014 | Oct 2018 | GB | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/GB2019/052737 | 9/27/2019 | WO |
Publishing Document | Publishing Date | Country | Kind |
---|---|---|---|
WO2020/070473 | 4/9/2020 | WO | A |
Number | Name | Date | Kind |
---|---|---|---|
20080298545 | Bueno et al. | Dec 2008 | A1 |
20080298546 | Bueno | Dec 2008 | A1 |
20120148020 | Arroyo, Jr. | Jun 2012 | A1 |
20130156156 | Roe et al. | Jun 2013 | A1 |
20130328919 | Holt | Dec 2013 | A1 |
20150325401 | Langeveld | Nov 2015 | A1 |
Number | Date | Country |
---|---|---|
108553121 | Sep 2018 | CN |
2002010039 | Jan 2002 | JP |
2016082006 | Jun 2016 | WO |
2017205914 | Dec 2017 | WO |
Entry |
---|
Thomas W Rogers et al., “Automated X-ray Image Analysis for Cargo Security: Critical Review and Future Promise”, arxiv.org, Cornell University Library, 201 Olin Library Cornell University Ithica, NY 14853, Aug. 3, 2016, XP080717884, the whole document. |
UK Search Report, Application No. GB1816014.3, dated Mar. 28, 2019, 3 pgs. |
PCT International Search Report and Written Opinion, Application No. PCT/GB2019/052737, dated Nov. 18, 2019, 2 pgs. |
Number | Date | Country | |
---|---|---|---|
20220020140 A1 | Jan 2022 | US | |
20230109669 A9 | Apr 2023 | US |