Physics-based, Bayesian sequential detection method and system for radioactive contraband

Information

  • Patent Grant
  • 8676744
  • Patent Number
    8,676,744
  • Date Filed
    Monday, October 27, 2008
    16 years ago
  • Date Issued
    Tuesday, March 18, 2014
    10 years ago
Abstract
A distributed sequential method and system for detecting and identifying radioactive contraband from highly uncertain (noisy) low-count, radionuclide measurements, i.e. an event mode sequence (EMS), using a statistical approach based on Bayesian inference and physics-model-based signal processing based on the representation of a radionuclide as a monoenergetic decomposition of monoenergetic sources. For a given photon event of the EMS, the appropriate monoenergy processing channel is determined using a confidence interval condition-based discriminator for the energy amplitude and interarrival time and parameter estimates are used to update a measured probability density function estimate for a target radionuclide. A sequential likelihood ratio test is then used to determine one of two threshold conditions signifying that the EMS is either identified as the target radionuclide or not, and if not, then repeating the process for the next sequential photon event of the EMS until one of the two threshold conditions is satisfied.
Description
FIELD OF THE INVENTION

The present invention relates to radionuclide detection methods. More particularly, the invention relates to a distributed sequential signal processing method and system for detecting and identifying radionuclides using a statistical approach based on Bayesian inference combined with physics-based emissions, transport, and detector processing models which represent radionuclides as a monoenergetic decomposition of photons at given energy amplitudes along with interarrival times.


BACKGROUND OF THE INVENTION

Timely and accurate radionuclide detection and identification is a critical capability and first line defense against the transportation of nuclear contraband and potential terrorist threats. However, radionuclide detection can be difficult due to low-count gamma emissions produced when, for example, sources are shielded to disguise their existence or are being transported and in relative motion with respect to the sensors. Moreover, background noise, finite detector resolution, and the heterogeneous media along transport paths between the sources and detectors all compound the measurement difficulty by “burying” the low-count emissions in the background and Compton scattering noise.


Various signal processing tools, techniques, and algorithms are known for detecting and identifying radionuclides from their gamma ray emission signatures produced in a gamma ray energy (probability) distribution or spectrum created as an energy histogram of measured arrival data at various energy levels (count vs. binned energy). In particular, these gamma spectroscopy methods analyze and interpret the energy spectrum to find emissions signatures (“energy lines”) uniquely characterizing individual radionuclides. However, these techniques have been known to fail on low-count measurement data, revealing inherent problems in both (a) the underlying physics models of the radiation emissions, transport, and measurement processes used for signal processing, and (2) the underlying mathematical framework for solving the detection problem.


For example, contemporary approaches to radionuclide detection utilize linearized approximations to the nonlinear processors (extended and unscented Kalman filters) which imply underlying Gaussian probabilistic assumptions. Unfortunately the nuclear physics dominating this problem is not characterized by unimodal (one peak) distributions, but rather by multimodal (multiple peaks) representations. Moreover, existing methodologies are based on enhancing the output gamma-ray spectrum by attempting to deconvolve the propagation uncertainties that contaminate the spectrum, i.e. remove background interference and noise, so as to increase the probability of extracting the spectral (energy) lines and identifying the radionuclide of interest. However, it is often the case when used in practice that the low-count detection limitations of contemporary gamma ray spectrometry tools and methods reveal the reliance of the underlying analysis algorithms upon heuristic approaches based upon the experience of analyst, even requiring in some cases the intervention of a trained practitioner to analyze the results and guide the interpretation process. In a terrorist type scenario, this is not acceptable, since timely and accurate performance is imperative. There is therefore a need for a new technique and methodology that provides for more timely, sensitive, and accurate detection of radionuclides that pose a significant terrorist threat.


SUMMARY OF THE INVENTION

One aspect of the present invention includes a photon-by-photon sequential radionuclide detection method comprising, detecting an event mode sequence (EMS) comprising a sequence of measured photon events each uniquely characterized by an energy amplitude-interarrival time parameter pair; for an nth photon event of the EMS: selecting a monoenergy processing channel from a set of parallel monoenergy processing channels derived from a monoenergetic decomposition of a target radionuclide into monoenergetic sources in which to process the nth photon event, said selection based on a determination that both of the energy amplitude and interarrival time values of the nth photon event satisfy respective energy amplitude and interarrival time confidence interval conditions of the selected monoenergy channel; upon selecting the monoenergy channel, using a sequential Bayesian processor of said selected monoenergy channel to update energy amplitude and interarrival time parameter estimates with the measured energy amplitude and interarrival time values of the nth photon event; using the updated amplitude and interarrival time parameter estimates to update a measured probability density function (PDF) estimate for the target radionuclide; determining whether a sequential likelihood ratio satisfies one of two threshold conditions signifying that the EMS is either identified as the target radionuclide or as not the target radionuclide, wherein said sequential likelihood ratio is based on a previous sequential likelihood ratio for a previous (n−1)th photon event, the sum of all updated measured PDF estimates produced as output from the set of parallel monoenergy channels; and the sum of all a-priori PDF estimates which are produced in parallel with the updated measured PDF estimates and based on expected amplitude level and interarrival time values of the target radionuclide; and upon determining that one of the two threshold conditions is satisfied, providing notification of the corresponding result, else repeating from the monoenergy selection step for the next (n+1)th photon event of the EMS until one of the two threshold conditions is satisfied.


Another aspect of the present invention includes a radionuclide detection system comprising: a detector for detecting an event mode sequence (EMS) comprising a sequence of measured photon events each uniquely characterized by an energy amplitude-interarrival time parameter pair; a set of parallel monoenergy processing channels derived from a monoenergetic decomposition of a target radionuclide into monoenergetic sources, each monoenergy processing channel comprising: an energy line discriminator module for determining if an energy amplitude value of an nth photon event satisfies a channel-specific energy amplitude confidence interval condition, and rejecting the photon event if the condition is not satisfied; an interarrival time (rate) discriminator module for determining, based upon acceptance of the photon event by the energy line discriminator module, if an interarrival time value of the nth photon event satisfies a channel-specific interarrival time confidence interval condition, and rejecting the photon event if the condition is not satisfied; an energy amplitude parameter estimator module including a sequential Bayesian processor for updating energy amplitude parameter estimates with the measured energy amplitude and interarrival time values of the nth photon event; an interarrival time (rate) parameter estimator module including a sequential Bayesian processor for updating interarrival time parameter estimates with the measured energy amplitude and interarrival time values of the nth photon event; and a measured probability density function (PDF) estimator module for using the updated amplitude and interarrival time parameter estimates to update a measured probability density function (PDF) estimate for the target radionuclide; a sequential likelihood ratio processor module for determining whether a sequential likelihood ratio satisfies one of two threshold conditions signifying that the EMS is either identified as the target radionuclide or as not the target radionuclide, wherein said sequential likelihood ratio is based on a previous sequential likelihood ratio for a previous (n−1)th photon event, the sum of all updated measured PDF estimates produced in all the monoenergy channels, and the sum of all a-priori PDF estimates which are produced in parallel with the updated measured PDF estimates and based on expected amplitude level and interarrival time values of the target radionuclide, wherein upon determining that one of the two threshold conditions is satisfied the sequential likelihood processor provides notification of the corresponding result; and a channel input module for providing the set of parallel monoenergy processing channels with a next (n+1)th photon event and its energy amplitude-interarrival time parameter pair values for processing until the sequential likelihood ratio processor module determines that one of the two threshold conditions is satisfied.





BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated into and form a part of the disclosure, are as follows.



FIG. 1 shows a schematic view of an overall radiation detection and signal processing model, illustrating gamma-ray evolution and measurement, and including the radionuclide source (EMS), medium transport (physics), detector material interaction, detector temporal response (pre-amplification/pulse shaping) and ADC conversion with quantization noise.



FIG. 2 shows a schematic view of gamma-ray evolution from a monoenergetic source, a scattering/transport medium, and a detector, and detector response function.



FIG. 3 shows the monoenergetic source decomposition: individual constituent EMS and ideal composite-free EMS.



FIG. 4 shows the Bayesian channel processing for radionuclide detection/classification including: energy/interarrival (rate) discrimination, parameter estimation (LKF and PF), probability density function (PDF) estimation and classification.



FIG. 5 shows the Bayesian radiation detection channel details, acquisition, preprocessing (MBP), energy/rate discrimination and classification.



FIG. 6 shows the Bayesian radiation detection parallel/distributed processing.



FIG. 7 shows the Bayesian model-based processing for 137Cs radionuclide zero-mean, whiteness testing: (a) Photon interarrival estimator (PF) (b) Zero-mealy whiteness testing (8.3×10−4<3.1×10−2)/4% out).



FIG. 8 shows the Bayesian model-based processing for 137Cs radionuclide: (a) Photon energy amplitude levels estimates. (b) Zero-mean/whiteness testing (8.7×10−19<3.1×10−2)/0.1% out).



FIG. 9 shows the results of Bayesian parameter estimation for 133Ba,137Cs, 60Co radionuclides: (a) PHS estimation using high precision HGe commercial detector. (b) Parallel/distributed Bayesian processor using LKF and PF parameter estimators.



FIG. 10 shows the overall structure of the sequential Bayesian radionuclide detection technique (log-likelihood).



FIG. 11 shows the conceptual implementation of the sequential Bayesian radionuclide detection technique. As each individual photon is extracted, it is discriminated, estimated, the decision function (log-likelihood) calculated and compared to a threshold to “decide” if the threat radionuclide is present.





DETAILED DESCRIPTION

The present invention relates to a sequential radionuclide detection method and system for detecting and identifying radioactive contraband from highly uncertain (noisy) low-count, radionuclide measurements using a statistical approach based on Bayesian inference, and incorporating physics-based statistical models of the emissions, transport, and measurement processes that capture the essence of this radiation detection problem. In particular, the method and system of the present invention models the source radionuclides by decomposing them uniquely as a superposition (union) of monoenergetic sources that are then smeared and distorted as they are transported through the usual path to the detector for measurement and counting as illustrated in FIG. 2. The measured data consists of a low energy count, impulsive-like, time series measurements (energy vs. time) in the form of an event mode sequence (EMS) obtained from pulse shaping circuitry [2]. The problems of interest are then defined in terms of this unique, orthogonal representation in which solutions based on extracting this characterization from uncertain detector measurements can be postulated. The inclusion of a basic radionuclide representation as a monoenergetic decomposition of photons at given energy levels or amplitudes along with interarrival times is used to extract the physics information available from the uncertain measurements. Not only does this decomposition lead to a “physics-based” structure that can be used to develop an effective detection technique, but it also leads to the implementation this approach using advanced signal processing methodologies such as sequential Monte Carlo processors or equivalently particle filters to enhance and extract the required information. Starting with this physics-based representation of nuclides as a monoenergetic decomposition, a Bayesian probabilistic framework is developed to theoretically define and solve the problem. The key idea is to process the data, photon-by-photon, rejecting any extraneous non-targeted radionuclide measurements and processing only those that correspond to the target contraband. As described herein, the present invention pertained only to photo-peaks, with Compton scattered photons being rejected. In general, the Bayesian approach-based framework of the present invention is applicable to many other problems of national security interests, other than radionuclide detection. By posing such problems within this statistical framework the detection method of the present invention may also potentially be used in the detection in weapons of mass destruction (biological, chemical, nuclear) detection (i.e. are they present?), classification (i.e. if present, what are they?), and identification/estimation (i.e. how much of each?).


In Section A., development of the physics-based signal processing models employed in the subsequent Bayesian constructs is described. In particular, the monoenergetic representation is first modeled, followed by more of the instrumentation and noise into the measurement model. Based on this representation the overall probabilistic design is described in Section B. illustrating how the sequential Bayesian detector design evolves naturally from the underlying source physics. In Section C. a preferred embodiment of the signal processing solution of the present invention to the processing problem is described as well as a sequential detection and classification scheme. Section D is the Appendix including the statistics of EMS, and particle filtering. And Section F are the References incorporated by reference herein.


A. PHYSICS-BASED PROCESSING MODELS

As a preliminary matter, it is well-known that a particular radionuclide can be uniquely characterized by two basic parameters: its energy amplitude levels emitted in the form of photons or gamma-rays (γ-rays) and its radioactive decay rate which is directly related to its arrival time [2]. Knowledge of one or both of these parameters provides a unique representation of a radionuclide. Mathematically, we define the pair, [{εm}, {λm}], as the respective energy level (MeV) and decay rate (probability of disintegration/nuclei/sec) of the mth-component of the elemental radionuclide. Although either of these parameters can be used to uniquely characterize a radionuclide, only one is actually necessary—unless there is uncertainty in extracting the parameter.


The present invention uses statistical models of both emission and measurement processes that can effectively be used in the Bayesian framework. The underlying probability distributions of photon events describe the physics of the radiation transport between the source and the detector. Furthermore, these stochastic models of the physical process must incorporate the loss of information resulting from the absorption of energy between an ideal source and the detector.


Semiconductor (high purity germanium or sodium iodide) energy detectors are designed to measure the γ-ray energy from the electron current induced by the energy deposition of the incoming photons in the detector material. A typical detector is plagued with a variety of extraneous measurement uncertainties that create inaccuracy and spreading of the measured current impulse (and therefore γ-ray energy). The evolution of a γ-ray as it is transported through the medium and interacts with materials, shield and the detector is shown in FIG. 2. It is important to realize that in the diagram, the source radionuclide can be represented by its constituents in terms of monoenergetic (constant energy amplitude) components and arrival times as ξ(εm, τm). Since this representation of the source radionuclide contains the constituent energy amplitude levels and timing, then all of the information is completely captured by the sets, [{εm, {τm}], m=1, . . . Mε. The source arrivals can be used to extract the corresponding set of decay constants, {λm} which are related [2]. Thus, from the detector measurement of the individual photon arrivals or equivalently the entire EMS, a particular radionuclide can be uniquely characterized. The constituent energy amplitude levels, {εm} and arrival times, {τm} extracted from the EMS are depicted infix. 3 where we show the union (superposition) of each of the individual constituent monoenergetic sequences composing the complete radionuclide FMS. Note that there is no overlapping of arrivals—a highly improbable event.


So we see that the signal processing model developed from the evolution of the γ-ray as it is transported and deposited in the detector semiconductor material is measured and evolves as a distorted EMS. With these parameters, most threat radionuclides and their corresponding composition are well-known and can be applied in a variety of problem formulations. Thus, we are taking a model-based approach based on Bayesian inference to solve a suite of radiation detection problems, that is, the estimation of the underlying posterior probability distribution governing the γ-ray emission process in terms of the individual models and parameters.


A.1. Event Mode Sequence


A more detailed mathematical representation of the event mode sequence is developed here in terms of its monoenergetic decomposition. From this decomposition, the basic signal processing model is then developed in terms of the random processes that govern its evolution. We start with a single γ-ray or photon arrival and then incorporate a set of monoenergetic source components that uniquely characterize the complete radionuclide. Finally we expand the model to a full emission sequence from the radionuclide source.


Define ξ(n;εmm) as the component of an EMS sequence as the nth-arrival from the mth-monoenergetic source of energy level (amplitude), εm(n) and arrival time, τm(n) with associated decay rate λm (n)—as a single photon impulse sample, that is,

ξ(n;εmm)=εm(n)δ(t−τm(n)) and source rate λm(n)  (1)


The ideal FMS is composed of sets of energy-arrival sample pairs, {εm(n),τm(n)}. We could visualize this energy exchange as a photon depositing its energy in the detector material and the pair of unique energy-arrival parameters being extracted by the measurement system.


In order to define the entire emission sequence over a specified time interval, [to, Y), we introduce the set notation, {tilde over (τ)}m:={τm(1) . . . τm(Nε(m))} at the nth-arrival with Nε(ii) the total number of counts for the mth-source in the interval. Therefore, ξ(n;εm,{tilde over (τ)}m) results in a unequally-spaced impulse train given by (see FIG. 3)











ξ


(


n
;

ɛ
m


,


τ
~

m


)


=





n
=
1



N
ɛ



(
m
)





ξ


(


n
;


ɛ
m



(
n
)



,


τ
m



(
n
)



)



=




n
=
1



N
ɛ



(
m
)







ɛ
m



(
n
)




δ


(

t
-


τ
m



(
n
)



)
















at





rate







λ
m



(
n
)







(
2
)







The interarrival time is defined by custom characterτm(n)=τm(n)−τm(n−1) for custom characterτm(0)=to with the corresponding set definition (above) of custom character{tilde over (τ)}m(n). Using this definition, we can rewrite the EMS in terms of interarrivals just as easily as arrival times, that is,











ξ


(


n
;

ɛ
m


,





τ
~

m



)


=





n
=
1



N
ɛ



(
m
)





ξ


(


n
;


ɛ
m



(
n
)



,


•τ
m



(
n
)



)



=




n
=
1



N
ɛ



(
m
)







ɛ
m



(
n
)




δ


(

t
-


•τ
m



(
n
)



)
















and





rate







λ
m



(
n
)







(
3
)








for to known. Again note that both τm(n) and custom characterτm(n) are unequally-spaced.


We summarize the monoenergetic source representation of a radionuclide source characterized by its unique set of energy/interarrival pairs, {εm,custom characterτm} (or equivalently as its energy/decay rate pairs, {εmm})










ξ


(


n
;

ɛ
m


,





τ
~

m



)


=




n
=
1



N
ɛ



(
m
)







ɛ
m



(
n
)




δ


(

t
-


•τ
m



(
n
)



)







and





rate







λ
m



(
n
)








(
4
)








Let us extend this EMS model from a single monoenergetic representation to incorporate a set of Mε-monoenergetic sources that compose a complete source radionuclide. Suppose we have a radionuclide source whose EMS is decomposed into its Mε-monoenergetic source components, ξ(n;ε,custom characterτ). From the composition of the EMS we know that










ξ


(


n
;
ɛ

,




τ
~



)


=





m
=
1


M
ɛ




ξ


(


n
;

ɛ
m


,





τ
~

m



)








m
=
1


M
ɛ




ξ


(


n
;

ɛ
m


,





τ
~

m



)








(
5
)








where the last equivalence results from the pragmatic assumption that it is highly improbable that any two arrival will overlap. Thus it follows from Eq. 1 that a complete radionuclide can be represented in terms of its monoenergetic decomposition as











R
η



(


n
;

ɛ
_


,




τ
_



)


=





m
=
1


M
ɛ







n
=
1



N
ɛ



(
m
)





ξ


(


n
;


ɛ
m



(
n
)



,


•τ
m



(
n
)



)




=




m
=
1


M
ɛ







n
=
1



N
ɛ



(
m
)







ɛ
m



(
n
)




δ


(

t
-


•τ
m



(
n
)



)










(
6
)







We summarize the EMS monoenergetic source representation (using the previous definitions of Eq. 4) as:











R
η



(


n
;

ɛ
_


,




τ
_



)


=




m
=
1


M
ɛ







n
=
1



N
ɛ



(
m
)







ɛ
m



(
n
)




δ


(

t
-


•τ
m



(
n
)



)









(
7
)








where


Rη(n;ε,custom characterτ) is the composite EMS of the radionuclide

    • Mε is the number of monoenergetic source components in the composite EMS
  • Nε(m) is the number (counts) of arrivals from the mth-monoenergetic source component in the time-interval, [to,T)
    • εm(n) is the nth-arrival of γ-ray energy (amplitude) level of the mth-monoenergetic component in the time-interval of the composite EMS
    • custom characterτm(n) is the nth interarrival time of the mth-monoenergetic component in the time interval of the composite EMS


Of course, this representation can be extended even further to capture a set of radionuclides. If we account for this set, that is,

Rη(n;ε,custom characterτ)→Rηl(n;ε,custom characterτ) for l=1, . . . ,LR

Then this characterization implies the following changes to other critical components as:

ξml(t)→ξm(t);εm→εml;custom characterτml;and Mε→Mεl

therefore, we have that Eq. 7 becomes











R
η



(


n
;

ɛ
_


,




τ
_



)


=





l
=
1


L
R





R

η
l




(


n
;

ɛ
_


,




τ
_



)



=




l
=
1


L
R







m
=
1


M

ɛ
l








n
=
1



N
ɛ



(
ml
)







ɛ
ml



(
n
)




δ


(

t
-


•τ
ml



(
n
)



)











(
8
)







So we see that an entire set of radionuclides can be decomposed as:

Rη(n;ε,custom characterτ)→{Rηl(n;ε,custom characterτ)}→{ξ(n;εml(n),custom characterτml(n))}→{εml(n),Δτml(n)}


This unique physics-based representation provides the basis to develop signal models for subsequent processing. The underlying statistics of the EMS are discussed in Appendix A. Next we consider the measurement of the EMS along with its inherent uncertainties.


A.2. Detector Measurements


Using the mathematical description of the EMS in terms of its monoenergetic source decomposition model discussed previously, we show how this ideal representation must be modified because of the distortion and smearing effects that occur as the γ-rays propagate according to the transport physics of the radiation process.


In our modeling we will only consider the pulse-mode of detector (semiconductor) operation, which is the most common employed in γ-ray detection, since both amplitude and arrivals are measured [2]. Amplitude variations are typically expressed in terms of the differential pulse height (amplitude) distribution which is a direct representation of the uncertainty in measuring the energy level. This distribution is commonly called the detector response function [2] and can be modeled in terms of our monoenergetic source amplitude (energy amplitude level). Here the detector response characterizes the energy deposited in the detector material scaled to produce the equivalent charge (current) at the pulse amplifier input.


The basic construct of a γ-ray detector starts with the material selected. We concentrate on semiconductor materials, primarily Ge and SiI; therefore, the applications discussed are based on these materials focusing on Ge, since it provides the most outstanding performance enabling us to upper bound our results. The spectrometer measurement device is generally constructed to provide a histogram or equivalently spectrum of the counts (probability) versus γ-ray energy and has heavily been depended upon for detection of threat materials and devices.


As the γ-rays penetrate the Ge material interaction energy from the detector material is converted from a charge or current pulse to a voltage pulse (ν=q/C) that is then conditioned, amplified, quantized and ultimately converted to an equivalent voltage to extract the required energy count and timing information. Uncertainties created by the detector material and the γ-ray interaction process are influential in characterizing the overall energy resolution (custom characterε) capability. Typically, these are quantified in terms of γ-ray spectral properties of energy “peak width” and “peak amplitude.” The uncertainties evolve from three factors inherent in the material and instrumentation; inherent statistical spread in the number of charge carriers, variations in the charge collection efficiency and electronic noise [2].


Next consider the uncertainties created in the associated measurement system that consists of a pre-amplifier and pulse shaping circuit. The pre-amplifier amplifies the amplitude of the collected detector current preserving its relationship to the photon deposition energy—this is where the actual energy physics is transformed into electrical signals. The output of the pre-amplifier carries not only the quantified γ-ray energy amplitude information (εm) enabling a single event mode impulse characterization associated with the monoenergetic decomposition, but also the arrival time (τm) used for the detector timing circuits (gating pulses, logic pulses, etc.). This information is then converted to a Gaussian-shaped pulse in order to extract the photon energy amplitude and timing information (arrival times, interarrival times, etc.)—a very clever ADC system. Note, however, that the actual “physics” (charge vs. time) is preserved at the output of the pre-amplifier not at the output of the shaper, since it basically gives a digitized version of {εmm}—the EMS or so-called “list” mode [2]. Thus, the pulse shaping circuitry transforms the “raw” charging current and shapes it into a Gaussian pulse [2]. Once the Gaussian pulse is created, the critical EMS parameters, [{εm},{τm}], can be extracted for further analysis and processing (energy histogram). There are a wide variety of pulse shaping circuits both active and passive that can be applied to this problem [2]; however, the most popular is the Gaussian pulse shaper.


Timing is a critical issue especially if we are interested in extracting decay rates accurately. Timing resolution is limited by two dominant factors: collection process time and random pulse shapes [2]. Collection process time is the time to collect the charge from the material after the γ-ray interaction. It is slow (100 ns in Ge) increasing the rise time of the pulse shaper. Pulse shape (rise) differs substantially in Ge detectors especially from pulse-to-pulse (event-to-event) creating large leading edge variations of the pulse [2]. This variation creates uncertainty, say jitter, in most timing circuits.


Next we define a signal processing model that captures the major characteristics of a solid state detector in order to subsequently formulate the model-based approach to the radiation detection problem. Consider the diagram again of the overall detector system shown in FIG. 1. Here we see how the photon is transported to the detector and interacts with its material (scattering and attenuation) creating a charge and then passes onto pulse shaping electronics that are contaminated with random instrumentation noise followed by the quantization to produce the noisy output. The γ-ray interacts with the solid state material and a charge is created proportional to its energy. We model this pre-amplifier output as random created by the intrinsic material property uncertainties in the form of the unknown number of charge carriers and charge collection efficiency (process noise). We lump the material uncertainties into an additive noise process. Thus, the measured nth-interarrival of the mth-monoenergetic component can be characterized by

pm(n)=ξ(n;εm,custom character{tilde over (τ)}m)+wcustom characterτm(n)=εm(n)δ(t−custom characterτm(n))+wcustom characterτm(n)  (9)

where the uncertain energy amplitude level is assumed Gaussian, ε custom character N ( εmεm2), with inherent uncertainty representing the material charge collection process time “jitter” by the additive zero-mean, Gaussian noise,







w

•τ
m











N
(






τ
_

i


,

σ

w

•τ
m


2


)

.






Next we investigate the use of these models in Bayesian processor designs.


B. BAYESIAN DETECTOR DESIGN

In this section we discuss the physics-motivated design of a Bayesian detector of the present invention for the radiation detection problem based on extracting the critical radionuclide parameters from the EMS using the monoenergetic physics and detector measurement models developed in the previous section. Since our goal is for a real-time system, we process each photon arrival individually requiring a “sequential” processor. First we discuss the overall structure of the algorithm motivated by the photon transport and detector measurements. We briefly discuss the development of the underlying theory and mathematics for the implementation of the sequential Bayesian processor. The main idea is to develop the device from a “bottoms-up” approach in which we process each photon individually as it is collected rather than wait for an entire EMS to be gathered. This concept is typical of the usual data acquisition techniques and enables sequential processing. After the single photon is processed by the acquisition system, the extracted parameters are enhanced and passed onto the energy/rate discriminators to “decide” on the photon's status (line/rate, Compton, reject). If acceptable, the probability density function estimates are sequentially updated and provided as input to the radionuclide detector.


Since we know all of the measurement data and required parameters evolve from the EMS, we are in search of an estimator and inherent structure that enables us to “decide” when a particular target radionuclide is present or not. We start with estimating the posterior distribution (or its equivalent) from the uncertain data, that is,

Pr(Rη(n;ε,custom characterτ)|Ξn)custom characterPr(ε,custom characterτ)|Ξn)

for ε:={ε1(n), . . . , εMε(n)}, the set of complete energy amplitude levels composing Rη along with custom characterτ:={custom characterτ1(n), . . . , custom characterτMε(n)}, the corresponding set of interarrival times with Ξn:={ξ(1), . . . ,ξ(n)}, the set of EMS measurements including the nth-interarrival.


Unfortunately, the basic radionuclide physics is more complicated, since the emission of monoenergetic photons follows a well-defined probability structure, that is, all monoenergetic photons are not present in the EMS during an individual event (single photon arrival) only one of the energy amplitude levels is present as dictated by its probability of occurrence (αi) associated with its inherent structure as specified in its energy decay diagram [2]. Therefore, we model this decay structure by a Markov chain model incorporating an indicator function defined by:








I
j



(
m
)


=

{



1



m
=
j





0



m

j










where Ij(m) is a random variable such that Pr(Ij(m)=1)=αj and αj is the corresponding probability of occurrence of the jth-monoenergetic RN component.


Motivated by this additional physics information based on the energy level diagrams of various radionuclides [2], we can model the radionuclide by its monoenergetic decomposition embedding the corresponding indicator function, Ij(m), such that











R
η



(


n
;

ɛ
_


,

Δ


τ
_



)


=




m
=
1


M
ɛ







n
=
1



N
ɛ



(
m
)







I
j



(
m
)





ɛ
m



(
n
)




δ


(

t
-


Δτ
m



(
n
)



)









(
10
)








and therefore, for the jth-monoenergetic source we have











ξ


(


n
;

ɛ
m


,

Δτ
m


)






m

j



=




n
=
1



N
ɛ



(
j
)







ɛ
j



(
n
)




δ


(

t
-


Δτ
j



(
n
)



)








(
11
)







With this in mind, the required radionuclide posterior distribution can be decomposed in terms of each arrival pair (εj(n), custom characterτj(n)) along with its associated probability of occurrence, αj, that is,

Pr(Rη(n;ε,custom characterτn)=Pr(ε(n),custom characterτ(n),Ij(m)|Ξn)  (12)

Applying Bayes' rule we obtain













Pr


(



R
η



(


n
;

ɛ
_


,




τ
_



)




Ξ
n


)


=




Pr


(







τ
_



(
n
)






ɛ
_



(
n
)



,


I
j



(
m
)


,

Ξ
n


)


×










Pr


(



ɛ
_



(
n
)


,



I
j



(
m
)




Ξ
n



)








=




Pr


(







τ
_



(
n
)






ɛ
_



(
n
)



,


I
j



(
m
)


,

Ξ
n


)


×











Pr


(




ɛ
_



(
n
)





I
j



(
m
)



,

Ξ
n


)


×










Pr


(



I
j



(
m
)




Ξ
n


)









(
13
)







For an individual photon arrival and therefore the corresponding energy-interarrival pair, we have only one monoenergetic source amplitude level, say the jth, occurring according to the probability law, αj; the corresponding probability is

Pr(Rη(n;εj,custom characterτj)|Ξn)→αj×Prj(n),custom characterτj(n)|Ξn)  (14)

which can be decomposed further using Eq. 13 to give

Pr(Rη(n;εi,custom characterτi)|Ξn)→αj×Pr(custom characterτj(n)|εj(n),ΞnPrj(n)|Ξn)  (15)


The posterior radionuclide probability can be estimated photon-by-photon and therefore evolves to the following processor:

    • 1. Given the “truth”: [{αm}, {εm}, {custom characterτm}]; m=1, . . . , Mε (from Tables);
    • 2. Determine the jth-monoenergetic component with Pr(Ij(m)=1)=αj, decide which energy-interarrival pair (εj, custom characterτj);
    • 3. Given m=j and the data Ξn, estimate the energy amplitude distribution: Pr(εj(n)|Ξn);
    • 4. Given εj(n) and the data Ξn, estimate the interarrival distribution: Pr(custom characterτj(n)|εj(n), Ξn);
    • 5. Update the radionuclide posterior distribution Pr(Rη(n;εj, custom characterτj)|Ξn) using Eq. 13; and
    • 6. Decide if this estimated mixture “matches” the target radionuclide distribution.


It is the joint relation of Eq. 13 that motivates the design of the processor. We note first that in this construct the interarrival times are conditioned on the energy amplitude levels and data implying that we first extract these amplitudes from the EMS. This also leads us to the required posterior on ε. Next, using the knowledge of the amplitude, we extract the corresponding interarrival. We realize that knowledge that this parameter is not the actual radionuclide source value, since it has been transported to the detector. However, for the same monoenergetic photon these values will be identical enabling us to “time-tag” the correct photon while allowing us to reject those that have been “down-scattered” from higher energies. So we see based on these conditions and motivated by the physics as well as the structure of the joint posterior we: (1) first detect the energy amplitudes and estimate (extract) their values from the EMS; and (2) then detect/extract the corresponding interarrival times.



FIG. 5 shows an exemplary embodiment of a single photon channel processor of the present invention for line/rate detection after the acquisition and pre-processing steps are performed along with a pulse-height spectrum (PHS) estimate (not required). Simple energy amplitude level and rate detectors are first performed to determine the status (accept or reject) of the processed photon—these discriminators implement the indicator function discussed previously. If acceptable, it is used to estimate the required posterior distribution for radionuclide detection.


Summarizing, we started with the objective of capturing the joint posterior probability distribution of a radionuclide for detection and then perform the required decompositions to characterize a potential sequential processor design. Again the design is completely driven by the idea of extracting the monoenergetic EMS from the measured data. We can accomplish this, sequentially, by individual photon processing on arrival. Therefore, we first uniquely defined an individual radionuclide by its set of monoenergetic parameters along with its corresponding probability distribution from its associated energy level diagram. We note that each energy amplitude level, interarrival time and associated rate parameter are independent of any of the other monoenergetic lines composing the radionuclide implying that the processor should first detect the energy amplitudes associated with the radionuclide mixture and then once detected should detect the interarrival time (rate parameter) or time-tag for that particular monoenergetic source from its corresponding interarrival times. These concepts then lead to a parallel/distributed structure illustrated in the diagram of FIG. 6.


After the photon is processed by a model-based physics processor using a sequential Bayesian technique the distributed detector: (1) discriminates the individual monoenergetic amplitudes identifying one of the parallel channels; (2) discriminates the corresponding rate parameter for that particular channel is then detected using the corresponding interarrival times available and confirming the monoenergetic source detection from two parameters rather than one amplitude parameter; (3) the particular amplitude and rate parameters are then estimated along with the corresponding distributions enabling the estimation of the radionuclide posterior; and (4) detection is performed.


The entire parallel/distributed processor structure is shown in FIG. 6. There are some interesting features and by-products of this design:

    • Incorporates an inherent distributed structure that evolves from the physics (monoenergetic decomposition);
    • Each photon is sequentially processed one-by-one on deposition in the detector material;
    • Only one energy amplitude level and rate parameter are detected per photon (single channel);
    • If no detection for a given photon is achieved, the photon is discarded (not used) mitigating false positive detections of radionuclides;
    • Bayesian classification is accomplished using the estimated joint probability distributions (after the channel detection is confirmed);
    • Other physics properties can be incorporated, if another distributed (parallel) bank of rate detectors are employed providing a means of detecting corresponding Compton photons and incorporating them into the estimated monoenergetic probability distributions, that is, they can be counted, since they are really a scattered monoenergetic photon;
    • Scattered photons from higher energy gamma-rays can be eliminated from the distribution using rate parameter discrimination;
    • Background photons are automatically rejected, since they are not identified with and monoenergetic channel; and
    • Parallel implementation of the processor (invention) is easily implemented enabling a potential real-time application due to the distributed structure.


To summarize, we are essentially implementing the monoenergetic decomposition using discriminators to “decide” which threat energy amplitude level/rate channel the photon belongs to or rejecting it completely if no such channel indicates a valid detection. In this way we are able to simplify such tools as the pulse-height spectrum for energy-line amplitude discrimination and improve overall threat detection performance. This completes the conceptual design of the Bayesian processor for radionuclide detection, next we develop the various components of the processor for implementation.


C. SEQUENTIAL BAYESIAN RADIATION DETECTION

In this section, we develop the Bayesian framework and individual components of the processor. Thus, we see that the overall system diagram of the process follows through the various operations of the component subsystems dictated by the physics and instrumentation. Mathematically, we see that the original γ-ray transport has evolved from the simple monoenergetic representation of Eq. 3 in terms of precise weighted impulses and interarrivals to be distorted and smeared by the detector physics and processing. We see that the intrinsic scattering and attenuation in the detector material can reduce the number of electrons that are thresholded by the detector electronics for counting. The energy level is distorted by the detector response and the timing by jitter and delay-time. This uncertain EMS propagates to the shaping electronics in which uncertainties of the impulse events are smeared and spread by the Gaussian filtering process.


For our radiation detection problem we are utilizing two-levels of energy and interarrival time (rate) detection. The first level consists of an acceptance/rejection of the photon for further processing based on simple hypotheses tests of its energy amplitude level followed by interarrival time testing. Since we are interested in the radionuclide detection problem, we have a-priori information available about the targeted radionuclide(s) such as expected energy line amplitude, probability of occurrence of that line and rates. We can use this information to implement a “discrimination” or pre-conditioning step that essentially “filters” each photon as it is collected and compares its amplitude to the a-priori line amplitude expected (theoretically). It is then processed further to make a more definitive decision. With the energy amplitude processed in the appropriate channel (see FIG. 5), the rate or equivalently interarrival time is processed to “decide” if this parameter corresponds to the targeted radionuclide, that is, we “time-tag” each photon with its measured interarrival time. If it is accepted, then both the raw energy amplitude and interarrival time are processed to improve the quality of their point estimates and specify the underlying probability distribution. This estimator incorporate the a-priori information about the initial parameters, noise and any other statistics available to extract an improved estimate, say {ε(n),custom characterτ(n)}→{{circumflex over (ε)}(n),custom character{circumflex over (τ)}(n)} at the nth-arrival. The estimates are then provided as inputs to a sequential Bayesian detection technique to further assure that the photon emanated from the targeted source. Upon acceptance, the improved estimates {{circumflex over (ε)}(n), custom character{circumflex over (τ)}(n)} are used to estimate the required conditional distributions used for classification. We first start with the basic sequential detection problem and then incorporate the required probability distributions for this problem.


To formally pose this problem, we appeal to classical (sequential) detection theory. We are to test the binary hypothesis that the measured EMS sequence has evolved from the targeted radionuclide (RN) characterized uniquely from the monoenergetic decomposition of Eq. 7. Therefore, we specify the hypothesis test

H0:ξ(n;ετ)=Rη(n;ε0τ0)+ν(n) [TARGET RN]
H1:ξ(n;ετ)=Rη(n;ετ)+ν(n) [NON-TARGET RN]  (16)

where Rη(n; ετ) is a random composite EMS contaminated with zero-mean, Gaussian measurement (instrumentation) noise, ν˜N(0,σν2) corresponding to the monoenergetic decomposition we have the “random” parametric model











R
η



(


n
;

ɛ
_


,

Δ


τ
_



)


=




m
=
1


M
ɛ







n
=
1



N
ɛ



(
m
)







I
j



(
m
)





ɛ
m



(
n
)




δ


(

t
-


Δτ
m



(
n
)



)









(
17
)








for εm˜N( εmεm2) and Δτm˜E(λΔτmΔτm(n)).


The optimal solution to this binary decision problem is based on applying the Neyman-Pearson theorem leading to the likelihood ratio [25] and is given by the ratio of probabilities










L


[

Ξ
N

]


:=



xPr


(


Ξ
N

|

H
1


)



Pr


(


Ξ
N

|

H
0


)








H
1






>
T





<





H
0









(
18
)








where ΞN:={ξ(0;ε,custom characterτ), ξ(1;ε,custom characterτ), . . . , ξ(N; ε, custom characterτ)} and






N
=




m
=
1


M
ɛ






N
ɛ



(
m
)


.






Expanding the likelihood ratio, we obtain










L


[

Ξ
N

]


=


Pr


(


ξ


(


0
;

ɛ
_


,

Δ


τ
_



)


,

ξ


(


1
;

ɛ
_


,

Δ


τ
_



)


,





,


ξ


(


N
;

ɛ
_


,

Δ


τ
_



)


|

H
1



)



Pr


(


ξ


(


0
;

ɛ
_


,

τ
_


)


,

ξ


(


1
;

ɛ
_


,

Δ


τ
_



)


,





,


ξ


(


N
;

ɛ
_


,

Δ


τ
_



)


|

H
0



)







(
19
)








but from the chain rule of probability, we have that

PrN|Hi)=Pr(ξ(N;ετ)|ΞN-1,Hi)× . . . ×Pr(ξ(1;ετ)|ξ(0;ε;Δu),HiPr(ξ(0;ετ)|Hi)  (20)

which can be expressed succinctly using Bayes' rule as

PrN|Hi)=Pr(ξ(N;ετ),ΞN-1|Hi)=Pr(ξ(N;ετ)|ΞN-1,HiPrN-1|Hi)  (21)


Substituting these expressions into the likelihood ratio of Eq. 18, replacing N→n and grouping we obtain










L


[

Ξ
n

]


=


[


Pr


(


Ξ

n
-
1


|

H
1


)



Pr


(


Ξ

n
-
1


|

H
0


)



]

×


Pr


(



ξ


(


n
;

ɛ
_


,




τ
_



)


|

Ξ

n
-
1



,

H
1


)



Pr


(



ξ


(


n
;

ɛ
_


,

Δ


τ
_



)


|

Ξ

n
-
1



,

H
0


)








(
22
)








and therefore, we have the recursion or equivalently sequential likelihood ratio for the nth arrival as










L


[

Ξ
n

]


=


L


[

Ξ

n
-
1


]


×


Pr


(



ξ


(


n
;

ɛ
_


,




τ
_



)


|

Ξ

n
-
1



,

H
1


)



Pr


(



ξ


(


n
;

ɛ
_


,




τ
_



)


|

Ξ

n
-
1



,

H
0


)








(
23
)







The corresponding Wald or sequential probability ratio test is then given by:













L


[

Ξ
n

]





T
1



(
n
)






Accept






H
1









T
0



(
n
)




L


[

Ξ
n

]





T
1



(
n
)





Continue






L


[

Ξ
n

]





T
0



(
n
)






Accept












H
0








(
24
)








where the thresholds are specified in terms of the false alarm (PFA) and miss (PM) probabilities as








T
0



(
n
)


=



P
M



(
n
)




P
FA



(
n
)











T
1



(
n
)


=


1
-


P
M



(
n
)





P
FA



(
n
)







If the distributions under investigation are members of the exponential family then taking logarithms can simply the computations We define Λ[Ξn]:=ln L[Ξn] to obtain the sequential log-likelihood

Λ[Ξn]=Λ[Ξn-1)]+ln Pr(ξ(n;ετ)|Ξn-1,H1)−ln Pr(ξ(n;ετ)|Ξn-1,H0)  (25)

and therefore, the corresponding test becomes













Λ


[

Ξ
n

]




ln







T
1



(
n
)







Accept






H
1








ln







T
0



(
n
)





Λ


[

Ξ
n

]




ln







T
1



(
n
)






Continue






Λ


[

Ξ
n

]




ln







T
0



(
n
)







Accept












H
0








(
26
)







So we see that at each photon arrival (at time n), we sequentially update the likelihood and thresholds to perform the detection—“photon-by-photon”.


To implement the sequential detector, we must specify the required distributions; therefore, we have

Pr(ξ(n;ε,custom characterτ)|Ξn-1,Hl)=Pr(Rη(n;ε,custom characterτ,Ij(m)|Ξn-1,Hl)+Pr(ν(n)|Ξn-1,Hl)  (27)

for the hypotheses is specified by Hl; l=0, 1.


Using the radionuclide model, we obtain

Pr(ξ(n;ε,custom characterτ)|Ξn-1,Hl)=Pr(ε(n),custom characterτ(n),Ij(m)|Ξn-1,Hl)+Pr(ν(n)|Ξn-1,Hl)  (28)


Applying Bayes' rule, we obtain the decomposition (as before)

Pr(ξ(n;ε,custom characterτ)|Ξn-1,Hl)=Pr(custom characterτ(n),Ij(m),Ξn-1,HlPr(ε(n)|Ij(m),Ξn-1,HlPr(Ij(m)|Ξn-1,Hl)+Pr(ν(n)|Ξn-1,Hl)  (29)


Decomposing the parameter vectors using the fact that each arrival has “no memory” and applying the chain rule of probability, we obtain











Pr


(







τ
_



(
n
)



|


ɛ
_



(
n
)



,


I
j



(
m
)


,

Ξ

n
-
1


,

H
l


)


=




m
=
1


M
ɛ








Pr


(




•τ
m



(
n
)


|


ɛ
m



(
n
)



,


I
j



(
m
)


,

Ξ

n
-
1


,

H
l


)











Pr


(



ɛ
_



(
n
)


,



I
j



(
m
)


|

Ξ

n
-
1



,

H
l


)


=




m
=
1


M
ɛ









Pr


(




ɛ
m



(
n
)


|


I
j



(
m
)



,

Ξ

n
-
1


,

H
l


)


×

Pr


(



I
j



(
m
)


|

Ξ

n
-
1



)









(
30
)








and therefore, we have










Pr


(



ξ


(


n
;

ɛ
_


,




τ
_



)


|

Ξ

n
-
1



,

H
l


)


=





m
=
1


M
ɛ









Pr


(




•τ
m



(
n
)


|


ɛ
m



(
n
)



,


I
j



(
m
)


,

Ξ

n
-
1


,

H
l


)


×

Pr


(




ɛ
m



(
n
)


|


I
j



(
m
)



,

Ξ

n
-
1


,

H
l


)


×

Pr


(




I
j



(
m
)


|

Ξ

n
-
1



,

H
l


)




+

Pr


(



v


(
n
)


|

Ξ

n
-
1



,

H
l


)







(
31
)







Substituting these distributions into Eq. 23 the sequential likelihood ratio detector is










L


[

Ξ
n

]


=


L


[

Ξ

n
-
1


]


×








m
=
1


M
ɛ









Pr


(




•τ
m



(
n
)


|


ɛ
m



(
n
)



,


I
j



(
m
)


,

Ξ

n
-
1


,

H
1


)


×








Pr


(



ɛ
m



(
n
)


,



I
j



(
m
)


|

Ξ

n
-
1



,

H
1


)


+

Pr


(



v


(
n
)


|

Ξ

n
-
1



,

H
1


)













m
=
1



M
s


tlon









Pr


(




•τ
m
o



(
n
)


|


ɛ
m
o



(
n
)



,


I
j
o



(
m
)


,

Ξ

n
-
1


,

H
0


)


×








Pr


(



ɛ
m
o



(
n
)


,



I
j
o



(
m
)


|

Ξ

n
-
1



,

H
0


)


+

Pr


(



v


(
n
)


|

Ξ

n
-
1



,

H
0


)












(
32
)








where

Prm(n),Ij(m)|Ξn-1,Hl)=Prm(n)|Ij(m),Ξn-1,HlPr(Ij(m)|Ξn-1,Hl)

giving us the general form for our problem. Note that this formulation provides us with a channel-by-channel (photon-by-photon) processor, since the mth terms in both numerator and denominator are available at the output of each channel (FIG. 6)


Let us also assume that the instrumentation noise (ν(n)) is small relative to the uncertainties and ignore it in the likelihood relation, then the likelihood ratio simplifies to










L


[

Ξ
n

]


=


L


[

Ξ

n
-
1


]


×








m
=
1


M
ɛ









Pr


(




•τ
m



(
n
)


|


ɛ
m



(
n
)



,


I
j



(
m
)


,

Ξ

n
-
1


,

H
1


)


×







Pr


(



ɛ
m



(
n
)


,



I
j



(
m
)


|

Ξ

n
-
1



,

H
1


)












m
=
1


M
ɛ









Pr


(




•τ
m
o



(
n
)


|


ɛ
m
o



(
n
)



,


I
j
o



(
m
)


,

Ξ

n
-
1


,

H
0


)


×







Pr


(



ɛ
m
o



(
n
)


,



I
j
o



(
m
)


|

Ξ

n
-
1



,

H
0


)











(
33
)







Taking logarithms, we obtain the log-likelihood ratio of Eq. 25 as










Λ


[

Ξ
n

]


=


Λ


[

Ξ

n
-
1


]


+




m
=
1


M
ɛ








ln






(


Pr


(




•τ
m



(
n
)


|


ɛ
m



(
n
)



,


I
j



(
m
)


,

Ξ

n
-
1


,

H
1


)




Pr


(



ɛ
m



(
n
)


,



I
j



(
m
)


|

Ξ

n
-
1



,

H
1


)



)



-




m
=
1


M
ɛ








ln






(


Pr


(




•τ
m
o



(
n
)


|


ɛ
m
o



(
n
)



,


I
j
o



(
m
)


,

Ξ

n
-
1


,

H
0


)








Pr
(







ɛ
m
o



(
n
)


,



I
j
o



(
m
)


|

Ξ

n
-
1



,

H
0


)


)








(
34
)








but the terms inside the summation are products which can also be written as summations, after applying Bayes' rule to the last term

ln Pr(custom characterτm(n)|εm(n),Ij(m),Ξn-1,HlPrm(n),Ij(m)|Ξn-1,Hl)=ln Pr(custom characterτm(n)|εm(n),Ij(m),Xin-1,Hl)+1n Prm(n)|Ij(m),Ξn-1,Hl)+ln Pr(Ij(m)|Ξn-1,Hl)  (35)


These relations will become important in the implementation of the processor discussed subsequently.


C.1 Sequential Radiation Detection


In this section we develop the statistical models to implement the likelihood-ratio detector of Eq. 32. We start with the additive noise source, ν(n), assumed Gaussian under both hypothesis, that is,











Pr


(



v


(
n
)


|

Ξ

n
-
1



,

H
l


)










N


(

0
,

σ
v
2


)



=


1




2





π









σ
v




exp


{

-



v
2



(
n
)



2


σ
v
2




}






(
36
)







Since each individual RN is uniquely specified (statistically) by the parameter set, {ε,custom characterτ,α}, we assume that α is known for each target (from tables). Therefore, the energy amplitude level distribution and its decomposition of Eq. 30










Pr


(



ɛ
_



(
n
)


,



I
j



(
m
)


|

Ξ

n
-
1



,

H
l


)


=




m
=
1


M
ɛ









Pr


(




ɛ
m



(
n
)


|


I
j



(
m
)



,

Ξ

n
-
1


,

H
l


)


×

Pr


(




I
j



(
m
)


|

Ξ

n
-
1



,

H
l


)








(
37
)







Thus, for the jth-monoenergetic source component selected by the indicator function, Ij(m), we obtain

Prj(n),Ij(m)|Ξn-1,Hl)=αjαjPrj(n)|Ξn-1,Hl)  (38)

where we have applied Pr(Ij(m)=l|Ξn-1)=αj.


Each energy amplitude component is assumed Gaussian with corresponding distribution











Pr


(




ɛ
m



(
n
)





I
j



(
m
)



,

Ξ

n
-
1


,

H
l


)










N
(




ɛ
_

j



(
n
)


,

σ


ɛ
j



ɛ
j


2


)


=


1



2





π




σ

ɛ
j





exp


{

-



(



ɛ
j



(
n
)


-



ɛ
_

j



(
n
)



)

2


2






σ

ɛ
j

2




}






(
39
)







Finally, the interarrival times, custom characterτ, are assumed conditionally independent of both ε and Ij(m) to give










Pr


(







τ
_



(
n
)






ɛ
_



(
n
)



,


I
j



(
m
)


,

Ξ

n
-
1


,

H
l


)


=


Pr


(







τ
_



(
n
)





Ξ

n
-
1



,

H
l


)


=




m
=
1


M
ɛ








Pr


(




•τ
m



(
n
)




Ξ

n
-
1



,

H
l


)








(
40
)







Each interarrival is independent and exponentially distributed such that










Pr


(







τ
_



(
n
)





Ξ

n
-
1



,

H
l


)


=





m
=
1


M
ɛ








Pr


(




•τ
m



(
n
)




Ξ

n
-
1



,

H
l


)



=




m
=
1


M
ɛ









λ

•τ
m



exp


{


-

λ

•τ
m






•τ
m



(
n
)



}








(
41
)








for the rate λcustom characterτm=l/custom characterτm or equivalently, the reciprocal of the mean interarrival time.


For the jth-monoenergetic source component, we have

Pr(custom characterτ(n)|Ij(m),Ξn-1,Hl)custom characterEcustom characterτjcustom characterτj(n))=λcustom characterτjexp{−λcustom characterτjcustom characterτj(n)}  (42)


With these distribution models in hand, we can now construct the sequential detection algorithm starting with the required distributions as













Pr


(



ξ


(


n
;

ɛ
_


,




τ
_



)




Ξ

n
-
1



,

H
l


)


=






k
=
1


M
ɛ









Pr


(




•τ
k



(
n
)




Ξ

n
-
1



,

H
l


)


×

Pr


(




ɛ
k



(
n
)





I
j



(
m
)



,

Ξ

n
-
1


,

H
l


)







umber
×

Pr


(



I
j



(
m
)




Ξ

n
-
1



)




+


Pr


(



v


(
n
)




Ξ

n
-
1



,

H
l


)











or






Pr


(



ξ


(


n
;

ɛ
_


,




τ
_



)




Ξ

n
-
1



,

H
l


)




=




m
=
1


M
ɛ









λ

•τ
k



exp


{


-

λ

•τ
n






•τ
n



(
n
)



}

×









α
m




2





π




σ

ɛ
m





exp






{

-



(



ɛ
m



(
n
)


-



ɛ
_

m



(
n
)



)

2


2






σ

ɛ
m

2




}


+


1



2





π




σ
v




exp


{

-



v
2



(
n
)



2






σ
v
2




}






(
43
)








which leads to the sequential likelihood ratio detection processor as










L


[

Ξ
n

]


=


L


[

Ξ

n
-
1


]


×









m
=
1


M
ɛ











α
m



λ

•τ
m






2





π




σ

ɛ
m





exp


{




-

λ

•τ
m






•τ
m



(
n
)



-


(



ɛ
m



(
n
)


-



ɛ
_

m



(
n
)



)

2



2






σ

ɛ
m

2



}



+







1



2










σ
v




exp


{

-



v
2



(
n
)



2






σ
v
2




}













m
=
1


M
ɛ











α
m
o



λ

•τ
m

o





2





π




σ

ɛ
m





exp


{




-

λ

•τ
m

o





•τ
m



(
n
)



-


(



ɛ
m



(
n
)


-


ɛ
m
o



(
n
)



)

2



2






σ

ɛ
m
o

2



}



+







1



2

π




σ
v




exp


{

-



v
2



(
n
)



2






σ
v
2




}











(
44
)








for the rate







λ

•τ
m

o

=


1


•τ
m
o

_


.





As before, assuming that the instrumentation noise (ν(n)) is small relative to the uncertainties, the likelihood ratio simplifies to










L


[

Ξ
n

]


=


L


[

Ξ

n
-
1


]


×





m
=
1


M
ɛ











α
m



λ

•τ
m






2





π




σ

ɛ
m





exp


{




-

λ

•τ
m






•τ
m



(
n
)



-


(



ɛ
m



(
n
)


-



ɛ
_

m



(
n
)



)

2



2






σ

ɛ
m

2



}







m
=
1


M
ɛ











α
m
o



λ

•τ
m

o





2





π




σ

ɛ
m
o





exp


{




-

λ

•τ
m

o





•τ
m



(
n
)



-


(



ɛ
m



(
n
)


-


ɛ
m
o



(
n
)



)

2



2






σ

ɛ
m
o

2



}









(
45
)







Taking logarithms, we obtain the log-likelihood ratio of Eq. 34 as










Λ


[

Ξ
n

]


=


Λ


[

Ξ

n
-
1


]


+




m
=
1


M
ɛ




ln


(



α
m



λ

•τ
m






2





π




σ

ɛ
m




)



-

ln


(



α
m
o



λ

•τ
m

o





2





π




σ

ɛ
m
o




)


+


(


λ

•τ
m

o

-

λ

•τ
m



)




•τ
m



(
n
)



+


1
2




(




ɛ
m



(
n
)


-


ɛ
m
o



(
n
)




σ

ɛ
m
o



)

2


-


1
2




(




ɛ
m



(
n
)


-



ɛ
_

m



(
n
)




σ

ɛ
m



)

2







(
46
)







This completes the structure of the sequential Bayesian radiation detector, we will discuss the actual photon-by-photon implementation of this processor in a subsequent section.


C.2 Sequential Bayesian Parameter Estimation


In order to implement this radionuclide detection scheme described in section C.1, we must estimate the underlying parameter (amplitude and interarrival time) distributions, but before we can accomplish this we have to specify the required signal and noise models. Investigating the monoenergetic EMS decomposition of a radionuclide Rη with Mε monoenergetic source components and Ne(m) counts in the total interval of count length N, we can define an overall parameter vector by

Θ:=[ε|τ]=[ε1ε2 . . . εMε|custom characterτ1custom characterτ2 . . . custom characterτMε] for ΘεR2Mε×1

requiring 2Mε parameters to specify the unknown radionuclide. The number of arrivals counted in the interval N is Nε:=[Nε(1) . . . Nε(Mε)] such that







N
=




m
=
1


M
ɛ





N
ɛ



(
m
)




,





as before.


We assume that the energy amplitudes can be characterized by a random walk model

ε(n)=ε(n−1)+wε(n−1)  (47)

for ε, wεR2M×1 and εcustom character N( ε, Rεεcustom character N(0, Rwεwε). The measurement instrument measures both photon energy amplitude and interarrival time from the EMS, therefore, it provides the vector measurement

ξ(n):=[ξε(n)|ξcustom characterτ(n)]  (48)


We model the energy amplitude component as the level contaminated with zero-mean, Gaussian instrumentation noise such that

ξε(n)=cε(n)+νε(n)=εm(n)+νε(n)  (49)

since the scalar measurement is photon-by-photon with νεcustom character N(0, Rνενε). The measurement system vector c′ is a 1×Mε, unit row vector, that is, c′=em with a one in the mth column. Thus, our final photon energy amplitude level model is given by a Gauss-Markov representation

ε(n)=ε(n−1)+wε(n−1)
ξε(n)=cε(n)+νε(n)  (50)

with noise sources wε and νε characterized by zero-mean, multivariate Gaussian distribution with covariance matrices, Rwεwε and Rνενε, respectively and the initial states the true mean values characterizing the target RN, ε(0)custom character N( εo, Rεoεo).


Since we first discriminate the energy amplitude level to determine which channel to process it, the actual implementation requires only a scalar algorithm for the mth-monoenergetic line, that is, the monoenergetic line estimator is based on the Markovian representation as

εm(n)=εm(n−1)+wεm(n−1) for wεmcustom characterN(0,Rwεmwεm)
ξε(n)=εm(n)+νε(n) for νεcustom characterN(0,Rνενε)  (51)

with εm(0) custom character N( εm, Rεmεm). Thus, photon-by-photon processing leads to a scalar channel-y-channel implementation.


Since these characterizations are linear Gauss-Markov models, we know that the optimal Bayesian processor is the linear Kalman filter with posterior distribution given by

Prm(n)|ΞnN({circumflex over (ε)}m*n|n),{tilde over (P)}εmεm(n|n))

with conditional mean and variance specified by

{circumflex over (ε)}m(n|n)={circumflex over (ε)}m(n|n−1)+Kεm(n)em(n)
em(n)=ξε(n)−{circumflex over (ε)}m(n|n−1)
Kεm(n)={tilde over (P)}εmεm(n|n))/Remem  (52)

where {circumflex over (ε)}m(n|n) is the conditional mean estimate of the mth-energy amplitude level at arrival time n based on all of the data up to n. Next we consider the interarrival processor.


From the statistics of the EMS process, we know that the interarrival times are exponentially distributed with parameter λcustom characterτ such that custom characterτ(n)custom characterE(λcustom characterτcustom characterτ(n)) where E(λcustom characterτcustom characterτ(n))=λcustom characterτ exp(−λcustom characterτ×custom characterτ(n)). Our process model for the interarrival time is just an exponential random variable, while the underlying measurement model is this variable contaminated with exponential measurement (instrumentation) noise given by

custom characterτm(n)=wcustom characterτm(n) for wcustom characterτmcustom characterEcustom characterτmcustom characterτm(n))
ξcustom characterτ(n)=custom characterτm(n)+νcustom characterτm(n) for νcustom characterτmcustom characterEcustom characterτmνcustom characterτm(n))  (53)


The corresponding likelihood for this problem is easily obtain using the measurement model and the transformation of random variable rules to give

PrΔτ(n)|Δτ(n))=λνeνΔτ(n)-Δτ(n))  (54)


We estimate the posterior distribution using a sequential Monte Carlo approach and construct a bootstrap particle filter (see appendix for details) using the following steps:

    • Initialize: custom characterτm(0)custom characterE(custom characterτm(0)), wcustom characterτmcustom characterE(custom characterτm(0)), Wi(0)=1/Np; i=1, . . . , Np;
    • State Transition: custom characterτmi(n)=wcustom characterτmi(n) for wmicustom characterPr(wmi(n));
    • Log-Likelihood: ln C(ξcustom characterτm(n)custom characterτmi(n))=ln λν−λν×(ξcustom characterτ(n)−custom characterτ(n));
    • Weights: Wi(n)=Wi(n−1)×C(ξcustom characterτm(n)custom characterτmi(n));
    • Normalize:









W
i



(
n
)


=



W
i



(
n
)






i
=
1


N
p





W
i



(
n
)





;






    • Resample: custom character{circumflex over (τ)}mi(n)custom charactercustom characterτmi(n);











Posterior


:







Pr


(



•τ
m



(
n
)


|

Ξ
n


)



=




i
=
1


N
p






W
i



(
n
)




δ


(



ξ

•τ
m




(
n
)


-


ξ


•τ
m

t




(
n
)



)





;





and

    • MAP Estimate: custom character{circumflex over (τ)}map(n)=argmax Pr(custom characterτm(n)|Ξn).


So we see that the sequential likelihood radionuclide detector evolves from estimating the required posterior distributions which require parameter estimates of both energy line amplitude and rate (interarrival times) for implementation. We used a Rao-Blackwellization approach by partitioning the state vector into the amplitude and interarrival estimators and applying a linear Kalman filter for the Gaussian distributed amplitude and a particle filter (see Appendix B) for the exponentially distributed interarrival times (rate)—channel-by-channel. Next we investigate the design and implementation of the actual processor.


C.3 Sequential Bayesian Processor Implementation


In this section we discuss the implementation of the processor for the radionuclide detection processor following the design structure developed in Sec. B. First, we investigate the individual channel processor illustrated in FIG. 4 one for each energy amplitude/rate composing the target radionuclide.


C.3.1 Energy Amplitude Level/Interarrival (Rate) Discriminator


Based on the parallel/distributed architecture of the detector/classifier illustrated in FIG. 6, we first apply an energy amplitude discriminator to “decide” on which channel the photon should be processed and then follow it with a rate discriminator using the interarrival time “tag” to eliminate downscattered photons from higher energy photons. The discriminator used implied hypothesis testing by constructing a confidence interval about the means of the respective parameters. The energy amplitude level discriminator performs the following confidence interval test to accept or reject the photon:

tru−κασξ≦εm(n)≦εtru−κασξ]  (55)

where εtru is the true (channel) energy amplitude associated with the targeted (for detection) radionuclide, ξε(n) is the raw EMS photon arrival amplitude level measurement, κα is the respective confidence coefficient with associated confidence level α and σξ is the associated standard deviation associated with the precision of the measurement instrument. When the photon amplitude is accepted as belonging to the mth-channel, then ξilonm→εm(n) and the interarrival measurement time-tag is tested similarly for validity by the following confidence interval discriminator. (Note that for large n, the estimate is approximately Gaussian, custom character{circumflex over (τ)}custom character N(λ, λ/√{square root over (n)}))

[custom characterτtru−κασcustom characterτcustom character{circumflex over (τ)}m(n)≦custom characterτtru−κασcustom characterτ]  (56)

where custom characterτtru is the true (channel) interarrival amplitude associated with the targeted (for detection) radionuclide, ξcustom characterτ(n) is the raw EMS photon arrival interarrival measurement, κα is the respective confidence coefficient with associated confidence level {tilde over (α)} and σcustom characterτ is the associated standard deviation associated with the variance of the interarrival. Since the estimated interarrival time (custom character{circumflex over (τ)}m) is not the actual source interarrival, we use two methods of obtain the estimate at the ADC output from the arrival time itself. The first method is to use a simple transport model with calibration data obtain prior to actual deployment processing while the second is based on performing a maximum likelihood estimate based on the rate parameter given by [11]












λ
m



(
n
)


=


(

1
-
β

)



λ


(
n
)
















τ
^

m



(
n
)



=

1

λ


(
n
)








(
57
)








where β is a downscatter fraction of the higher energy photons estimated from the energy bins adjacent to εm of the calibration pulse-height spectrum. Using this estimate, when the photon interarrival is accepted as belonging to the mth-channel, then ξcustom characterτmcustom characterτm(n) and the raw measurements are then processed using the Bayesian techniques of the linear Kalman filter (LKF) and the particle filter (PF) developed in the previous section. However, if the time-tag does not match the true, then photon is rejected and no further processing occurs.


C.3.2 Energy Amplitude Level/Interarrival (Rate) Bayesian Estimation


In this section, we discuss the application of the Bayesian processors to the accepted photon data. As each photon is acquired and the measurement and arrival times are extracted both the associated energy amplitude level and interarrival time is sequentially updated using the LKF processor for the amplitude and PF processor for the interarrival time. A typical result of the processing for an entire run is shown in FIG. 8 for a cesium radionuclide (137Cs). In 8a we set the energy amplitude level estimate and its zero-mean/whiteness test in FIG. 8b. Recall that for a LKF processor the resulting innovations sequence must be zero-mean and white (uncorrelated). This is the case for the energy amplitude estimates with (8.7×10−19<3.1×10−2)/0.1% out) as illustrated in the figure. We observe the corresponding interarrival time-tag estimate in FIG. 7. The interarrival estimates appear reasonable and the zero-mean/whiteness check validates its performance with (8.3×10−4<3.1×10−2)/4% out) quite good. In summary both estimators perform reasonably and are checked for validity by performing statistical whiteness tests which are optimal in the LKF case and reasonable for the PF case.


C.3.3 Radionuclide Parameter Estimation


In this section we apply the sequential Bayesian parameter estimators to actual experimental data. The experimental set-up is shown in FIG. 10 along with the equipment consisting of sources, measurement instruments (some for monitoring) including a high purity germanium (HPG) commercial detector. The sources consisted of a set of known calibration sources with multiple lines and unknown background sources as shown in the PHS of FIG. 10. The results of the processing using the parallel/distributed processing scheme described in the previous sections are shown in FIG. 9 where we see the raw PHS measured by the commercial instrumentation as well as that by the sequential Bayesian processor. Clearly, the sequential processor is capable of performing the estimation quite well as demonstrated previously on the cesium source (see FIGS. 8, 9). Its PHS is uncluttered with undesirable energy counts and background primarily due to the processing scheme demonstrating its effectiveness over this controlled experimental data set.


C.3.4. Sequential Radionuclide Detection/Classification


The sequential radionuclide detector is constructed as discussed in Sec. 4.1 and Eq. 44. However, it is implemented in a channel-by-channel framework as depicted in FIG. 6. Basically, the individual distributions are calculated in parallel at each channel and then combined in the detector/classifier as illustrated for the specific distributions in FIG. 10 where the required parameters are replaced by their estimates. At each arrival after discrimination, the accepted channel photon, say jth is processed by the energy amplitude level and interarrival parameter estimators ({circumflex over (θ)}) providing the input to the likelihood ratio along with the truth parameters (θ°) available from the tables to give [{εmo},{Δτmo},{αmo}]; m=1, . . . , Mε. Using the distribution relations developed for the joint parametric distributions, we have the likelihood ratio (as before)










L


[

Ξ
n

]


=


L


[

Ξ

n
-
1


]


×








m
=
1


M
ɛ











α
m





λ
^


Δτ
m




(

n

n

)






2





π






σ
^


ɛ
m




(

n

n

)





exp







{




-



λ
^


Δτ
m




(

n

n

)






Δτ
m



(
n
)



-


(



ɛ
m



(
n
)


-



ɛ
^

m



(

n

n

)



)

2



2








σ
^


ɛ
m

2



(

n

n

)




}








m
=
1


M
ɛ











α
m
o



λ

Δτ
m

o





2





π




σ

ɛ
m
o





exp


{





-

λ

•τ
m

o





Δτ
m



(
n
)



-


(



ɛ
m



(
n
)


-


ɛ
m
o



(
n
)



)

2



2






σ

ɛ
m
o

2




ht

}









(
58
)







In order to simplify notation somewhat, we define the following general functional form (see FIG. 10)

Θm(n;θ):=Pr(custom characterτm(n)|Ξn-1,HlPrm(n)|Im(k),Ξn-1,HlPr(Im(k)|Ξn-1,Hl)  (59)

and for our specific problem, we have under hypothesis H1











Θ
m



(

n
;

θ
^


)


=




α
m





λ
^


•τ
m




(

n

n

)






2





π






σ
^


ɛ
m




(

n

n

)





exp


{




-



λ
^


•τ
m




(

n

n

)






•τ
m



(
n
)



-


(



ɛ
m



(
n
)


-



ɛ
^

m



(

n

n

)



)

2




2




σ
^


ɛ
m

2



(

n

n

)









}






(
60
)








and under hypothesis H0











Θ
m



(

n
;

θ
o


)


=




α
m
o



λ

•τ
m

o





2





π




σ

ɛ
m
o





exp


{




-

λ

•τ
m

o





•τ
m



(
n
)



-


(



ɛ
m



(
n
)


-

ɛ
m
o


)

2




2


σ

ɛ
m
o

2








}






(
61
)







Therefore, we can re-write Eq. 58 using this notation simply as:










L


[

Ξ
n

]


=


L


[

Ξ

n
-
1


]


×





m
=
1


M
ɛ








Θ
(

n
;

θ
^


)






m
=
1


M
ɛ








Θ


(

n
;

θ
o


)









(
62
)








and taking logarithms of this expression, we obtain










Λ


[

Ξ
n

]


=


Λ


[

Ξ

n
-
1


]


+




m
=
1


M
ɛ




ln







Θ
m



(

n
;

θ
^


)




-




m
=
1


M
ɛ




ln







Θ
m
o



(

n
;

θ
o


)









(
63
)








giving the intermediate result










Λ


[

Ξ
n

]


=


Λ


[

Ξ

n
-
1


]


+




m
=
1







M

ɛ










ln


(




α
m





λ
^




τ
m





(

n
|
n

)






2





π






σ
^


ɛ
m




(

n
|
n

)





exp


{



-



λ
^




τ
m





(

n
|
n

)








τ
m



(
n
)




-



(



ɛ
m



(
n
)


-



ɛ
^

m



(

n
|
n

)



)

2



2








σ
^


ɛ
m

2



(

n
|
n

)










}


)



-




m
=
1







M

ɛ










ln


(




α
m
o



λ




τ
m







o





2





π




σ

ɛ
m
o





exp


{



-

λ



τ
m


o







τ
m



(
n
)




-



(



ɛ
m



(
n
)


-

ɛ
m
o


)

2


2






σ

ɛ
m
o

2




}


)











(
64
)






(
65
)










Combining similar terms, we obtain the final sequential log-likelihood ratio radionuclide detector specified by:










Λ


[

Ξ
n

]


=


Λ


[

Ξ

n
-
1


]


+




m
=
1







M

ɛ










ln


(



α
m
o





λ
^




τ
m





(

n
|
n

)






2





π






σ
^


ɛ
m




(

n
|
n

)




)



-

ln


(



α
m
o



λ




τ
m







o





2





π




σ

ɛ
m
o




)


+


(


λ



τ
m


o

-



λ
^




τ
m





(

n
|
n

)



)






τ
m



(
n
)




+


1
2




(




ɛ
m



(
n
)


-


ɛ
m
o



(
n
)




σ

ɛ
m
o



)

2


-


1
2




(



ɛ
m



(
n
)


-




ɛ
_

m



(

n
|
n

)



r








σ
^


ɛ
m




(

n
|
n

)




)

2







(
66
)








with implementation depicted in the figure where we observe that after successful discrimination the parameters are estimated and employed to calculate the log-likelihood function as in Eq. 66. These are estimated channel-by-channel (mth-channel) and the overall decision function implemented sequentially (in arrival time). The diagram shows the input photon measurement data (raw amplitude/interarrival) after discrimination as input to the individual channel parameter estimators. Once the parameters are estimated they are implemented in each channel log-likelihood partial calculation (Θm(n;θ)) and all of the partial sums are combined along with the previous (in arrival time) log-likelihood to sequentially update the new log-likelihood at time n. It is then compared to the threshold to see if a detection is possible. If not, the next photon is processed and the log-likelihood updated to see if a decision can be made. This sequential radionuclide process continues until there is enough data for a decision to made. Conceptually, we depict the sequential detector in FIG. 11.


D. APPENDIX

D.1. Statistics of EMS


Since the EMS is a random process, we must define the underlying assumptions and associated statistics for its to complete characterization. The number of arrivals in a given interval is Poisson distributed characterized by a Poisson counting process itesny 11, that is, if we define the counting increment for the mth-source as

Ncustom characterτm(n):=Nτm(n)−Nτm(n−1) for τm(n−1)≦t≦τm(n)  (61)

then the corresponding Poisson counting distribution is










P


[



N



τ
m





(
n
)


=
m

]


=




(



Λ

τ
m




(
n
)


-


Λ

τ
m




(

n
-
1

)



)

m


m
!




exp


[

-

(



Λ

τ
m




(
n
)


-


Λ

τ
m




(

n
-
1

)



)


]







(
62
)








for m=0, . . . , Nε(m) with Λτm(n)>0 the intensity function. Here it is assumed that the increments are independent and non-overlapping implying that the number of points in each interval [τm(n−1), τm(n)) is independent leading to the usual factorization of the joint distribution










Pr


[



N







τ
1





(
n
)


,





,


N



τ


M
ɛ

-
1






(
n
)


,


N

τ

N
ɛ





(
n
)



]


=




m
=
1


M
ɛ








Pr


[


N



τ
m





(
n
)


]







(
63
)








with the corresponding intensity function specified by

Λτm(n)=∫λm(α) or Λτm(n)=λm×custom characterτm(n)  (64)

depending on the respective decay rate being inhomogeneous or homogeneous.


Clearly, since the EMS is the superposition of Poisson processes, then it is also a composite Poisson process [11] with parameters:










λ
=




m
=
1


M
ɛ




λ
m



,

ɛ
=




m
=
1


M
ɛ




ɛ
m



,


M
ɛ

=




m
=
1


M
ɛ





N
ɛ



(
m
)








(
65
)








for λ the total decay rate, ε the associated energy levels and Nε the total counts in the interval, [to,T). Note that the composite decay rate is the superposition of all of the individual component rates as in Eq. 5. This follows directly from the fact that the sum of exponentially (Poisson) distributed variables are gamma (Poisson). We note that the (composite) EMS of the radionuclide directly contains information about λ, but not about its individual components—unless we can extract the monoenergetic representation (Eq. 6) from the measured data.


Since ξ is a process characterized by a Poisson distribution, then the interarrival times, Δτm(n) associated with the mth-monoenergetic source are exponentially distributed. That is, assuming a homogeneous Poisson process, we have











Pr


[



N

Δτ
m




(
n
)


=
m

]


~

P


(


λ
m



Δτ
m


)







(


λ
m



Δτ
m


)

m


m
!




exp


(


-

λ
m




Δτ
m


)









(
66
)






(
65
)











and therefore,

Pr[Δτm=m]˜Em)=λmexp(−λmΔτm)  (67)

with mean,







μ

Δτ
m


=

1

λ
m







and variance,







σ

Δ






τ
m


2

=


1

λ
m
2


.





Similarly, it is well-known (see Snyder, Theorem 2.3.1, [11]) that for a homogeneous Poisson counting process with intensity, λm the interarrival times, custom characterτm(n) are i.i.d and E(λmcustom characterτm(n)). For an inhomogeneous Poisson process this property is no longer valid.


To complete the statistics of our component EMS representation, we have that the arrival (occurrence) times for a homogeneous Poisson process are gamma-distributed, that is, for the τm(n) arrival time, we have











Γ


(

k
,

τ
m


)


=


Pr


[


τ
m



(
n
)


]


=




(


λ
m




τ
m



(
n
)



)


k
-
1




(

k
-
1

)

!




λ
m



exp


[


-

λ
m





τ
m



(
n
)



]












for







τ
m



(
n
)




0








with





E


{


τ
m



(
n
)


}


=



n

λ
m







and






σ


τ
m



(
n
)


2


=


n

λ
m
2


.







(
68
)







This completes the statistical description of the composite EMS in terms of its monoenergetic source decomposition. With this representation it is clear that when measuring the EMS, it is characterized by the following properties:

    • non-uniform arrival time samples, τm(n)
    • monoenergetic source components, ξ(n;εm(n),τm(n)) having their own unique decay rate, λm
    • unique energy level, εm
    • gamma distributed arrival times, τm(n), Γ(k,τm)
    • Poisson distributed counts, Nε(m), P(Nε(n)=m)
    • exponentially distributed interarrival times, custom characterτm(n), E(λmcustom characterτm(n))
    • composite decay rate, λ


      Particle Filtering


Particle filtering (PF) is a sequential Monte Carlo method employing the sequential estimation of relevant probability distributions using so-called “importance sampling” techniques incorporating distribution approximations with discrete random measures. The key idea is to represent the posterior distribution by a set of Np, random samples, the particles, with associated weights, {xi(t),Wi(t)}; i=1, . . . , Np, and compute the required Monte Carlo posterior estimates. As the number of particles becomes very large the MC representation becomes an equivalent characterization of the analytical description of the posterior distribution converging to the optimal Bayesian estimate. In PF, continuous distributions are approximated by discrete random measures composed of these weighted particles or point masses where the particles are actually samples of the unknown or hidden states from the state-space representation and the weights are the “probability masses” estimated using the Bayesian recursions. Thus, associated with each particle, xi(t) is a corresponding weight or (probability) mass, Wj(t). Knowledge of this random measure characterizes an estimate of the instantaneous (at time t) filtering posterior distribution,










Pr


(


x


(
t
)


|

Y
t


)







i
=
1


N
p






W
i



(
t
)




δ


(


x


(
t
)


-


x
i



(
t
)



)

















Statistics are calculated across the ensemble of particle representations at each time-step to provide estimates of the states. For example, the minimum mean-squared error (MMSE) estimate is easily determined by averaging over xi, since









x
^

MMSE



(
t
)


=






x


(
t
)




Pr


(


x


(
t
)


|

Y
t


)





x








x


(
t
)




Pr


(


x


(
t
)


|

Y
t


)





x




=





x


(
t
)




(




i
=
1


N
p






W
i



(
t
)




δ


(


x


(
t
)


-


x
i



(
t
)



)




)




x



=




i
=
1


N
p






W
i



(
t
)





x
i



(
t
)










The maximum a-posteriori (MAP) estimate is simply determined by finding the sample corresponding to the maximum weight of xi(t) across the ensemble at each time-step as












x
^

MAP



(
t
)


=

arg







max


x
i



(
t
)





Pr


(


x


(
t
)


|

Y
t


)








(
69
)







In Bayesian processing, the idea is to sequentially estimate the posterior, Pr(x(t−1)|Yi-1)→Pr(x(t)|Yt). The sequential importance sampling solution evolves from the recursive form for the importance distribution, q(•) as

q(Xi|Yi):=q(Xt-1|Yt-1q(x(t)|Xt-1,Yt)

leading to the sequential expression for the importance weights as












W


(
t
)





Pr


(


X
t

|

Y
t


)



q


(


X
t

|

Y
t


)




=



Pr


(


Y
t

|

X
t


)


×

Pr


(

X
t

)





q


(


X

t
-
1


|

Y

t
-
1



)


×

q


(



x


(
t
)


|

X

t
-
1



,

Y
t


)












W


(
t
)


=


W


(

t
-
1

)


×




Pr


(


y


(
t
)


|

x


(
t
)



)




Likelihood


×


Pr


(


x


(
t
)


|

x


(

t
-
1

)



)




Transition




q


(



x


(
t
)


|

X

t
-
1



,

Y
t


)









(
70
)







Similarly the state-space particle filter (SSPF) evolving from this sequential importance sampling construct follows directly. Recall that the generic state-space characterization representing the transition and likelihood probabilities is:

Pr(x(t)|x(t−1))custom characterA(x(t)|x(t−1))
Pr(y(t)|x(t))custom characterC(y(t)|x(t))


The generic state-space sequential importance sampling solution is given by












x
i



(
t
)






q


(



x


(
t
)


|

X

t
-
1



,

Y
t


)












W
i



(
t
)


=



W
i



(

t
-
1

)


×



C


(


y


(
t
)


|


x
i



(
t
)



)


×

A


(



x
i



(
t
)


|


x
i



(

t
-
1

)



)




q


(




x
i



(
t
)


|


X

i
-
1




(
i
)



,

Y
t


)













W
i



(
t
)


=



W
i



(
t
)






i
=
1


N
p





W
i



(
t
)









(
71
)







Here we use the bootstrap particle filter based on sequential sampling-importance-resampling ideas (SIR) using the transition prior as its underlying importance proposal distribution,

qprior(x(t)|x(t−1),Yt=Pr(x(t)|x(t−1))=A(x(t)|x(t−1))


Thus, the corresponding weight only depends on the likelihood







W


(
t
)


=



(


C


(


y


(
t
)






x


(
t
)


)

×

A
(

x


(
t
)






x


(

t
-
1

)



)



A


(


x


(
t
)


|

x


(

t
-
1

)



)



)

×

W


(

t
-
1

)



=


W


(

t
-
1

)


×

C


(


y


(
t
)


|

x


(
t
)



)








One of the primary features as well as shortcomings of this technique is that in order to achieve convergence, it is necessary to resample at every time step to mitigate variance (weight) increases at each time step [34]. After resampling, the new weights become








W


(
t
)




1

N
p




W


(
t
)



=

C


(


y


(
t
)


|

x


(
t
)



)






The bootstrap particle filter algorithm is given by:

    • Generate the initial state, xi(0)
    • Generate the process noise, wi(t)
    • Generate the particles, xi(t)=A(xi(t−1), u(t−1), wi(t−1))—the prediction-step
    • Generate the likelihood, C(y(t)|xi(t)) using the current particle and measurement—the update step
    • Resample the set of particles retaining and replicating those of highest weight (probability), xi(t)custom character{circumflex over (x)}i(t)
    • Generate the new set,








{




x
^

i



(
t
)


,



W
^

i



(
t
)



}






with








W
^

i



(
t
)



=

1

N
p






E. REFERENCES

The following cited references are incorporated by reference herein in their entirety:

  • [2] G. F. Knoll, Radiation Detection and Measurement, 3rd Ed., (Hoboken N.J.: John Wiley, 2000).
  • [11] D. L. Snyder and M. I. Miller, Random Point Process in Time and Space. (New York: Springer-Verlag, 1991).
  • [12] C. Andrieu, E. Barat and A. Doucet, Bayesian deconvolution of noisy filtered point processes, IEEE Trans. Sig. Proc., Vol. 49, 2001.
  • [14] A. Doucet and P. Duvaut, Bayesian estimation of state space models applied to deconvolution of Bernoulli-Gaussian processes, Signal Process., Vol. 57, 1997.
  • [16] S. Gulam Razul, W. J. Fitzgerald and C. Andrneu, Bayesian model selection and parameter estimation of nuclear emission spectra using RJMCMC, Nucl. Instrum. And Methods in Physics Res. A, Vol. 497, 2003.
  • [21] K. Sale, J. Candy, E. Breitfeller, B. Guidry, D. Manatt, T. Gosnell and D. Chambers, “A Bayesian sequential approach to spectroscopic portal system decisions” SPIES Confr. Proceed., 2007.
  • [22] J. Candy, K. Sale, B. Guidry, E. Breitfeller, D. Manatt, D. Chambers and A. Meyer, “Bayesian processing for the detection of radiactive contraband from uncertain measurements,” IEEE CAMSAC Confr., 2007.


While particular embodiments and parameters have been described and/or illustrated, such are not intended to be limiting. Modifications and changes may become apparent to those skilled in the an, and it is intended that the invention be limited only by the scope of the appended claims.

Claims
  • 1. A photon-by-photon sequential radionuclide detection method comprising: detecting an event mode sequence (EMS) comprising a sequence of measured photon events each uniquely characterized by an energy amplitude-interarrival time parameter pair;for an nth photon event of the EMS: selecting a monoenergy processing channel from a set of parallel monoenergy processing channels derived from a monoenergetic decomposition of a target radionuclide into monoenergetic sources in which to process the nth photon event, said selection based on a determination that both of the energy amplitude and interarrival time values of the nth photon event satisfy respective energy amplitude and interarrival time confidence interval conditions of the selected monoenergy channel;upon selecting the monoenergy channel, using a sequential Bayesian processor of said selected monoenergy channel to update energy amplitude and interarrival time parameter estimates with the measured energy amplitude and interarrival time values of the nth photon event;using the updated amplitude and interarrival time parameter estimates to update a measured probability density function (PDF) estimate for the target radionuclide;determining whether a sequential likelihood ratio satisfies one of two threshold conditions signifying that the EMS is either identified as the target radionuclide or as not the target radionuclide, wherein said sequential likelihood ratio is based on a previous sequential likelihood ratio for a previous (n−1)th photon event, the sum of all updated measured PDF estimates produced as output from the set of parallel monoenergy channels, and the sum of all a-priori PDF estimates which are produced in parallel with the updated measured PDF estimates and based on expected amplitude level and interarrival time values of the target radionuclide; andupon determining that one of the two threshold conditions is satisfied, providing notification of the corresponding result, else repeating from the monoenergy selection step for the next (n+1)th photon event of the EMS until one of the two threshold conditions is satisfied.
  • 2. The radionuclide detection method of claim 1, wherein the step of updating the energy amplitude parameter estimate is performed using a linear Kalman filter.
  • 3. The radionuclide detection method of claim 1, wherein the step of updating the interarrival time parameter estimate is performed using a bootstrap particle filter.
  • 4. A radionuclide detection system comprising: a detector for detecting an event mode sequence (EMS) comprising a sequence of measured photon events each uniquely characterized by an energy amplitude-interarrival time parameter pair;a set of parallel monoenergy processing channels derived from a monoenergetic decomposition of a target radionuclide into monoenergetic sources, each monoenergy processing channel comprising: an energy line discriminator module for determining if an energy amplitude value of an nth photon event satisfies a channel-specific energy amplitude confidence interval condition, and rejecting the photon event if the condition is not satisfied;an interarrival time discriminator module for determining, based upon acceptance of the photon event by the energy line discriminator module, if an interrival time value of the nth photon event satisfies a channel-specific interarrival time confidence interval condition, and rejecting the photon event if the condition is not satisfied;an energy amplitude parameter estimator module including a sequential Bayesian processor for updating energy amplitude parameter estimates with the measured energy amplitude and interarrival time values of the nth photon event;an interarrival time parameter estimator module including a sequential Bayesian processor for updating interarrival time parameter estimates with the measured energy amplitude and interarrival time values of the nth photon event; anda measured probability density function (PDF) estimator module for using the updated amplitude and interarrival time parameter estimates to update a measured probability density function (PDF) estimate for the target radionuclide;a sequential likelihood ratio processor module for determining whether a sequential likelihood ratio satisfies one of two threshold conditions signifying that the EMS is either identified as the target radionuclide or as not the target radionuclide, wherein said sequential likelihood ratio is based on a previous sequential likelihood ratio for a previous (n−1)th photon event, the sum of all updated measured PDF estimates produced in all the monoenergy channels, and the sum of all a-priori PDF estimates which are produced in parallel with the updated measured PDF estimates and based on expected amplitude level and interarrival time values of the target radionuclide, wherein upon determining that one of the two threshold conditions is satisfied the sequential likelihood processor provides notification of the corresponding result; anda channel input module for providing the set of parallel monoenergy processing channels with a next (n+1)th photon event and its energy amplitude-interarrival time parameter pair values for processing until the sequential likelihood ratio processor module determines that one of the two threshold conditions is satisfied.
  • 5. The radionuclide detection system of claim 4, wherein the step of updating the energy amplitude parameter estimate is performed using a linear Kalman filter.
  • 6. The radionuclide detection system of claim 4, wherein the step of updating the interarrival time parameter estimate is performed using a bootstrap particle filter.
CLAIM OF PRIORITY IN PROVISIONAL APPLICATION

This application claims priority in provisional application filed on Oct. 25, 2007, entitled “Physics-based Detection, Classification and Estimation of Radioactive Contraband: A Distributed/Parallel Solution” Ser. No. 60/982,607, by James V. Candy et al, and incorporated by reference herein.

FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

The United States Government has rights in this invention pursuant to Contract No. DE-AC52-07NA27344 between the United States Department of Energy and Lawrence Livermore National Security, LLC for the operation of Lawrence Livermore National Laboratory.

US Referenced Citations (6)
Number Name Date Kind
5376795 Hasegawa et al. Dec 1994 A
7711661 Gentile et al. May 2010 B2
20040099813 Eggeling et al. May 2004 A1
20060182327 Mundy et al. Aug 2006 A1
20080056443 Hu et al. Mar 2008 A1
20080240578 Gudmundson et al. Oct 2008 A1
Non-Patent Literature Citations (19)
Entry
Anderson et al., A Probabilistic Derivation of Gamma-Ray Attenuation and Application: Bayesian Mass Estimation with a Low Count Spectrum, Feb. 2006, Pacific Northwest National Laboratory Richland, p. 1-6.
Sun et al., Photon Counting with Silicon Avalanche Photodiodes, Aug. 1992, Journal of Lightwave Technology, vol. 10 No. 8, p. 1-10.
Bouchud et al., Bayesian Statistics in Radionuclide Metrology: Measurement of a Decaying Source, Mar. 2007, IOP Publishing, p. s95-s101.
Candy et al., Bayesian Processing for the Detection of Radioactive Contraband from Uncertain Measurements, Jun. 2007, IEEE CAMSAP '07, JRNL 232317, p. 1-6.
Sullivan et al. “Sequential Bayesian Detection: A Model-Based Approach”, UCRL-Book-235410, 2007, 11 pages.
Sale et al. “A Bayesian Sequential Processor Approach to Spectroscopic Portal System Decisions”, SPIE Conference, 2007, 14 pages.
Hero, et al., “Timing Estimation for a Filtered Poisson Process in Gaussian Noise”, IEEE Transactions on Information Theory, vol. 37, No. 1, pp. 92-106 (1991).
Bouchet, “A comparative study of deconvolution methods for gamma-ray spectra”, Astronomy & Astrophysics, Supplemental Series 113, pp. 167-179 and 182-183, (1995).
Doucet, et al., “Bayesian estimation of state-space models applied to deconvolution of Bernoulli-Gaussian processes”, Signal Processing 57, pp. 147-161 (1997).
Meng, et al., “An Inter-comparison of Three Spectral-Deconvolution Alogorithms for Gamma-ray Spectroscopy”, IEEE Transactions on Nuclear Science, vol. 47, No. 4, pp. 1329-1336, (Aug. 2000).
Andrieu, et al., “Bayesian Deconvolution of Noisy Filtered Point Processes”, IEEE Transactions on Signal Processing, vol. 49, No. 1, pp. 134-146, (Jan. 2001).
Sale et al., “Pulse-Height Spectrum Measurement Expirement for Code Benchmarking: Initial Results”, Application of Accelerators in Research and Industry—Sixteenth Int'l Conference, pp. 567-570, (2001).
Razul, et al., “Bayesian model selection and parameter estimation of nuclear emission spectra using RJMCMC”, Nuclear Instruments & Methods in Physics Research, pp. 492-509, (2002).
Arulampalam, et al., “A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking”, IEEE Transactions on Signal Processing, vol. 50, No. 2, pp. 174-188, (Feb. 2002).
Djuric, et al., “Particle Filtering”, IEEE Signal Processing Magazine, pp. 19-38, (Sep. 2003).
Mazet, et al., “Background removal from spectra by designing and minimising a non-quadratic cost function”, Science Direct, Chemometrics and intelligent laboratory systems, 13 pages, (2004).
Jarman, et al., “Sequential Probability Ratio Test for Long-Term Radiation Monitoring”, IEEE Transactions on Nuclear Science, vol. 51, No. 4, pp. 1662-1666, (Aug. 2004).
Doucet, et al., “Monte Carlo Methods for Signal Processing”, IEEE Signal Processing Magazine, pp. 152-170, (Nov. 2005).
Cappe, et al., “An Overview of Existing Methods and Recent Advances in Sequential Monte Carlo”, Proceedings of the IEEE, vol. 95, No. 5, pp. 899-924, (May 2007).
Related Publications (1)
Number Date Country
20100030721 A1 Feb 2010 US
Provisional Applications (1)
Number Date Country
60982607 Oct 2007 US