Real-time signal detection, localization, and classification in noisy, cluttered RF environments is a difficult problem. Existing systems in RF machine learning focus on utilizing the You Only Look Once (YOLO) algorithm applied to wideband RF spectrograms to jointly detect, localize (i.e. frequency, bandwidth, SNR etc.), and classify emitters. Estimating these parameters degrades in low SNR conditions.
In one aspect, embodiments of the inventive concepts disclosed herein are directed to a system and method for detecting, localizing, and classifying RF signals via probability analysis in the decision space. A wideband IQ sample stream is received and a probability analysis is employed to isolate noise from the magnitude spectrum. Derived probability information is used for RF detection and localization.
In a further aspect, the probability analysis is a Bayesian probability analysis and the detection and localization algorithm is a modified “you only look once” (YOLO) algorithm.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and should not restrict the scope of the claims. The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments of the inventive concepts disclosed herein and together with the general description, serve to explain the principles.
The numerous advantages of the embodiments of the inventive concepts disclosed herein may be better understood by those skilled in the art by reference to the accompanying figures in which:
Before explaining at least one embodiment of the inventive concepts disclosed herein in detail, it is to be understood that the inventive concepts are not limited in their application to the details of construction and the arrangement of the components or steps or methodologies set forth in the following description or illustrated in the drawings. In the following detailed description of embodiments of the instant inventive concepts, numerous specific details are set forth in order to provide a more thorough understanding of the inventive concepts. However, it will be apparent to one of ordinary skill in the art having the benefit of the instant disclosure that the inventive concepts disclosed herein may be practiced without these specific details. In other instances, well-known features may not be described in detail to avoid unnecessarily complicating the instant disclosure. The inventive concepts disclosed herein are capable of other embodiments or of being practiced or carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein is for the purpose of description and should not be regarded as limiting.
As used herein a letter following a reference numeral is intended to reference an embodiment of the feature or element that may be similar, but not necessarily identical, to a previously described element or feature bearing the same reference numeral (e.g., 1, 1a, 1b). Such shorthand notations are used for purposes of convenience only, and should not be construed to limit the inventive concepts disclosed herein in any way unless expressly stated to the contrary.
Further, unless expressly stated to the contrary, “or” refers to an inclusive or and not to an exclusive or. For example, a condition A or B is satisfied by anyone of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).
In addition, use of the “a” or “an” are employed to describe elements and components of embodiments of the instant inventive concepts. This is done merely for convenience and to give a general sense of the inventive concepts, and “a” and “an” are intended to include one or at least one and the singular also includes the plural unless it is obvious that it is meant otherwise.
Finally, as used herein any reference to “one embodiment,” or “some embodiments” means that a particular element, feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the inventive concepts disclosed herein. The appearances of the phrase “in some embodiments” in various places in the specification are not necessarily all referring to the same embodiment, and embodiments of the inventive concepts disclosed may include one or more of the features expressly described or inherently present herein, or any combination of sub-combination of two or more such features, along with any other features which may not necessarily be expressly described or inherently present in the instant disclosure.
Broadly, embodiments of the inventive concepts disclosed herein are directed to a system and method for detecting, localizing, and classifying RF signals via probability analysis in the decision space. A wideband IQ sample stream is received and a probability analysis is employed to isolate noise from the magnitude spectrum. Derived probability information is used for RF detection and localization. The probability analysis is a Bayesian probability analysis and the detection and localization algorithm is a modified “you only look once” (YOLO) algorithm. The instant disclosure may be more fully understood with reference to U.S. Pat. No. 9,450,688 (issued Sep. 20, 2016).
Referring to
After the probability analysis, a probability signal detection and localization process 102 receives the spectrogram information and uses it to detect and localize. Detection and localization may comprise identifying a signal-to-noise ratio, center frequency, and bandwidth. In at least one embodiment, the probability signal detection and localization process 102 utilizes a Bayesian “tiny-YOLO” algorithm acting on a data set of know signal characteristics to identify the signal-to-noise ratio, center frequency, and bandwidth based on known relationships between those characteristics and received signal spectrograms. In at least one embodiment, the probability signal detection and localization process 102 utilizes a Monte Carlo sampling algorithm to sample probability determinations from the Bayesian tiny-YOLO algorithm; such samples may be used by the probability signal detection and localization process 102 to decide if a signal has been detected.
An overt classification and characterization process 104 receives the detected signal decision and Monte Carlo metadata, and uses such data to classify and characterize the signal. The overt classification and characterization process 104 processes the identified center frequency, bandwidth, and signal-to-noise ratio to extract IQ samples from memory, mix to baseband and sample at the Nyquist rate. In at least one embodiment, this form of pre-processing normalizes an input to a defined region.
Since it's difficult to accurately estimate a large number of modulation classes with one network, in at least one embodiment, the overt classification and characterization process 104 breaks the task into two steps: first, the overt classification and characterization process 104 performs modulation family recognition, classifying a signal according to AM, FM, PSK, ASK, QAM, FSK, CDMA, and multicarrier, respectively; second, the overt classification and characterization process 104 classifies the signal according to M-ary modulation order within a given family. In at least one embodiment, both steps utilize a Bayesian Convolutional Neural Networks operating on complex spectral samples.
In at least one embodiment, the output of the overt classification and characterization process 104, or metadata corresponding to such output, may be stored in a memory 106, along with the corresponding probability signal detection and localization process 102 metadata, for future analysis to refine known Bayesian probabilities.
Referring to
Referring to
In at least one embodiment, the estimation of uncertainty using Bayesian inference is utilized during trials 400, computation of histograms 402, and calculating 404 a confidence level. For example, the confidence in detecting and localizing a signal in a particular band may be high, but the modulation family and M-ary number classification confidence may be low. This combination could signify that there is a signal present in the environment that doesn't fall into the overt classification set triggering further interrogation.
Referring to
To calculate the probability spectrum, Bayesian signal analysis process requires an estimate of the spectral noise floor. Unlike classical radar-based techniques, this process does not rely on a communications signal to be absent in order to perform the calculation. In at least one embodiment, a minima controlled recursive averaging (MCRA) algorithm defines the spectral noise floor. Because MCRA was formulated based on statistics of speech, not RF, the Bayesian signal analysis process includes an image de-noising algorithm known as “opening” in addition to MCRA. The combined opening MCRA algorithm for RF noise estimation algorithm may be known as Opening Controlled Recursive Averaging (OCRA).
In at least one embodiment, the Bayesian signal analysis process operates on a maximum number A of independent noisy RF channels ya(n)=xa(n)+da(n), where xa(n) is the desired RF signal, da(n) is the additive noise, and a is the channel index. Before transforming to the frequency domain, the Bayesian signal analysis process applies a technique known as the weighted overlap add (WOLA) filter 500 to enable detection of signals close in proximity
where h is the window function, N is the FFT size, and P is the total number of FFT blocks. A discrete FFT 502 is then applied according to:
where k is the spectral bin index and l is the frame index, respectively. After converting to the frequency domain, the spectral power on each channel is smoothed in frequency via a frequency averaging process 504 to reduce “RF popcorn noise” according to:
where b is a hamming window with span 2w+1. The channels are then non-coherently combined 506 according to:
The resulting signal is recursively smoothed 508 according to:
S(k,l)=asS(k,l−1)+(1−as)Sf(k,l)
where the forgetting factor is given by:
time constant τTA, and update rate Fs.
To calculate the spectral noise floor, OCRA utilizes knowledge that in short time periods not all spectral bins contain energy from an emitter. Therefore, a coarse noise estimate 510 is obtained utilizing spectral opening:
where 2Z+1 is the spectral search range. Then a priori probability of signal absence is calculated 512:
where ap controls how long a decision l (k, l) is retained, and δ is the signal absence threshold.
The preceding calculations are used to produce the spectral noise estimate 514:
This equation allows continuous estimation of the RF spectral noise floor under all signal conditions. If a signal is determined to be absent, the noise is updated based on the smoothed channel power Sf(k, l); otherwise, the noise is updated based on the coarse noise estimate smin(k, l). Finally, the probability spectrum 516 is determined according to:
The a posteriori signal-to-noise ratio 518 is:
and a priori signal-to-noise ratio 520 given by:
ξ(k,l)=aG2H1(k,l−1)γ(k,l−1)+(1−a)max{γ(k,l)−1,0}
In at least one embodiment, a priori signal-to-noise ratio is determined via a spectral gain function 522 with the Weiner filter criterion:
The probability spectrum is high (P(H1(k, l)|Y(k, l)>>0) when a signal is present in the current frame (γ(k, l)>>1) or when a signal has been present for several prior frames (q′(k, l)<<1). This property allows the Bayesian signal analysis process to bridge the gap between rapid detection of bursty high signal-to-noise ratio communications and the ability to detect persistent low signal-to-noise ratio signals.
Referring to
An emitter's burst length can span an unknown amount of time requiring an indefinite time dimension to localize temporally (i.e. calculate dwell time). Therefore, in at least one embodiment, the Bayesian signal detection and localization process localizes in the frequency axis. The time axis is sized based on the number of frames needed to accurately detect a signal in a given frequency cell S. This simplifies the network architecture, requiring half the number of grid cells as compared to existing processes.
In at least one embodiment, the Bayesian YOLO network comprises convolutional flipout layers provided in the TensorFlow Probability in place of hidden layers, transforming the network into a Bayesian tiny-YOLO enabling Monte Carlo testing to estimate the uncertainty for each one of its metadata predictions.
In at least one embodiment, the Bayesian tiny-YOLO loss function includes a term for estimation of the signal-to-noise ratio:
where S is the number of frequency cells, B is the number of signal detectors per frequency cell, and λcoord is the weight given to frequency and bandwidth loss calculations. The term ∥ijobj is set to one for the detector j in cell i that maximizes the intersection over union (IOU) relative to all other detectors.
Referring to
Referring to
Referring to
A digital down conversation stage removes the estimated frequency offset Fc and decimate to the Nyquist rate according to the bandwidth BW. If this is a new target, target tracking estimates the rise time Trise; otherwise it keeps track of the total time the target has been transmitting Δt.
During a second phase (Normalization) 802, the baseband block of time-domain IQ samples is transformed into the complex frequency domain. The complex spectral samples are then normalized to the range −1 to 1 by dividing by the maximum spectral magnitude.
During a third phase (Classification) 804, modulation classification is performed by two levels of a Bayesian convolution neural network. The first level estimates the modulation family such as, AM, FM, PSK, FSK, QAM, OFDM, CDMA, and continuous wave (CW). The second level estimates the M-ary number under each modulation family (i.e. PSK4, PSK8, etc.). Breaking the problem into family then M-ary number classification addresses the issue of “over dimensionality” where a single network performs poorly when required to classify too large a data set.
Embodiments of the present disclosure utilize probabilities, and specifically Bayesian probability analysis, to enrich the decision space. Recorded or otherwise pre-determined probabilities are used to process a wideband IQ sample stream, isolating the noise and probability from the magnitude spectrum. During Bayesian Signal Detection and Localization, this information is used to detect and localize signals via the Bayesian Tiny-YOLO algorithm.
A spectrum analyzer embodying the present disclosure returns probabilities for every element in a spectrogram, producing a spectrogram magnitude spectrum and a probability spectrum. The probability spectrum is sensitive and capable of detecting weak signals. A probability, a spectral magnitude, and a noise estimate are provided as inputs to the YOLO algorithm to enhance RF localization.
It is believed that the inventive concepts disclosed herein and many of their attendant advantages will be understood by the foregoing description of embodiments of the inventive concepts disclosed, and it will be apparent that various changes may be made in the form, construction, and arrangement of the components thereof without departing from the broad scope of the inventive concepts disclosed herein or without sacrificing all of their material advantages; and individual features from various embodiments may be combined to arrive at other embodiments. The form herein before described being merely an explanatory embodiment thereof, it is the intention of the following claims to encompass and include such changes. Furthermore, any of the features disclosed in relation to any of the individual embodiments may be incorporated into any other embodiment.
Number | Name | Date | Kind |
---|---|---|---|
8326240 | Kadambe et al. | Dec 2012 | B1 |
8699971 | Kadambe et al. | Apr 2014 | B1 |
9450688 | Murphy | Sep 2016 | B1 |
9692529 | Music et al. | Jun 2017 | B1 |
9804253 | Nijsure | Oct 2017 | B2 |
10645601 | Kleinbeck et al. | May 2020 | B2 |
20080293353 | Mody | Nov 2008 | A1 |
20090047920 | Livsics | Feb 2009 | A1 |
20090299665 | Irizarry | Dec 2009 | A1 |
20190253905 | Kleinbeck | Aug 2019 | A1 |
Number | Date | Country |
---|---|---|
111181671 | May 2020 | CN |