Patent Application
20240397327
The present invention relates to spectrum analysis and management for electromagnetic signals, and more particularly for providing dynamic, prioritized spectrum utilization management.
It is generally known in the prior art to provide wireless communications spectrum management for detecting devices and for managing the space. Spectrum management includes the process of regulating the use of radio frequencies to promote efficient use and gain net social benefit. A problem faced in effective spectrum management is the various numbers of devices emanating wireless signal propagations at different frequencies and across different technological standards. Coupled with the different regulations relating to spectrum usage around the globe effective spectrum management becomes difficult to obtain and at best can only be reached over a long period of time.
Another problem facing effective spectrum management is the growing need from spectrum despite the finite amount of spectrum available. Wireless technologies and applications or services that require spectrum have exponentially grown in recent years. Consequently, available spectrum has become a valuable resource that must be efficiently utilized. Therefore, systems and methods are needed to effectively manage and optimize the available spectrum that is being used. Prior art patent documents include the following:
U.S. Patent Publication No. 2018/0352441 for Devices, methods, and systems with dynamic spectrum sharing by inventors Zheng, et al., filed Jun. 4, 2018 and published Dec. 6, 2018, is directed to devices, methods, and systems with dynamic spectrum sharing. A wireless communication device includes a software-defined radio, a spectrum sensing sub-system, a memory, and an electronic processor. The software-defined radio is configured to generate an input signal, and wirelessly communicate with one or more radio nodes using a traffic data channel and a broadcast control channel. The spectrum sensing sub-system is configured to sense local spectrum information from the input signal. The electronic processor is communicatively connected to the memory and the spectrum sensing sub-system and is configured to receive the local spectrum information from the spectrum sensing sub-system, receive spectrum information from the one or more radio nodes, and allocate resources for the traffic data channel based on the local spectrum information and the spectrum information that is received from the one or more radio nodes.
U.S. Patent Publication No. 2018/0295607 for Method and apparatus for adaptive bandwidth usage in a wireless communication network by inventors Lindoff, et al., filed Oct. 10, 2017 and published Oct. 11, 2018, is directed to reconfiguration of a receiver bandwidth of the wireless device is initiated to match the second scheduling bandwidth, wherein the second scheduling bandwidth is larger than a first scheduling bandwidth currently associated with the wireless device, and wherein the first and second scheduling bandwidths respectively define the bandwidth used for scheduling transmissions to the wireless device.
U.S. Pat. No. 9,538,528 for Efficient co-existence method for dynamic spectrum sharing by inventors Wagner, et al., filed Oct. 6, 2011 and issued Jan. 3, 2017, is directed to an apparatus that defines a set of resources out of a first number of orthogonal radio resources and controls a transmitting means to simultaneously transmit a respective first radio signal for each resource on all resources of the set. A respective estimated interference is estimated on each of the resources of the set when the respective first radio signals are transmitted simultaneously. A first resource of the set is selected if the estimated interference on the first resource exceeds a first predefined level and, in the set, the first resource is replaced by a second resource of the first number of resources not having been part of the set. Each of the controlling and the estimating, the selecting, and the replacing is performed in order, respectively, for a predefined time.
U.S. Pat. No. 8,972,311 for Intelligent spectrum allocation based on user behavior patterns by inventors Srikanteswara, et al., filed Jun. 26, 2012 and issued Mar. 3, 2015, is directed to a platform to facilitate transferring spectrum rights is provided that includes a database to ascertain information regarding available spectrum for use in wireless communications. A request for spectrum use from an entity needing spectrum may be matched with available spectrum. This matching comprises determining a pattern in user requests overtime to optimize spectrum allocation. The Cloud Spectrum Services (CSS) process allows entities to access spectrum they would otherwise not have; it allows the end user to complete their download during congested periods while maintaining high service quality; and it allows the holder of rental spectrum to receive compensation for an otherwise idle asset.
U.S. Pat. No. 10,536,210 for Interference suppressing method and device in dynamic frequency spectrum access system by inventors Zhao, et al., filed Apr. 14, 2016 and issued Jan. 14, 2020, is directed to an interference suppressing method and device in a dynamic frequency spectrum access (DSA) system. The system includes: a frequency spectrum management device, a primary system including a plurality of primary devices, and a secondary system including a plurality of secondary devices. The method includes: transmitting position information of each of the secondary devices to the frequency spectrum management device; determining, by the frequency spectrum management device, a weight factor for a specific secondary device according to the received position formation; and performing a second-stage precoding, and in the second-stage precoding, adjusting, by using the weight factor, an estimated power of the specific secondary device leaking to the other secondary device.
U.S. Pat. No. 10,582,401 for Large scale radio frequency signal information processing and analysis system by inventors Mengwasser, et al., filed Apr. 15, 2019 and issued Mar. 3, 2020, is directed to a large-scale radio frequency signal information processing and analysis system that provides advanced signal analysis for telecommunication applications, including band capacity and geographical density determinations and detection, classification, identification, and geolocation of signals across a wide range of frequencies and across broad geographical areas. The system may utilize a range of novel algorithms for bin-wise processing, Rayleigh distribution analysis, telecommunication signal classification, receiver anomaly detection, transmitter density estimation, transmitter detection and location, geolocation analysis, telecommunication activity estimation, telecommunication utilization estimation, frequency utilization estimation, and data interpolation.
U.S. Pat. No. 10,070,444 for Coordinated spectrum allocation and de-allocation to minimize spectrum fragmentation in a cognitive radio network by inventors Markwart, et al., filed Dec. 2, 2011 and issued Sep. 4, 2018, is directed to an apparatus and a method by which a fragmentation probability is determined which indicates a probability of fragmentation of frequency resources in at least one network section for at least one network operating entity. Moreover, an apparatus and a method by which frequency resources in at least one network section are allocated and/or de-allocated, priorities of frequency resources are defined for at least one network operating entity individually, and allocating and/or de-allocating of the frequency resources for the at least one network operating entity is performed based on the priorities. For allocating and/or de-allocating of the frequency resources, also the fragmentation probability may be taken into account.
U.S. Patent Publication No. 2020/0007249 for Wireless signal monitoring and analysis, and related methods, systems, and devices by inventors Derr, et al., filed Sep. 12, 2019 and published Jan. 2, 2020, is directed to wireless signal classifiers and systems that incorporate the same may include an energy-based detector configured to analyze an entire set of measurements and generate a first single classification result, a cyclostationary-based detector configured to analyze less than the entire set of measurements and generate a second signal classification result; and a classification merger configured to merge the first signal classification result and the second signal classification result. Ensemble wireless signal classification and systems and devices the incorporate the same are disclosed. Some ensemble wireless signal classification may include energy-based classification processes and machine learning-based classification processes. Incremental machine learning techniques may be incorporated to add new machine learning-based classifiers to a system or update existing machine learning-based classifiers.
U.S. Patent Publication No. 2018/0324595 for Spectral sensing and allocation using deep machine learning by inventor Shima, filed May 7, 2018 and published Nov. 8, 2018, is directed to methods and systems for identifying occupied areas of a radio frequency (RF) spectrum, identifying areas within that RF spectrum that are unusable for further transmissions, and identifying areas within that RF spectrum that are occupied but that may nonetheless be available for additional RF transmissions are provided. Implementation of the method then systems can include the use of multiple deep neural networks (DNNs), such as convolutional neural networks (CNN's), that are provided with inputs in the form of RF spectrograms. Embodiments of the present disclosure can be applied to cognitive radios or other configurable communication devices, including but not limited to multiple inputs multiple output (MIMO) devices and 5G communication system devices.
U.S. Patent Publication No. 2017/0041802 for Spectrum resource management device and method by inventors Sun, et al., filed May 27, 2015 and published Feb. 9, 2017, is directed to a spectrum resource management device: determines available spectrum resources of a target communication system, so that aggregation interference caused by the target communication system and a communication system with a low right against a communication system with a high right in a management area does not exceed an interference threshold of the communication system with a high right; reduces available spectrum resources of the communication system with a low right, so that the interference caused by the communication system with a low right against the target communication system does not exceed an interference threshold of the target communication system; and updates the available spectrum resources of the target communication system according to the reduced available spectrum resources of the communication system with a low right, so that the aggregation interference does not exceed the interference threshold of the communication system with a high right.
U.S. Pat. No. 9,900,899 for Dynamic spectrum allocation method and dynamic spectrum allocation device by inventors Jiang, et al., filed Mar. 26, 2014 and issued Feb. 20, 2018, is directed to a dynamic spectrum allocation method and a dynamic spectrum allocation device. In the method, a centralized node performs spectrum allocation and transmits a spectrum allocation result to each communication node, so that the communication node operates at a corresponding spectrum resource in accordance with the spectrum allocation result and performs statistics of communication quality measurement information. The centralized node receives the communication quality measurement information reported by the communication node, and determines whether or not it is required to trigger the spectrum re-allocation for the communication node in accordance with the communication quality measurement information about the communication node. When it is required to trigger the spectrum re-allocation, the centralized node re-allocates the spectrum for the communication node.
U.S. Pat. No. 9,578,516 for Radio system and spectrum resource reconfiguration method thereof by inventors Liu, et al., filed Feb. 7, 2013 and issued Feb. 21, 2017, is directed to a radio system and a spectrum resource reconfiguration method thereof. The method comprises: a Reconfigurable Base Station (RBS) divides subordinate nodes into groups according to attributes of the subordinate nodes, and sends a reconfiguration command to a subordinate node in a designated group, and the RBS and the subordinate node execute reconfiguration of spectrum resources according to the reconfiguration command; or, the RBS executes reconfiguration of spectrum resources according to the reconfiguration command; and a subordinate User Equipment (UE) accessing to a reconfigured RBS after interruption. The reconfiguration of spectrum resources of a cognitive radio system can be realized.
U.S. Pat. No. 9,408,210 for Method, device and system for dynamic frequency spectrum optimization by inventors Pikhletsky, et al., filed Feb. 25, 2014 and issued Aug. 2, 2016, is directed to a method, a device and a system for dynamic frequency spectrum optimization. The method includes: predicting a traffic distribution of terminal(s) in each cell of multiple cells; generating multiple frequency spectrum allocation schemes for the multiple cells according to the traffic distribution of the terminal(s) in each cell, wherein each frequency spectrum allocation scheme comprises frequency spectrum(s) allocated for each cell; selecting a frequency spectrum allocation scheme superior to a current frequency spectrum allocation scheme of the multiple cells from the multiple frequency spectrum allocation schemes according to at least two network performance indicators of a network in which the multiple cells are located; and allocating frequency spectrum(s) for the multiple cells using the selected frequency spectrum allocation scheme. This improves the utilization rate of the frequency spectrum and optimizes the multiple network performance indicators at the same time.
U.S. Pat. No. 9,246,576 for Apparatus and methods for dynamic spectrum allocation in satellite communications by inventors Yanai, et al., filed Mar. 5, 2012 and issued Jan. 26, 2016, is directed to a communication system including Satellite Communication apparatus providing communication services to at least a first set of communicants, the first set of communicants including a first plurality of communicants, wherein the communication services are provided to each of the communicants in accordance with a spectrum allocation corresponding thereto, thereby to define a first plurality of spectrum allocations apportioning a first predefined spectrum portion among the first set of communicants; and Dynamic Spectrum Allocations apparatus operative to dynamically modify at least one spectrum allocation corresponding to at least one of the first plurality of communicants without exceeding the spectrum portion.
U.S. Pat. No. 8,254,393 for Harnessing predictive models of durations of channel availability for enhanced opportunistic allocation of radio spectrum by inventor Horvitz, filed Jun. 29, 2007 and issued Aug. 28, 2012, is directed to a proactive adaptive radio methodology for the opportunistic allocation of radio spectrum is described. The methods can be used to allocate radio spectrum resources by employing machine learning to learn models, via accruing data over time, that have the ability to predict the context-sensitive durations of the availability of channels. The predictive models are combined with decision-theoretic cost-benefit analyses to minimize disruptions of service or quality that can be associated with reactive allocation policies. Rather than reacting to losses of channel, the proactive policies seek switches in advance of the loss of a channel. Beyond determining durations of availability for one or more frequency bands statistical machine learning also be employed to generate price predictions in order to facilitate a sale or rental of the available frequencies, and these predictions can be employed in the switching analyses. The methods can be employed in non-cooperating distributed models of allocation, in centralized allocation approaches, and in hybrid spectrum allocation scenarios.
U.S. Pat. No. 6,990,087 for Dynamic wireless resource utilization by inventors Rao, et al., filed Apr. 22, 2003 and issued Jan. 24, 2006, is directed to a method for dynamic wireless resource utilization includes monitoring a wireless communication resource; generating wireless communication resource data; using the wireless communication resource data, predicting the occurrence of one or more holes in a future time period; generating hole prediction data; using the hole prediction data, synthesizing one or more wireless communication channels from the one or more predicted holes; generating channel synthesis data; receiving data reflecting feedback from a previous wireless communication attempt and data reflecting a network condition; according to the received data and the channel synthesis data, selecting a particular wireless communication channel from the one or more synthesized wireless communication channels; generating wireless communication channel selection data; using the wireless communication channel selection data, instructing a radio unit to communicate using the selected wireless communication channel; and instructing the radio unit to discontinue use of the selected wireless communication channel after the communication has been completed.
U.S. Pat. No. 10,477,342 for Systems and methods of using wireless location, context, and/or one or more communication networks for monitoring for, preempting, and/or mitigating pre-identified behavior by inventor Williams, filed Dec. 13, 2017 and issued Nov. 12, 2019, is directed to systems and methods of using location, context, and/or one or more communication networks for monitoring for, preempting, and/or mitigating pre-identified behavior. For example, exemplary embodiments disclosed herein may include involuntarily, automatically, and/or wirelessly monitoring/mitigating undesirable behavior (e.g., addiction related undesirable behavior, etc.) of a person (e.g., an addict, a parolee, a user of a system, etc.). In an exemplary embodiment, a system generally includes a plurality of devices and/or sensors configured to determine, through one or more communications networks, a location of a person and/or a context of the person at the location; predict and evaluate a risk of a pre-identified behavior by the person in relation to the location and/or the context; and facilitate one or more actions and/or activities to mitigate the risk of the pre-identified behavior, if any, and/or react to the pre-identified behavior, if any, by the person.
U.S. Pat. No. 8,442,789 for Method and device for determining a frequency mask for a frequency spectrum by inventor Eckert, et al., filed Dec. 14, 2010 and issued May 14, 2013, is directed to a method and a device for determining a frequency mask disposed above or below a frequency spectrum of a detected signal determines every individual ordinate value of a first envelope curve disposed completely above or below the frequency spectrum as the maximum value or minimum value of a given number of respectively adjacent ordinate values of the frequency spectrum linked to a window function. Following this, each individual ordinate value of a second envelope curve disposed completely above or below the frequency spectrum and completely above or below the first envelope curve is determined as the maximum value or minimum value of a given number of respectively adjacent ordinate values of the frequency spectrum linked to a window function. Finally, a minimum number of ordinate values of the frequency mask from ordinate values of the first and/or second envelope curve disposed completely between the first and second envelope curve is determined, wherein in each case two successive ordinate values of the frequency mask with a maximum horizontal spacing distance within the first and second envelope curve can be reached in a linear manner relative to one another.
U.S. Pat. No. 6,983,009 for Median weighted tracking for spread-spectrum communications by inventor Lomp, filed Jan. 18, 2001 and issued Jan. 3, 2006, is directed to an improvement for a method and system for tracking a spreading code, used in a code division multiple access (CDMA) system. An input signal has spread-spectrum modulation. The spreading code embedded in the spread-spectrum modulation has a plurality of chips. The input signal is sampled, and half-chip offset samples are formed from the sampled input signal. An even set of the half-chip offset samples are grouped into an early set of samples, and an odd set of the half-chip offset samples are grouped into a late set of samples. Each early set of samples is multiplied by the spreading code c(n+1), c(n+2), . . . , c(n+L), to generate a first plurality of products. L is approximately equal to the number of chips of delay between the earliest and latest multipath signals. A first plurality of sums and magnitudes are computed from the first plurality of products. The first plurality of magnitudes are summed to generate an early signal-energy value. Each late set of samples is multiplied by the spreading-code c(n−1), c(n−2), . . . , c(n−L), thereby generating a second plurality of products. A second plurality of sums and magnitudes are computed from the second plurality of products. The second plurality of magnitudes are summed to generate a late signal-energy value. A difference is calculated between the early signal-energy value and the late signal-energy value, thereby producing an error signal.
U.S. Pat. No. 5,559,756 for Acoustic intercept receiver-combined frequency and bearing processor by inventor Connolly, Jr., filed Jul. 19, 1971 and issued Sep. 24, 1996, is directed to a signal processor for obtaining frequency and bearing information of an ustical signal. Responsive to the acoustical signal, a multimode hydrophone generates a plurality of electrical signals which are combined to form a first omnidirectional signal and two spatially orthogonal directional signals. The directional signals are then combined to form a second omnidirectional signal. Additional circuitry is provided to analyze the two omnidirectional signals using the cross-spectral density function of the two omnidirectional signals to obtain said frequency and bearing information.
U.S. Pat. No. 4,944,036 for Signature filter system by inventor Hyatt, filed Aug. 10, 1987 and issued Jul. 24, 1990, is directed to a filtering system is provided for acquiring and processing signals using a sampled filter for signal separation and signal enhancement; such as for determining locations, distances, and times in a geophysical exploration system. Signature signals permit mixing and separation with sampled filters, such as for sharing common circuitry and for increasing the amount of acquired information. A sampled filter, such as a digital correlator, is provided for generating high resolution output data in response to low resolution input data processed with low resolution computation circuits. A real-time time-domain correlator is provided with single-bit resolution computational elements to provide improved correlation filtering. A high speed real-time correlator is provided to enhance signals with compositing-after-correlation and with correlation using a plurality of correlation operators.
U.S. Pat. No. 4,903,297 for Restricted access television transmission system by inventors Rist, et al., filed Nov. 7, 1988 and issued Feb. 20, 1990 is directed to a Television Signal Transmission Security System which provides a higher degree of security then previously possible by utilizing encoding and decoding technology which effectively prevents pirating by amateurs or experimenters. The television signal transmitted is encoded by injecting one or more modulated interfering signals in specific frequency slots in close proximity to the video carrier. Continuous or alternating interfering signals can be injected either above or below the video carrier between harmonics of the horizontal frequencies. Combinations of interfering signals provide coding techniques making the system virtually pirate proof. The interfering signal is removed by very narrow band rejection filters having a rejection band attenuation greater than about 40 dB over a bandwidth equal to the bandwidth between adjacent harmonics of the horizontal sweep frequency. The filters are constructed using advanced technology to produce the quartz crystal bulk resonators or surface acoustic wave filters. Pre-compensation at the transmitter improves overall amplitude and phase response to provide a nearly perfect decoded picture.
U.S. Pat. No. 11,943,003 for Wireless device classification apparatus and method by inventors Elmaghbub, et al., filed Oct. 8, 2021 and issued Mar. 26, 2024, is directed to a scheme for identifying wireless devices by capturing out-of-band information in addition to in-band information from wireless devices for enabling accurate classification of wireless devices. Both the in-band and out-of-band spectrum emissions of the received signal are used to capture hardware signatures and features. These hardware signatures are used to discriminate different wireless devices uniquely and efficiently, even when the devices have the same hardware with significantly reduced distortions. The out-of-band information can be extracted using radios with software defined capabilities. Deep learning-based device classification technique is applied that uses IQ samples collected from the RF signals to efficiently identify and classify high-performing transmitters that have the same, minimally distorted hardware components.
U.S. Patent Pub No. 2024/0015776 for Avoiding cellular co-existence interference in a wi-fi network by inventors Gandhi, et al., filed Jan. 3, 2023 and published Jan. 11, 2024, is directed to techniques for wireless communications are disclosed. These techniques include identifying a change in at least one of: (i) a WiFi radio channel or (ii) a cellular radio channel for a wireless station (STA) supporting both WiFi and cellular radio access technologies. The techniques further include determining one or more WiFi radio channels subject to interference from the cellular radio for the STA, based on a network message received from the STA, and modifying one or more parameters for WiFi communication relating to the STA, based on the determined one or more WiFi radio channels subject to interference.
U.S. Patent Pub No. 2023/0324512 for Radar device with compensation of nonlinearities by inventor Christoffers, filed Mar. 31, 2023 and published Oct. 10, 2023, is directed to this description relates to a method for suppressing intermodulation distortion in a digital output signal of a radar device. In one implementation, the method includes-in a first mode-feeding a test signal into a receiving channel, the test signal is fed to a mixer contained in the receiving channel and is downconverted to a baseband, a baseband signal that includes intermodulation products on account of a nonlinearity of the transfer characteristic of the receiving channel being provided at the mixer output. The digital output signal is generated based on the baseband signal. The method further includes-in the first mode-determining an intermodulation product and, on the basis thereof, ascertaining a parameter of a model characterizing the nonlinearity. In a second mode, in which an antenna signal is fed to the mixer-suppressing the intermodulation product in the digital output signal based on the parameter and the baseband signal.
U.S. Patent Pub No. 2023/0232210 for Transpositional modulation fortified communications by inventor Velazquez, et al., filed May 23, 2022 and published Jul. 20, 2023, is directed to a method and system for transpositional modulation fortified communication includes an original carrier of an RF channel operating within a spectral mask. The original carrier has a carrier signal with a first quantity of data. At least one transpositional modulation (TM) channel has a TM signal second quantity of data. The at least one TM channel is added to the original carrier thereby generating a TM fortified carrier signal having the first and second quantities of data. The at least one TM channel and the original carrier do not exceed the spectral mask. At least one device with a receiver receives the TM fortified carrier signal.
U.S. Pat. No. 10,681,573 for System and methods for identifying and locating distinct interference sources in a wireless network by inventors Christopherson, et al., filed May 7, 2018 and issued Jun. 9, 2020, is directed to a system described herein may provide a mechanism for identifying unique sources of interference in a wireless telecommunication network. A unique noise signature, associated with a particular source of radio frequency (“RF”) interference, may be identified by detecting physical resource blocks (“PRBs”), in a sector, that exhibit excessive interference, as compared to surrounding PRBs. The unique noise signature may be detected across multiple sectors, and a location of the interference source may be determined. Corrective action may be taken once an interference source is detected, such as by ceasing to utilize, or by reducing the utilization of, affected PRBs.
U.S. Pat. No. 10,560,143 for Detection of intermodulation issues and transmission scheme configuration to remedy intermodulation issues by inventors Zeng, et al., filed Aug. 30, 2018 and issued Feb. 11, 2020, directed to apparatuses, systems, and methods for a wireless device to detect intermodulation issues and configure a transmission scheme to remedy detected intermodulation issues. The wireless device may perform measurements on a downlink carrier while one uplink carrier is scheduled for the wireless device. The wireless device may also perform measurements on the downlink carrier while two uplink carriers are scheduled for the wireless device. The wireless device may provide information based on those measurements to a serving base station. The base station may determine that an intermodulation issue is occurring at the wireless device based on the information provided, and may configure the wireless device to use a single uplink carrier at a time based at least in part on the intermodulation issue.
U.S. Pat. No. 10,904,781 for Mobility measurements with interference caused by intermodulation products by inventors Gheorghiu, et al., filed Sep. 7, 2018 and issued Jan. 26, 2021, is directed to methods, systems, and devices for wireless communication are described. A user equipment (UE) may mitigate self-interference and intermodulation products caused by communicating over two carriers in order to improve measurements of a third carrier. The UE may determine a measurement configuration to determine the quality of the third carrier. The measurement configuration may include identifying time periods with no scheduled uplink transmissions, time periods with a transmit power below a power threshold, time periods with frequency locations with an expected lower intermodulation interference, or time periods with a scheduled reference signal transmission (e.g., a synchronization signal (SS) block). The UE may also reduce a transmit power for a time period or drop a scheduled uplink transmission in order to perform more accurate measurements on the third carrier. In some cases, a base station may schedule a measurement gap for the UE to perform the measurements.
The present invention relates to spectrum analysis and management for electromagnetic signals, and more particularly for providing dynamic, prioritized spectrum utilization management. Furthermore, the present invention relates to spectrum analysis and management for electromagnetic (e.g., radio frequency (RF)) signals, and for automatically identifying baseline data and changes in state for signals from a multiplicity of devices in a wireless communications spectrum, and for providing remote access to measured and analyzed data through a virtualized computing network. In an embodiment, signals and the parameters of the signals are identified and indications of available frequencies are presented to a user. In another embodiment, the protocols of signals are also identified. In a further embodiment, the modulation of signals, data types carried by the signals, and estimated signal origins are identified.
It is an object of this invention to prioritize and manage applications in the wireless communications spectrum, while also optimizing application performance.
In one embodiment, the present invention provides a system for autonomous spectrum management in an electromagnetic environment including at least one monitoring sensor operable to autonomously monitor the electromagnetic environment and create measured data based on the electromagnetic environment, at least one data analysis engine for analyzing the measured data, a semantic engine including a programmable rules and policy editor, and a tip and cue server, wherein the at least one data analysis engine includes a detection engine and a learning engine, wherein the detection engine is operable to automatically detect at least one signal of interest, wherein the learning engine is operable to learn the electromagnetic environment, wherein the programmable rules and policy editor includes at least one rule and/or at least one policy, wherein the tip and cue server is operable to use analyzed data from the at least one data analysis engine to create actionable data, and wherein the tip and cue server and the at least one data analysis engine are operable to run autonomously without requiring user interaction and/or input.
In another embodiment, the present invention provides a system for autonomous spectrum management in a radio frequency (RF) environment including at least one monitoring sensor operable to autonomously monitor the RF environment and create measured data based on the RF environment, at least one data analysis engine for analyzing the measured data, a semantic engine including a programmable rules and policy editor, and a tip and cue server, wherein the at least one data analysis engine includes a detection engine, a geolocation engine, and a learning engine, wherein the detection engine is operable to automatically detect at least one signal of interest, wherein the learning engine is operable to learn the RF environment, wherein the programmable rules and policy editor includes at least one rule and/or at least one policy, wherein the semantic engine is operable to create a semantic map including target data, wherein the tip and cue server is operable to use analyzed data from the at least one data analysis engine to create actionable data, and wherein the tip and cue server and the at least one data analysis engine are operable to run autonomously without requiring user interaction and/or input.
In yet another embodiment, the present invention provides a method for autonomous spectrum management in an electromagnetic environment including providing a semantic engine including a programmable rules and policy editor, wherein the programmable rules and policy editor includes at least one rule and/or at least one policy, monitoring the electromagnetic environment using at least one monitoring sensor and creating measured data based on the electromagnetic environment, analyzing the measured data using at least one data analysis engine, thereby creating analyzed data, wherein the at least one data analysis engine includes a detection engine and a learning engine, learning the electromagnetic environment using the learning engine, automatically detecting at least one signal of interest using the detection engine, and creating actionable data using a tip and cue server based on the analyzed data from the at least one data analysis engine, wherein the tip and cue server and the at least one data analysis engine are operable to run autonomously without requiring user interaction and/or input.
These and other aspects of the present invention will become apparent to those skilled in the art after a reading of the following description of the preferred embodiment when considered with the drawings, as they support the claimed invention.
The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee.
The present invention is generally directed to spectrum analysis and management for electromagnetic signals, and more particularly for providing dynamic, prioritized spectrum utilization management.
In one embodiment, the present invention provides a system for autonomous spectrum management in an electromagnetic environment including at least one monitoring sensor operable to autonomously monitor the electromagnetic environment and create measured data based on the electromagnetic environment, at least one data analysis engine for analyzing the measured data, a semantic engine including a programmable rules and policy editor, and a tip and cue server, wherein the at least one data analysis engine includes a detection engine and a learning engine, wherein the detection engine is operable to automatically detect at least one signal of interest, wherein the learning engine is operable to learn the electromagnetic environment, wherein the programmable rules and policy editor includes at least one rule and/or at least one policy, wherein the tip and cue server is operable to use analyzed data from the at least one data analysis engine to create actionable data, and wherein the tip and cue server and the at least one data analysis engine are operable to run autonomously without requiring user interaction and/or input. In one embodiment, the tip and cue server is operable to activate an alarm and/or provide at least one report based on the actionable data. In one embodiment, the alarm is stored in a database for visualization. In one embodiment, the at least one monitoring sensor includes at least one antenna, at least one antenna array, at least one radio server, and/or at least one software defined radio. In one embodiment, one or more of the at least one monitoring sensor is integrated with at least one camera to capture video and/or still images. In one embodiment, the at least one data analysis engine further includes an identification engine, a classification engine, and/or a geolocation engine. In one embodiment, the system further includes a resource brokerage application, wherein the resource brokerage application is operable to optimize resources to improve performance of at least one customer application and/or at least one customer device. In one embodiment, the system further includes a certification and compliance application, wherein the certification and compliance application is operable to determine if at least one customer application and/or at least one customer device is behaving according to the at least one rule and/or the at least one policy. In one embodiment, the system further includes a survey occupancy application, wherein the survey occupancy application is operable to determine occupancy in frequency bands and schedule occupancy in at least one frequency band. In one embodiment, the actionable data indicates that the at least one signal of interest is behaving like a drone. In one embodiment, the semantic engine is operable to receive queries, searches, and/or search-related functions using natural language. In one embodiment, the semantic engine is operable to receive data as audio data, text data, video data, and/or image data. In one embodiment, the semantic engine is operable to create a semantic map including target data, wherein the semantic engine is operable to analyze related data and/or data with similar characteristics to the target data. In one embodiment, the system further includes a translator, wherein the translator is operable to receive data input including at least one use case, at least one objective, and/or at least one signal. In one embodiment, the learning engine is operable to use machine learning (ML), artificial intelligence (AI), deep learning (DL), neural networks (NNs), artificial neural networks (ANNs), support vector machines (SVMs), Markov decision process (MDP), natural language processing (NLP), control theory, and/or statistical learning techniques. In one embodiment, the learning engine is operable to compute a set of possible conditional probabilities depicting a set of all possible outputs based on input measurements to provide a predicted outcome using a data model. In one embodiment, the learning engine is operable to use third party data, wherein the third party data includes social media, population, real estate, traffic, geographic information system (GIS), network, signal site, site issue, and/or crowdsourced information. In one embodiment, the learning engine is operable to determine whether a data set processed and/or analyzed represents a sufficient statistical data set. In one embodiment, the learning engine includes a learning engine software development kit (SDK) operable to manage system resources relating to monitoring, logging, and/or organizing learning aspects of the system. In one embodiment, the semantic engine further includes a language dictionary. In one embodiment, the actionable data indicates that one or more of the at least one signal of interest is behaving like a drone. In one embodiment, the actionable data indicates a location for at least one macrosite and/or at least one tower. In one embodiment, the actionable data is created in near-real time.
In another embodiment, the present invention provides a system for autonomous spectrum management in a radio frequency (RF) environment including at least one monitoring sensor operable to autonomously monitor the RF environment and create measured data based on the RF environment, at least one data analysis engine for analyzing the measured data, a semantic engine including a programmable rules and policy editor, and a tip and cue server, wherein the at least one data analysis engine includes a detection engine, a geolocation engine, and a learning engine, wherein the detection engine is operable to automatically detect at least one signal of interest, wherein the learning engine is operable to learn the RF environment, wherein the programmable rules and policy editor includes at least one rule and/or at least one policy, wherein the semantic engine is operable to create a semantic map including target data, wherein the tip and cue server is operable to use analyzed data from the at least one data analysis engine to create actionable data, and wherein the tip and cue server and the at least one data analysis engine are operable to run autonomously without requiring user interaction and/or input. In one embodiment, the system further includes a visualization of the semantic map.
In yet another embodiment, the present invention provides a method for autonomous spectrum management in an electromagnetic environment including providing a semantic engine including a programmable rules and policy editor, wherein the programmable rules and policy editor includes at least one rule and/or at least one policy, monitoring the electromagnetic environment using at least one monitoring sensor and creating measured data based on the electromagnetic environment, analyzing the measured data using at least one data analysis engine, thereby creating analyzed data, wherein the at least one data analysis engine includes a detection engine and a learning engine, learning the electromagnetic environment using the learning engine, automatically detecting at least one signal of interest using the detection engine, and creating actionable data using a tip and cue server based on the analyzed data from the at least one data analysis engine, wherein the tip and cue server and the at least one data analysis engine are operable to run autonomously without requiring user interaction and/or input. In one embodiment, the method further includes the tip and cue server activating an alarm and/or providing at least one report based on the actionable data. In one embodiment, the method further includes the semantic engine creating a semantic map including target data. In one embodiment, the actionable data is created in near-real time.
Traditional management of spectrum is static, based on licenses that are geographical and band specific. The Federal Communications Commission (FCC) has allocated spectrum into a table. Utilization is increased by slicing the spectrum into finer slices. Additionally, interference is limited by imposing penalties by strict geographical band utilization rules and licenses. However, these traditional methods of spectrum management do not work with increasing demand and new services coming out. The new services would have to be at higher frequencies (e.g., above 10 GHz), which is very expensive and requires costly transceiver with a limited distance range.
Spectrum is valuable because it is a finite resource. Further, the demand for spectrum is ever-increasing. The Shannon-Hartley theorem calculates the maximum rate at which information can be transmitted over a communications channel of a specified bandwidth in the presence of noise as follows:
where C is the channel capacity in bits per second, BW is the bandwidth of the channel in Hz, and SNR is the signal-to-noise ratio.
Early attempts at managing spectrum include developing technology that increases spectrum efficiency (i.e., maximizing SNR). Although this results in more bits per Hz, the logarithmic function limits the gains in channel capacity resulting from improving technology. Additional attempts at managing spectrum also include developing technology to enable use of alternate spectrum (e.g., free-space optical (FSO) communication). However, using alternate spectrum, such as higher frequencies, leads to smaller ranges, line of sight limitations, increased elevation of transmission structures, and/or expensive infrastructure.
The missing component to spectrum management is bandwidth management. Bandwidth management provides flexible utilization of the spectrum, enables management of spectrum resources and users, while allowing spectrum usage to be quantified. The majority of applications using the spectrum can coexist if each application knows about the spectrum needs of other applications and how they plan to use the spectrum. However, because the needs of each application are dynamic, a dynamic spectrum management system is needed. The present invention allows autonomous, dynamic sharing of the electromagnetic spectrum to allow maximum utilization by diverse applications according to specific utilization rules (dynamic and/or static) while maintaining minimum interference between applications. This requires new tools that provide dynamic environmental spectral awareness of all signals present in the electromagnetic (e.g., radio frequency (RF)) environment to properly execute utilization rules, which are operable to describe or facilitate sharing spectrum resources among several competing users or protect one service user from others, among others.
5G requires spectrum awareness. Larger blocks of spectrum are required to support higher speeds. Dynamic spectrum sharing is necessary to make the spectrum assets available. Further, visibility of spectrum activity is required to support reliability targets. Interference avoidance and resolution must be embedded. Internet of Things (IoT)/machine communication wireless dependency elevates the need for real-time RF visibility to avoid disruption and safety concerns.
One problem facing effective spectrum management is the trade-off between power and accuracy of the management system. A more accurate management system would require more power while a more efficient system would sacrifice accuracy. Therefore, dynamic systems that can recommend and adjust power consumption and accuracy based on customer goals are needed.
Intermodulation occurs when a strong signal, in the presence of weaker signals, applies distortion to the RF environment. Broadcasters, for example, use older modulation schemes where emitted signal power is directly proportional to signal distance. A cellular signal next to a broadcasting station will cause intermodulation distortion (IMD) because there is now a high power signal right next to a weaker signal. To mitigate intermodulation, broadcast signals are filtered out because they are on a lower band and far away enough from the cellular signal that is at a higher band. However, as the demand for spectrum rises and signals cover more frequencies, IMD becomes an increasing issue. Therefore, there is a need for dynamic spectrum management that identifies intermodulation occurrences in the electromagnetic (e.g. RF) environment and mitigates the surrounding signals accordingly.
The system of the present invention provides scalable processing capabilities at the edge. Edge processing is fast and reliable with low latency. Environmental sensing processes optimize collection and analytics, making data sets manageable. Advantageously, the system minimizes backhaul requirements, allowing for actionable data to be delivered faster and more efficiently.
Deep learning techniques extract and deliver knowledge from large data sets in near-real time. These deep learning techniques are critical for identifying and classifying signals. Edge analytics further allow third party data (e.g., social media, population information, real estate information, traffic information, geographic information system) to further enrich captured data sets. A semantic engine and inference reasoner leverages insights generated by machine learning and edge analytics. Ontologies are established allowing for the creation of knowledge operable to inform and direct actions and/or decisions.
Referring now to the drawings in general, the illustrations are for the purpose of describing one or more preferred embodiments of the invention and are not intended to limit the invention thereto.
The present invention provides systems, methods, and apparatuses for spectrum analysis and management by identifying, classifying, and cataloging at least one or a multiplicity of signals of interest based on electromagnetic spectrum measurements (e.g., radiofrequency spectrum measurements), location, and other measurements. The present invention uses real-time and/or near real-time processing of signals (e.g., parallel processing) and corresponding signal parameters and/or characteristics in the context of historical, static, and/or statistical data for a given spectrum, and more particularly, all using baseline data and changes in state for compressed data to enable near real-time analytics and results for individual monitoring sensors and for aggregated monitoring sensors for making unique comparisons of data.
The systems, methods, and apparatuses according to the present invention preferably are operable to detect in near real time, and more preferably to detect, sense, measure, and/or analyze in near real time, and more preferably to perform any near real time operations within about 1 second or less. In one embodiment, near real time is defined as computations completed before data marking an event change. For example, if an event happens every second, near real time is completing computations in less than one second. Advantageously, the present invention and its real time functionality described herein uniquely provide and enable the system to compare acquired spectrum data to historical data, to update data and/or information, and/or to provide more data and/or information on open space. In one embodiment, information (e.g., open space) is provided on an apparatus unit or a device that is occupying the open space. In another embodiment, the system compares data acquired with historically scanned (e.g., 15 min to 30 days) data and/or or historical database information in near-real time. Also, the data from each monitoring sensor, apparatus unit, or device and/or aggregated data from more than one monitoring sensor, apparatus unit, and/or device are communicated via a network to at least one server computer and stored on a database in a virtualized or cloud-based computing system, and the data is available for secure, remote access via the network from distributed remote devices having software applications (apps) operable thereon, for example by web access (mobile app) or computer access (desktop app). The at least one server computer is operable to analyze the data and/or the aggregated data.
The system is operable to monitor the electromagnetic (e.g., RF) environment via at least one monitoring sensor. The system is then operable to analyze data acquired from the at least one monitoring sensor to detect, classify, and/or identify at least one signal in the electromagnetic environment. The system is operable to learn the electromagnetic environment, which allows the system to extract environmental awareness. In a preferred embodiment, the system extracts environmental awareness by including customer goals. The environmental awareness is combined with the customer goals, customer defined policies, and/or rules (e.g., customer defined rules, government defined rules) to extract actionable information to help the customer optimize performance according to the customer goals. The actionable information is combined and correlated with additional information sources to enhance customer knowledge and user experience through dynamic spectrum utilization and prediction models.
The systems, methods, and apparatuses of the various embodiments enable spectrum utilization management by identifying, classifying, and cataloging signals of interest based on electromagnetic (e.g., radio frequency) measurements. In one embodiment, signals and parameters of the signals are identified. In another embodiment, indications of available frequencies are presented to a user and/or user equipment. In yet another embodiment, protocols of signals are also identified. In a further embodiment, the modulation of signals, data types carried by the signals, and estimated signal origins are identified. Identification, classification, and cataloging signals of interest preferably occurs in real time or near-real time.
Embodiments are directed to a spectrum monitoring unit that is configurable to obtain spectrum data over a wide range of wireless communication protocols. Embodiments also provide for the ability to acquire data from and send data to database depositories that are used by a plurality of spectrum management customers and/or applications or services requiring spectrum resources.
In one embodiment, the system includes at least one spectrum monitoring unit. Each of the at least one spectrum monitoring unit includes at least one monitoring sensor that is preferably in network communication with a database system and spectrum management interface. In one embodiment, the at least one spectrum monitoring unit and/or the at least one monitoring sensor is portable. In a preferred embodiment, one or more of the at least one spectrum monitoring unit and/or the at least one monitoring sensor is a stationary installation. The at least one spectrum monitoring unit and/or the at least one monitoring sensor is operable to acquire different spectrum information including, but not limited to, frequency, bandwidth, signal power, time, and location of signal propagation, as well as modulation type and format. The at least one spectrum monitoring unit is preferably operable to provide signal identification, classification, and/or geo-location. Additionally, the at least one spectrum monitoring unit preferably includes a processor to allow the at least one spectrum monitoring unit to process spectrum power density data as received and/or to process raw In-Phase and Quadrature (I/Q) complex data. Alternatively, the at least one spectrum monitoring unit and/or the at least one monitoring sensor transmits the data to at least one data analysis engine for storage and/or processing. In a preferred embodiment, the transmission of the data is via a backhaul operation. The spectrum power density data and/or the raw I/Q complex data are operable to be used to further signal processing, signal identification, and data extraction.
The system preferably is operable to manage and prioritize spectrum utilization based on five factors: frequency, time, spatial, signal space, and application goals.
The frequency range is preferably as large as possible. In one embodiment, the system supports a frequency range between 1 MHz and 6 GHz. In another embodiment, the system supports a frequency range with a lower limit of 9 kHz. In yet another embodiment, the system supports a frequency range with a higher limit of 12.4 GHz. In another embodiment, the system supports a frequency range with a higher limit of 28 GHz or 36 GHz. Alternatively, the system supports a frequency range with a higher limit of 60 GHz. In still another embodiment, the system supports a frequency range with a higher limit of 100 GHz. The system preferably has an instantaneous processing bandwidth (IPBW) of 40 MHz, 80 MHz, 100 MHz, or 250 MHz per channel.
The time range is preferably as large as possible. In one embodiment, the number of samples per dwell time in a frequency band is calculated. In one example, the system provides a minimum coverage of 2 seconds. The number of samples per dwell in time in the frequency band is calculated as follows:
The storage required in a buffer is a minimum of 2 seconds per channel per dwell time, which is calculated as follows:
Spatial processing is used to divide an area of coverage by a range of azimuth and elevation angles. The area of coverage is defined as an area under a certain azimuth and range. This is implemented by antenna arrays processing, steerable beamforming, array processing, and/or directional antennas. In one embodiment, the directional antennas include at least one steerable electrical or mechanical antenna. Alternatively, the directional antennas include an array of steerable antennas. More antennas require more signal processing. Advantageously, spatial processing allows for better separation of signals, reduction of noise and interference signals, geospatial separation, increasing signal processing gains, and provides a spatial component to signal identification. Further, this allows for simple integration of geolocation techniques, such as time difference of arrival (TDOA), angle of arrival (AOA), and/or frequency difference of arrival (FDOA). This also allows for implementation of a geolocation engine, which will be discussed in detail infra.
Each signal has inherent signal characteristics including, but not limited to a modulation type (e.g., frequency modulation (FM), amplitude modulation (AM), quadrature phase-shift keying (QPSK), quadrature amplitude modulation (QAM), binary phase-shift keying (BPSK), etc.), a protocol used (e.g., no protocol for analog signals, digital mobile radio (DMR), land mobile radio (LMR), Project 25 (P25), NXDN, cellular, long-term evolution (LTE), universal mobile telecommunications system (UMTS), 5G), an envelope behavior (e.g., bandwidth (BW), center frequency (Fc), symbol rate, data rate, constant envelope, peak power to average power ratio (PAR), cyclostationary properties), an interference index, and statistical properties (e.g., stationary, cyclostationary, higher moment decomposition, non-linear decomposition (e.g., Volterra series to cover non-linearities, learning basic model).
The application goals are dependent on the particular application used within the system. Examples of applications used in the system include, but are not limited to, traffic management, telemedicine, virtual reality, streaming video for entertainment, social media, autonomous and/or unmanned transportation, etc. Each application is operable to be prioritized within the system according to customer goals. For example, traffic management is a higher priority application than streaming video for entertainment.
As previously described, the system is operable to monitor the electromagnetic (e.g., RF) environment, analyze the electromagnetic environment, and extract environmental awareness of the electromagnetic environment. In a preferred embodiment, the system extracts the environmental awareness of the electromagnetic environment by including customer goals. In another embodiment, the system uses the environmental awareness with the customer goals and/or user defined policies and rules to extract actionable information to help the customer optimize the customer goals. The system combines and correlates other information sources with the extracted actionable information to enhance customer knowledge through dynamic spectrum utilization and prediction models.
The antenna subsystem monitors the electromagnetic (e.g., RF) environment to produce monitoring data. The monitoring data is then processed through the RF conditioning subsystem before being processed through the front end receivers. The AGC double loop subsystem is operable to perform AGC adjustment. Data is converted from analog to digital by the front end receivers.
The digital data is then sent through the programmable channelizer, and undergoes I, Q buffering and masking. A fast Fourier transform (FFT) is performed and the blind detection engine performs blind detection. Additionally, the blind classification engine performs blind classification. Information (e.g., observed channels) is shared from the blind detection engine to the blind classification and/or the programmable channelizer (e.g., to inform logic and selection processes). Information from the blind detection engine is also sent to the envelope feature extraction module. Information from the blind classification engine is sent to the demodulation bank.
Information from the envelope feature extraction module, the demodulation bank, and/or the blind classification engine are operable to be used by the signal identification engine, the feature extraction engine, the learning engine, and/or the geolocation engine. Information from the AGC double loop subsystem, the I, Q buffer, masking, the programmable channelizer, the signal identification engine, the feature extraction engine, the learning engine, and the geolocation engine, the envelope feature extraction module, the demodulation bank, and/or the blind classification engine is operable to be stored in the database storing information related to the at least one signal (e.g., signal data, metadata, timestamps).
Information from the database (i.e., the database storing information related to the at least one signal), the signal identification engine, the feature extraction engine, the learning engine, and/or the geolocation engine is operable to be sent to the data analysis engine for further processing.
The alarm system includes information from the database storing information related to the at least one signal and/or the database of customer goals and operational knowledge. Alarms are sent from the alarm system to the visualization subsystem. In a preferred embodiment, the visualization subsystem customizes a graphical user interface (GUI) for each customer. The visualization system is operable to display information from the database of actionable data and decisions. In one embodiment, the alarms are sent via text message and/or electronic mail. In one embodiment, the alarms are sent to at least one internet protocol (IP) address.
The database of customer goals and operational knowledge is also operable to send information to a semantic engine (e.g., customer alarm conditions and goals) and/or an operational semantic engine (e.g., customer operational knowledge). The semantic engine translates information into constraints and sends the constraints to the customer optimization module, which also receives information (e.g., signal metadata) from the data analysis engine. The customer optimization module is operable to send actionable data related to the electromagnetic environment to the operational semantic engine. The customer optimization module is operable to discern which information (e.g., environmental information) has the largest statistically sufficient impact related to the customer goals and operation.
In one embodiment, the system includes at least one monitoring sensor, at least one data analysis engine, at least one application, a semantic engine, a programmable rules and policy editor, a tip and cue server, and/or a control panel as shown in
The at least one monitoring sensor includes at least one radio server and/or at least one antenna. The at least one antenna is a single antenna (e.g., uni-directional or directional) or an antenna array formed of multiple antennas resonating at different frequency bands and configured in a 1D (linear), 2D (planar), or 3D (area) antenna configuration. The at least one monitoring sensor is operable to scan the electromagnetic (e.g., RF) spectrum and measure properties of the electromagnetic spectrum, including, but not limited to, receiver I/Q data. The at least one monitoring unit is preferably operable to autonomously capture the electromagnetic spectrum with respect to frequency, time, and/or space. In one embodiment, the at least one monitoring sensor is operable to perform array processing.
In another embodiment, the at least one monitoring sensor is mobile. In one embodiment, the at least one monitoring sensor is mounted on a vehicle or a drone. Alternatively, the at least one monitoring sensor is fixed. In one embodiment, the at least one monitoring sensor is fixed in or on a street light and/or a traffic pole. In yet another embodiment, the at least one monitoring sensor is fixed on top of a building.
In one embodiment, the at least one monitoring sensor is integrated with at least one camera. In one embodiment, the at least one camera captures video and/or still images.
In another embodiment, the at least one monitoring sensor includes at least one monitoring unit. Examples of monitoring units include those disclosed in U.S. Pat. Nos. 10,122,479, 10,219,163, 10,231,206, 10,237,770, 10,244,504, 10,257,727, 10,257,728, 10,257,729, 10,271,233, 10,299,149, 10,498,951, and 10,529,241, and U.S. Publication Nos. 20190215201, 20190364533, and 20200066132, each of which is incorporated herein by reference in its entirety.
In a preferred embodiment, the system includes at least one data analysis engine to process data captured by the at least one monitoring sensor. An engine is a collection of functions and algorithms used to solve a class of problems. The system preferably includes a detection engine, a classification engine, an identification engine, a geo-location engine, a learning engine, and/or a statistical inference and machine learning engine. For example, the geolocation engine is a group of functions and geolocation algorithms that are used together to solve multiple geolocation problems.
The detection engine is preferably operable to detect at least one signal of interest in the electromagnetic (e.g., RF) environment. In a preferred embodiment, the detection engine is operable to automatically detect the at least one signal of interest. In one embodiment, the automatic signal detection process includes mask creation and environment analysis using masks. Mask creation is a process of elaborating a representation of the electromagnetic environment by analyzing a spectrum of signals over a certain period of time. A desired frequency range is used to create a mask, and FFT streaming data is also used in the mask creation process. A first derivative is calculated and used for identifying possible maximum power values. A second derivative is calculated and used to confirm the maximum power values. A moving average value is created as FFT data is received during a time period selected by the user for mask creation. For example, the time period is 10 seconds. The result is an FFT array with an average of the maximum power values, which is called a mask.
The classification engine is preferably operable to classify the at least one signal of interest. In one embodiment, the classification engine generates a query to a static database to classify the at least one signal of interest based on its components. For example, the information stored in static database is preferably used to determine spectral density, center frequency, bandwidth, baud rate, modulation type, protocol (e.g., global system for mobile (GSM), code-division multiple access (CDMA), orthogonal frequency-division multiplexing (OFDM), LTE, etc.), system or carrier using licensed spectrum, location of the signal source, and/or a timestamp of the at least one signal of interest. In an embodiment, the static database includes frequency information gathered from various sources including, but not limited to, the Federal Communication Commission, the International Telecommunication Union, and data from users. In one example, the static database is an SQL database. The data store is operable to be updated, downloaded or merged with other devices or with its main relational database. In one embodiment, software application programming interface (API) applications are included to allow database merging with third-party spectrum databases that are only operable to be accessed securely. In a preferred embodiment, the classification engine is operable to calculate second, third, and fourth order cumulants to classify modulation schemes along with other parameters, including center frequency, bandwidth, baud rate, etc.
The identification engine is preferably operable to identify a device or an emitter transmitting the at least one signal of interest. In one embodiment, the identification engine uses signal profiling and/or comparison with known database(s) and previously recorded profile(s) to identify the device or the emitter. In another embodiment, the identification engine states a level of confidence related to the identification of the device or the emitter.
The geolocation engine is preferably operable to identify a location from which the at least one signal of interest is emitted. In one embodiment, the geolocation engine uses statistical approximations to remove error causes from noise, timing and power measurements, multipath, and non-line of sight (NLOS) measurements. By way of example, the following methods are used for geolocation statistical approximations and variances: maximum likelihood (nearest neighbor or Kalman filter); least squares approximation; Bayesian filter if prior knowledge data is included; and the like. In another embodiment, time difference of arrival (TDOA) and frequency difference of arrival (FDOA) equations are derived to assist in solving inconsistencies in distance calculations. In still another embodiment, angle of arrival (AOA) is used to determine geolocation. In yet another embodiment, power distribution ratio versus azimuth measurements are used to determine geolocation. In a preferred embodiment, geolocation is performed using Angle of Arrival (AOA), Time Difference of Arrival (TDOA), Frequency Difference of Arrival (FDOA), and power distribution ratio measurements. Several methods or combinations of these methods are operable to be used with the present invention because geolocation is performed in different environments, including but not limited to indoor environments, outdoor environments, hybrid (stadium) environments, inner city environments, etc.
The learning engine is preferably operable to learn the electromagnetic environment. In one embodiment, the learning engine uses statistical learning techniques to observe and learn an electromagnetic environment over time and identify temporal features of the electromagnetic environment (e.g., signals) during a learning period. In a preferred embodiment, the learning engine is operable to learn information from the detection engine, the classification engine, the identification engine, and/or the geolocation engine. In one embodiment, the learning function of the system is operable to be enabled and disabled. When the learning engine is exposed to a stable electromagnetic environment and has learned what is normal in the electromagnetic environment, it will stop its learning process. In a preferred embodiment, the electromagnetic environment is periodically reevaluated. In one embodiment, the learning engine reevaluates and/or updates the electromagnetic environment at a predetermined timeframe. In another embodiment, the learning engine reevaluates and/or updates the electromagnetic environment is updated after a problem is detected.
The statistical inference and machine learning (ML) engine utilizes statistical learning techniques and/or control theory to learn the electromagnetic environment and make predictions about the electromagnetic environment.
The survey occupancy application is operable to determine occupancy in frequency bands. In another embodiment, the survey occupancy application is operable to schedule occupancy in a frequency band. The survey occupancy application is also used to preprocess at least two signals that exist in the same band based on interference between the at least two signals.
The resource brokerage application is operable to optimize resources to improve application performance. In a preferred embodiment, the resource brokerage application is operable to use processed data from the at least one monitoring sensor and/or additional information to determine environmental awareness (e.g., environmental situational awareness). The environmental awareness and/or capabilities of a device and/or a resource are used to determine policies and/or reasoning to optimize the device and/or the resource. The resource brokerage application is operable to control the device and/or the resource. Additionally, the resource brokerage application is operable to control the at least one monitoring sensor.
The certification and compliance application is operable to determine if applications and/or devices are behaving according to rules and/or policies (e.g., customer policies and/or rules, government rules). In another embodiment, the certification and compliance application is operable to determine if the applications and/or the devices are sharing frequency bands according to the rules and/or the policies. In yet another embodiment, the certification and compliance application is operable to determine if the applications and/or the devices are behaving according to non-interferences rules and/or policies.
The sharing application is operable to determine optimization of how applications and/or devices share the frequency bands. In a preferred embodiment, the sharing application uses a plurality of rules and/or policies (e.g., a plurality of customer rules and/or policies, government rules) to determine the optimization of how the applications and/or the devices share the frequency bands. Thus, the sharing application satisfies the plurality of rules and/or policies as defined by at least one customer and/or the government.
The statistical inference and prediction utilization application is operable to utilize predictive analytics techniques including, but not limited to, machine learning (ML), artificial intelligence (AI), neural networks (NNs), historical data, and/or data mining to make future predictions and/or models. The system is preferably operable to recommend and/or perform actions based on historical data, external data sources, ML, AI, NNs, and/or other learning techniques.
The semantic engine is operable to receive data in forms including, but not limited to, audio data, text data, video data, and/or image data. In one embodiment, the semantic engine utilizes a set of system rules and/or a set of system policies. In another embodiment, the set of system rules and/or the set of system policies is created using a prior knowledge database. The semantic engine preferably includes an editor and a language dictionary.
The semantic engine preferably further includes a programmable rules and policy editor. The programmable rules and policy editor is operable to include at least one rule and/or at least one policy. In one embodiment, the at least one rule and/or the at least one policy is defined by at least one customer. Advantageously, this allows the at least one customer to dictate rules and policies related to customer objectives.
The system further includes a tip and cue server. The tip and cue server is operable utilize the environmental awareness from the data processed by the at least one data analysis engine in combination with additional information to create actionable data. In a preferred embodiment, the tip and cue server utilizes information from a specific rule set (e.g., customer defined rule set), further enhancing the optimization capabilities of the system. The specific rule set is translated into optimization objectives, including constraints associated with signal characteristics. In a preferred embodiment, the tip and cue server is operable to activate at least one alarm and/or provide at least one report. In another embodiment, the tip and cue server is operable to activate the at least one alarm and/or provide the at least one report according to the specific rule set.
Advantageously, the system is operable to run autonomously and continuously. The system learns from the environment, and, without operator intervention, is operable to detect anomalous signals that either were not there before, or have changed in power or bandwidth. Once detected, the system is operable to send alerts (e.g., by text or email) and begin high resolution spectrum capture, or I/Q capture of the signal of interest. Additionally, the system is operable to optimize and prioritize applications using the learning engine.
The system preferably uses multiple receiver channels for the front end. In one embodiment, there are 4 receiver channels. Alternatively, there are 8, 12, 16, or 32 receiver channels. I, Q data is preferably tagged by the receiver channel and receiver antenna (e.g., bandwidth, gain, etc.) and then stored in the I, Q buffer before analysis is completed.
Advantageously, the system is hardware agnostic. The system is operable to provide a suggestion for hardware for a particular frequency set. Additionally, the hardware agnostic nature of the system allows for established architecture to persist. The system is cost effective because it also allows for cheaper antennas to be used, as well as less expensive filters, because calibration can be done using the system rather than the antennas and/or filters, as well as post-ADC processing to rectify any performance loss. Because the system processes all signals present in the spectrum and their inter-relationships to extract environmental awareness, so the analog front end does not require elaborate filtering to avoid interference and provide optimum dynamic range. Additionally, the analog front end does not require optimal antennas for all frequency bands and ranges to obtain environmental awareness.
For a time domain programmable channelizer, all filters' impulse responses must be programmable and the number of filters must be programmable. Additionally, the channel bandwidth resolution must be programmable starting from a minimum bandwidth. The center frequency of each channel must also be programmable. Decimation is based on channel bandwidth and desired resolution. However, these requirements are difficult to implement for channels with variable bandwidth and center frequency. Wavelet filters can be used effectively if the center frequency and channel's bandwidth follow a tree structure (e.g., Harr and Deubauchi wavelets).
In a preferred embodiment, the system includes a frequency domain programmable channelizer as shown in
Advantageously, the frequency domain programmable channelizer is more computationally efficient than a time domain programmable channelizer because each filter is just a vector in the frequency domain and the filtering operation is just a vector multiplication, decomposing the input signal into multiple channels of differing bandwidths is parsing the vector representing the input signal frequency domain content into a subvector of different length.
In one embodiment, the channelizer is operable to receive information from an FFT engine and/or a FFT configuration module. In one embodiment, the FFT engine and/or the FFT configuration module are incorporated into the channelizer. Alternatively, FFT engine and/or the FFT configuration module are separate from and not incorporated into the channelizer. In one embodiment, the FFT engine and/or the FFT configuration module includes at least one channel definition, at least one FFT configuration, at least one deference matrix, at least one detector configuration, and/or at least one channel detection.
In one embodiment, the FFT engine and/or the FFT configuration module is operable to provide information to other parts of the blind detection engine (e.g., the noise floor estimator, the blind detection engine, the statistical channel occupancy algorithm), the channelizer, the at least one data analysis engine (e.g., the classification engine, the geolocation engine, the identification engine, the learning engine), the semantic engine, and/or the optimization engine.
In one embodiment, the FFT Configuration is operable to capture channels in their entirety. In one embodiment, the FFT Configuration is operable to capture channels with a minimum number of points to support detection probabilities. In one embodiment, the FFT Configuration is operable to resolve ambiguities between channels by employing a sufficiently small RBW.
In one embodiment, a channelization vector is operable to specify normalized power levels per FFT bin for at least one channel (e.g., each channel). In one embodiment, the channelization vector power levels are preferably normalized with respect to peak power in the channel's spectrum envelope.
In one embodiment, a deference matrix is operable to identify channels with bandwidth that falls within the bandwidth of other channels (i.e., channels with wider bands). In one embodiment, the channels defer to the channels with wider bands. In one embodiment, the detector is operable to evaluate narrower band channels before the detector evaluates wider band channels. In one embodiment, positive detection of wider band channels is operable to further constrain criteria that defines the positive detection of deferring narrower band channels.
In one embodiment, noise floor estimation is operable to define the mean and standard deviation of noise from the average power FFT (e.g., block). In one embodiment, statistics are operable to be on a channel span level, a block containing multiple channels, or a bin level. In one embodiment, the statistics are operable to be used by the channel detector to set criteria for asserting channel detection.
In one embodiment, detector configuration is operable to set a minimum acceptable probability of false alarm. In one embodiment, the detector configuration is operable to set a minimum acceptable probability of missed detection.
In one embodiment, channel detection is operable to evaluate presence of channels in order of increasing bandwidths (i.e., narrowband channels before wideband channels). In one embodiment, the channel detection is operable to perform a hypothesis test for each bin using Noise Floor Estimation and maximum probability of false alarm. In one embodiment, the hypothesis test includes a first hypothesis that a bin contains only noise (H0) and/or a second hypothesis that a bin contains noise and signal (Ha). In one embodiment, the channel detection is operable to determine the probability that S≤s bins within a given channel's bandwidth reject the “Noise only” hypothesis. In one embodiment, the channel detection is operable to assert that a channel is detected if the probability is greater than pmin. In one embodiment, the channel detection is operable to adjust the hypothesis test for deferring narrowband channels if detection probability is greater than p. In one embodiment, the channel detection is operable to set a new mean and a new standard deviation.
In one embodiment, the probability of false detection (α) is calculated using the following equation:
In one embodiment, the probability of correctly rejecting the noise only hypothesis is equal to the probability of getting as many as s bins with power above the threshold if the noise only hypothesis is true. In one embodiment, the probability of correctly rejecting the noise only hypothesis is calculated using the following equation:
In one embodiment, the CNR is determined as follows:
In another embodiment, the CNR is determined as follows:
In one embodiment, CV=[μH
The above equation is operable to be substituted as follows:
The above equation is operable to be substituted as follows:
The above equation is operable to be substituted as follows:
In yet another embodiment, the CNR is calculated as follows:
The above equation is operable to be substituted as follows:
The above equation is operable to be substituted as follows:
The above equation is operable to be substituted as follows:
The above equation is operable to be substituted as follows:
The above equation is operable to be substituted as follows:
In one embodiment, the system is operable to calculate a threshold for the probability of missed detection (ka) on the channel level (βch). In one embodiment, ka is equal to kobs. In one embodiment, ka is calculated as follows:
In one embodiment, the system is operable to select a probmin, αch, and βch (e.g., via manual input). In one embodiment, the probmin, the αch, and the βch are set manually based on desired goals. For example, and not limitation, in one embodiment, the probability of false alarm for a channel is set at <5% and the probability of missed detection for a channel is set at <5%. In one embodiment, the system is operable to determine k0 given n bins, αch, and αbn. In one embodiment, the system is operable to determine βch.
Thus, for α=0.05 and β=0.05, the probability of channel presence=0.9.
In one embodiment, Noise Only (No Signal), Assert Noise Only uses the following equation:
In one embodiment, Noise Only (No Signal), Assert Noise and Signal uses the following equation:
In one embodiment, Noise and Signal, Assert Noise Only uses the following equation:
In one embodiment, Noise and Signal, Assert Noise and Signal uses the following equation:
H
0=(μN, σN2)
The algorithm 6100 includes estimating the bin-wise noise model 6104. In one embodiment, the bin-wise noise and signal model is obtained from the FFT or block FFT. In one embodiment, the bin-wise noise and signal model is calculated using the following equation:
H
a=(μNS, σNS2)
The algorithm 6100 includes determining a bin-level probability of false alarm (PFA=αbin) 6106. The algorithm 6100 further includes determining a bin-level threshold 6108. In one embodiment, the bin-level threshold is calculated using the following equation:
where Q(⋅) is the complementary error function (ERFC) for Gaussian distributions.
The algorithm 6100 includes determining a channel-level probability of false alarm (αchan) 6110. The algorithm 6100 further includes determining a channel-level threshold 6112. In one embodiment, the channel-level threshold is calculated using the following equation:
The algorithm 6100 includes calculating a detection vector (v) 6114. In one embodiment, an element of the detection vector is calculated as follows:
The algorithm 6100 includes counting the number of detection vector elements equal to 1 and comparing to k 6116. The algorithm 6100 further includes determining the p-value 6118, where the p-value is the probability of false alarm. In one embodiment, the p-value is calculated using the following equation:
The algorithm 6100 includes determining the probability of missed detection (βchan) 6120. In one embodiment, the probability of missed detection is calculated using the following equation:
The algorithm 6100 includes determining the overall detection probability 6122. In one embodiment, the overall detection probability is calculated using the following equation:
In one embodiment, the signal to noise ratio is calculated using the following equation:
The blind classification engine receives information from the blind detection engine as shown in
From the definitions of the second and fourth moments, the following equations are used to calculate the cumulants:
If it assumed that transmitted constellations are normalized to unity average power, which is easily completed by a power factor equal to 0 dB, this results in Ĉ21≈1. To calculate a normalized fourth moment is calculated using the following equation:
Advantageously, normalizing the fourth moment cumulants removes any scaling power problems.
Additional information about selection match based on cumulants for modulation selection is available in Table 1 below.
40
42
)40
)42
The control panel manages all data flow between the I/Q buffer, library functions, the plurality of engines, applications, and user interface. A collection of basic functions and a particular sequence of operations are called from each of the plurality of engines. Each of the plurality of engines is operable to pass partially processed and/or analyzed data to other engines to enhance functionality of other engines and/or applications. The data from the engines are then combined and processed to build applications and/or features that are customer or market specific.
In one embodiment, a plurality of state machines performs a particular analysis for a customer application. In one embodiment, the plurality of state machines is a plurality of nested state machines. In another embodiment, one state machine is utilized per each engine application. The plurality of state machines is used to control flow of functions and/or an engine's input/output utilization to perform required analyses.
In one embodiment, the systems and methods of the present invention provide unmanned vehicle (e.g., drone) detection. The overall system is capable of surveying the spectrum from 20MHz to at least 6 GHz, not just the common 2.4 GHz and 5.8 GHz bands as in the prior art. The systems and methods of the present invention are operable to detect UVs and their controllers by protocol.
In one embodiment, the systems and methods of the present invention maintain a state-of-the-art learning system and a protocol library for classifying detected signals by manufacturer and controller type. The state-of-the-art learning system and the protocol library are updated as new protocols emerge.
In one embodiment, classification by protocol chipset is utilized to provide valuable intelligence and knowledge for risk mitigation and threat defense. The valuable intelligence and knowledge include effective operational range, supported peripherals (e.g., external or internal camera, barometers, global positioning system (GPS) and dead reckoning capabilities), integrated obstacle avoidance systems, and interference mitigation techniques.
Advantageously, the system is operable to detect drones that are not in the protocol library. Further, the system is operable to detect drones without demodulating command and control protocols. In one embodiment, the system does not include a protocol library. New protocols and new drones are constantly being released. Additionally, a nefarious operator can switch out the chipset of a drone, which would leave an area vulnerable to the modified drone because a system would not be able to identify the signal as a drone if the protocol is not in the protocol library. In one embodiment, the system generates actionable data that indicates that at least one signal is behaving like a drone. The system performs blind detection, which allows the system to detect the drone signal without the protocol library. In one embodiment, the system is operable to detect drones by evaluating an envelope of the command and control signal. In one embodiment, the system detects the drone signal based on a duty cycle and/or changes in power levels of the signal envelope. In one example, an LTE signal is classified by the system as a drone when moving at a high velocity.
As previously described, in one embodiment, the data analysis engine is operable to perform mask creation and analyze an electromagnetic (e.g., RF) environment using masks. Mask creation is a process of elaborating a representation of an electromagnetic environment by analyzing a spectrum of signals over a certain period of time. A mask is created with a desired frequency range (e.g., as entered into the system via user input), and FFT streaming data is also used in the mask creation process. A first derivative is calculated and used for identifying maximum power values. A moving average value is created as FFT data is received during a selected time period for mask creation (e.g., via user input). For example, the time period is 10 seconds. The result is an FFT array with an average of maximum power values, which is called a mask.
In one embodiment, the mask is used for electromagnetic environment analysis. In one embodiment, the mask is used for identifying potential unwanted signals in an electromagnetic (e.g., RF) environment. The system is operable to utilize masks based on a priori knowledge and/or masks based on expected behavior of the electromagnetic environment.
Each mask has an analysis time. During its analysis time, a mask is scanned and live FFT streaming data is compared against the mask before next mask arrives. If a value is detected over the mask range, a trigger analysis is performed. Each mask has a set of trigger conditions, and an alarm is triggered into the system if the trigger conditions are met. In one embodiment, there are three main trigger conditions including an alarm duration, a decibel (dB) offset, and a count. The alarm duration is a time window an alarm needs to appear to be considered a trigger condition. For example, the time window is 2 seconds. If a signal is seen for 2 seconds, it passes to the next condition. The dB offset is a threshold value (i.e., dB value) a signal needs to be above the mask to be considered as a potential alarm. The count is the number of times the first two conditions need to happen before an alarm is triggered into the system.
In one embodiment, utilization masks define the signals in a spectrum over a set time and are refreshed periodically. In one embodiment, the set time is defined by an update rate. In one embodiment, the update rate is dynamic and recommended by the semantic engine based on customer goals.
The update rate of the utilization mask is operable to be dynamically adjusted based on customer goals, the RF environment, and/or service. Each of these factors affects the required update rate of the utilization mask. For a low latency requirement service such as autonomous driving, the update rate is quicker and therefore more accurate to account for the service needs of autonomous driving. The quicker update rate allows for a better, more accurate view of the RF environment in real time, with the drawback being the greater power consumption required for the quicker update rate. To solve this optimization problem, the ML of the system takes into account the customer goals, the RF environment, and/or service requirements and the power consumption required for each refresh rate to determine the optimal refresh rate that meets the required goals and minimizes power consumption.
In one embodiment, the semantic engine is operable to receive information from the database of customer goals. In one embodiment, the semantic engine uses large language models (LLMs) to translate the received information into constraints and sends the constraints to the customer optimization module. The customer optimization module receives the constraints as well as extracted environment awareness information from sensors to output actionable data. In one embodiment, actionable data includes recommendations for the update rate based on all the inputs. Received recommendations for the update rate determine accuracy and power prioritization. In an alternative embodiment, the update rate is preset based upon customer goals, the RF environment, and/or service. The preset update rate is operable to utilize ML to change over time to better account for the current RF environment and/or customer goals.
In another embodiment, the utilization mask is operable to change length of time and/or sample rate based upon the needs of the customer and/or the signal being detected. Depending on if the signal is predictable/continuous or unpredictable/variable will determine the longevity for the utilization mask capture to discover possible interference in the RF environment. The sample rate and length of the utilization mask depends on what insights or interference are being observed in the environment.
Intermodulation distortion affects both narrowband and wideband signal. Those with general knowledge in the art know that the fundamental principles of intermodulation in narrowband and wideband signals are the same, with minor adjustments to the calculations. The fundamental principles of intermodulation distortion are described herein. Two or more signals of varying frequencies existing in a non-linear system results in intermodulation distortion, where harmonics of the original signals exist in the spectrum-denoted as intermodulation product signals hereon out.
f1+f2
f1−f2
2f1
2f2
2f1−f2
2f2−f1
The amplitude of the intermodulation product signals decreases as order increases, hence why the second order intermodulation product signals have a greater amplitude than the third-order product signals. Furthermore, the third order intermodulation product signals are closer in frequency to the original signals compared to the second order intermodulation product signals, making them a greater interference threat to the original signals.
In one embodiment, the intermodulation engine is used to determine intermodulation distortion in an environment. In a further embodiment, the environment is an airport or an environment around an airport.
Prediction models used by the platform provide an accurate insight into the dynamic spectrum allocation and utilization functionalities. These prediction models enable the platform to autonomously create forecasts for future spectrum usage. In addition, the prediction models used by the platform incorporate descriptive analytics, diagnostic analytics, predictive analytics, and/or prescriptive analytics. Descriptive analytics refers specifically to the data stored, analyzed, and/or used by the platform. Descriptive analytics provides data enabling the platform to act and/or provide a suggested action. Diagnostic analytics refers to how and/or why the descriptive analytics acted and/or suggested an action. Predictive analytics specifically refers to the utilization of techniques including, but not limited to, ML, AI, NNs, historical data, and/or data mining to make future predictions and/or models. Prescriptive analytics refers to the act and/or the suggested act generated by the descriptive analytics. Once this predictive model is in place, the platform is operable to recommend and/or perform actions based on historical data, external data sources, ML, AI, NNs, and/or other learning techniques.
Referring back to
Geolocation is an additional aspect relating to electromagnetic (e.g., RF) analysis of an environment. The primary functions of the electromagnetic analysis of the environment include, but are not limited to, detection, classification, identification, learning, and/or geolocation. Additionally, the electromagnetic analysis is operable to output environmental awareness data.
The system includes a geolocation engine, operable to use both passive and/or active methods of radio geolocation. In general, radio geolocation refers to the geographic location of man-made emitter sources propagating using radio (electromagnetic) waves as they impinge upon a man-made geo-locator, or receiver. Passive radio geolocation requires no transmission of signals by a geo-locator, whereas active radio geolocation involves a geolocator transmitting signals that interact with an emitter source. Passive methods of geolocation include, but are not limited to, single directional beam antenna response, multidirectional beam antenna response (Amplitude Ratio), multi-antenna element response (Array Processing), line of bearing (LOB)-to-position solutions, and/or general optimization. Multi-antenna element response methods include, but are not limited to, phase interferometry, beamforming, conventional array manifold processing approaches, and/or high-resolution array manifold processing approaches using signals subspace. While these passive methods primarily apply to approaches for Direction Finding (DF) as spatial filtering, passive methods that apply to approaches other than DF as spatial filtering are operable for use by the system. DF refers to the process of estimating the direction of arrival of propagating emitter signals as they impinge on a receiver. Passive methods further include DF approaches based on general optimization including, but not limited to, digital pre-distortion (DPD), convex programming, and/or distributed swarm approaches.
In addition to the previously mentioned passive approaches, the system is operable to apply approaches based on ranging observations including, but not limited to, receiver signal strength indicators (RSSI), time of arrival (TOA), and/or time difference of arrival (TDOA) methods. RSSI approaches relate to the generation of observable data and/or location estimation. TOA and/or TDOA approaches relate to generating observable data from distributed multi antenna systems and/or single antenna systems, and/or location estimation using non-linear optimization and/or constraint linear optimization.
In a preferred embodiment, geolocation is performed using Angle of Arrival (AOA), Time Difference of Arrival (TDOA), Frequency Difference of Arrival (FDOA), and power distribution ratio measurements.
The geolocation engine is operable to use a plurality of algorithms to determine a location of the at least one signal. The plurality of algorithms includes, but is not limited to, TDOA, FDOA, AOA, power level measurements, and/or graphical geolocation, which is described below. The geolocation is operable to autonomously decide what algorithm(s) to use to determine the location.
In one embodiment, the geolocation engine uses graphical geolocation techniques. An area is pictorially represented in a grid. Resolution of the grid determines a position in space. The system is operable to detect the at least one signal in the space and determine a location of the at least one signal using the graphical geolocation techniques. In one embodiment, outputs (e.g., location) to a non-linear equation are used to determine possible inputs (e.g., power measurements). The possible outputs are placed on a two-dimensional map. Inputs are then mapped to form a hypothesis of possible outputs. In one embodiment, the graphical geolocation techniques include an image comparison between the two-dimensional map of the possible outputs and the signal data. In another embodiment, the graphical geolocation techniques further include topology (e.g., mountains, valleys, buildings, etc.) to create a three-dimensional map of the possible outputs. The graphical geolocation techniques in this embodiment include an image comparison between the three-dimensional map of the possible outputs and the signal data.
The geolocation engine is operable to make use of spinning DF, through the use of rotating directional antennas and estimating the direction of arrival of an emitter. The rotating directional antennas measure the received power as a function of the direction, calculating a local maximum assumed direction of the emitter. The geolocation engine is also operable to account for any transient signals that escape detection based on rotation speed. This is accomplished by using at least one broad antenna, reducing the chance of the system missing a signal, as well as reducing angular resolution. Practical considerations for these calculations include, but are not limited to, antenna rotation speed (
The system is further operable to use amplitude ratio methods for geolocation. These methods involve a multi-lobe amplitude comparison. This is performed using a set of fixed directional antennas pointing in different directions. A ratio corresponding to two responses is calculated, account for antenna patterns. This ratio is used to obtain a direction estimate. By not using moving parts and/or antennas, the system is more responsive to transient signals. However, this does require accurate antenna patterns, as these patterns also control system resolution.
General antenna array processing assumes that a signal, s(t), remains coherent as it impinges at each antenna in the array. This enables the delay (τm) of the signal at an m-th sensor relative to the signal at the origin of the coordinate system can be expressed as:
Where c is the propagation of light and θ is the angle of the signal impinging in the sensor relative to the r-axis. Since the signal is assumed to have a Taylor series decomposition, the propagation delay, τm, is equivalent to the phase shift of:
Thus, the vector x(t) of antenna responses can be written as:
More generally, the sensor has different directionality and frequency characteristics which are modeled by applying different gains and phases to the model above, where the gain and phase of the m-th sensor is denoted as: gm (w, θ) and ϕm(w, θ)
Then, the above equation for x(t) can be expressed as:
Where a(w, θ) is known as the array response vector.
The collection of all array response vectors for all angles θ and all frequencies, w, is known as an array manifold (i.e., a vector space). In general, if the array manifold is known and it is free of ambiguities, then obtaining the k−1 angles (θ1 . . . θk−1) of k−1 signals if their corresponding array response vector are linearly independent is performed by correlating x (t) with the array response vector of the appropriate angle. In one embodiment, ambiguities refer to the array manifold lacking rank deficiencies to k if the system is trying to resolve k−1 directions at the same frequency. The array manifold does not typically have a simple analytical form and thus the array manifold is approximated using discrete angles for each frequency of interest.
In more general cases, where multiple sinusoidal signals arrive at the array with additive noise, then the x(t) can be expressed as:
In one embodiment, additive noise refers to thermal noise from sensors and associated electronics, background noise from the environment, and/or other man-made interference sources including, but not limited to, diffuse signals.
Where one or more signals are non-sinusoidal (i.e., broadband), the equivalent can be expressed by its Taylor series over the relevant frequencies. However, when looking for a narrow frequency band of interest, the system is operable to assume an array response vector, a(w, θ), is approximately constant with respect to w over all angles, θ. This implies that the reciprocal of the time required for the signal to propagate across the array is much less than the bandwidth of the signal. If sensor characteristics do not vary significantly across bandwidth, then the dependency on w can be dropped off of the array response vector and/or matrix, resulting in:
For example, in an antenna array using a uniform linear array (ULA), a signal source, s(t)=ej(wt+ϕ), impinges in the ULA at angle θ. Thus, if the received signal at a first sensor is x1(t)=s(t), then it is delayed at sensor m by:
In vector form, this is represented as:
If there are source signals received by the ULA, then:
x(t) is the received signal vector (M by 1), s(t)=[s1(t) . . . sI(t)]T is the source signal vector (I by 1), n(t) is the noise signal vector (M by 1), and A(θ)=[a(w, θ1), . . . a(w, θ1)] a(M by I) matrix=>Array manifold. In this example, typical assumptions include, but are not limited to, sources of signal(s) are independent and narrow band in relation to dimensions of the ULA (d, Md) and around the same max frequency, all antenna elements are the same,
to avoid rank ambiguities, the system can resolve M−1 direction angles without rank, and/or noises are uncorrelated.
In another example, array processing is performed for DF using beamforming. Given knowledge of the array manifold, the array can be maneuvered by taking linear combinations of each element response. This is similar to how a fixed, single antenna can be maneuvered mechanically. Thus, y(t)=wHx(t), where w is interpreted as a Finite Impulse Response (FIR) of a filter in the spatial domain. To calculate the power of y(t), assuming a discretization to N samples, the system uses the following:
Where .
N denotes the time averaging over N sample times and Rxx is the measured spatial autocorrelation matrix of the received array output data.
In another example, array processing is performed for DF using beamforming, where
In one embodiment, the system assumes a source signal is uncorrelated to a noise source, resulting in:
Thus, the power of the linear combination and/or spatial filtering of the array vector response elements are expressed as:
In examples where array processing for DF is performed using beamforming, for a single unit magnitude sinusoid impinging the array at angle θo with no noise becomes:
Accounting for the Cauchy-Schwarz inequality |wHa(θo)|2≤∥w∥2∥a(θo)∥2, for all vectors w with equality if, and only if, w is proportional to a(θo), the spatial filter that matches the array response at the direction of arrival, θo, produces a maximum value for Py(θ).
In addition, DF can be accomplished by searching over all possible angles to maximize Py(θ), and/or search over all filters w that are proportional to some array vectors responding to an impinging angle θ, a(θ), where Max{Py(θ)}over all angles=>filters w=a(θ). When this method is used, the system behaves like a spinning DF system where the resulting beam is changing for each search angle. Advantageously, this method encounters no blind spots due to the rotational and/or rate of arrival of the source signal.
Moreover, when the system is using beamforming techniques and/or processes, the system is operable to search for multiple directions of arrival of different sources with resolutions depending on the width of the beam formed and the height of the sidelobes. For example, a local maximum of the average filter output power is operable to be shifted away from the true direction of arrival (DOA) of a weak signal by a strong source of interference in the vicinity of one of the sidelobes. Alternatively, two closely spaced signals results in only one peak or two peaks in the wrong location.
In yet another example, array processing for DF is performed using a Capon Minimum Variance Distortionless Response (MVDR) approach. This is necessary in cases where multiple source signals are present. The system obtains more accurate estimates of the DOA when formatting the array beam using degrees of freedom to form a beam in the “look” direction and any remaining degrees of freedom to from “nulls” in remaining directions. The result is a simultaneous beam and null forming filter. Forming nulls in other directions is accomplished by minimizing Py(θ) while constraining a beam in the look direction. This avoids the trivial solution of w=0. Thus:
minover all wPy(θ) subject to wHa(θ)=1
The resulting filter, wc(θ), is shown as:
Using this filter, the filter output power is expressed as:
Therefore, the Capon approach searches over all DOA angles that the above power has maximized, using maxover all angles(aH(θ)Rxx−1a(θ))−1. A Capon approach is able to discern multiple signal sources because while looking at signals impinging at 0, the system attenuates a signal arrive at fifteen degrees by a formed beam.
A Capon approach is one method for estimating an angular decomposition of the average power received by the array, sometimes referred to as a spatial spectrum of the array. The Capon approach is a similar approach to spectrum estimation and/or modeling of a linear system.
The system is further operable to employ additional resolution techniques including, but not limited to, Multiple Signal Classifier (MUSIC), Estimation of Signal Parameters via Rotational Invariance Technique (ESPRITE), and/or any other high-resolution DOA algorithm. These resolution techniques enable the system to find DOAs for multiple sources simultaneously. In addition, these resolution techniques generate high spatial resolution when compared with more traditional methods. In one embodiment, these techniques apply only when determining DOAs for narrowband signal sources.
For example, when using MUSIC-based methods, the system computes an N×N correlation matrix using Rx=E{x(t)xH(t)}=ARsAH+σ02I, where Rs=E{s(t)sH(t)}=diag.{σ12, . . . ,σ12}. If the signal sources are correlated so that Rs is not diagonal, geolocation will still work while Rs has full rank. However, if the signal sources are correlated such that Rs is rank deficient, the system will then deploy spatial smoothing. This is important, as Rs defines the dimension of the signal subspace. However, For N>I, the matrix ARsAH is singular, where det[ARsAH]=det[Rx−σ02I]=0. But this implies that σ02 is an eigenvalue of Rx. Since the dimension of the null space ARsAH is N−I, there are N−I such eigenvalues σ02 of Rx. In addition, since both Rx and ARsAH are non-negative, there are I other eigenvalues σi2 such that σi2>σ02>0.
In a preferred embodiment, geolocation is performed using Angle of Arrival (AOA), Time Difference of Arrival (TDOA), Frequency Difference of Arrival (FDOA), and power distribution ratio measurements. Advantageously, using all four measurements to determine geolocation results in a more accurate determination of location. In many instances, only one type of geolocation measurement is available that forces the use of one particular approach (e.g., AOA, TDOA, FDOA), but in many cases geolocation measurements are operable to be derived from behavior of the signals, thus allowing for the use of multiple measurements (e.g., all four measurements) that are combined to obtain a more robust geolocation solution. This is especially important when most of the measurements associated with each approach are extremely noisy.
In addition, the system includes a learning engine, operable to incorporate a plurality of learning techniques including, but not limited to, machine learning (ML), artificial intelligence (AI), deep learning (DL), neural networks (NNs), artificial neural networks (ANNs), support vector machines (SVMs), Markov decision process (MDP), and/or natural language processing (NLP). The system is operable to use any of the aforementioned learning techniques alone or in combination.
Advantageously, the system is operable for autonomous operation using the learning engine. In addition, the system is operable to continuously refine itself, resulting in increased accuracy relating to data collection, analysis, modeling, prediction, measurements, and/or output. The learning engine is further operable to analyze and/or compute a conditional
probability set. The conditional probability set reflects the optimal outcome for a specific scenario, and the specific scenario is represented by a data model used by the learning engine. This enables the system, when given a set of data inputs, to predict an outcome using a data model, where the predicted outcome represents the outcome with the least probability of error and/or a false alarm.
Without a learning engine, prior art systems are still operable to create parametric models for predicting various outcomes. However, these prior art systems are unable to capture all inputs and/or outputs, thereby creating inaccurate data models relating to a specific set of input data. This results in a system that continuously produces the same results when given completely different data sets. In contrast, the present invention utilizes a learning engine with a variety of fast and/or efficient computational methods that simultaneously calculate conditional probabilities that are most directly related to the outcomes predicted by the system. These computational methods are performed in real-time or near-real-time.
Additionally, the system employs control theory concepts and methods within the learning engine. This enables the system to determine if every data set processed and/or analyzed by the system represents a sufficient statistical data set.
Moreover, the learning engine includes a learning engine software development kit (SDK), enabling the system to prepare and/or manage the lifecycle of datasets used in any system learning application. Advantageously, the learning engine SDK is operable to manage system resources relating to monitoring, logging, and/or organizing any learning aspects of the system. This enables the system to train and/or run models locally and/or remotely using automated ML, AI, DL, and/or NN. The models are operable for configuration, where the system is operable to modify model configuration parameters and/or training data sets. By operating autonomously, the system is operable to iterate through algorithms and/or hyperparameter settings, creating the most accurate and/or efficient model for running predictive system applications. Furthermore, the learning engine SDK is operable to deploy webservices in order to convert any training models into services that can run in any application and/or environment.
Thus, the system is operable to function autonomously and/or continuously, refining every predictive aspect of the system as the system acquires more data. While this functionality is controlled by the learning engine, the system is not limited to employing these learning techniques and/or methods in only the learning engine component, but rather throughout the entire system. This includes RF fingerprinting, RF spectrum awareness, autonomous RF system configuration modification, and/or autonomous system operations and maintenance.
The learning engine uses a combination of physical models and convolutional neural networks algorithms to compute a set of possible conditional probabilities depicting the set of all possible outputs based on input measurements that provide the most accurate prediction of solution, wherein accurate means minimizing the false probability of the solution and also probability of error for the prediction of the solution.
The system further includes an automated semantic engine and/or translator as shown in
By separating the data translation process from the automated semantic engine, the system is operable to provide more processing power once the data input is sent to the automated semantic engine, reducing the overall processing strain on the system.
The automated semantic engine includes a rule component, a syntax component, a logic component, a quadrature (Q) component, and/or a conditional set component. In addition, the semantic engine is operable for network communication with a prior knowledge database, an analytics engine, and/or a monitoring and capture engine. Data is initially sent to the automated semantic engine via the translator. The automated semantic engine is operable to receive data from the translator in forms including, but not limited to, audio data, text data, video data, and/or image data. In one embodiment, the automated semantic engine is operable to receive a query from the translator. The logic component and/or the rule component are operable to establish a set of system rules and/or a set of system policies, where the set of system rules and/or the set of system policies is created using the prior knowledge database.
Advantageously, the automated semantic engine is operable to run autonomously using any of the aforementioned learning and/or automation techniques. This enables the system to run continuously, without requiring user interaction and/or input, resulting in a system that is constantly learning and/or refining data inputs, creating more accurate predictions, models, and/or suggested actions.
Moreover, the automated semantic engine enables the system to receive queries, searches, and/or any other type of search-related function using natural language, as opposed to requiring a user and/or customer to adapt to a particular computer language. This functionality is performed using a semantic search via natural language processing (NLP). The semantic search combines traditional word searches with logical relationships and concepts.
In one embodiment, the automated semantic engine uses Latent Semantic Indexing (LSI) within the automated semantic engine. LSI organizes existing information within the system into structures that support high-order associations of words with text objects. These structures reflect the associative patterns found within data, permitting data retrieval based on latent semantic context in existing system data. Furthermore, LSI is operable to account for noise associated with any set of input data. This is done through LSI's ability to increase recall functionality, a constraint of traditional Boolean queries and vector space models. LSI uses automated categorization, assigning a set of input data to one or more predefined data categories contained within the prior knowledge database, where the categories are based on a conceptual similarity between the set of input data and the content of the prior knowledge database. Furthermore, LSI makes use of dynamic clustering, grouping the set of input data to data within the prior knowledge database using conceptual similarity without using example data to establish a conceptual basis for each cluster.
In another embodiment, the automated semantic engine uses Latent Semantic Analysis (LSA) within the automated semantic engine. LSA functionalities include, but are not limited to, occurrence matrix creation, ranking, and/or derivation. Occurrence matrix creation involves using a term-document matrix describing the occurrences of terms in a set of data. Once the occurrence matrix is created, LSA uses ranking to determine the most accurate solution given the set of data. In one embodiment, low-rank approximation is used to rank data within the occurrence matrix.
In another embodiment, the automated semantic engine uses semantic fingerprinting. Semantic fingerprinting converts a set of input data into a Boolean vector and creates a semantic map using the Boolean vector. The semantic map is operable for use in any context and provides an indication of every data match for the set of input data. This enables the automated semantic engine to convert any set of input data into a semantic fingerprint, where semantic fingerprints are operable to combine with additional semantic fingerprints, providing an accurate solution given the set of input data. Semantic fingerprint functionality further includes, but is not limited to, risk analysis, document search, classifier indication, and/or classification.
In yet another embodiment, the automated semantic engine uses semantic hashing. By using semantic hashing, the automated semantic engine maps a set of input data to memory addresses using a neural network, where semantically similar sets of data inputs are located at nearby addresses. The automated semantic engine is operable to create a graphical representation of the semantic hashing process using counting vectors from each set of data inputs. Thus, sets of data inputs similar to a target query can be found by accessing all of the memory addresses that differ by only a few bits from the address of the target query. This method extends the efficiency of hash-coding to approximate matching much faster than locality sensitive hashing.
In one embodiment, the automated semantic engine is operable to create a semantic map. The semantic map is used to create target data at the center of the semantic map, while analyzing related data and/or data with similar characteristics to the target data. This adds a secondary layer of analysis to the automated semantic engine, providing secondary context for the target data using similar and/or alternative solutions based on the target data. The system is operable to create a visualization of the semantic map.
Traditional semantic network-based search systems suffer from numerous performance issues due to the scale of an expansive semantic network. In order for the semantic functionality to be useful in locating accurate results, a system is required to store a high volume of data. In addition, such a vast network creates difficulties in processing many possible solutions to a given problem. The system of the present invention solves these limitations through the various learning techniques and/or processes incorporated within the system. When combined with the ability to function autonomously, the system is operable to process a greater amount of data than systems making use of only traditional semantic approaches.
By incorporating the automated semantic engine within the system, the system has a greater understanding of potential solutions, given a provided set of data. Semantic engines are regularly associated with semantic searches or searches with meaning or searches with understanding of overall meaning of the query, thus by understanding the searcher's intent and contextual meaning of the search to generate more relevant results. Semantic engines of the present invention, along with a spectrum specific ontology (vocabulary and operational domain knowledge), help automate spectrum utilization decisions based on dynamic observations and extracted environmental awareness, and create and extend spectrum management knowledge for multiple applications.
The system uses a set of “tip and cue” processes, generally referring to detection, processing, and/or providing alerts using creating actionable data from acquired RF environmental awareness information in conjunction with a specific rule set, further enhancing the optimization capabilities of the system. The specific rule set is translated into optimization objectives, including constraints associated with signal characteristics. The tip and cue processes of the present invention produce actionable data to solve a plurality of user issues and/or objectives.
Tip and cue processes are performed by an awareness system. The awareness system is operable to receive input data including, but not limited to, a set of use cases, at least one objective, and/or a rule set. The input data is then analyzed by a translator component, where the translator component normalizes the input data. Once normalized, the input data is sent to a semantic engine. The semantic engine is necessary for analyzing unstructured data inputs. Thus, a semantic engine is necessary to understand data inputs and apply contextual analysis as well, resulting in a more accurate output result. This accuracy is primarily accomplished using the previously mentioned learning techniques and/or technologies.
The semantic engine uses the input data to create a set of updated rules, a syntax, a logic component, a conditional data set, and/or Quadrature (Q) data. The semantic engine is operable for network communication with components including, but not limited to, a prior knowledge database, an analytics engine, and/or a monitoring and capture engine. The monitoring and capture engine operates with an RF environment and includes a customer application programming interface (API), a radio server, and/or a coverage management component. The customer API and the radio server are operable to output a set of I-phase and Q-phase (I/Q) data using a Fast Fourier Transform (FFT). The set of I/Q data demonstrates the changes in amplitude and phase in a sine wave. The monitor and capture engine also serves as an optimization point for the system.
The awareness engine operates as both a platform optimization unit and a client optimization unit. The awareness engine is operable to perform functions including, but not limited to, detection, classification, demodulation, decoding, locating, and/or signaling alarms. The detection and/or classification functions assist with incoming RF data acclimation and further includes a supervised learning component, where the supervised learning component is operable to make use of any of the aforementioned learning techniques and/or technologies. The demodulation and/or decode functionalities are operable to access RF data from WIFI, Land Mobile Radio (LMR), Long Term Evolution (LTE) networks, and/or Unmanned Aircraft Systems (UAS). The location component of the awareness engine is operable to apply location techniques including, but not limited to, DF, geolocation, and/or Internet Protocol (IP) based location. The awareness engine is operable to signal alarms using FASD and/or masks. In one embodiment, the masks are dynamic masks.
The analytics engine is operable to perform functions including, but not limited to, data qualification, data morphing, and/or data computing.
The awareness engine, analytics engine, and the semantic engine are all operable for network communication with the prior knowledge database. This enables each of the previously mentioned engines to compare input and/or output with data already processed and analyzed by the system.
The various engines present within the Tip & Cue process further optimize client output in the form of dynamic spectrum utilization and/or allocation. The system uses the Tip & Cue process to provide actionable information and/or actionable knowledge to be utilized by at least one application to mitigate problems of the at least one application and/or to optimize services or goals of the at least one application.
In a preferred embodiment, each customer has a service level agreement (SLA) with the system manager that specifies usage of the spectrum. The system manager is operable act as an intermediary between a first customer and a second customer in conflicts regarding the spectrum. If signals of the first customer interfere with signals of the second customer in violation of one or more of SLAs, the system is operable to provide an alert to the violation. Data regarding the violation is stored in at least one database within the system, which facilitates resolution of the violation. The control plane is operable to directly communicate the first customer (i.e., customer in violation of SLA) and/or at least one base station to modify parameters to resolve the violation.
In one embodiment, the system is used to protect at least one critical asset. Each of the at least one critical asset is within a protection area. For example, a first critical asset is within a first protection area, a second critical asset is within a second protection area, etc. In one embodiment, the protection area is defined by sensor coverage from the at least one monitoring sensor. In other embodiments, the protection area is defined by sensor coverage from the at least one monitoring sensor, a geofence, and/or GPS coordinates. The system is operable to detect at least one signal within the protection area and send an alarm for the at least one signal when outside of allowed spectrum use within the protection area.
The system is further operable to determine what information is necessary to provide actionable information. For example, sensor processing requires a large amount of power. Embedding only the sensors required to provide sufficient variables for customer goals reduces computational and/or power requirements.
Further, wireless information is associated with a most statistically relevant combination of extracted measurements in at least one dimension in Step 3012. The at least one dimension includes, but is not limited to, time, frequency, signal space and/or signal characteristics, spatial, and/or application goals and/or customer impact. In a preferred embodiment, the at least one dimension includes time, frequency, signal space and/or signal characteristics, spatial, and application goals and/or customer impact. The RF awareness measurements are then qualified in Step 3014 and actionable data is provided in Step 3016 based on the relationship established in Steps 3002-3012. Actionable data efficiency is qualified in Step 3018 based on Step 3014. All actionable data and its statistical significance is provided in Step 3020.
In one example, the system is used by a tower company to evaluate if a carrier's performance can be improved by placing at least one additional macrosite on at least one additional tower. If the evaluation shows that the carrier's performance can be improved, it supports a pitch from the tower company to place the at least one macrosite on the at least one additional tower, which would generate revenue for the tower company.
In a second example, the system is also used by a tower company to evaluate if a carrier's performance can be improved by placing at least one additional macrosite on at least one additional tower. If the evaluation shows that the carrier's performance can be improved, it supports a pitch from the tower company to place the at least one macrosite on the at least one additional tower, which would generate revenue for the tower company.
Although adding the 3-sector eNodeB does slightly improve performance, this performance improvement is not significant enough to support the addition of the three proposed macrosites to the tower.
In a third example, the system is used to evaluate which carrier provides better service.
The system is operable to be implemented through a plurality of configurations of hardware and/or software. For example, and not limitation, the components described in the description and figures (e.g.,
In one embodiment, the hardware includes, but is not limited to, at least one very-large-scale integration (VLSI) circuit, at least one field programmable gate array (FPGA), at least one system on a chip (SoC), at least one system in a package (SiP), at least one application-specific integrated circuit (ASIC), at least one multi-chip package (MCP), at least one logic circuit, at least one logic chip, at least one programmable logic controller (PLC), at least one programmable logic device (PLD), at least one transistor, at least one switch, at least one filter, at least one amplifier, at least one antenna, at least one transceiver, and/or similar hardware elements. In one embodiment, components of the system are combined in a single chip, a single chipset, multiple chips, multiple chipsets, or provided on a single circuit board (e.g., a plurality of SoCs mounted on the single circuit board). In one embodiment, the hardware is referred to as a circuit or a system of multiple circuits configured to perform at least one function in an electronic device. In one embodiment, the circuit or the system of multiple circuits is operable to execute at least one software and/or at least one firmware program to perform at least one function in the system. The combination of the hardware and the at least one software and/or the at least one firmware program is operable to be referred to as circuitry.
In one embodiment, the software is operable to be executed by at least one processor. In one embodiment, the at least one processor includes, but is not limited to, at least one central processing unit (CPU), at least one graphics processing unit (GPU), at least one data processing unit (DPU), at least one neural processing unit (NPU), at least one crosspoint unit (XPU), at least one application processor, at least one baseband processor, at least one ultra-low voltage processor, at least one embedded processor, at least one reduced instruction set computer (RISC) processor, at least one complex instruction set computer (CISC), at least one advanced RISC machine (ARM) processor, at least one digital signal processor (DSP), at least one field programmable gate array (FPGA), at least one application-specific integrated circuit (ASIC), at least one programmable logic controller (PLC), at least one programmable logic device (PLD), at least one radio-frequency integrated circuit (RFIC), at least one microprocessor, at least one microcontroller, at least one single-core processor, at least one multi-core processor (e.g., a dual-core processor, a triple-core processor, a quad-core processor, etc.), and/or at least one multithreaded processor. In one embodiment, one or more of the at least one processor includes a special-purpose processor and/or a special-purpose controller constructed and configured to execute one or more components in the system. For example, but not limitation, the at least one processor is operable to include an INTEL ARCHITECTURE CORE-based processor, an INTEL microcontroller-based processor, an INTEL PENTIUM processor, an ADVANCED MICRO DEVICES (AMD) ZEN ARCHITECTURE-based processor, a QUALCOMM SNAPDRAGON processor, and/or an ARM processor.
In one embodiment, one or more of the at least one processor includes and/or is in communication with at least one memory (e.g., volatile and/or non-volatile memory). The at least one memory includes, but is not limited to, random-access memory (RAM), dynamic random-access memory (DRAM), static random-access memory (SRAM), synchronous dynamic random-access memory (SDRAM), magnetoresistive random-access memory (MRAM), phase-change memory (PRAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, solid-state memory, optical drive, magnetic hard drive, and/or any other suitable type of memory. In one embodiment, the at least one memory includes electronic, magnetic, optical, electromagnetic, infrared, holographic, micromechanical, phase change, resistance change, chemical, and/or semiconductor systems, devices, and/or apparatuses. In one embodiment, the at least one memory includes at least one shared memory. In one embodiment, the at least one memory includes at least one single die package (SDP), at least one dual die package (DDP), at least one quad die package (QDP), and/or at least one octo die package (ODP). In one embodiment, the at least one shared memory is operable to be accessed by a plurality of processing elements. In one embodiment, one or more of the at least one memory is operable to store data and/or processor-executable code. In one embodiment, the data and/or processor-executable code is loaded in response to execution of a function by one or more of the at least one processor. In one embodiment, the at least one processor is operable to read data from and/or write data to the at least one memory.
One or more of the at least one processor is operable to execute computer-executable instructions (e.g., program code, software, firmware, operating system) stored in one or more of the at least one memory. The computer-executable instructions are operable to be written in any computer language and/or combination of computer languages (e.g., Python, Ruby, Java, C++, C, assembly, etc.). The computer-executable instructions are operable to include at least one instruction (e.g., one instruction, a plurality of instructions). The computer-executable instructions are operable to be stored in one or more of the at least one memory. In one embodiment, the computer-executable instructions are distributed between a plurality of the at least one memory. In one embodiment, the computer-executable instructions are organized as at least one object, at least one procedure, and/or at least one function. In one embodiment, one or more of the at least one processor is operable to execute machine learning, artificial intelligence, and/or computer vision algorithms.
In one embodiment, the system includes at least one secure execution environment. In one embodiment, the at least one processor includes a secure-embedded controller, a dedicated SoC, and/or a tamper-resistant chipset or microcontroller. In one embodiment, the at least one secure execution environment further includes at least one tamper-resistant or secure memory. In one embodiment, the at least one secure execution environment includes at least one secure enclave. The at least one secure enclave is operable to access, process, and/or execute data stored within the at least one secure enclave.
In one embodiment, the system further includes at least one power supply (e.g., battery, power bus), at least one power controller, and/or at least one power manager. For example, and not limitation, the at least one power manager is operable to save power and/or provide thermal management. In one embodiment, the at least one power manager is operable to adjust a power supply voltage in real time and/or in near-real time, control production of thermal energy, and/or provide other power management. In one embodiment, the at least one power manager includes a power management integrated circuit (PMIC). In one embodiment, the PMIC provides power via at least one voltage rail to one or more system components (e.g., at least one processor, etc.). In one embodiment, the system includes dynamic clock and voltage scaling (DCVS). For example, and not limitation, the at least one processor is operable to be adjusted dynamically (e.g., in real time, in near-real time) in response to operating conditions.
In one embodiment, the system includes at least one interface operable to exchange information between at least two components or devices. In one embodiment, the at least one interface includes, but is not limited to, at least one bus, at least one input/output (I/O) interface, at least one peripheral component interface, and/or similar interfaces.
In one embodiment, the system includes at least one communication interface operable to provide communications between at least two components or devices. For example, and not limitation, the at least one communication interface is operable to provide communications between the system and a remote device (e.g., an edge device) and/or between a first component of the system (e.g., the RF awareness subsystem) and a second component of the system (e.g., data analysis engine). In one embodiment, the at least one communication interface is any communication circuit or device operable to transmit and/or receive data over a network. The at least one communication interface is operable to transmit and/or receive data via wired or wireless communications. In one embodiment, the at least one communication interface includes WI-FI, WORLDWIDE INTEROPERABILITY FOR MICROWAVE ACCESS (WIMAX), Radio Frequency (RF) communication including RF identification (RFID), NEAR FIELD COMMUNICATION (NFC), BLUETOOTH including BLUETOOTH LOW ENERGY (BLE), ZIGBEE, Infrared (IR) communication, cellular communication, satellite communication, Universal Serial Bus (USB), Ethernet communications, communication via fiber-optic cables, coaxial cables, twisted pair cables, and/or any other type of wireless or wired communication. In one embodiment, the at least one communication interface further includes at least one wire, at least one cable, and/or at least one printed circuit board trace.
The following documents include additional information about chipsets, SoCs, VLSIs, and/or components thereof: U.S. Pat. Nos. 9,170,957; 9,300,320; 9,330,736; 9,354,812; 9,386,521; 9,396,070; 9,400,295; 9,443,810; 9,467,453; 9,489,305; 9,542,333; 9,552,034; 9,552, 163; 9,558,117; 9,575,881; 9,588,804; 9,612,615; 9,639,128; 9,640,242; 9,652,026; 9,658,671; 9,690,364; 9,690,710; 9,699,683; 9,703,493; 9,734,013; 9,734,073; 9,734,878; 9,747,038; 9,747,209; 9,748,847; 9,749,962; 9,778,871; 9,785,371; 9,819,357; 9,823,846; 9,846,612; 9,858,637; 9,921,909; 9,928,168; 9,928,924; 9,940,109; 9,959,075; 9,973,431; 9,983,930; 10,019,602; 10,048,316; 10,061,644; 10,090,040; 10,101,756; 10,121,001; 10,140,223; 10,157,008; 10,162,543; 10,169,262; 10,247,617; 10,296,069; 10,310,757; 10,359,803; 10,387,333; 10,454,487; 10,482,943; 10,509,588; 10,558,369; 10,579,516; 10,586,038; 10,591,965; 10,591,975; 10,628,308; 10,707,753; 10,713,189; 10,725,932; 10,769,073; 10,783,252; 10,817,224; 10,878,880; 11,115,176; 11,139,830; 11,249,134; 11,360,897; 11,416,049; 11,452,001; 11,463,141; 11,489,608; 11,490,457; 11,493,970; 11,493,980; 11,493,986; and 11,494,248 and U.S. Patent Publication Nos. 20150138714, 20160105549, 20160269185, 20160270134, 20160338137, 20170078890, 20170079012, 20170127411, 20170164220, 20170181134, 20170187886, 20180007627, 20180020365, 20180020462, 20180059863, 20180063820, 20180063869, 20180069651, 20180069664, 20180070219, 20180083684, 20180098370, 20180109346, 20180124685, 20180146487, 20180146494, 20180152819, 20180152950, 20180159668, 20180159935, 20180205438, 20180206108, 20180206260, 20180206269, 20180212733, 20180213425, 20180213498, 20180219605, 20180219662, 20180220386, 20180220399, 20180227958, 20180241458, 20180242224, 20180254805, 20180254851, 20180254853, 20180255576, 20180263013, 20180269945, 20180270860, 20180279408, 20180288715, 20180294924, 20180302868, 20180302900, 20180309928, 20180316409, 20180316453, 20180324826, 20180338281, 20180352564, 20180376474, 20180376531, 20190007812, 20190013901, 20190013908, 20190020451, 20190021026, 20190021053, 20190021105, 20190036552, 20190037429, 20190041223, 20190043968, 20190044066, 20190044794, 20190045390, 20190045581, 20190052317, 20190068352, 20190074887, 20190081679, 20190086955, 20190132089, 20190132860, 20190141679, 20190149379, 20190149434, 20190150017, 20190150155, 20190150157, 20190158331, 20190174423, 20190182696, 20190208507, 20190215907, 20190230550, 20190239093, 20190239212, 20190239245, 20190239286, 20190246377, 20190257916, 20190261361, 20190261453, 20190261454, 20190268061, 20190268128, 20190268935, 20190268970, 20190273569, 20190288811, 20190289668, 20190296790, 20190296877, 20190297662, 20190306737, 20190319699, 20190319868, 20190326959, 20190327024, 20190327117, 20190327621, 20190334611, 20190349272, 20190356463, 20190364456, 20190364556, 20190373667, 20190379492, 20190387401, 20190387424, 20190387577, 20190394719, 20190394741, 20200008088, 20200014483, 20200015128, 20200022218, 20200029392, 20200045618, 20200077414, 20200092876, 20200092946, 20200112943, 20200119893, 20200128579, 20200136777, 20200163156, 20200178288, 20200196186, 20200236572, 20200260526, 20200260527, 20200274666, 20200280466, 20200281021, 20200296155, 20200382190, 20200389836, 20200389917, 20210007023, 20210014656, 20210058206, 20210058748, 20210058785, 20210058946, 20210076389, 20210076397, 20210099976, 20210112528, 20210135803, 20210144517, 20210144624, 20210168577, 20210176762, 20210176769, 20210219166, 20210258811, 20210266915, 20210297204, 20210307051, 20210314954, 20210328739, 20210345163, 20210345395, 20210352655, 20210360563, 20210378041, 20210385865, 20210392673, 20210392714, 20210400584, 20210409335, 20220014286, 20220022019, 20220022167, 20220030475, 20220038164, 20220039032, 20220060905, 20220108092, 20220110018, 20220116334, 20220123849, 20220124043, 20220286972, 20220287083, 20220300418, 20220317901, 20220318343, 20220332350, 20220343241, 20220345863, and 20220353732, each of which is incorporated herein by reference in its entirety.
In one example, provided for example and not limitation, the present invention includes the system 7100 in a system on a chip (SoC) and the system 7200 in a custom VLSI and/or FPGA chipset.
Alternative combinations are compatible with the present invention.
The server 850 is constructed, configured, and coupled to enable communication over a network 810 with a plurality of computing devices 820, 830, 840. The server 850 includes a processing unit 851 with an operating system 852. The operating system 852 enables the server 850 to communicate through network 810 with the remote, distributed user devices. Database 870 is operable to house an operating system 872, memory 874, and programs 876.
In one embodiment of the invention, the system 800 includes a network 810 for distributed communication via a wireless communication antenna 812 and processing by at least one mobile communication computing device 830. Alternatively, wireless and wired communication and connectivity between devices and components described herein include wireless network communication such as WI-FI, WORLDWIDE INTEROPERABILITY FOR MICROWAVE ACCESS (WIMAX), Radio Frequency (RF) communication including RF identification (RFID), NEAR FIELD COMMUNICATION (NFC), BLUETOOTH including BLUETOOTH LOW ENERGY (BLE), ZIGBEE, Infrared (IR) communication, cellular communication, satellite communication, Universal Serial Bus (USB), Ethernet communications, communication via fiber-optic cables, coaxial cables, twisted pair cables, and/or any other type of wireless or wired communication. In another embodiment of the invention, the system 800 is a virtualized computing system capable of executing any or all aspects of software and/or application components presented herein on the computing devices 820, 830, 840. In certain aspects, the computer system 800 is operable to be implemented using hardware or a combination of software and hardware, either in a dedicated computing device, or integrated into another entity, or distributed across multiple entities or computing devices.
By way of example, and not limitation, the computing devices 820, 830, 840 are intended to represent various forms of electronic devices including at least a processor and a memory, such as a server, blade server, mainframe, mobile phone, personal digital assistant (PDA), smartphone, desktop computer, netbook computer, tablet computer, workstation, laptop, and other similar computing devices. The components shown here, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the invention described and/or claimed in the present application.
In one embodiment, the computing device 820 includes components such as a processor 860, a system memory 862 having a random access memory (RAM) 864 and a read-only memory (ROM) 866, and a system bus 868 that couples the memory 862 to the processor 860. In another embodiment, the computing device 830 is operable to additionally include components such as a storage device 890 for storing the operating system 892 and one or more application programs 894, a network interface unit 896, and/or an input/output controller 898. Each of the components is operable to be coupled to each other through at least one bus 868. The input/output controller 898 is operable to receive and process input from, or provide output to, a number of other devices 899, including, but not limited to, alphanumeric input devices, mice, electronic styluses, display units, touch screens, signal generation devices (e.g., speakers), or printers.
By way of example, and not limitation, the processor 860 is operable to be a general-purpose microprocessor (e.g., a central processing unit (CPU)), a graphics processing unit (GPU), a microcontroller, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a controller, a state machine, gated or transistor logic, discrete hardware components, or any other suitable entity or combinations thereof that can perform calculations, process instructions for execution, and/or other manipulations of information.
In another implementation, shown as 840 in
Also, multiple computing devices are operable to be connected, with each device providing portions of the necessary operations (e.g., a server bank, a group of blade servers, or a multi-processor system). Alternatively, some steps or methods are operable to be performed by circuitry that is specific to a given function.
According to various embodiments, the computer system 800 is operable to operate in a networked environment using logical connections to local and/or remote computing devices 820, 830, 840 through a network 810. A computing device 830 is operable to connect to a network 810 through a network interface unit 896 connected to a bus 868. Computing devices are operable to communicate communication media through wired networks, direct-wired connections or wirelessly, such as acoustic, RF, or infrared, through an antenna 897 in communication with the network antenna 812 and the network interface unit 896, which are operable to include digital signal processing circuitry when necessary. The network interface unit 896 is operable to provide for communications under various modes or protocols.
In one or more exemplary aspects, the instructions are operable to be implemented in hardware, software, firmware, or any combinations thereof. A computer readable medium is operable to provide volatile or non-volatile storage for one or more sets of instructions, such as operating systems, data structures, program modules, applications, or other data embodying any one or more of the methodologies or functions described herein. The computer readable medium is operable to include the memory 862, the processor 860, and/or the storage media 890 and is operable be a single medium or multiple media (e.g., a centralized or distributed computer system) that store the one or more sets of instructions 900. Non-transitory computer readable media includes all computer readable media, with the sole exception being a transitory, propagating signal per se. The instructions 900 are further operable to be transmitted or received over the network 810 via the network interface unit 896 as communication media, which is operable to include a modulated data signal such as a carrier wave or other transport mechanism and includes any delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics changed or set in a manner as to encode information in the signal.
Storage devices 890 and memory 862 include, but are not limited to, volatile and non-volatile media such as cache, RAM, ROM, EPROM, EEPROM, FLASH memory, or other solid state memory technology; discs (e.g., digital versatile discs (DVD), HD-DVD, BLU-RAY, compact disc (CD), or CD-ROM) or other optical storage; magnetic cassettes, magnetic tape, magnetic disk storage, floppy disks, or other magnetic storage devices; or any other medium that can be used to store the computer readable instructions and which can be accessed by the computer system 800.
In one embodiment, the computer system 800 is within a cloud-based network. In one embodiment, the server 850 is a designated physical server for distributed computing devices 820, 830, and 840. In one embodiment, the server 850 is a cloud-based server platform. In one embodiment, the cloud-based server platform hosts serverless functions for distributed computing devices 820, 830, and 840.
In another embodiment, the computer system 800 is within an edge computing network. The server 850 is an edge server, and the database 870 is an edge database. The edge server 850 and the edge database 870 are part of an edge computing platform. In one embodiment, the edge server 850 and the edge database 870 are designated to distributed computing devices 820, 830, and 840. In one embodiment, the edge server 850 and the edge database 870 are not designated for distributed computing devices 820, 830, and 840. The distributed computing devices 820, 830, and 840 connect to an edge server in the edge computing network based on proximity, availability, latency, bandwidth, and/or other factors.
It is also contemplated that the computer system 800 is operable to not include all of the components shown in
The above-mentioned examples are provided to serve the purpose of clarifying the aspects of the invention, and it will be apparent to one skilled in the art that they do not serve to limit the scope of the invention. By nature, this invention is highly adjustable, customizable and adaptable. The above-mentioned examples are just some of the many configurations that the mentioned components can take on. All modifications and improvements have been deleted herein for the sake of conciseness and readability but are properly within the scope of the present invention.
This application is related to and claims priority from the following U.S. patents and patent applications. This application is a continuation of U.S. patent application Ser. No. 18/782,909, filed Jul. 24, 2024, which is a continuation-in-part of U.S. patent application Ser. No. 18/781,456, filed Jul. 23, 2024, which is a continuation-in-part of U.S. patent application Ser. No. 18/756,489, filed Jun. 27, 2024, which is a continuation of U.S. patent application Ser. No. 18/409,340, filed Jan. 10, 2024, which is a continuation of U.S. patent application Ser. No. 18/524,945, filed Nov. 30, 2023, which is a continuation of U.S. patent application Ser. No. 18/218,379, filed Jul. 5, 2023, which is a continuation of U.S. patent application Ser. No. 18/085,874, filed Dec. 21, 2022, which is a continuation-in-part of U.S. patent application Ser. No. 17/992,490, filed Nov. 22, 2022, which is a continuation-in-part of U.S. patent application Ser. No. 17/985,570, filed Nov. 11, 2022, which is a continuation-in-part of U.S. patent application Ser. No. 17/691,683, filed Mar. 10, 2022, which is a continuation of U.S. patent application Ser. No. 17/470,253, filed Sep. 9, 2021, which is a continuation of U.S. application Ser. No. 17/085,635, filed Oct. 30, 2020, which claims the benefit of U.S. Provisional Application No. 63/018,929, filed May 1, 2020. Each of the above listed applications is incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 63018929 | May 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 18782909 | Jul 2024 | US |
| Child | 18783221 | US | |
| Parent | 18409340 | Jan 2024 | US |
| Child | 18756489 | US | |
| Parent | 18524945 | Nov 2023 | US |
| Child | 18409340 | US | |
| Parent | 18218379 | Jul 2023 | US |
| Child | 18524945 | US | |
| Parent | 18085874 | Dec 2022 | US |
| Child | 18218379 | US | |
| Parent | 17470253 | Sep 2021 | US |
| Child | 17691683 | US | |
| Parent | 17085635 | Oct 2020 | US |
| Child | 17470253 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 18781456 | Jul 2024 | US |
| Child | 18782909 | US | |
| Parent | 18756489 | Jun 2024 | US |
| Child | 18781456 | US | |
| Parent | 17992490 | Nov 2022 | US |
| Child | 18085874 | US | |
| Parent | 17985570 | Nov 2022 | US |
| Child | 17992490 | US | |
| Parent | 17691683 | Mar 2022 | US |
| Child | 17985570 | US |
