Intent-based satellite transmit management based on preexisting historical location and machine learning

Information

  • Patent Grant
  • 12368503
  • Patent Number
    12,368,503
  • Date Filed
    Wednesday, September 18, 2024
    10 months ago
  • Date Issued
    Tuesday, July 22, 2025
    6 days ago
Abstract
The techniques disclosed herein include formulation and communication of intent-based instructions that include predetermined desired outcomes associated with satellites and/or corresponding ground stations even under dynamically-changing conditions, that allow for desired satellite behaviors and facilitate high-performance payload delivery. An intent processor, located on each satellite and/or on each corresponding ground station, is used to generate and execute low-level command sequences in order to fulfill the semantics of the intent-based instructions. The intent-based instructions and/or the low-level command sequences relate to dynamic operation of the satellite under changing conditions, and/or dynamic operation of corresponding ground stations so as to achieve on-going desired behaviors of the satellite with respect to the corresponding ground stations. Additionally, situation-aware and dynamically tunable models are produced and selectively invoked to be able to accurately achieve desired satellite behavior.
Description
FIELD OF THE INVENTION

The present disclosure generally relates to satellites, and more specifically, satellite constellation management and control.


BACKGROUND

Satellite constellations may include groups of satellites working together in a coordinated manner to provide global or near-global coverage for various applications such as communication, earth observation, and navigation. These constellations can range from a few satellites to hundreds or even thousands of satellites, depending on the specific application and coverage requirements.


Managing and controlling these satellite constellations can be a complex task due to the large number of satellites involved, the distance from a control point, and the dynamic and harsh space environment in which they operate. Such ability to control satellites typically may involve various aspects such as mission planning, satellite scheduling, communication management, and fault detection and recovery. However, current systems to control satellites are often confronting issues of delay (in delivering updates to satellite nodes), outdated infrastructure, lack of communication (such as when a satellite node exits a window of transmission), etc.


As such, there is thus a need for addressing these and/or other issues associated with the prior art.


SUMMARY

This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.


In some aspects, the techniques described herein relate to a satellite optimization management system, including: a natural language processing module configured to receive and interpret user input expressed in natural language to determine a user's intent and map it to specific tasks for a satellite, wherein the natural language processing module uses a neural network to determine the user's intent; an execution module configured to generate and execute satellite command sequences based on operational tasks derived from the user's intent; and a communication interface configured to facilitate data transmission between the satellite and ground control.


In some aspects, the techniques described herein relate to a satellite management system, including: a plurality one or more satellites in a constellation; a ground-based control system for managing operations of the one or more of satellites, the ground-based control system including satellite control and payload delivery systems, wherein the ground-based control system manages interaction between the one or more of satellites and at least one of: at least one ground station, at least one mission control station, or at least one data center; a messaging module configured to route messages between the one or more of satellites and the ground-based control system; and a micro-batch delivery module configured to transmit and receive the messages to and from the one or more of satellites.


In some aspects, the techniques described herein relate to an advanced mission control system, including: a ground-based satellite control system; a communication module for communicating between the ground-based satellite control system and one or more satellites; a satellite transit behavior prediction module configured to: receive current and past orbital transit paths of the one or more satellites, train a neural network based on the current and past orbital transit paths, and predict future orbital transit paths for the one or more satellites using the trained neural network; and a satellite management module for managing the one or more satellites based on the future orbital transit paths.


In some aspects, the techniques described herein relate to an intent-based satellite management system, including: one or more satellites in a constellation; a ground-based control system to manage the one or more satellites; a communication module configured to transmit intent-based instruction from the ground-based control system to the one or more satellites, wherein the intent-based instruction includes one or more predetermined outcomes; and an intent-based module, located on each satellite of the one or more satellites, configured to receive the intent-based instruction and instruct a processor to generate and execute command sequences in order to fulfill the intent-based instruction.


In some aspects, the techniques described herein relate to a satellite management system, further including a data processing module configured to analyze data collected by the one or more satellites and to provide feedback to the ground-based control system for adjusting future commands sent as micro-batch packets of data.


In some aspects, the techniques described herein relate to a satellite management system, further including a flight dynamics module for determining a correct Acquisition of Signal (AOS) and Loss of Signal (LOS) times for successful communication with the one or more satellites.


In some aspects, the techniques described herein relate to a satellite management system, further including a message broker of the messaging module, wherein the message broker is configured to route messages based on a location and availability of the plurality satellites in the constellation.


In some aspects, the techniques described herein relate to a satellite management system, further including a sidecar proxy of the micro-batch delivery module, wherein the sidecar proxy is configured to work with a send-queue and a receive-queue for messages to and from the one or more satellites using a secure database.


In some aspects, the techniques described herein relate to a satellite management system, further including a virtual satellite simulation infrastructure for creating new satellites to study what-if scenarios to pre-determine before-launch trajectories for new satellites of the one or more satellites or after-launch trajectories for existing satellites before a specific date.


In some aspects, the techniques described herein relate to a satellite management system, wherein the at least ground stations functions as the mission control station.


In some aspects, the techniques described herein relate to a satellite management system, wherein the at least one data center hosts a portion of a computing cloud and is further configured to provide storage of data and allow packetized transfer of the data.


In some aspects, the techniques described herein relate to a satellite management system, wherein the ground-based control system is configured to communicate with the satellites using micro-batching commands.


In some aspects, the techniques described herein relate to a satellite management system, wherein the ground-based control system is configured to provide fault tolerance by allowing remote rescheduling or reset of a satellite On-Board Computer (OBC) at another compliant ground station when at least one of the one or more satellites passes over the ground-based control system.


In some aspects, the techniques described herein relate to a satellite management system, wherein the micro-batch delivery module is configured to transmit micro-batch commands to the one or more satellites including instructions for at least one of: adjusting satellite positions, changing satellite orientations, or modifying operational parameters of the one or more satellites.


In some aspects, the techniques described herein relate to a satellite management system, wherein the micro-batch delivery module is further configured to optimize a timing and sequencing of data to or from the one or more satellites, wherein the sequencing of data includes segmenting the data into micro-batch packets of data.


In some aspects, the techniques described herein relate to a satellite management system, wherein the one or more satellites are equipped with sensors and instruments to perform data collection, imaging, or communication relay tasks in response to commands associated with the micro-batch packets of data.


In some aspects, the techniques described herein relate to a satellite management system, wherein the one or more satellites in the constellation are small satellites, wherein the small satellites are CubeSats.


In some aspects, the techniques described herein relate to a satellite management system, wherein the predetermined parameters include location, flight path, and times of Acquisition of Signal (AOS) and Loss of Signal (LOS) of the one or more satellites.


In some aspects, the techniques described herein relate to a satellite management system, wherein the satellite control and payload delivery systems are configured to segment the data based on a predictive model of satellite positions and operational requirements.


In some aspects, the techniques described herein relate to a satellite management system, wherein the virtual satellite simulation infrastructure is configured to simulate the trajectories of the one or more satellites based on predetermined parameters.


In some aspects, the techniques described herein relate to a satellite management system, wherein the virtual satellite simulation infrastructure is further configured to adjust the predetermined parameters based on real-time data received from the satellites.


In some aspects, the techniques described herein relate to a satellite optimization management system which uses an expert system coupled to and controlled by an intent-based processing system.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the coarse-grained prediction includes workflow-based instructions pertaining to at least an entire orbit of the satellite, and the fine-grained prediction includes measurements to carry out the workflow-based instructions based on then-current information associated with the satellite.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data compression system for optimizing the transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data encryption system for securing the transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data transmission error detection and correction system for detecting and correcting errors in the data transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data transmission logging system for logging the data transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data transmission monitoring system for monitoring the data transmission and providing feedback on the data transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data transmission protocol for managing the transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data transmission rate control system for controlling the rate of data transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the communication interface includes a data transmission scheduling system for scheduling the data transmission.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the data compression system is configured to optimize a timing and sequencing of data to or from the satellite.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the execution module includes a command generation system or command execution system for generating the satellite command sequences.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the intent-based instructions are based on coarse-grained prediction and fine-grained in-flight measurements.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the natural language processing module includes a speech recognition system for receiving voice-based user input.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the natural language processing module includes a text analysis system for receiving text-based user input.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the natural language processing module is configured to display a user interface to receive the user input.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the neural network used by the natural language processing module is one of a recurrent neural network, or convolutional neural network.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the sequencing of data includes segmenting the data into micro-batch packets of data.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the user input includes unstructured text relating to intent-based instructions for the satellite.


In some aspects, the techniques described herein relate to a satellite optimization management system, wherein the user's intent is interpreted by the natural language processing module by at least one of tokenization, part-of-speech tagging, named entity recognition, stemming, lemmatization, sentiment analysis, syntax, or grammar.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the communication module is configured to optimize a timing and sequencing of data to or from the one or more satellites by segmenting the data into micro-batch packets of data.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the communication module uses radio frequency communication to communicate between the ground-based satellite control system and the one or more satellites.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the data processing module includes a data cleaning module for removing or correcting erroneous or missing data.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the data processing module includes a data normalization module for adjusting values of the satellite data to a common scale.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the data processing module includes a data transformation module for converting the satellite data into a suitable format or scale.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the ground-based satellite control system includes a data analysis module for analyzing satellite data.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the ground-based satellite control system includes a data mining module for mining satellite data.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the ground-based satellite control system includes a data processing module for preprocessing satellite data.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the ground-based satellite control system includes a data visualization module for visualizing satellite data.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the ground-based satellite control system includes a model training module for training machine learning models.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the ground-based satellite control system includes a user interface for managing operations of the one or more satellites.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the historical satellite transit data includes data related to orbital inclination, right ascension of an ascending node, eccentricity, argument of perigee, mean anomaly, and mean motion.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the machine learning model is trained using historical satellite transit data.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the model training module uses one of: a supervised learning model, an unsupervised learning model, a semi-supervised learning model, or a reinforcement learning model to train the machine learning models.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the satellite management module includes a scheduling module for scheduling satellite operations based on the future orbital transit paths.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the satellite transit behavior prediction module uses a machine learning model to predict the future orbital transit paths.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the segmenting is based on one or more areas of interest or a location of the ground-based satellite control system.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the segmenting is based on the future orbital paths.


In some aspects, the techniques described herein relate to an advanced mission control system, wherein the user interface includes a display for visualizing the current and future orbital transit paths of the one or more satellites.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the coarse-grained prediction includes workflow-based instructions pertaining to at least an entire orbit, and the fine-grained prediction includes measurements to carry out the workflow-based instructions based on then-current information associated with at least one satellite of the one or more satellites.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences are configured for future execution.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences are executed based on a schedule.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences are executed based on current and predicted future states of one or more of: a plurality of the satellite, a ground station, or a mission control station.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences are executed based on current and predicted future states of the satellite and the ground-based control system.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences are executed based on current and predicted future states of the satellite.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences are executed in real-time or near real-time.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences include flight dynamics commands.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences include payload delivery commands.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the command sequences include telemetry tracking and control (TTC) commands.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-base instruction includes taking a predetermined action associated an area of interest.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-based instruction includes a set of high-level goals for the one or more satellites.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-based instruction includes an if-this-then-that configuration based on in-situ real-time measurements provided by any satellite of the one or more satellites.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-based instruction is associated with a state of each satellite of the one or more satellites, and the command sequences are configured as real-time commands to achieve the state.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-based instruction is based on coarse-grained prediction and fine-grained in-flight measurements.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-based instruction is provided by a user through a user interface, wherein the user interface includes a natural language processing module for interpreting an intent of the user.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-based module uses a neural network to generate the command sequences.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the intent-based module uses one of a deep learning model, a reinforcement learning model, a supervised learning model, an unsupervised learning model, or a semi-supervised learning model to generate the command sequences.


In some aspects, the techniques described herein relate to an intent-based satellite management system, wherein the natural language processing module uses a neural network to interpret the intent.


In some aspects, the techniques described herein relate to a rules-based expert system configured to create commands for any of the one or more pre-determined outcomes, the intent-based processing, and/or one or more actions implemented by a satellite.


The foregoing general description of the illustrative embodiments and the following detailed description thereof are merely exemplary aspects of the teachings of this disclosure and are not restrictive.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1A illustrates satellite control and payload delivery systems, according to aspects of the present disclosure.



FIG. 1B illustrates command-based and intent-based satellite instructions, in another embodiment.



FIG. 1C illustrates a distributed system comprising satellites in a constellation, ground-stations, mission control, back-office(s), and datacenters, in another embodiment.



FIG. 2 depicts a satellite as a node in a distributed system, in another embodiment.



FIG. 3 shows a constellation of satellites in the sky over the earth where one or more satellites may be communicating with their nearest ground stations, in another embodiment.



FIG. 4 presents satellites transiting over a ground location, in another embodiment.



FIG. 5 demonstrates communication between Mission Control center and one or


more satellites in the sky, in another embodiment.



FIG. 6 highlights the concept of micro-batching commands, in another embodiment.



FIG. 7 illustrates a fault-tolerant and load balancing infrastructure, in another embodiment.



FIG. 8 shows an area on earth divided into tiles by latitude and longitude for a constellation of satellites to perform aerial survey, in another embodiment.



FIG. 9A provides a UI/UX front-end for Mission Control and Flight Dynamics Software, in another embodiment.



FIG. 9B shows computing infrastructure for control of satellites, in another embodiment.



FIG. 10 shows an integrated simulation workspace for satellites, in another embodiment.



FIG. 11 shows a user interface for control of satellites, in another embodiment.



FIG. 12 illustrates a network architecture, in accordance with one possible embodiment.



FIG. 13 illustrates an exemplary system, in accordance with one embodiment.



FIG. 14 shows a system for prioritization of tasks, in another embodiment.



FIG. 15 shows a method for message passing, in another embodiment.



FIGS. 16A and 16B show a system for re-assignment/re-purposing of tasks, in another embodiment.



FIG. 17 illustrates a system for tracking a satellite over an interval of time, in another embodiment.



FIG. 18 illustrates a system for determining a future time and date where a satellite passes over one or more AOIs, in another embodiment.



FIGS. 19A and 19B provide example scenarios for the elevation profile of a satellite in transit over a ground station, in another embodiment.



FIGS. 20A and 20B illustrate methods for gathering Two-Line Element (TLE) and mission control data to train a machine learning model, in another embodiment.



FIG. 21 illustrates a method designed to train a predictive machine learning model, in another embodiment.



FIG. 22 illustrates a method for mission planning and mission administration, in another embodiment.



FIG. 23 illustrates a method for parameter and command generation for flight control, in another embodiment.



FIG. 24 illustrates a system for machine learning-based declarative infrastructure for automated mission planning, mission administration, and control, in another embodiment.



FIG. 25 illustrates an intent-based satellite instruction system, in accordance with one embodiment.





DETAILED DESCRIPTION

The following description sets forth exemplary aspects of the present disclosure. It should be recognized, however, that such description is not intended as a limitation on the scope of the present disclosure. Rather, the description also encompasses combinations and modifications to those exemplary aspects described herein.


The present disclosure pertains to the field of satellite constellation management and control, specifically focusing on systems, methods, and devices that facilitate distributed, scalable, and fault-tolerant management of satellite constellations. This may be achieved by leveraging modern distributed computing principles and technologies. In some aspects, the system comprises a constellation of satellites, one or more ground stations, a mission control station, and a data center hosting a portion of an internet cloud. The system may also include a message broker and send and receive queues for routing messages between the satellites, the ground stations, the mission control station, and the data center, and a sidecar proxy for communicating messages to and from the satellites.


In some cases, the satellites in the constellation may be small satellites, such as CubeSats. The message broker may be configured to route messages based on the location and availability of the satellites in the constellation. The sidecar proxy may work in conjunction with the send-queue and the receive-queue for messages to and from the satellites using a secure database. The system may also include a flight dynamics software for determining the correct Acquisition of Signal (AOS) and Loss of Signal (LOS) times for successful communication with the satellites. The mission control station may communicate with the satellites using micro-batching commands, and the data center hosting a portion of an internet cloud may provide storage of data and allow packetized transfer of data similar to the internet.


In some aspects, the system may provide fault tolerance by allowing remote rescheduling or reset of a satellite On-Board Computer (OBC) at another compliant ground station when the satellite passes over it. The system may also include a virtual satellite simulation infrastructure for creating new satellites to study what-if scenarios to pre-determine the trajectories before launch for new satellites or the trajectories for existing satellites before a specific date. The virtual satellite simulation infrastructure may simulate one or more trajectories of the satellites based on predetermined parameters, which may include the location, flight path, and times of Acquisition of Signal (AOS) and Loss of Signal (LOS) of the satellites. The virtual satellite simulation infrastructure may further adjust the predetermined parameters based on real-time data received from the satellites.


This approach to satellite constellation management and control offers potential benefits such as increased efficiency, scalability, and fault tolerance, addressing some of the challenges associated with managing and controlling large numbers of satellites in a constellation.


A variety of benefits may be achieved by implementation of the framework and/or methods/systems disclosed herein, including: 1) increase speed of deployment (which may be achieved through standardized satellite infrastructure using on board computer(s)), 2) one click user interface (to control and/or manage satellite(s)), 3) accuracy of commands (which may be used to reduce human error and increase optimized commands sent in near real time), 4) case of use (via standardization of deployment such as of the Mission Control software platform), 5) decrease of cost (based in large part on the decrease in time to implement changes/management of satellites), and/or 6) reduced time of configuration (for example, an advertised life of a satellite may be only a few years, and configuration of the satellite may conventionally take a significant portion of such advertised life, whereas the present disclosure may reduce the time of configuration of the satellite, thereby maximizing an advertised life).


Definitions and Use of Figures


Some of the terms used in this description are defined below for easy reference. The presented terms and their respective definitions are not rigidly restricted to these definitions-a term may be further defined by the term's use within this disclosure. The term “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the word exemplary is intended to present concepts in a concrete fashion. As used in this application and the appended claims, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise, or is clear from the context, “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, if X employs A, X employs B, or X employs both A and B, then “X employs A or B” is satisfied under any of the foregoing instances. As used herein, at least one of A or B means at least one of A, or at least one of B, or at least one of both A and B. In other words, this phrase is disjunctive. The articles “a” and “an” as used in this application and the appended claims should generally be construed to mean “one or more” unless specified otherwise or is clear from the context to be directed to a singular form.


Various embodiments are described herein with reference to the figures. It should be noted that the figures are not necessarily drawn to scale, and that elements of similar structures or functions are sometimes represented by like reference characters throughout the figures. It should also be noted that the figures are only intended to facilitate the description of the disclosed embodiments-they are not representative of an exhaustive treatment of all possible embodiments, and they are not intended to impute any limitation as to the scope of the claims. In addition, an illustrated embodiment need not portray all aspects or advantages of usage in any particular environment.


An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated. References throughout this specification to “some embodiments” or “other embodiments” refer to a particular feature, structure, material or characteristic described in connection with the embodiments as being included in at least one embodiment. Thus, the appearance of the phrases “in some embodiments” or “in other embodiments” in various places throughout this specification are not necessarily referring to the same embodiment or embodiments. The disclosed embodiments are not intended to be limiting of the claims.


Ground stations may play a pivotal role in the management and control of satellite constellations. They serve as the primary interface between the satellites and the mission control center, facilitating the exchange of commands and data between them. The ground stations may be equipped with various types of equipment such as antennas, transceivers, and computers to enable this communication.


Mission control centers may be responsible for the overall management and control of the satellite constellations. They may be equipped with various types of software and hardware systems to perform tasks such as mission planning, satellite scheduling, data processing, and system monitoring. These centers typically may have a team of operators and engineers who monitor the status of the satellites and the constellation as a whole, and take appropriate actions as and when required.


Distributed computing principles and technologies, as applied to control of satellites, may enable the efficient and effective management of distributed systems by allowing the system components to work together in a coordinated manner, sharing resources and tasks, and providing fault tolerance and scalability.


Internet cloud technology may be used to provide for satellite control and/or management, thereby providing a scalable and flexible platform for hosting the various software and hardware systems involved in the management and control of satellite constellations.


Descriptions of Exemplary Embodiments


FIG. 1A illustrates satellite control and payload delivery systems 101, according to aspects of the present disclosure.


As shown, the system 101 may be composed of several interconnected components that work together to manage and control satellite operations. At the core of the system are the satellite control and payload delivery systems 103, which are responsible for the overall management of satellite functions, including the deployment and delivery of payloads.


The micro-batch delivery and smart batching 105 component is depicted as an integral part of the system, indicating its role in optimizing the delivery of commands and data to the satellites. This component is designed to more efficiently communicate with, control, and/or manage satellites. Additionally, the micro-batch delivery and smart batching 105 may involve coordination by the satellite control and payload delivery systems 103 by multiple satellites 107 and multiple ground control stations. For example, a data stream from a first satellite to a first ground control station may complete a first micro-batch transmission, and transmit a second micro-batch from the first satellite to a second ground control station. As such, the satellites 107 are equipped to execute commands for micro-batching as part of their operational activities. These satellites 107 may be involved in various missions, such as earth observation, surveillance, communication, scientific research, etc., and rely on the satellite control and payload delivery systems 103 for guidance and instructions.


In one embodiment, the techniques described herein relate to a distributed satellite management system, including one or more satellites in a constellation, and a ground-based control system for managing operations of the one or more satellites, the ground-based control system including satellite control and payload delivery systems, where the ground-based control system manages interaction between the one or more satellites and at least one of: at least one ground station, at least one mission control station, or at least one data center. Additionally, the system may include a messaging module configured to route messages between the one or more satellites and the ground-based control system, and a micro-batch delivery module configured to transmit and receive the messages to and from the one or more satellites.


In various embodiments, the micro-batch delivery module may be further configured to optimize the timing and sequencing of data to or from the one or more satellites, where the sequencing of data comprises segmenting the data into micro-batch packets of data. Additionally, the satellite control and payload delivery systems may be configured to segment the data based on a predictive model of satellite positions and operational requirements. Further, the one or more satellites may be equipped with sensors and instruments to perform data collection, imaging, or communication relay tasks in response to commands associated with the micro-batch packets of data.


In various embodiments, a data processing module may be included and configured to analyze data collected by the one or more satellites and to provide feedback to the ground-based control system for adjusting future commands sent as micro-batch packets of data. The micro-batch delivery module may be configured to transmit micro-batch commands to the one or more satellites including instructions for at least one of: adjusting satellite positions, changing satellite orientations, or modifying operational parameters of the one or more satellites. The one or more satellites in the constellation may be small satellites, where the small satellites may include CubeSats. Additionally, the messaging module may include a message broker which may be configured to route messages based on a location and availability of a satellite in the constellation. Further, the micro-batch delivery module may include a sidecar proxy configured to work with the send-queue and the receive-queue for messages to and from the one or more satellites using a secure database.


In various embodiments, the system may include a flight dynamics module for determining the correct Acquisition of Signal (AOS) and Loss of Signal (LOS) times for successful communication with the one or more satellites. The ground-based control system may be configured to communicate with the satellites using micro-batching commands. Additionally, the at least one data center may host a portion of the computing cloud and may be further configured to provide storage of data and allow packetized transfer of the data. The ground-based control system may be configured to provide fault tolerance by allowing remote rescheduling or reset of a satellite On-Board Computer (OBC) at another compliant ground station when at least one of the one or more satellites passes over a first of the one or more ground stations. It is to be appreciated that the reset of a satellite may be tied to a particular satellite (e.g. Satellite X needs to be reset and a command is given specific to Satellite X to reset, etc.).


In various embodiments, a virtual satellite simulation infrastructure may be included for creating new satellites to study what-if scenarios to pre-determine the trajectories before launch for new satellites of the one or more satellites or the trajectories for existing satellites before a specific date. The virtual satellite simulation infrastructure may be configured to simulate the trajectories of the one or more satellites based on predetermined parameters. Additionally, the predetermined parameters may include the location, flight path, and/or times of Acquisition of Signal (AOS) and Loss of Signal (LOS) of the one or more satellites. The virtual satellite simulation infrastructure may be further configured to adjust the predetermined parameters based on real-time data received from the satellites. Further, the at least one ground stations may function as the mission control station.


It is to be appreciated that the system 101 displays a distribute network of ground resources and satellites, a multi-path fault-tolerant network, and/or smart-batching capabilities of the system.


Some types of satellite management systems involve issuing instructions that are optimally carried out in a future timeframe. Aspects of such instructions rely on accurate prediction, and accurate prediction relies on models that are both accurate and precise. An enormous amount of research and development effort has been applied to making models accurate and precise, however such models have not kept pace with the accuracy and precision needed for various critical satellite management functions (e.g., precise correlation of satellite positions with respect to multi-frame image capture, or precise correlation of satellite positions with respect to upload/download events). Virtually all of the efforts to ameliorate these deficiencies have relied on improvement of models. Unfortunately, models however well conceived and implemented will never be able to predict stochastic events that happen in space (e.g., encounters with space junk or other gravitational perturbations). As such, a different approach needs to be taken.


There needs to be some way to combine satellite behavior prediction with actual real-time in-situ information. That is, there needs to be both, a technique to combine model-based “coarse-grained” predictions of satellite behavior and techniques for actual real-time “fine-grained” in-flight measurements. Such a combination enables highly accurate and precise satellite command and control (e.g., based on the combination of coarse-grained predictions and “fine-grained” in-flight measurements that inform then current state traversal).


More specifically, one way to combine is to use (1) coarse-grained predictions to generate workflow-based instructions (e.g., pertaining to a long-running workflow that covers an entire orbit or more) and then to use (2) actual real-time “fine-grained” in-flight measurements to carry out those workflow-based instructions based on then-current information. In order to accomplish the foregoing, commands are delivered to the satellite as “intents”. That is, rather than issuing a command like “start collecting data when the satellite's position is at <longitude, latitude, altitude>” an intent-based instruction may be sent, such as, “start collecting data when the satellite is in clear view of a particular terrestrial station”. As can now be understood, this combination of (1) using coarse-grained predictions for delivering intents to a satellite, and then (2) using the satellite's in-situ, real-time measurement facilities to carry out operations based on then-current conditions to achieve the intents' demands coordination between the ground stations and the satellite. Moreover, the satellite must be equipped with one or more forms of an “intent processor” that takes in an intent specification in the form of a set of to-be-achieved states, and then, in a future time and based on the given to-be-achieved states, the satellite's intent processor generates low-level, real-time commands that do achieve the intents in a manner that is both accurate and precise.


With this context in place, therefore, the command-based satellite instructions 109A of FIG. 1B shows commands sent for future execution 111. Such commands may be sent from a ground station, and/or any earth-based system. Additionally, any number of commands (shown as Command C1-Command C3) may be sent to a satellite when it is in communication with the ground station (shown in current position 113). As the satellite moves (via passage 115), it seeks to implement the commands provided via the future flyover period 117. Such commands (per the commands sent for future execution 111) are static, in the sense that once they are sent by a ground station (or ground-based system), they are executed accordingly by the satellite as dictated and instructed.


In contrast, the intent-based satellite instructions 109B of FIG. 1B shows intents sent for future execution 121. Such instructions may be sent from a ground station, and/or any earth-based system. Additionally, any number of intents (shown as Intent I1-Intent I3) may be sent to a satellite when it is in communication with the ground station (shown in current position 113). As discussed herein, intent-based instructions may be based on coarse-grained predictions and actual real-time fine-grained in-flight measurements. As the satellite moves (via passage 115), an intent processor 123B may be used by the satellite to implement the appropriate commands that conform to the intent-based instruction originating from a ground station. In one embodiment, the ground station may include an intent processor 123A that may receive intent based instruction from a user. Such intent based instruction may be received by the intent processor 123A and implemented at a later time period by the intent processor 123B.


Thus, in one example, an intent-based instruction may indicate that when a satellite is over a specific (longitude and latitude) predetermined area of interest, and if the cloud cover is clear, to then take a predefined number of images. Thus, at the future flyover period 117, when the satellite is at a future position2, the intent processor 123B may first determine that the satellite is nearing the coarse-grained predicted location, and may use actual real-time fine grained in-flight measurements to determine when the satellite's position corresponds with the specific predetermined area of interest. The intent processor 123B may further determine if the cloud cover at the specific predetermined area of interest conforms with the intent-based instruction (namely whether it is clear). Having satisfied such conditions, the intent processor 123B may then execute instructions to capture images accordingly. This intent-based processing may include a determination of compliance (shown as state transversal under then current conditions 125) with the intent-based instructions by the intent processor 123B.


It is to be appreciated that any number and any form of intent-based instructions may be sent to the satellite. Thus, the intent-based instructions may relate to if-then type conditions that must be satisfied before a predetermined action is taken. Additionally, in another embodiment, the intent-based instructions may relate to satellite configuration and/or manipulation, such that the satellite is modified in real-time (orientation of satellite (including pitch, yaw, and roll adjustments including change in gyroscope configurations), change in orbital altitude, change in orbital inclination, change in orbit circularization, change in orbit transfer, change in orbital maintenance, etc. As such, the intent processor 123B may not only satisfy a compliance requirement, but may also be used to change one or more aspects of the movement of the satellite in order to have the satellite conform with the intent-based instruction provided. As one other example, an intent-based instruction may be given to photograph a predetermined area of interest. Upon nearing such area of interest, the intent processor 123B may determine that the trajectory of the satellite (using fine-grained in-flight measurements) will be over the specified area of interest at a precise time. The intent processor 123B may determine (based on the fine-grained in-flight measurements) that the satellite will not be optimized (in terms of attitude and angle of position) for the area of interest, and may therefore change the trajectory (using fine-grained changes) to maximize the capture of photos at the area of interest. In this manner, therefore, the intent processor 123B may be used to execute intent-based commands (including instruction from the intent processor 123A), and control the satellite to maximize the fulfillment of the intent-based commands. Further, in some embodiments, intents may be processed at mission control or any of the ground-stations, or at other ground locations on the network and converted into command batches that may be sent to the satellite as in FIG. 1B.



FIG. 1C illustrates a distributed system 100 comprising satellites in a constellation, ground-stations, mission control, back-office(s), and datacenters, according to aspects of the present disclosure. As an option, FIG. 1C may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 1C may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, the distributed satellite constellation management and control system may comprise one or more satellites in a constellation 102. These satellites may include, but not be limited solely to, small satellites, such as CubeSats, in some cases. The system may also include one or more ground station(s) 104, mission control station(s) 110, and a cloud datacenter 106 hosting a portion of an internet cloud.


In some embodiments, the system may include a message broker. The message broker may be configured to route messages between the satellites, the ground station(s) 104, the mission control station(s) 110, and the cloud datacenter 106. The routing of messages may be based on the location and availability of one or more of the satellites 114A-114D in the constellation 102 in some cases.


The system may also include a sidecar proxy in some embodiments. In some embodiments, sidecar proxies may serve as ground interfaces for satellites, may encrypt and/or decrypt messages, and may work in conjunction with a send-queue and a receive-queue for messages to and from the satellites. The send-queue and the receive-queue may be maintained using a secure database in some cases.


In some aspects, the system may provide fault tolerance by allowing remote rescheduling or reset of a satellite On-Board Computer (OBC) at another compliant ground station when the satellite passes over it. The system may also include a virtual satellite simulation infrastructure for creating new satellites to study what-if scenarios to pre-determine the trajectories before launch for new satellites or the trajectories for existing satellites before a specific date.


The virtual satellite simulation infrastructure may simulate one or more trajectories of the satellites based on predetermined parameters, which may include the location, flight path, and times of Acquisition of Signal (AOS) and Loss of Signal (LOS) of the satellites. The virtual satellite simulation infrastructure may further adjust the predetermined parameters based on real-time data received from the satellites in some cases.


This approach to satellite constellation management and control offers potential benefits such as increased efficiency, scalability, and fault tolerance, addressing some of the challenges associated with managing and controlling large numbers of satellites 114A-114D in a constellation 102.


In various embodiments, a distributed system may comprise one or more satellites in a constellation (such as SAT1114A-SAT4114D), one or more ground-station(s) 104, mission control 110, one or more back-office(s) 108, and/or one or more cloud datacenter(s) 106 hosting a portion of the internet cloud, the cloud being a public internet segment, a private intranet, etc.


Further, similar to modern distributed computing, the satellite configuration may be scaled from, for example, one satellite node to 100s of satellite nodes by few lines of code changes. For example, new satellite nodes may be added to a satellite constellation (such as the constellation 102), including when new satellites are launched. Configuring the new satellite nodes may additionally require minimal additional software. For example, each satellite node may include a beacon, a NORAD ID (e.g. which can be programmed to identify the satellite), software to enable Machine Message Queue Telemetry Transport (MQTT), and/or other protocol identification or other addresses or identifiers.


It is to be understood, that a portion of code can run either on a ground device, and/or an edge device, including but not limited to the satellite or a constellation 102 of satellites. Additionally, each satellite may include, but not be limited to, an onboard computer (OBC) and/or DSP (digital signal processor). Such satellites 114A-114D may be in direct communication via the transmission 112A and/or 112B with one or more of the ground station(s) 104, the mission control 110, etc. and indirectly in communication (via an intermediary node such as the ground station(s) 104 and/or the mission control 110) with the cloud datacenter 106 and/or the back-office 108.


More illustrative information will now be set forth regarding various optional architectures and uses in which the foregoing method may or may not be implemented, per the desires of the user. It should be strongly noted that the following information is set forth for illustrative purposes and should not be construed as limiting in any manner. Any of the following features may be optionally incorporated with or without the exclusion of other features described.



FIG. 2 illustrates a depiction 200 of a satellite as a node in a distributed system, in another embodiment. As an option, FIG. 2 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 2 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, a satellite (Satellite 1202A and/or Satellite 2202B) may be represented as a node in a distributed system. It is to be understood that although the below description may be in reference to a particular satellite (such as the satellite 1202A), such description may apply equally to one or more of other satellites as well. This node may be associated with specific ports of specific addresses in the distributed system. The satellite 202A, 202B node may include one or more On-Board Computers (OBCs) 204A, 204B residing on these specific ports. The OBCs 204A, 204B may be responsible for controlling and managing various operations of the satellite 202A, 202B, such as communication, navigation, and payload management.


In some cases, the satellite node may host re-programmable resources such as one or more Field Programmable Gate Arrays (FPGAs) 210A, 210B coupled to one or more ports associated with the satellite 202A, 202B. These FPGAs 210A, 210B may be programmed using the OBC 204A, 204B to pre-process, compress, or encrypt data from one or more resources on board the satellite. This may allow for enhancement and expansion of the functionality of the satellite 202A, 202B to maintain compatibility with newer models of the satellites in a constellation.


In some embodiments, the satellite node may also include various other resources such as camera(s) 212A, 212B, X-Band antenna(s) 216A, 216B, S-Band antenna(s) 214A, 214B, other antennas, GPS 208A, 208B, other sensors, and other equipment. These resources may be available on specific ports of the node that is the satellite. This configuration allows for efficient and effective management of the satellite resources and operations in the distributed system. Further, the satellite node may include attitude determination and control (ADCS) 206A, 206B to assist with controlling the satellite (including flight parameters, angle, speed, etc.).


In some aspects, the satellite node may also include a sidecar proxy for working with a send-queue and a receive-queue for messages to and from at least one satellite with a ground station. In some embodiments, sidecar proxies may serve as ground interfaces for satellites, may encrypt and/or decrypt messages, and may work in conjunction with a send-queue and a receive-queue for messages to and from the satellites. This allows for secure and efficient communication between the satellite and other nodes in the distributed system, such as ground stations, mission control stations, and datacenters. In one embodiment, the sidecar may be a separate discrete component of the satellite 202A, 202B, and/or may be included as a function of an existing component (such as of the OBC 204A, 204B).


In other embodiments, a satellite may function as a node in a distributed system. The satellite may include On-Board Computers 204A, 204B residing on specific ports of specific addresses in the Distributed System. The resources on the satellite 202A, 202B such as for e.g., a Camera 212A, 212B, an S-Band Antenna 214A, 214B, X-Band Antenna 216A, 216B, etc. may be available on specific ports of the node (e.g. Satellite 1202A, Satellite 2202B).


Further, encrypted Communication with Resources in the Distributed System of Satellites and Ground Stations may be required and may be achieved using Sidecar Proxies. It is to be understood that a sidecar proxy may be a dedicated component deployed alongside each microservice to handle a variety of issues (e.g. logging, security, monitoring, etc.). It may be used to intercept and manages inbound and outbound traffic to the microservice, providing a variety of functionalities, such as but not limited to load balancing, routing, security, encryption, authentication, logging, monitoring, etc.


A satellite may host re-programmable resources such as one or more FPGAs 210A, 210B coupled to one or more ports associated with the satellite(s) 202A, 202B. Hardware functions that were not implemented before the time of launch may be programmed into the FPGA 210A, 210B using the OBC 204A, 204B to pre-process or compress or encrypt data from one or more resources on board the satellite(s) 202A, 202B to allow for enhancement and expansion of the functionality of the satellite to maintain compatibility with newer models of the satellites in a constellation.


In one embodiment, a satellite may be assigned a desired state, and such state may be translated into a set of preconfigured operations. TLS 2.0 or TLS 3.0 may be used with each satellite in a constellation for communication, and public and private keys may be used to communicate with a satellite for encrypted communication using AES-256 or DES or any other encryption mechanism. Providing new keys or key changes or key rotations may be performed for the satellites as communicating nodes. Public key Infrastructure (PKI) mechanisms may be implemented in satellites to allow key rotation, etc. All these actions can be done using a declarative infra structure. As such, various options may be implemented to protect the integrity (security) of the satellite node.


For example, infrastructure as code and/or policy as code may help to ensure that a security posture (of the satellite and/or satellite constellation) is consistent and enforceable across a variety of environments.


It is to be understood that such configuration of satellite nodes may allow for minimal pre-processing operations (for configuring code) such that a variety of functions (sensor calibration, atmospheric correction, radiometric calibration, noise to signal processing, remote sensing) may occur as needed without complicated coding of each satellite node.


Further, automated security scanning may occur such that declarative configurations may be analyzed automatically by security tools to ensure the satellite (or constellation of satellites) meets predetermined security standards. This automated scanning may identify misconfigurations or policy violations before the satellite(s) are deployed.


With respect to compliance, it is to be understood that any change in compliance may be proliferated immediately using the declarative infrastructure to all the nodes, including but not limited to satellites, ground stations, mission control, etc. In various embodiments, a command (originated from a human and/or ground control center) may be broken into multiple commands, and in turn, micro-batching (as described in further detailed hereinbelow) may be used to send the commands to individual satellites. Further, compliance as code may be embedded into each satellite to facilitate management once deployed.


As such, this approach in managing security and encryption for satellite(s) allows for a more consistent, auditable, and automated way of enforcing security policies.



FIG. 3 illustrates a depiction 300 of a constellation of satellites in the sky over the earth where one or more satellites may be communicating with their nearest ground stations, in another embodiment. As an option, FIG. 3 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 3 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, the system may include a constellation of satellites in the sky over the earth where one or more satellites (such as satellites SAT1302A-SAT4302D) may be communicating with their nearest ground stations (such as ground station 1304A-ground station 4304D). The constellation of satellites (the satellites SAT1302A-SAT4302D) may be distributed in a manner that allows for efficient and effective communication with the ground stations (the ground station 1403A-ground station 4304D). The satellites (satellites SAT1302A-SAT4302D) may be positioned in various orbits around the earth, and their positions may be determined based on various factors such as the specific application requirements, the coverage requirements, and the availability of the satellites. For example, the ground aperture 306 shows the area on earth that can receive and send communication signals to the satellite (and hence can communicate data back- and forth to and from the satellite(s)).


In some cases, the system may include a message broker that is configured to route messages between the satellites (satellites SAT1302A-SAT4302D), the ground stations (ground station 1304A-ground station 4304D), the mission control station (not specifically shown in FIG. 3 but found in other figures), and the data center (not specifically shown in FIG. 3 but found in other figures). The message broker may be configured to route messages based on the location and availability of the satellites (satellites SAT1302A-SAT4302D) in the constellation. For example, the message broker may route messages to a satellite that is currently in a position to communicate with a ground station, and may route messages away from a satellite that is not currently in a position to communicate with a ground station. This allows for efficient use of the communication resources and ensures that the messages are delivered in a timely manner.


In some embodiments, the system may also include a sidecar proxy (not shown specifically in FIG. 3 but shown in other Figures herein) working with a send-queue and a receive-queue for messages to and from the satellites. In some embodiments, sidecar proxies may serve as ground interfaces for satellites, may encrypt and/or decrypt messages, and may work in conjunction with a send-queue and a receive-queue for communicating messages to and from the satellites. This allows for secure and efficient communication between the satellite and other nodes in the distributed system, such as ground stations, mission control stations, and datacenters.



FIG. 4 illustrates a depiction 400 satellites transiting over a ground location, in another embodiment. As an option, FIG. 4 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 4 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, the system may include a satellite (SAT2402B) transiting over a ground location and a second satellite (SAT4402D) following it. The transit of the satellite (SAT2402B) over the ground location may be determined based on various factors such as the satellite's orbit, the ground location's geographical coordinates, and the current time. The second satellite (SAT4402D) following the first satellite (SAT2402B) may be part of the same constellation and may be scheduled to transit over the same ground location at a later time, or it may be scheduled to transit over a different ground station if it is in a different orbit.


In some cases, the system may include a flight dynamics software for determining the correct Acquisition of Signal (AOS) 404 and Loss of Signal (LOS) 406 times for successful communication with the satellites. The AOS 404 time may be the time at which the satellite comes into the line of sight of the ground station, and the LOS 406 time may be the time at which the satellite goes out of the line of sight of the ground station. The flight dynamics software may calculate these times based on the satellite's orbit, the ground station's geographical coordinates, and the current time.


In some embodiments, the flight dynamics software may also calculate the Time of Closest Approach (TCA) 408, which is the time at which the satellite is closest to the ground station. The TCA 408 may be used to optimize the communication between the satellite (SAT2402B) and the ground station, as the signal strength is typically strongest when the satellite is closest to the ground station.


In some aspects, the system may also include a mechanism for scheduling the communication between the satellites and the ground stations based on the AOS 404, LOS 406, and TCA 408 times. This scheduling mechanism may ensure that the communication is initiated at the AOS 404 time, maximized at the TCA 408 time, and terminated at the LOS 406 time, thereby optimizing the use of the communication resources.


In some cases, the system may also include a mechanism for rescheduling the communication in case of any disruptions or changes in the satellite's orbit or the ground station's availability. This rescheduling mechanism may ensure that the communication is seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted communication in some cases. It should be noted that most satellites may be equipped with GPSs which allow the satellites to identify their own locations and may indicate its position to a ground station to initiate further communication upon Acquisition of Signal is completed.



FIG. 5 illustrates a depiction 500 of communication between Mission Control center and one or more satellites in the sky, in another embodiment. As an option, FIG. 5 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 5 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the satellites SAT 504A, SAT2504B, SAT3504C, and SAT4504D may be included in the satellite constellation 502. It is to be appreciated that communication to any such satellites (such as with mission control 506) may occur individually, such as a direct communication between a single satellite such as SAT1504A and the mission control 506, and/or between multiple satellites (such as satellite-to-satellite transmissions, or satellites-to-ground station transmissions). For purposes of the description herein, any transmission may be communicated to/from the mission control 506 to any or multiple of satellites in the satellite constellation 502.


The mission control 506 may comprise radio equipment 508, and a computer 510 including sidecar1 and sidecar2 proxies working with a send queue and receive queue. The mission control 506 may further comprise a computer 512 comprising mission control software and persistent storage. The computer 512 may be used to interface and/or receive commands from a user.


The datacenter/back-office 514 may comprise a computer 516 which may include a message broker configured with a receive queue and a task queue, as well as cloud-based sidecar proxy.


It is to be appreciated that the computer 510, the computer 512, and/or the computer 516 may be configured in a variety of alternative configurations. The intent is to have hardware sufficient for interaction with a user, storage of data generated using such systems, message brokers and sidecar proxies for sending/receive messages, etc. Further, such systems and configurations are intended to be scalable as needed such that multiple mission controls and/or datacenters/back-offices may be in communication in relation to the transmission to one or more satellites of the satellite constellation 502.


In some aspects, the system may include a communication mechanism between a human operator in a back-office or in Mission Control center (shown in FIG. 5 as mission control 506 and datacenter/back-office 514) and one or more satellites (via the satellite constellation 502 comprising but not limited or restricted to SAT1504A-SAT4504D) in the sky via a sidecar proxy (such as by using CELERY task queue framework) via the computer 510. The sidecar proxy via the computer 510 may be configured to work with a send-queue and a receive-queue for messages to and from the satellites. In some cases, the sidecar proxy via the computer 510 may work with the send-queue and the receive-queue using a secure database. This allows for secure and efficient communication between the satellite (and/or the constellation 502) and other nodes in the distributed system, such as ground stations, mission control stations (including the mission control 506), and datacenters (including the datacenter/back-office 514).


In some embodiments, the mission control 506 may communicate with the satellites of the satellite constellation 502 using micro-batching commands. This approach allows for efficient use of the communication window between the satellite and the ground station, ensuring that the maximum amount of data is transmitted within the available time.


In some cases, the datacenter/back-office 514 hosting a portion of an internet cloud may provide storage of data and allow packetized transfer of data similar to the internet. This enables the system to handle large volumes of data generated by the satellites and ensures that the data is readily available for processing and analysis.


In some aspects, the system may also include a mechanism for rescheduling the communication in case of any disruptions or changes in the satellite's orbit or the ground station's availability. This rescheduling mechanism may ensure that the communication is seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted communication. Alternatively, the rescheduling mechanism may also ensure that the communication is seamlessly continued with the same satellite during a future passage over a ground station, as necessary.


In various embodiments, one or more operators may use mission control software (MCS) and Flight Dynamics Software/Simulator (FDS) (such as running on a local laptop or computer) via the computer 512 to determine and set up one or more commands to communicate to a satellite or a ground station and pass the one or more commands to a Message Broker (MB) of the computer 516. The message broker of the computer 516 may run as a process or thread in the datacenter/back-office 514. Additionally, it may run in a computer in mission control 506, etc. The message broker of the computer 516 can be implemented using a secure database that sets up a send-queue to send messages and a receive-queue to receive messages. The messages may be encrypted at any and all stages of such communication. The send-queue may receive messages from multiple operators and for one of more satellites. The message broker of the computer 516 may route the messages to the sidecar proxies (e.g. CELERYs) of the computer 510 of the appropriate satellites running as processes or threads on computers in the mission control 506 (or Ground Stations, etc.), and the sidecar proxies of the computer 510 may send the messages to the satellites (and/or the satellite constellation 502) via the radio equipment 508 and antennas of the mission control 506 (or a Ground Station) that is in communication with a satellite (or the constellation 502) in the sky transitioning to that ground location.


A sidecar proxy (e.g. CELERY, etc.) of the computer 510 may maintain a send-queue to send messages to the satellite using a predetermined radio channel of the radio equipment 508. Likewise, a sidecar proxy (e.g. CELERY, etc.) of the computer 510 may maintain a receive-queue to receive messages from the satellite (and/or the satellite constellation 502).


In one embodiment, it may be possible to implement a sidecar proxy even within a satellite for purposes of security, such as, for example, where the legacy code is running on the OBC (such as the OBC 204A, 204B) and all code on the OBC executes and communicates only with the sidecar proxy inside the satellite to send messages to the ground or another node. Further, messages and responses may be received from the satellite (or the satellite constellation 502) by a sidecar proxy via the radio equipment 508 and the antennas of a ground station or the mission control 506. The sidecar proxy of the computer 510 may forward the messages to the message broker of the computer 516 which may route them to the appropriate/respective operators or software for analysis. Additionally, the operator may subscribe to the receive queue in the message broker of the computer 516 in order to view, listen, and/or act upon the messages received.


Overall, given the fact that the ground aperture (of a satellite trajectory) at a location and the interval between AOS and LOS may be limited, it is important to implement the procedures and methods disclosed herein such that active communication time with a satellite is as effective as possible.



FIG. 6 highlights a depiction 600 of the concept of micro-batching commands, in another embodiment. As an option, FIG. 6 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 6 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, the mission control station may be configured to communicate with the satellites using micro-batching commands. Within the context of the present disclosure, micro-batching includes separating data (or data streams) into small discrete batches. For example, micro-batching may include a technique that allows for efficient use of the communication window between the satellite and the ground station, ensuring that the maximum amount of data is transmitted within the available time. This approach can be particularly useful in scenarios where the communication window is limited, such as when the satellite is passing over a ground station.


In some cases, the micro-batching commands may be generated based on various factors such as the current state of the satellite, the type of data to be transmitted, and the available bandwidth. The micro-batching commands may include instructions for the satellite to perform various operations such as data collection, data processing, and data transmission. In a further embodiment, bulk data transmission may occur via protocols handling packetized data. However, scheduling the transmission of the data packets after packetizing may be dynamically controlled using commands sent via micro-batching.


In some embodiments, the micro-batching commands may be generated in a dynamic manner, taking into account the real-time conditions of the satellite and the ground station. For example, if the satellite is experiencing a high level of interference, the mission control station may generate micro-batching commands that instruct the satellite to reduce its data transmission rate or to switch to a different frequency band.


In some aspects, the micro-batching commands may be encrypted to ensure the security of the communication between the mission control station and the satellites. The encryption may be performed using various encryption algorithms and techniques, and the encrypted micro-batching commands may be decrypted by the satellites using corresponding decryption algorithms and techniques.


In some cases, the micro-batching commands may be transmitted to the satellites via a sidecar proxy, as described earlier, and shown as sidecar for SAT1626A and sidecar for SAT2626B. In some embodiments, sidecar proxies may serve as ground interfaces for satellites, may encrypt and/or decrypt messages, and may work in conjunction with a send-queue and a receive-queue for the micro-batching commands, and to transmit the micro-batching commands to the satellites in a timely and efficient manner.


In some embodiments, the system may also include a mechanism for rescheduling the communication in case of any disruptions or changes in the satellite's orbit or the ground station's availability. This rescheduling mechanism may ensure that the communication is seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted communication. Alternatively, the rescheduling mechanism may also ensure that the communication is seamlessly continued with the same satellite during a future passage over a ground station, as necessary.


It is recognized that the amount of power available to a satellite to communicate with a ground station may be limited and be constrained by the charge in its batteries. As such, there exists a need to micro-batch such that commands and data may be effectively transmitted to and/or received from the satellite.


In one embodiment, FIG. 6 shows an example where a human operator may be given a task to determine one or more possible satellites to designate for the tasks and to transmit a set of commands (including a human command 618) associated with the task to mission control software (MCS) 622. In one embodiment, the task may be received by a command interpreter 620 software component for mission planning (MP) and mission administration (MA) which may work with mission planning software and flight dynamics software module. The MCS 622 may work with flight dynamics (FD) software module to determine the satellite trajectories and assignments. The MCS 622 may separate a set of commands from the command interpreter (CI) into satellite specific OBC Command Sets to be executed on the On-Board Computer(s) (OBC) of each of the satellites. These OBC commands may then be sent to appropriate sidecar proxies for each satellite. The OBC commands may be encrypted (such as the by the sidecar proxies) and routed to a designated ground station(s) (GS) that may communicate with the respective satellites. As such, therefore the MCS 622 may generate MCS commands (shown as MCS Command 1 SAT 1, MCS Command 2 SAT 1, MCS Command 3 SAT 2, etc.) via command signals command 624A, 624B, 624C, which may include OBC commands (shown as OBC Command 1A-1D, OBC Command 2A-2C, OBC Command 3A-3E, etc.). The OBC commands may then be sent to the appropriate sidecars and then communicated on to the appropriate satellite. Thus, OBC Command 2A-2C, for example, may be sent to sidecar for SAT1626A, and communicate on to the S-Band antenna 616 of the satellite 1602.


Consistent with the FIG. 2 description provided hereinabove, the satellite 1 may be configured to include a camera 612, a S-band antenna 616, a X-band antenna 614, an OBC 604, a ADCS 606, a GPS 608, a FPGA 610, etc. Further, data received, such as via the sidecar proxy for SAT 1626A may be received via an antenna of the satellite 1602, such as the S-band antenna 616, and communicated to the OBC 604 from processing, such as by a particular function program code module.


By way of example, a human command (such as the human command 618, control center command, and/or human task (e.g., various tasks such as ‘use camera to survey polygon Area A on Earth’, etc.) may be segmented into multiple commands and micro-batching may be used to send the commands to individual satellites. Further, the commands may be segmented into sets of OBC commands, which, in turn, may be sent as commands to the individual satellites. It is recognized that a variety of parameters may need to be configured (such as associated with motion of the satellite like the AOS, LOS, task queue, etc.). One advantage of using smart batching and micro-batching is that it may allow the human operator to guess and program certain parameters into a virtual satellite model and/or the flight dynamics software for a satellite approaching a ground station and iteratively determine the correct AOS and LOS and the interval size in time for the visibility of the satellite (e.g. 3 minutes, etc.). Smart batching allows the testing and readiness of the command set and its size before transit and/or passage over a ground station. It is to be appreciated that a mission control may also be a ground station.


As such, an integrated system (such as the system shown in FIG. 6) with micro-batching may assist in removing potential errors and automating correct and highly optimized commands in near real time. Further, in one embodiment, a command set sent to a satellite may be executed atomically.


In other embodiments, a human operator may target individual OBCs of individual satellites for communication and message passing. Further, such a distributed architecture mechanism may allow for load-balancing of tasks, or repurposing tasks between individual satellites of a cluster based on their location and availability. Such distribute architecture may therefore increase overall availability of satellite(s). Additionally, in various embodiments, the distributed architecture mechanism may allow for distributed message passing and queuing mechanism, thereby reducing human error and time (as the system can be used to determine parameters associated with motion of the satellite (such as AOS, LOS, task queue) and the programming of each parameter and/or individual OBC commands.


By way of example, if any satellite temporarily disappears from the ground aperture at a ground location or is disabled, the flight dynamics control and distributed system may allow remote rescheduling or reset of a satellite OBC at another compliant ground station when it passes over it.


In one embodiment, through having an architecture including sidecar proxies, the system may be scaled such that new satellites may be easily deployed within the system. In this manner, addition (and/or deletion) and management of satellite(s) may be facilitated by the distributed system disclosed herein.


In one embodiment, the movement of the earth may cause a satellite to be in a shadow and become unavailable for remote sensing or aerial survey over certain earth locations for several weeks sometimes. However, for a constellation of satellites spread geographically over the earth, at least one or more satellites of the constellation may be available for the survey or remote sensing at some of those locations. Therefore, re-balancing by re-purposing the individual satellites between themselves for the task can allow for task continuity and completion in a reasonable time without waiting several weeks.


As such, the present disclosure discusses such repurposing and rebalancing of tasks between satellites in a constellation, thereby significantly improving availability. In one embodiment, achieving continuous and meaningful coverage of a large area may occur via tiling (as shown herein with respect to FIG. 8, disclosed hereinbelow).



FIG. 7 illustrates a depiction 700 of a fault-tolerant and load balancing infrastructure, in another embodiment. As an option, FIG. 7 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 7 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, the system may include a fault-tolerant infrastructure comprising a constellation of satellites SAT1702A-SAT4702D, mission control 708 and ground stations 704, cloud datacenters 706, and/or back-office 710. The cloud datacenters 706 may host a portion of an internet cloud, which in some cases, may be configured to provide storage of data and allow packetized transfer of data similar to the internet. This enables the system to handle large volumes of data generated by the satellites 702A-702D and ensures that the data is readily available for processing and analysis.


In some embodiments, the system may be configured to provide fault tolerance by allowing remote rescheduling or reset of a satellite On-Board Computer (OBC) at another compliant ground station of the ground stations 704 when the satellite passes over it. This feature may ensure that the communication is seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted communication.


In some cases, the system may provide fault tolerance by allowing remote rescheduling or reset of a satellite On-Board Computer (OBC) at another compliant ground station of the ground stations 704 when the satellite passes over it. This rescheduling mechanism may ensure that the communication is seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted communication. Alternatively, the rescheduling mechanism may also ensure that the communication is seamlessly continued with the same satellite during a future passage over a ground station, as necessary. This feature may be particularly useful in scenarios where a satellite temporarily disappears from the ground aperture at a ground location or is disabled.


In some aspects, the fault-tolerant infrastructure may be designed to handle various types of disruptions or changes in the satellite's orbit or the ground station's availability. This may include, for example, changes in the satellite's orbit due to space weather events, equipment failures, or other unforeseen circumstances. The infrastructure may also be designed to handle changes in the ground station's availability due to factors such as equipment failures, network outages, or other unforeseen circumstances.


In some embodiments, the fault-tolerant infrastructure may include various mechanisms for detecting and responding to these disruptions or changes. These mechanisms may include, for example, sensors and monitoring systems for detecting disruptions or changes, algorithms and decision-making systems for determining the appropriate response, and control systems for implementing the response. These mechanisms may be implemented in hardware, software, or a combination of both, and may be distributed across the various components of the infrastructure.


In various embodiments, a satellite may be configured to send messages via ground resources (such as a control center) using message passing protocols (such as similar to TCP/IP but with limited retries, Cubesat Space Protocol (CSP), GRPC, etc.). It is recognized that if a satellite of the satellites 702A-702D is in a location not visible to a ground station of the ground stations 704, then the message communicated by the satellite may be lost. As such, the time aperture for communication with a satellite may be bound by the time of Acquisition of Signal (AOS) and the time of Loss of Signal (LOS). Between the AOS and LOS there is a point in time when the satellite is closest to a location on earth called the TCA (Time of Closest Approach). The Flight Dynamics software may be used to determine the correct AOS and LOS times in order to successfully communicate with the satellite. For example, the Flight Dynamics may use NORADs and/or two line element (TLE) to predict/determine the ground track of a satellite.


Further, the ground aperture, the AOS, the TCA and/or the LOS at a ground location on earth may be used for communication, aerial survey, aerial photography, and system recalibration, repair, diagnosis, testing, etc. As such, communication at that location must be completed within the interval of time between the AOS and LOS. It is to be appreciated that any ground location (such as the ground stations 704, the cloud datacenter 706, the mission control 708, and/or the back-office 710) may be used singularly or in combination for communication between ground-based systems and/or the satellite systems.


In one embodiment, every time a new satellite is added, or an existing satellite is altered (such as being disabled, decommissioned, and/or temporarily absent, etc.), the software system may have to be reconfigured (in part and/or in whole, etc.). For example, the operator may substitute a first satellite with another one that is approaching the location with appropriate parameters. Further, the operator can modify the availability list of satellites that use the message broker, and the distributed system may affect such changes (such that the availability list is distributed throughout the system).


By way of example, in one case, a file transfer task from one ground location to another ground location may be interrupted if a satellite is outside the line of sight (LoS) and/or aperture of sight of the locations. However, if the file transfer task can be seamlessly transferred from one satellite moving out to another satellite moving into a location, then the task may continue without interruption. This distributed architecture therefore may allow such tasks to be seamlessly ported from one satellite to another in a constellation. The ground station of the ground stations 704, cloud datacenter 706, the mission control 708, and/or the back-office 710 can provide storage of data and allow packetized transfer (in a manner similar to the internet transmit/receipt of data packets). It is envisioned that isochronous channels may be integrated of short duration for voice and video communication using this distributed system of satellites.


In one embodiment, the mission control 708 may have to reset or even update the BIOS and the OS kernel in an older satellite. This can be done, in one embodiment, using commands (such as simple FTP commands) to the OBC on the satellites. Multiple versions of OS kernels can reside on the satellite and rollover of a non-working kernel to a previous revision is envisioned.



FIG. 8 illustrates a depiction 800 of an area on earth divided into tiles by latitude and longitude for a constellation of satellites to perform aerial survey, in another embodiment. As an option, FIG. 8 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 8 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, the system may include an area on earth divided into tiles (herein referred to as tiling 804) by latitude and longitude for a constellation of satellites SAT2802B and/or SAT4802D to perform aerial survey. This tiling 804 approach allows for efficient and effective management of the aerial survey tasks by dividing the large survey area into smaller, manageable tiles. Each tile of the tiling 804 may represent a specific geographical area on the earth, and the satellites in the constellation may be tasked with performing the aerial survey of these tiles of the tiling 804 in a coordinated manner.


In some cases, the tiling 804 of the ground area into tiles and the tasks for each tile are enqueued and the message broker and the constellation can distribute or redistribute the tasks or work between multiple satellites based on their ground location, flight path, and times of Acquisition of Signal (AOS), Loss of Signal (LOS), and Time of Closest Approach (TCA) at a preceding ground station. This allows for efficient use of the satellite resources and ensures that the aerial survey tasks are completed in a timely manner.


In some embodiments, the system may also include a mechanism for rescheduling the aerial survey tasks in case of any disruptions or changes in the satellite's orbit or the ground station's availability. This rescheduling mechanism may ensure that the aerial survey tasks are seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted aerial survey.


In some aspects, the system may also include a mechanism for repurposing the aerial survey tasks between individual satellites based on their location and availability. This repurposing mechanism may allow the aerial survey tasks to be reassigned from one satellite to another satellite that is approaching the same tile or a nearby tile of the tiling 804. This can increase the overall efficiency and effectiveness of the aerial survey and can help to ensure that the aerial survey tasks are completed in a timely manner, even in the face of disruptions or changes in the satellite's orbit or the ground station's availability.


In various embodiments, the tiles of the tiling 804 may be detailed by latitude and longitude, such as for a constellation of satellites to perform aerial survey. Tiling 804 the ground area may include separating the area into configured (defined geographic area) tiles. Further, the tasks for each tile may be enqueued, and the message broker and the constellation can distribute or redistribute the tasks/work between multiple satellites based on their ground location, flight path, and times of AOS, LOS and TCA (Time of Closest Approach).



FIG. 9A provides a UI/UX 901A front-end for Mission Control and Flight Dynamics Software, in another embodiment. As an option, FIG. 9A may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 9A may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


Additionally, FIG. 9B shows computing infrastructure 901B for control of satellites, in another embodiment. As an option, FIG. 9B may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 9B may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In some aspects, the system may include a user interface/user experience (UI/UX), UI/UX 901A front-end for session control software 912 and flight dynamics software 910, along with a virtualized platform of virtual satellites, virtual ground stations, and a model of earth in simulation. This virtualized platform may serve as a virtual satellite simulation infrastructure that allows for the creation of new satellites to study what-if scenarios. These scenarios may be used to pre-determine the trajectories before launch for new satellites or the trajectories for existing satellites before a specific date.


In some cases, the virtual satellite simulation infrastructure of the UI/UX 901A, may be configured to simulate one or more trajectories of the satellites based on predetermined parameters. These parameters may include the location, flight path, desired elevation, and times of Acquisition of Signal (AOS) and Loss of Signal (LOS) of the satellites. This simulation capability allows for efficient planning and management of the satellite operations, ensuring that the satellites are positioned in the right orbits and are able to communicate effectively with the ground stations.


In some embodiments, the virtual satellite simulation infrastructure may be further configured to adjust the predetermined parameters based on real-time data received from the satellites. This feature allows for dynamic adjustment of the satellite trajectories based on the actual conditions in space, thereby enhancing the accuracy and reliability of the satellite operations.


In various embodiments, the UI/UX 901A may include a variety of different information, data, functions, and/or controls, including but not limited to command description (to delineate the command to be executed), a ground station pass date and time, a raw command in binary form, ground station ID, ground station name, maximum elevation, acquisition of signal (AOS), time of closest approach (TCA), loss of signal (LOS), adjusted time, offset, CSP address, preamble, duration, TTC ID, and/or passage ID. In the context of this description a raw command may include a binary or hex version of an ASCII/UNICODE or English (or human language) command/mnemonic.


In some aspects, the UI/UX 901A front-end for mission control and flight dynamics software may provide a user-friendly interface for the human operators to interact with the system. The operators may use this interface to monitor the status of the satellites, plan and schedule satellite operations, and analyze the data received from the satellites. The interface may also provide various tools and features to assist the operators in their tasks, such as data visualization tools, alert and notification systems, and decision support systems.


In some cases, the UI/UX 901A front-end may be designed to be intuitive and easy to use, reducing the learning curve for the operators and increasing their productivity. It may also be customizable to suit the specific requirements and preferences of the operators, thereby enhancing their user experience.


In some embodiments, the UI/UX 901A front-end may be accessible from various devices, such as desktop computers, laptops, tablets, and smartphones. This allows the operators to access the system from anywhere, at any time, thereby increasing the flexibility and convenience of the system.


In some aspects, the UI/UX 901A front-end may be integrated with other systems and applications, such as data analysis tools, reporting tools, and communication tools. This allows for seamless data sharing and collaboration between the operators and other stakeholders, thereby enhancing the efficiency and effectiveness of the satellite constellation management and control process.


In various embodiments, the software systems for controlling satellites may allow a user 916 to present a distributed task via computer 908 to a constellation of virtual machines or virtual satellites, and the message broker and flight control system may allow the distributed task to be appropriately scheduled and/or load balanced based on the location, AOS, LOS of the satellites in the constellation.


As such, virtual satellites and simulations may be used to prepare for and test deployment of satellite(s) prior to actual deployment. In one embodiment, using virtual satellites and performing simulations ahead of time may prepare the human operator to quickly set up and communicate with an actual satellite when it is able to communicate with a permitted ground station. As such, a user 916 in communication with the software systems, such as the computer 908, may view and/or control a virtual platform 906 comprising virtual satellites, virtual ground stations, and earth map/globe. In this manner, ground stations GS1904A-GS4904D may be in communication with any or all of satellites SAT1902A-SAT4902D. Such virtual platform 906 of the computer 908 may also work in combination with the flight dynamics software 910, the mission control software 912, and/or sidecar proxies 914A-914D to accurately create a virtualized simulation of satellites, satellite interaction, and predicted satellite trajectories.


In one embodiment, such software systems may allow dockers (e.g. kubernites) to be used to create virtual workers that can be ported wholesale across OBCs inside satellites. Such an architecture may allow for replication of workers/tasks.


In another embodiment, the virtual satellite simulation infrastructure may allow for creation of new satellites to study what-if scenarios to pre-determine the trajectories before launch for new satellites or the trajectories for existing satellites before a certain date. It may allow a user in Mission Planning to study load balancing and tiling scenarios as well as for testing out new and existing commands to control satellites, along with small micro-batching command blocks in preparation for deployment at a later time. Furthermore, the integrated system may allow for seamless deployment from the virtual environment to the real-world environment.



FIG. 10 illustrates an integrated simulation workspace 1000 for satellites, in another embodiment. As an option, FIG. 10 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 10 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the integrated simulation workspace 1000 comprises a variety of information and/or controls for interaction with a real or simulated satellite action. For example, a simulation may be conducted for a particular customer (e.g. remote sensing customers, surveillance customers, telecommunication customers, etc.), and/or order type (e.g., mining tailing, mineral exploration, subsidence, mapping, GIS mapping, imaging method, etc.), as well as display associated information including an order ID and/or status (of the satellites in the simulation). Further, this UI/UX based workspace may be applicable and function as the main interface for both REAL satellites in space and for virtual satellites in simulation. Additionally, the satellites may be configured (within real-world or insimulated setting) with respect to resolution (of cameras within the satellite, such imagery at e.g., 30 cm, 50 cm, 70 cm, 2 m, 5 m, 10 m, 15 m, 30 m resolution, etc., for example). Additionally, the satellite band (e.g., 450-464 nm, 464-478 nm, 478-492 nm, 675-689 nm, etc.) may be specified. Further, services performed by the satellite may be specified, including but not limited to capturing a raw image, controlling atmospheric correction and/or radiometric correction, making signal-to-noise ratio (SNR) improvements, visualizing current view of the satellite, etc. It is to be appreciated that other functions, controls, and data may be displayed as desired in relation to the simulated workspace. In the context of this description radiometric correction implies modifying the raw binary data obtained from a camera or sensor into a corrected and intelligible image that indicates certain properties of the area photographed or sensed. In the context of this description, the term visualization implies overlaying a photographed or sensed image of an area of interest over an existing map of the area of interest as in a GIS or using a GIS.


Further, information on the Area of Interest (latitudes and longitudes to bound an area of interest, and/or a representative center (e.g., LATTITUDE-C, LONGITUDE-C)) and satellites may be displayed, including position (latitude, longitude), as well as satellite transit information, including points of interest, time of AOS, time of TCA, time of LOS, etc. Again, as discussed above, the integrated simulation workspace 1000 may conduct simulations and display results within the context of a simulation result.


In some aspects, the system may include one or more satellites in a constellation. These satellites may be small satellites, such as CubeSats, in some cases. The small size and low cost of CubeSats make them an attractive option for various applications, including communication, earth observation, and scientific research. Despite their small size, CubeSats can be equipped with a variety of sensors and instruments, allowing them to perform a wide range of tasks. In another aspect, a single satellite may be used.


In some embodiments, the system may include a message broker configured to route messages between the satellites, the ground stations, the mission control station, and the data center. The routing of messages may be based on the location and availability of the satellites in the constellation. For example, the message broker may route messages to a satellite that is currently in a position to communicate with a ground station, and may route messages away from a satellite that is not currently in a position to communicate with a ground station. This allows for efficient use of the communication resources and ensures that the messages are delivered in a timely manner.


In some cases, the system may include a mechanism for rescheduling the communication in case of any disruptions or changes in the satellite's orbit or the ground station's availability. This rescheduling mechanism may ensure that the communication is seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted communication. Alternatively, the rescheduling mechanism may also ensure that the communication is seamlessly continued with the same satellite during a future passage over a ground station, as necessary. This feature may be particularly useful in scenarios where a satellite temporarily disappears from the ground aperture at a ground location or is disabled.


In some aspects, the fault-tolerant infrastructure may be designed to handle various types of disruptions or changes in the satellite's orbit or the ground station's availability. This may include, for example, changes in the satellite's orbit due to space weather events, equipment failures, or other unforeseen circumstances. The infrastructure may also be designed to handle changes in the ground station's availability due to factors such as equipment failures, network outages, or other unforeseen circumstances.


In some embodiments, the fault-tolerant infrastructure may include various mechanisms for detecting and responding to these disruptions or changes. These mechanisms may include, for example, sensors and monitoring systems for detecting disruptions or changes, algorithms and decision-making systems for determining the appropriate response, and control systems for implementing the response. These mechanisms may be implemented in hardware, software, or a combination of both, and may be distributed across the various components of the infrastructure.



FIG. 11 illustrates a user interface 1100 for control of satellites, in another embodiment. As an option, FIG. 11 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 11 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the user interface 1100 includes data, functions, and controls relating to a user interface for a mission control center, and/or a ground based system to control satellites. The user interface 1100 includes transit related information, comprising telemetry, tracking and command (TTC) data, ground station pass (date/time of passage of satellite), a passage id (of the satellite over the ground based center), a ground station ID and/or name, elevation of the satellite over a ground station, AOS, TCA, LOS, duration (of the transit), offset (in degrees or in time units), adjusted time or adjusted duration of passage, CSP address which may indicate the communication network address of a satellite, etc. The offset may be an interval of time or an interval or a portion of an elevation angle sweep associated with a satellite transit over a ground station at the beginning or towards the end of the transit where only preamble type signals may be sent to complete an acquisition of signal (AOS) or to complete close of communication before loss of signal (LOS). The offset may be taken from the AOS (or LOS) or it may be measured from the TCA as the valid region when messaging can be done to and from the satellite. The AOS, LOS and/or TCA may be given as date and time pairs. It is to be appreciated that any type of information associated with the satellites, the ground based control centers (mission control, ground stations, cloud datacenters, back-office, etc.) may be displayed within the user interface 1100. A variety of CSP addresses (or other network addresses) may be selected for communication with entities within a satellite like OBC or ADCS, or outside a satellite, including ground stations, virtual satellites in simulation, mission control software, or for network loopback, or for broadcast to one or more satellites in a constellation. Further, the command types/structures being used may also be included in the user interface 1100 in the user interface 1100. Examples of command types/structures may include intents at the highest level, high level mnemonic or Unicode commands, or ASCII commands, or raw hex or binary commands (sometimes referred to as micro-commands), or commands in smart batches or micro batches.


Further, the user interface 1100 may include the ability to control and/or manipulate satellite actions, and provide fields for input relating to a command template (which can then be modified/filled out as desired), command name, command type, and/or command category. In this manner, control of the satellite may be configured by the user interface 1100. It is to be further appreciated that the user interface 1100 may be used to control deployed satellites (in actual orbit) and/or virtualized satellites (such as in relation to the integrated simulation workspace 1000 and/or the computing infrastructure 901B and/or UI/UX 901A.


In some aspects, the system may include one or more satellites in a constellation. These satellites may be small satellites, such as CubeSats, in some cases. The small size and low cost of CubeSats make them an attractive option for various applications, including communication, earth observation, and scientific research. Despite their small size, CubeSats can be equipped with a variety of sensors and instruments, allowing them to perform a wide range of tasks. In other aspects, a single satellite may be used.


In some embodiments, the system may include a message broker configured to route messages between the satellites, the ground stations, the mission control station, and the data center. The routing of messages may be based on the location and availability of the satellites in the constellation. For example, the message broker may route messages to a satellite that is currently in a position to communicate with a ground station, and may route messages away from a satellite that is not currently in a position to communicate with a ground station. This allows for efficient use of the communication resources and ensures that the messages are delivered in a timely manner.


In some cases, the system may include a mechanism for rescheduling the communication in case of any disruptions or changes in the satellite's orbit or the ground station's availability. This rescheduling mechanism may ensure that the communication is seamlessly continued with the second satellite following the first satellite, thereby providing fault tolerance and ensuring uninterrupted communication. Alternatively, the rescheduling mechanism may also ensure that the communication is seamlessly continued with the same satellite during a future passage over a ground station, as necessary. This feature may be particularly useful in scenarios where a satellite temporarily disappears from the ground aperture at a ground location or is disabled.


In some aspects, the fault-tolerant infrastructure may be designed to handle various types of disruptions or changes in the satellite's orbit or the ground station's availability. This may include, for example, changes in the satellite's orbit due to space weather events, equipment failures, or other unforeseen circumstances. The infrastructure may also be designed to handle changes in the ground station's availability due to factors such as equipment failures, network outages, or other unforeseen circumstances.


In some embodiments, the fault-tolerant infrastructure may include various mechanisms for detecting and responding to these disruptions or changes. These mechanisms may include, for example, sensors and monitoring systems for detecting disruptions or changes, algorithms and decision-making systems for determining the appropriate response, and control systems for implementing the response. These mechanisms may be implemented in hardware, software, or a combination of both, and may be distributed across the various components of the infrastructure.


In various embodiments, the systems and methods disclosed herein may allow for a lower-cost, highly distributed, highly customizable deployment and management/control of satellite and/or satellite constellations. Further, implementing the virtual satellite systems disclosed herein may allow for greater insights into actual satellite deployment (which in turn may drive down cost and increase fidelity of data with real world conditions). As such, machine learning may be implemented to model and train satellite activity both before (via virtual deployment) and/or after actual deployment.



FIG. 12 illustrates a network architecture 1200, in accordance with one possible embodiment. As shown, at least one network 1202 is provided. In the context of the present network architecture 1200, the network 1202 may take any form including, but not limited to a telecommunications network, a local area network (LAN), a wireless network, a wide area network (WAN) such as the Internet, peer-to-peer network, cable network, etc. While only one network is shown, it should be understood that two or more similar or different networks 1202 may be provided.


Coupled to the network 1202 is a plurality of devices. For example, a server computer 1212 and an end user computer 1208 may be coupled to the network 1202 for communication purposes. Such end user computer 1208 may include a desktop computer, lap-top computer, and/or any other type of logic. Still yet, various other devices may be coupled to the network 1202 including a personal digital assistant (PDA) device 1210, a mobile phone device 1206, a television 1204, etc. It is to be appreciated that a satellite may include an on-board computer and function (within the context of FIG. 12) in a manner similar to the operation of the computer 1208.



FIG. 13 illustrates an exemplary system 1300, in accordance with one embodiment. As an option, the system 1300 may be implemented in the context of any of the devices of the network architecture 1200 of FIG. 12. Of course, the system 1300 may be implemented in any desired environment.


As shown, a system 1300 is provided including at least one central processor 1302 which is connected to a communication bus 1312. The system 1300 also includes main memory 1304 [e.g. random access memory (RAM), etc.]. The system 1300 also includes a communication interface 1308 and a display 1310. Further, although not shown, the system 1300 may include a graphics processor.


The system 1300 may also include a secondary storage 1306. The secondary storage 1306 includes, for example, a hard disk drive and/or a removable storage drive, representing a floppy disk drive, a magnetic tape drive, a compact disk drive, etc. The removable storage drive reads from and/or writes to a removable storage unit in a well known manner.


Computer programs, or computer control logic algorithms, may be stored in the main memory 1304, the secondary storage 1306, and/or any other memory, for that matter. Such computer programs, when executed, enable the system 1300 to perform various functions (as set forth above, for example). Memory 1304, storage 1306 and/or any other storage are possible examples of non-transitory computer-readable media. It is noted that the techniques described herein, in an aspect, are embodied in executable instructions stored in a computer readable medium for use by or in connection with an instruction execution machine, apparatus, or device, such as a computer-based or processor-containing machine, apparatus, or device. It will be appreciated by those skilled in the art that for some embodiments, other types of computer readable media are included which may store data that is accessible by a computer, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memory (RAM), read-only memory (ROM), and the like.


As used here, a “computer-readable medium” includes one or more of any suitable media for storing the executable instructions of a computer program such that the instruction execution machine, system, apparatus, or device may read (or fetch) the instructions from the computer readable medium and execute the instructions for carrying out the described methods. Suitable storage formats include one or more of an electronic, magnetic, optical, and electromagnetic format. A non-exhaustive list of conventional exemplary computer readable medium includes: a portable computer diskette; a RAM; a ROM; an erasable programmable read only memory (EPROM or flash memory); optical storage devices, including a portable compact disc (CD), a portable digital video disc (DVD), a high definition DVD (HD-DVD™), a BLU-RAY disc; and the like.


It should be understood that the arrangement of components illustrated in the Figures described are exemplary and that other arrangements are possible. It should also be understood that the various system components (and means) defined by the claims, described below, and illustrated in the various block diagrams represent logical components in some systems configured according to the subject matter disclosed herein.


For example, one or more of these system components (and means) may be realized, in whole or in part, by at least some of the components illustrated in the arrangements illustrated in the described Figures. In addition, while at least one of these components are implemented at least partially as an electronic hardware component, and therefore constitutes a machine, the other components may be implemented in software that when included in an execution environment constitutes a machine, hardware, or a combination of software and hardware.


More particularly, at least one component defined by the claims is implemented at least partially as an electronic hardware component, such as an instruction execution machine (e.g., a processor-based or processor-containing machine) and/or as specialized circuits or circuitry (e.g., discreet logic gates interconnected to perform a specialized function). Other components may be implemented in software, hardware, or a combination of software and hardware. Moreover, some or all of these other components may be combined, some may be omitted altogether, and additional components may be added while still achieving the functionality described herein. Thus, the subject matter described herein may be embodied in many different variations, and all such variations are contemplated to be within the scope of what is claimed.


In the description above, the subject matter is described with reference to acts and symbolic representations of operations that are performed by one or more devices, unless indicated otherwise. As such, it will be understood that such acts and operations, which are at times referred to as being computer-executed, include the manipulation by the processor of data in a structured form. This manipulation transforms the data or maintains it at locations in the memory system of the computer, which reconfigures or otherwise alters the operation of the device in a manner well understood by those skilled in the art. The data is maintained at physical locations of the memory as data structures that have particular properties defined by the format of the data. However, while the subject matter is being described in the foregoing context, it is not meant to be limiting as those of skill in the art will appreciate that various of the acts and operations described hereinafter may also be implemented in hardware.


To facilitate an understanding of the subject matter described herein, many aspects are described in terms of sequences of actions. At least one of these aspects defined by the claims is performed by an electronic hardware component. For example, it will be recognized that the various actions may be performed by specialized circuits or circuitry, by program instructions being executed by one or more processors, or by a combination of both. The description herein of any sequence of actions is not intended to imply that the specific order described for performing that sequence must be followed. All methods described herein may be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context.



FIG. 14 shows a depiction 1400 of a system for prioritization of tasks, in another embodiment. As an option, FIG. 14 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 14 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the depiction 1400 shows prioritization of tasks. For example, tasks may be prioritized by human operators, mission planning software, etc. to achieve timely completion based on satellite availability and satellite orbit across a constellation. High priority, medium priority and low priority tasks may be scheduled for different satellites based on orbit and business customer requirements and remuneration. Such tasks may be in relation to an area of interest (AOI) 1414 on the earth 1404, and controlled by an operator and/or mission control 1408 (including any number of operators and/or mission control centers). The message broker 1410 may be in communication with the operator/mission control 1408 to manage tasks (and its associated priority).


In one embodiment, three task priorities may be used-High, Medium and Low priorities, as managed by the message broker 1410. However, it is acknowledged that any prioritization of tasks (in terms of priority levels) may be preconfigured and determined as needed.


Further, in one embodiment, high priority and medium priority tasks, as managed by the message broker 1410, may be designated for satellites that are in transit over the AOI within a short time (e.g. 1 day or less for high priority, under 3 to 5 days for medium priority, etc.). Satellites in orbits that are unable to transit over AOI due to any reasons may be scheduled with low priority tasks.


It is recognized that tasks may be switched and their priority changed based on a variety of factors (such as but not limited to age of the task, the expected time of completion, availability of other satellites, human designated change in priority, etc.).


Further, as an example, satellite SAT4 may be in an orbit that may take several days or weeks to transit over the AOI shown, and hence it is not designated to survey that AOI, and instead, it is given some other low priority survey task (as an option). Several operators are shown providing tasks as commands to a message broker 1410 via the operator/mission control 1408 (and/or command interpreter and mission planner as disclosed hereinabove). The message broker 1410 may maintain a variety of priority queues (such as low, medium, high, etc.) to receive and/or hold the tasks. The message broker 1410 may enqueue a set of task commands (which may be referred to as a task) into a designated queue in a worker component (shown as various workers, WORKER 11412A, WORKER 21412B, WORKER N 1412N, etc.) where, as one example the tasks may be allocated to a WORKER1, based on whether the task is a mission administration task (such as a telemetry, tracking and control command (TTC) task), a mission planning task (e.g., aerial survey task), etc. As shown, other tasks are assigned by the message broker 1410 to various other workers. Further, the workers 1412A, 1412B, 1412N may each be in communication with one or more sidecar proxies, which in turn, may be used to communication directly with one or more satellites, including but not limited to SAT11402A (with a high designated priority), SAT21402B (with a high and medium designated priority), SAT31402C (with a medium designated priority), and/or SAT 41402D (with a low designated priority). It is to be appreciated that the priority designation may be a reflection of the particular satellite within the context of an AOI, and/or a reflection of the task allocated to the satellite. Thus, in this manner, a satellite that will not pass over an AOI may be designated a low priority task (in view of its lack of passing over the AOI), whereas a satellite that does pass directly over an AOI may be designated a high priority task (in view of its direct passing over the AOI). In this manner, therefore, tasks and satellites may be prioritized and/or may relate in some manner to the AOI. It should be noted that AOI alone may not determine a priority of a task, and other considerations like time of passage of a satellite over a ground station and imminence of the passage may also affect the priority of a task.


In one embodiment, the worker components (as disclosed in FIG. 14) may maintain at least two queues-one MP tasks queue and another TTC queue for MA tasks. A worker can use flight dynamics software to determine suitable satellite trajectories and reassign a task based on its priority, to an appropriate satellite just prior to the satellite's transit over a ground station and send the task commands as OBC commands to a sidecar proxy associated with the satellite for encryption, compliance check and other processing. The sidecar proxy sends the commands as one or messages to the designated ground station to relay the messages to the satellite. The process, as disclosed herein, may further increase the availability of satellites to complete one or more tasks.


It is to be appreciated that the particular configuration of the context for FIG. 14 is envisioned as just one possible set of conditions. Such disclosure of particular arrangements therefore is not to be construed as limiting to only such disclosure.



FIG. 15 shows a method 1500 for message passing, in another embodiment. As an option, FIG. 15 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIG. 15 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the method 1500 shows one embodiment of a flow diagram that illustrates the command, control and response flow via message passing in a distributed system of satellites, ground stations, mission control, message brokers, mission administrators, operators, mission planners, simulators, etc. An operator may define an area of interest (AOI) and/or a polygon of interest and may use a declarative infrastructure to create a task (e.g. such as use of a camera to survey polygon area on earth, etc.) and provides it to a command interpreter for mission planning. See operation 1502. The task is converted into a series of commands to the flight dynamics software module and the mission planner. The flight dynamics software may receive the task (as commands), create one or more tiles for survey, and determine transit related information (such as transit times, elevation, ground aperture, AOS, LOS, TCA, etc.) of satellites in, e.g., a constellation transiting over the tiles of the AOI in the next 30 days or so and provides this data to the mission planner software. See operation 1504. Of course, the task may encompass any preconfigured geographic area (tile) and time period.


In one embodiment, the mission planner software may select the best days and times for task execution based on two or more levels of priority (or any combination of levels of priority). See operation 1506. For example, in one embodiment, three priorities (high, medium, low) may be used. Additionally, high priority, medium priority and low priority tasks may be identified (tagged) by task identifiers and may be scheduled for different satellites based on task priorities, satellite orbit, and/or business customer requirements and remuneration (as described within the context of FIG. 14).


In one embodiment, the MP may plan ground station transit for the tasked satellites, and use a one-click mechanism to transfer the task/command set to the mission control software. See operation 1508. The mission planner may also receive telemetry, tracking and control command (TTC) tasks (as commands) from a mission administrator. The MA may plan and/or monitor the health of one or more satellites (e.g. temperature, voltage/charge of the battery, data storage capacity, telemetry data, etc.), and may plan action(s) to complete the task/command at an available ground stations over which one or more satellites are expected to transit. See operation 1516. The MA may provide the task commands to MP which may then transfer the task/command to mission control with appropriate designation. The mission control may plan ground station transit for the tasked satellites for payload data download and/or TTC. See operation 1510.


In one embodiment, the mission control may receive all commands and create a priority based task set of OBC commands using micro-batching and smart batching (e.g., sizing up the command sets correctly to complete transmission to satellite for execution within the available time of transit and ground aperture) and transfer them to the message broker's prioritized master queue. The message broker may enqueue tasks as OBC command sets into appropriate worker's queues (such as when satellites approach certain appropriate ground stations). See operation 1512. A worker may use flight dynamics software module to refresh any flight dynamics calculations to determine the best course of action and may re-designate the satellite for completing a task at the last minute. Sec operation 1514. Tasks may be enqueued into specific worker queues. For example, per operation 1520A, tasks may be enqueued into WORKER1 queues. Additionally, the worker queues may be then assigned to a sidecar proxy (such as Sidecar 11522A). In one embodiment, MP aerial survey and similar tasks may be reassigned. This kind of re-assignment of a satellite is shown via the dashed line from operation 1520A to operation 1522B. Such reassignment may include worker1 re-assigning a task to a satellite sat2 via a sidecar proxy sidecar2.


Mission administration based TTC commands may be specific to a particular satellite. In this manner, one set of TTC commands intended for a first satellite may not be executed on another satellite because such TTC commands are satellite specific task/commands. As such, if necessary, MA tasks may be configured to wait for a next transit of the satellite at a ground station (either same or another ground station) from which they can beam micro-batch commands to satellites. This is one example of fault-tolerant smart batching. It is envisioned that other configurations may be equally applicable (and equally allow for smart batching).


In one embodiment, tasks enqueued into a worker's queue where the worker dies subsequently, or tasks which fail to proceed forward for any reason may be returned to the message broker, are marked incomplete in the message broker, etc. Such tasks may be re-executed. See operation 1518.


In one embodiment, commands of tasks sent from workers to sidecar proxies may be encrypted, processed, and/or sent to ground stations which beam them to the designated satellites upon their arrival/transit as determined by acquisition of signal (AOS). MA commands may be prioritized so that their response from a satellite can also be received right away by the ground station. Further, the response tagged by the task identifier may be sent on to a designated sidecar proxy. The sidecar proxy may return the response to the designated worker which may send the response to the result backend software component. Ground failures (such as but not limited to failure of ground stations, loss of connectivity, and/or loss of signal (LOS)) may be marked as ground-failures and messaged to the message broker for re-execution/re-starting. See operation 1518 (option failure).


In one embodiment, response(s) from a satellite (including failures on the satellite side due to execution failure of a set of command(s) and/or responses that are result data or result status) may be sent to mission control for further action. See operation 1518 (option results/responses). Based on the refreshed flight dynamics calculations (per operation 1514), tasks may be enqueued into WORKER2 queues, or otherwise may be returned on failures (see operation 1520B), and/or tasks enqueued into WORKER4 queues may be delivered to an associated sidecar (such as sidecar 41522C).


In various embodiments, the tasks sent to a sidecar proxy may be provided to a ground station which may then forward on the commands. See operation 1524A. Such commands may then be beamed to a satellite for task execution by priority, and responses/data may be beamed back. See operation 1526A. In one embodiment, a command may be sent from a first ground station to a first satellite, and a response may be sent from the first satellite back to the first ground station. Alternatively, the first satellite may send a response back to an alternative ground station, such as ground station 2 (operation 1524B). The ground station 2 (operation 1524B) may forward and/or beam tasks by priority to a second satellite (per option 1526B), and a response may be provided back to any ground station, including a third ground station (which may return the responses by second satellite based on tasks previously sent by the second ground station) (see operation 1524C). Additionally, the ground station 21524B may receive commands from the sidecar 21522B (and/or any other sidecar) for sending to a satellite.


The ground stations may return responses back to the sidecar, which may, in turn, provide feedback to the WORKER queue, which in turn may report failures or success back to the ground station and/or the message broker for action as needed. In this manner, tasks may be assigned to specific WORKERS, sidecar proxies, allocated to a ground station, and then communicated to a satellite, which in response, the satellites may deliver a response which may be provided to the original originating ground station, and/or delivered to an alternative new ground station (different from the original sending ground station source).


In various embodiments, within the context of repurposing/rebalancing tasks, the workers can re-assign MP tasks at the last minute to a different satellite (via their sidecar proxy) than previously chosen. This may happen for a variety of reasons including, but not limited to, loss of health of a satellite (loss of power in the satellite, bad elevation of the satellite, bad attitude of the satellite, etc.). As discussed hereinabove, tasks may be reassigned from one sidecar to another. This may increase the availability of satellites as a resource in a constellation. This re-assignment may also be done to reduce the number of commands a satellite may need to execute at any time. Aerial survey tasks/commands may be reassigned at the last moment.


Besides reassigning satellites, the reassignment of ground stations for receiving the result data for an MP task can also be performed by sending commands via a first ground station GS1 and receiving the result response from the satellite via different second ground station GS2 at a later time (such as shown within the context of FIG. 15). For example, if a task is in a satellite queue, but a satellite ‘disappears’ (and/or loses connection) then the worker queue entry may time out and the task may then be put back on a different satellite's queue for execution/completion.



FIGS. 16A-16B show a system for re-assignment/re-purposing of tasks, in another embodiment. As an option, FIGS. 16A-16B may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, FIGS. 16A-16B may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


In one embodiment, if there are not enough satellites for a set of tasks, a new satellite can be commissioned and the task may enter the framework with an additional worker and an additional corresponding sidecar, as shown in the rebalance/repurposing 1604. This is one example where the declarative infrastructure is structured to conveniently add additional satellite resources and ground stations to the distributed infrastructure. Similarly, a non-functional satellite or dysfunctional satellite can be temporarily or permanently removed from the distributed infrastructure respectively.


The distributed system of satellites in a constellation and the ground stations and mission control may be configured to allow re-assignment/re-purposing of satellites to increase availability, as shown in rebalance/repurpose 1604.


As shown in the embodiment of rebalance/repurposing 1602, a tiled survey task that cannot be completed by a first satellite may completed by a second satellite. Task commands (e.g, MP tiling Cmd1, MP tiling Cmd2) in a worker's queue may be completed by the first satellite SAT1 and then by the second satellite SAT2 in order to complete a defined task. However, mission administration task commands (e.g., MA Cmdla, MA Cmd1b, etc.) may be completed by the satellite they are designated for, since such commands may be particular to a satellite. In this example, the second (MA Cmd1b) command cannot be completed during a first transit over a ground station GS1 of the first satellite SAT1. Thus, it may be scheduled to complete when the first satellite (satellite SAT1) has a next transit over a ground station, which can be a second ground station GS2 (and re-routing may be handled automatically) or it can be during the next transit of satellite SAT1 over the first ground station GS1.


If satellite SAT1 is unable to handle the task then WORKER1 may look for another satellite within a set distance that can receive the task and complete with the same priority by a certain time, and the WORKER may request a re-run of the flight dynamics simulation with the new/repurposed satellite. If no suitable satellite can be substituted, then the task may be returned to the message broker task master queue. The human operator can intervene and manage queues (such as if there are too many retries or failures). As such, the automatic allocation of tasks may occur without much human intervention, thereby function in a fault-tolerant manner.


Further, rebalance/repurposing 1604 shows the fault-tolerance and load-balancing capabilities. For example, rebalance/repurposing 1604 includes message brokers, workers, sidecar proxies, ground stations and satellites which may communicate via message passing. Additionally, tasks and commands may be scheduled, re-scheduled, routed, re-routed at the last moment (or any desired timeframe) prior to final communication with the satellites. For example, if a task is in a satellite queue, but the satellite ‘disappears’ (and/or loses connection) then the worker queue entry may time out and the task may then be put back on a different satellite's queue.


In one embodiment, satellites may also be re-assigned for tasks enqueued, subject to certain constraints (such as but not limited to compliance with regulations, task types, etc.). Further, some tasks may be enqueued to specific types of satellites if customer so demands based on feature availability.


In one embodiment, commands and tasks that fail on a satellite may be retried via the message broker on the same satellite but at a different ground station with better elevation (such as based on satellite angle to ground station with respect to the ground position, such as 90 degrees may refer to an angle overhead and the best elevation for signal reception), at a more suitable latitude-longitude pair, satellite attitude, and longer ground aperture with regard to the orbit of the satellite, etc.



FIG. 17 illustrates a system 1700 for tracking a satellite over an interval of time. As an option, the system 1700 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the system 1700 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


Referring to the map illustration of system 1700, the illustration provides a visual representation of the ground track of a satellite. The map includes multiple ground stations 1702 distributed across different regions. These ground stations 1702 may be strategically located to maximize the coverage and communication with the satellites in the constellation. In some aspects, the ground stations 1702 may include various components, such as a communication system, a power system, and a control system, that facilitate communication with the satellites and manage the reception and transmission of signals and data.


An area of interest 1704 is marked on the map of the system 1700, indicating a specific region that the satellite is tasked to monitor or survey. The area of interest 1704 may be defined based on various factors, such as the mission objectives, the capabilities of the satellites, the operational constraints, etc. Additionally, the area of interest 1704 may be selected based on an intent-based instruction. In some cases, the area of interest 1704 may include various geographical features, such as landforms, bodies of water, and man-made structures, that are relevant to the mission objectives and/or the intent-based instruction.


The current path 1706 of the satellite is shown with a dotted line, while the future path 1708 is indicated with a long dash line. The current path 1706 represents the trajectory of the satellite at the present time, while the future path 1708 represents the predicted trajectory of the satellite based on various factors, such as the current position and velocity of the satellite, the gravitational forces acting on the satellite, the operational constraints of the satellite, etc., all of which may be more accurately predicted and modeled using machine learning. The depiction of the current path 1706 and the future path 1708 can provide valuable information for mission planning and control, such as determining the timing and scheduling of tasks, predicting the visibility conditions, and planning the communication with the satellite.


As shown, the area of interest 1704 is shown within the trajectory map of the future path 1708. It is to be appreciated that the area of interest may be at any current or future location of a trajectory of a satellite.


As shown, tracking a satellite over an interval of time may be performed as a ground track computed using, in one embodiment, the most recent TLE parameters. In one embodiment, the ground track may shift over time on multiple transits around a location as TLE parameters change over time. Such a shift may be due to the instantaneous dynamics and kinematics of the satellite or due to longer-term seasonal variations due to the “precision” of the earth and other considerations. In addition, the area of interest (AOI) that is within the ground track at a point in time may be surveyed effectively during transit or during a near term repetition (i.e., within one or two days). As such, however, an AOI outside of the ground track that may be based on the latest TLE at an instance that is further away from the ground track, it may become extremely difficult and computationally expensive to compute the transit time of the satellite over the AOI at a distant point in the future. Additionally, similar or identical considerations may apply for the satellite transit over a ground station (GS), wherein the same above-stated problems may need to be addressed because commands may need to be sent to the satellite and data may need to be downloaded. It should be noted that the system 1700 may address this problem for one or more satellites in a constellation.


As illustrated in system 1700, a ground station GS1 of the ground stations 1702 appears adjacent to the satellite ground track (via the current path 1706) while ground station GS2 of the ground stations 1702 and the AOI 1704 may not intersect with the current ground track (the current path 1706) but may intersect with a future ground track (the future path 1708). It is to be appreciated that one of many ground stations may intersect the ground track (e.g., lie within the ground track) a day or two into the future. An issue exists, however, wherein the exact times and durations of transit over any one or more of the ground stations must be correctly and efficiently determined, so that a correct set and the correct number of commands may be prepared to be uploaded to the satellite in question. In addition, a user may determine one or more transits for the purpose using machine learning that predicts a few suitable transits (such as the future path 108) that are verified using flight dynamics simulation in advance.


As such, the system 1700 shows that a future path of a satellite may be determined with greater accuracy and precision. In some aspects, the map illustration of the system 1700 may be generated using various mapping and visualization tools, such as geographic information system (GIS) software, computer-aided design (CAD) software, and data visualization software. The map illustration 1700 may also be updated in real-time or near real-time to reflect the current position and trajectory of the satellite, the status of the ground stations, and the changes in the area of interest. This can provide operators with up-to-date and accurate information for managing and controlling the satellite constellation.



FIG. 18 illustrates a system 1800 for determining a future time and date where a satellite passes over one or more AOIs. As an option, the system 1800 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the system 1800 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


Referring to the satellite constellation of the system 1800, the system may include one or more satellites in a constellation. The current location of SAT11802A and future locations of SAT1, including the first future location 1802B and the second future location 1802C, are determined based on various factors, such as the current position and velocity of SAT1, the gravitational forces acting on SAT1, the operational constraints of SAT1, TLE parameters, etc., all of which may be more accurately predicted and modeled using machine learning. As such, the determination of the current and future locations of SAT1 may be performed using various algorithms and models, such as orbital mechanics models, flight dynamics models, and machine learning models.


In some aspects, the ground stations 1804 may be strategically located at various geographical locations on Earth to maximize the coverage and communication with the satellites in the constellation. Each ground station 1804 may include various components, such as a communication system, a power system, and a control system, that facilitate communication with the satellites and manage the reception and transmission of signals and data.


The ground aperture 1806 represents the area on Earth that can communicate with the satellites. The size and shape of the ground aperture 1806 may depend on various factors, such as the altitude and inclination of the satellites, the geographical location of the ground stations, and the communication capabilities of the satellites and the ground stations.


In one embodiment, the areas of interest 1808 may include specific regions on Earth that the satellites are tasked to monitor or survey. The areas of interest 1808 may be defined based on various factors, such as the mission objectives, the capabilities of the satellites, the operational constraints, the intent-based instructions, etc. In some cases, the areas of interest 1808 may include various geographical features, such as landforms, bodies of water, and man-made structures, that are relevant to the mission objectives.


In some cases, the satellite constellation management system 1800 may use machine learning algorithms to optimize the assignment and execution of tasks. For example, the system may use a machine learning model trained on historical satellite data to predict the future locations of the satellites, optimize the scheduling of tasks, or detect anomalies in the satellite data. This can help to ensure that the tasks are completed efficiently and effectively, as the tasks are assigned and executed in a way that maximizes the use of the satellites' resources and minimizes the time taken to complete the tasks.


In some aspects, the system 1800 may provide fault tolerance by allowing remote rescheduling or reset of a satellite On-Board Computer (OBC) at another compliant ground station when a satellite passes over it. This can ensure that the satellite operations continue smoothly even in the event of a failure or disruption in the communication with a particular ground station.


Furthermore, the system 1800 may include a virtual satellite simulation infrastructure for creating new satellites to study what-if scenarios to pre-determine the trajectories before launch for new satellites or the trajectories for existing satellites before a specific date. This can help in better planning and management of the satellite constellation.


In various embodiment, the system 1800 may further address known issues (similar in nature to system 1700) with determining a time and date upon which a satellite may pass over one or more AOIs given the satellite's current/instantaneous location. In an embodiment, such a future date and time is to be extrapolated using the satellite's current/instantaneous location, which may be performed using machine learning. It should be noted that the system 1800 may address this problem for one or more satellites in a constellation. For example, a satellite may be currently/instantly in transit over a ground station GS1, and two unknown values may need to be determined for 1) a location of the satellite at a time “FUTURE1,” and 2) another time “FUTURE2,” wherein the satellite may pass over one or more AOIs.


In one embodiment, the instant disclosure describes a machine learning mechanism that may estimate a location, time, and date associated with FUTURE1 (SAT Future Location 11802B) and FUTURE2 (SAT1 Future Location 21802C), each associated with a respective AOI. In operation, all predicted/generated estimates may be verified using flight dynamics simulations recorded a few hours or even a full day or so in advance. It should be noted that flight dynamics simulation accuracy may decrease as the temporal separation between the current/instantaneous location and one or more future locations (1802B, 1802C, for example) increases. As such, a machine learning based prediction model working from prior data may be significantly more efficient. In operation, it is to be appreciated that, even if the satellite passes over an AOI or a GS multiple times, only a subset of the transit data may be useful due to the fact that the orientation of a survey camera must be correct to support good data collection and recording. Further, it should be noted that the angle of elevation from a GS must be closer to perpendicular to maximize the potential for reliable data exchange and recording between the satellite and a GS.



FIGS. 19A and 19B illustrate example scenarios 1900 and 1901 for the elevation profile of a satellite in transit over a ground station. As an option, the scenarios 1900 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the scenarios 1900 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


Referring to the scenario 1900 and/or scenario 1901 each showing an elevation profile graph, the graphs illustrates the elevation in degrees over time from the acquisition of signal (AOS) to the loss of signal (LOS). The elevation profile graph provides a visual representation of the satellite's elevation as it transits over a ground station. The elevation is plotted on the y-axis, while the time since the acquisition of signal (AOS) is plotted on the x-axis. The graph shows how the elevation changes over time, with the peak of the graph representing the time of closest approach (TCA), when the satellite is at its maximum elevation.


In some aspects, the elevation profile graph of the of scenario 1900 and/or scenario 1901 may be divided into two regions: Region 1 and Region 2. Region 1 represents the time intervals where communication with the satellite is not possible, while Region 2 represents the useful regime where communication is established. The division between Region 1 and Region 2 may be determined based on various factors, such as the elevation angle threshold for communication, the signal strength, the operational constraints of the satellite and the ground station, etc.


In some cases, the elevation profile graph of scenario 1900 and/or scenario 1901 may be used to plan and schedule satellite operations. For example, the graph may be used to determine the optimum times for sending commands to the satellite, receiving data from the satellite, or performing other operations that require communication with the satellite. The graph may also be used to monitor the performance of the satellite and the ground station, and to detect any anomalies or issues that may affect the communication.


In some aspects, the elevation profile graph of scenario 1900 and/or scenario 1901 may be generated using various algorithms and models, such as orbital mechanics models, flight dynamics models, and signal propagation models. The graph may also be updated in real-time or near real-time to reflect the current position and velocity of the satellite, the current conditions at the ground station, and other relevant factors.


In some cases, the elevation profile graph of scenario 1900 and/or scenario 1901 may be displayed on a user interface, such as a mission control console, a ground station monitor, or a mobile device. The graph may be accompanied by various controls and indicators that allow operators to interact with the graph, adjust the parameters, and view additional information. The graph may also be integrated with other tools and systems, such as mission planning software, satellite control systems, and data analysis tools, to provide a comprehensive solution for managing and controlling satellite operations.


In various embodiment, the scenarios 1900 and/or 1901 show the elevation profile of a satellite in transit over a ground station as a function of time for two separate transits: TRANSIT A of the scenario 1900 and TRANSIT B of the scenario 1901. In one embodiment, REGION_1 of scenarios 1900 and 1901 may depict a time regime during which no communication with satellite is available/possible, while REGION_2 shows a time regime during which communication with a satellite has been established (also called a “Useful Regime”). In the case of scenario 1900, the time of closest approach (TCA) may be shown to fall outside the useful regime REGION_2. It should be noted that, while some communication is possible in such a scenario, the size of regime REGION_2 and the angle of elevation (shown on the y-axis) may not be optimum. Alternatively, in the case of scenario 1901, the TCA is shown to fall within the useful regime REGION_2 of the transit. Thus, the exemplary transit in scenario 1901 may be much more favorable for communication between the satellite and a GS under consideration. As such, the techniques depicted in scenarios 1900 and 1901 may allow for a machine learning model to estimate (predict or pre-determine) the time and date of transit over an AOI or a particular GS, prioritize “good” and “best” transits over less favorable transits based on respective elevation profiles and adjusted duration of passage or transit, as discussed in the context of related figures herein.


In one embodiment, the adjusted duration of passage (ADP) may be a defined portion of the time between acquisition of signal (AOS) and loss of signal (LOS). Additionally, the length of the adjusted duration of passage and elevation profile may determine both the number of commands that can be sent to the satellite and the amount of data that can be returned from the satellite. It should be noted, as well, that the respective sizes of the micro-batches of commands may be determined (predicted, estimated, or computed) using machine learning model(s) trained on prior real data from previous transits. As a result, the micro-batches of commands may then be generated and prepared for use prior to an actual target transit. This method of creating correctly sized micro-batches using machine learning is one of the methods of smart-batching. Alternately, in some aspects, smart batching may also be performed using inputs from the flight dynamics simulation.



FIGS. 20A and 20B illustrate methods 2000A and 2000B for gathering TLE and mission control data to train a machine learning model. As an option, the methods 2000A and 2000B may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the methods 2000A and 2000B may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


Referring to the method 2000A, the process begins with gathering TLE data associated with a satellite or a satellite constellation. See operation 2002. The TLE data, which is a data format widely used to convey sets of orbital elements that describe the orbits of Earth-orbiting satellites, may be obtained from various sources, such as satellite operators, space agencies, NORAD, and/or other organizations that track and catalog space objects. The TLE data may include information such as the satellite's orbital inclination, right ascension of the ascending node, eccentricity, argument of perigee, mean anomaly, mean motion, and other relevant parameters.


The gathered TLE data is then pre-processed resulting in a standardized data set. See operation 2003. The pre-processing step may involve various operations, such as data cleaning, data transformation, and data normalization, to prepare the TLE data for further analysis and processing. For example, data cleaning may involve removing or correcting erroneous or missing data, data transformation may involve converting the data into a suitable format or scale, and data normalization may involve adjusting the values of the data to a common scale.


The standardized data set is then partitioned into a control set and a test set. See operation 2005. The control set may be used as a baseline, and thereby remain constant and unaltered to provide a standard for comparison. In contrast, the test data may be manipulated and/or used in forecasting and/or predicting TLE data.


For example, physics based flight dynamics model simulation may be applied to forecast predicted trajectory paths. See operation 2007. The flight dynamics model may be evaluated by making predictions on the test data using physics based model where an accuracy of the model may be calculated by comparing predicted labels with actual data weekly using an accuracy scoring function. See operation 2009.


In the event that the accuracy of the model is below a predetermined threshold, the method may return to operations 2007 and/or 2003 (depending on the lack of accuracy of the model). If the accuracy of the model surpasses the predetermined threshold, the method continues on to operation 2011, where the simulation model state is saved. See operation 2011. In one embodiment, the simulation model state may be saved daily, and/or saved daily after update. Further, the physics based model may be rerun for the target data generation for a target date and time. See operation 2013. Further, ranking criteria may be applied to the rerun. See operation 2015.


Referring to the method 2000B, the process begins with gathering TLE data associated with a satellite or a satellite constellation. See operation 2002. The TLE data, which is a data format widely used to convey sets of orbital elements that describe the orbits of Earth-orbiting satellites, may be obtained from various sources, such as satellite operators, space agencies, NORAD, and/or other organizations that track and catalog space objects. The TLE data may include information such as the satellite's orbital inclination, right ascension of the ascending node, eccentricity, argument of perigee, mean anomaly, mean motion, and other relevant parameters.


The gathered TLE data is then preprocessed. See operation 2004. The preprocessing step may involve various operations, such as data cleaning, data transformation, and data normalization, to prepare the TLE data for further analysis and processing. For example, data cleaning may involve removing or correcting erroneous or missing data, data transformation may involve converting the data into a suitable format or scale, and data normalization may involve adjusting the values of the data to a common scale.


In one embodiment, the operation 2004 may involve parsing data to extract relevant parameters (e.g., mean motion, first and second derivatives of mean motion, right ascension, inclination, etc.), as well as compiling a list of associated ground location (AOI or GS) coordinates from which distances between AOIs and/or GSs and a projected satellite path may be computed. Additionally, parameter values such as month, date, time of day of transit; AOS, LOS, TCA, elevation, cloud cover may be extracted therefrom. Further, distances and angles of elevation along the satellite path from one or more ground locations (AOIs or GSs) may also be computed and prepared as training and testing data set material.


The preprocessed data is standardized for feature scaling. See operation 2006. Feature scaling may include using a machine learning system to normalize the range of independent variables or features of data. This can be particularly useful when the data includes features with different scales or units, as it can help to ensure that all features contribute equally to the model's performance. The standardization process may involve various techniques, such as min-max normalization, z-score normalization, or scaling to unit length, depending on the specific requirements of the machine learning model.


The standardized data is used for machine learning model training. Sec operation 2008. The machine learning model may be any suitable type of model, such as a supervised learning model, an unsupervised learning model, a semi-supervised learning model, or a reinforcement learning model. The model may be trained using various algorithms, such as linear regression, logistic regression, decision trees, random forests, support vector machines, neural networks, or deep learning algorithms, depending on the specific task and the nature of the data.


In one embodiment, operation 2006 may involve a process wherein the data set(s) determined in operation 2004 may be split into a set of features (X) and a set of targets (Y) using processes and techniques or methods applied on data such as auto scaling, statistical scaling, normalization, etc., designed for training a predictive machine learning model as in operation 2008. In one embodiment, the auto scaling, statistical scaling, normalization processes may allow model weights to be brought within acceptable bounds (e.g., within certain delineations of data known to be in appropriate intervals (0,1) or [0,1], and so on). Examples of such feature sets (X) may include adjusted duration of passage (ADP), ratio of ADP to Total Duration of Passage (TDP), combinations of AOI+angle of elevation+time of day, and so on. In addition, targets (Y) may be a set of ranks or confidence intervals, and the target categories may be created based on one or more ranking criteria provided by a user based on the purpose served by such information. For example, in order to maximize the ratio of adjusted duration of passage to total duration of passage at available GSs in order to increase the size of the command batches for smart batching, such feature set creation may be necessary. In another example, the ranking criteria when creating target sets may serve the purpose of maximizing the angle of elevation of one or more satellites at a point inside an AOI to improve aerial survey. Further, within the functions of operation 2004, the one or more data sets may also be split into a training data set and a testing data set.


In another embodiment, a machine learning model (e.g., a Random Forest Classifier) may be trained using the training data set(s) produced previously, as in operation 2008. The resulting machine learning model may be a predictive machine learning model for classification and ranking purposes. Alternately, the machine learning model may be a generative machine learning model used for the purposes of generating hypothetical TLE data for transits in the distant future (for example, from one to two weeks, or even a few months into the future) in order to plan remote sensing missions into the future.


Per operation 2010, the trained model is evaluated by making predictions on test data and calculating the accuracy of the model by comparing predicted labels with actual labels using an accuracy scoring function. The evaluation process may involve various metrics, such as accuracy, precision, recall, F1 score, area under the ROC curve, mean squared error, or mean absolute error, depending on the specific task and the nature of the data. The evaluation process may also involve cross-validation techniques, such as k-fold cross-validation or leave-one-out cross-validation, to assess the model's performance on unseen data and to prevent overfitting.


After the final training epoch, the trained model weights are saved. Sec operation 2012. The model weights represent the learned parameters of the model, and they can be used to make predictions on new data. The model weights may be saved in various formats, such as binary files, text files, or database records, depending on the specific requirements of the machine learning model and the computing environment.


Next, model deployment and output generation occurs where the trained model is loaded for inference, input data is provided, and predictions are made. See operation 2014. The model deployment process may involve various steps, such as loading the model weights, initializing the model's architecture, preparing the input data, running the model's inference function, and processing the model's output. The output generation process may involve various operations, such as converting the model's output into a suitable format, visualizing the output, or integrating the output with other systems or processes.


The ranking criteria 2016 may be used to rank the predictions based on predefined metrics. The ranking criteria may involve various metrics, such as the confidence of the predictions, the relevance of the predictions, the novelty of the predictions, or other suitable metrics. The ranked predictions may be used for various purposes, such as decision making, prioritization, recommendation, or other suitable purposes. In some cases, the ranked predictions may be used to determine a list of parameters and their values such that the mission planning software/processes and the flight dynamics software/simulation quickly converge on an intended trajectory; and quickly determine the command batches and micro-batches, and the time instances to upload these command batches to satellites via available ground stations. Additionally, the ranking criteria 2016 may be fed as an input into the machine learning model training of operation 2008, the model evaluation of operation 2010, and/or the model deployment of operation 2014.


Further, based on the results of the model evaluation per operation 2010, the system may determine that the accuracy of the model is of insufficient quality, and based on such scoring, may reroute the data either back to operation 2004 (for pre-processing of the TLE data again) and/or to operation 2008 (for further training of the machine learning model). In the event that the accuracy of the operation 2010 surpasses a minimum (or predetermined) threshold, the trained model then proceeds on to operation 2012.


In various embodiment, the methods 2000A and/or 2000B may show a method for gathering TLE and mission control data to train a machine learning model which may be used to determine (predict, estimate, and/or compute) successful combinations of ground locations and date and time of transit for one or more satellites in a constellation. In an embodiment, the success of a combination is either individually determined for a specific combination, or a prioritized list of combinations may be determined given an initial list of desired ground locations. The necessary training may be performed with data from a single satellite or from all satellites in a constellation. It should be noted that such capability may be required because, in one embodiment, a GS operator or flight dynamics simulator may provide limited quantity of data (such as only two or three days of predictable events) where a satellite is to pass over a particular GS. As such, it may become imperative to predict transits taking place more than three days (perhaps even a week) into the future based on past TLE data.


In one embodiment of the learning model training process, an evaluation may be modeled by making predictions on test data using a trained model and calculating the accuracy of the model by comparing predicted labels with actual labels using an accuracy scoring function, as in operation 2010. If indications are that one or more parts of the evaluation criteria are not met following training operation 2008, said test data is sent back through machine the learning training process before re-evaluation.


In another embodiment, per operation 2012 once evaluation criteria are met within the operation 2010, the trained model weights and other parameters may be saved in a file (such as like a “pickle file,” for example).


In a still further embodiment, per operation 2014 a model may be deployed and output generated by loading trained model for inference, providing input data, and making a prediction. During this process, the trained model may be deployed for inference by loading the weights and starting the inference process on new input data. Additionally, input data may be provided in the same format as the data used to train the model (as in operation 2008) to obtain the prediction array, and the resulting predictions may be interpreted to determine whether the simulation result is predicted to be successful. By way of non-limiting example, a ground location (AOI or GS, and optionally a date range and/or a TLE) may be provided to the machine learning model and the predicted response of the machine learning model generated to determine the chances of success, which may then used to obtain a prioritized list of AOI and date combinations based on chances of success as predicted by the machine learning model. In a related embodiment, a user may input a specific AOI/GS, along with a desired date range and TLE, and the resulting chances of success may be output.


In a further embodiment, Mission Administrators (MAs) and Mission Planners (MPs) may input different goals and different ranking criteria 2016 and the machine learning model(s) may be trained to rank accordingly by receiving direct input from said MAs and/or MPs to further guide model generation. For example, MAs may prioritize maximizing the command batch size, correlating with increased adjusted duration of passage at a ground station. MPs, on the other hand, may have a greater interest in maximizing the angle of elevation at a time of day to improve remote sensing and aerial survey quality and success. It should be noted that both MAs and MPs may use the trained machine learning model(s), accessed via a simple or complex user interface, to provide a specific command batch size or AOI, juxtaposed with desired passage date(s), to obtain a ranking or prediction of success for given transits/passages.


In various embodiments, within the context of operation 2004, the pre-processing of TLE data may include parsing TLE data to extract relevant parameters, parse a list of associated ground coordinates/AOI visited, extracting features, computing distance of AOI, a GS, and/or a Satellite Path (and/or distance from any).



FIG. 21 illustrates a method 2100 designed to train a predictive machine learning model. As an option, the method 2100 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the method 2100 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the method 2100 depicts a flowchart for evaluating and prioritizing satellite transits or passages using an ensemble of predictive machine learning (ML) models. The process begins with the input of a feature set 2102 into the ensemble of predictive ML models 2106. The feature set 2102 may include various characteristics or attributes of the satellite or its environment. In some aspects, the feature set may be a set of passages or transits obtained from Flight Dynamics Simulation. In some aspects, the feature set may be a set of passages or transits obtained from a generative machine learning model as in the generated list of passages 2210 in FIG. 22, which may be used during inference. In some aspects the feature set 2102 is available from historical data used for training. The target set may be obtained from historical data and/or from flight dynamics software and may provide the ranked list of passages.


The ensemble of predictive ML models 2106 processes the input data and results in a prioritized list of transits/passages 2112. The prioritized list of transits/passages 2112 may rank the predicted transits or passages according to their likelihood of occurrence or other relevant criteria, allowing for efficient scheduling and resource allocation.


In one embodiment, the prioritized list of transits/passages are compared against actual outcomes or benchmarks using an error comparison 2108. In one embodiment, the error comparison 2108 may be used to assess the accuracy and reliability of the predictions made by the ML models.


The error comparison 2108 leads to the generation of a classification report 2110, which provides detailed information about the prioritized list of transits/passages 2112, the performance of the ML models, (such as precision, recall, F1 score of the ML model of operation 2106). In one embodiment, the classification report 2110 may assist in understanding the strengths and weaknesses of the models in predicting satellite transits or passages.


In one embodiment, the error comparison 2108 may compare the prioritized list of transits/passages 2112 to a target set 2104, which may include the desired outcomes or predictions. Additionally, the error comparison 2108 may provide feedback back to the prioritized list of transits/passages and/or may generate the classification report 2110 which may be provided back to the ensemble of predictive ML models 2106, which may be used, in one embodiment, to further refine the ML models (for greater accuracy prediction and modeling).


The prioritized list of transits/passages 2112 is then used in a flight dynamics simulation 2114, which models the behavior of the satellites during the predicted transits or passages. The simulation provides insights into the expected satellite trajectories and operational parameters. In one embodiment, the flight dynamics simulation 2114 may be inputted as data to the target set 2104.


Finally, the simulation results are compiled into a target transits/passages list 2116, which serves as a reference for actual mission planning and execution. This list includes the transits or passages that are deemed to be the most viable and strategically valuable for the satellite mission.


Additionally, the method 2100 may be used to train a predictive machine learning model with TLE and ground location data (AOI and/or GS location with ground station availability data) along with other telemetry parametric data for time and date prediction or location prediction. In one embodiment, using specified TLE and ground location data, a trained predictive ML model may determine and/or prioritize satellite passage over available GSs (in the instance of telecommunications, for example) and/or over an AOI (as may be the case for surveying) for the best opportunity and best signal strength, which may be based on angle of elevation and transit duration, to achieve desired objectives. As such, the feature set 2102 may include a database of features, and a target set 2104 may include associated targets. Additionally, features for each passage or transit may include adjusted duration of passage (ADP), ratio of ADP to Total Duration of Passage (TDP), and one or more combinations of AOI+angle of elevation+time of day, and so on. Conversely, targets may be a set of rankings or confidence intervals that may indicate varying degree(s) of success. Such targets may also have originated rankings specifically created for training purposes based on past data gathered during recording and assessment processes.


In another embodiment, the error comparison 2108 function may be used to determine an error tolerance between a prediction and a target, wherein the resulting error tolerance is used to generate a classification report 2110. It is to be appreciated that an error tolerance may be multi-dimensional. In a related embodiment, the classification report 2110 may be presented in terms of correction parameters for model re-training and may be fed to an ensemble of machine learning models 2106 to further reduce the error in a next epoch of training. This method 2100 continues until the error is withing acceptable limits or until a maximum number of training epochs are completed, resulting in a prioritized list of transits/passages 2112 to be passed as working combinations to a flight dynamics simulator 2114. It should be noted that, at any time during the training process, predicted and corresponding input features from feature set 2102, target set 2104 (by way of error comparison function 2108), and the ensemble of machine learning models 2106 may be ranked on a per passage basis and may ultimately be passed as one or more additional combinations to flight dynamics simulator 2114 to verify the quality of prediction of success or the rank of a transit/passage among a list of transits or passages. During evaluation of new/hypothetical passages, ranked transit/passage parameters originating from flight dynamics simulator 2114 may be received and finalized as a collection desired/targeted transits/passages 2116.



FIG. 22 illustrates a method 2200 of a flow diagram for mission planning and mission administration. As an option, the method 2200 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the method 2200 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


Referring to the method 2200, the process begins with the input of a ground location and date range. See operation 2202. The ground location may be a specific geographical location on Earth, such as a city, a region, or a set of coordinates. The date range may be a specific period of time, such as a day, a week, or a month. The ground location and date range may be input by an operator, an automated system, or a combination of both. The input of the ground location and date range may be used to define the scope of the satellite mission and to determine the relevant parameters for the mission planning and control.


The input of the ground location and date range is then used by generative machine learning (operation 2204) to generate TLEs of hypothetical transits or passages (operation 2206). The generative machine learning 2204 may be a machine learning model that is trained to generate hypothetical transits or passages based on the input of the ground location and date range. The generative machine learning 2204 may use various techniques, such as generative adversarial networks (GANs), variational autoencoders (VAEs), or other suitable generative models, to generate the tiles of hypothetical transits or passages 2206.


The hypothetical transits or passages 2206 are then used to produce ground tracks. See operation 2208. The ground tracks may represent the predicted paths of the satellites over the ground location during a predetermined date range, time range, etc. The ground tracks may be generated using various algorithms and models, such as orbital mechanics models, flight dynamics models, and machine learning models. The ground tracks may be visualized on a map or a globe to provide a visual representation of the predicted paths of the satellites.


Next, the hypothetical transits or passages, and/or the ground tracks, are then compiled into a generated list of passages/transits. See operation 2210. The generated list of passages and transits may include various information, such as the predicted times of the transits or passages, the predicted locations of the satellites during the transits or passages, the predicted elevations of the satellites during the transits or passages, and other relevant information. The generated list of passages may be used for various purposes, such as mission planning, satellite scheduling, resource allocation, or other suitable purposes.


The generated list of passages is then evaluated by predictive machine learning (per operation 2212) to identify candidate transits or passages (per operation 2214). The predictive machine learning may be a machine learning model that is trained to predict the likelihood of a transit or passage occurring based on the generated list of passages (per operation 2210). The predictive machine learning may use various techniques, such as regression models, classification models, or other suitable predictive models, to identify the candidate transits or passages. Additionally, customer order parameters (per operation 2218) may be inputted into the predictive machine learning per operation 2212. The customer order parameters may be used to rank for future passages.


The candidate transits or passages are then used for mission planning. Sec operation 2216. The mission planning may involve various operations, such as scheduling the satellite operations, allocating the satellite resources, generating the satellite commands, and other relevant operations. The mission planning may be performed by an operator, an automated system, or a combination of both. The mission planning may use the candidate transits and/or passages to optimize the satellite operations and to achieve the mission objectives.


In other embodiments, the method 2200 may comprise multiple sub-flows and methods used for mission planning and mission administration which may predict passages/transits of a satellite or a constellation of satellites for points further in the future. Where information may be required for more than one week to a few months (i.e., perhaps even six months) into the future for mission planning, the satellite transits over a ground location such as an AOI or a passage over a ground station may not be computed reliably using flight dynamic software with a high degree of confidence in a short amount of time with high computational efficiency. There are many factors such as precision of earth, solar activity, etc., that can affect the trajectories of satellites. However, given a year's worth of actual transit data comprising TLEs, ground tracks, angles of elevation, etc., machine learning is used herein to generate candidate TLE and ground track data for protracted-date hypothetical transits/passages into the future that are of interest to a mission planner.


In one embodiment, an initial generative machine learning model (such as that produced according to the method described in the method 2100) may be passed to the method 2200, wherein the data set comprises the TLE and one or more features used for training. This training process is continuous, designed to correct the training machine learning model using the actual data obtained during every iteration (which is may typically be within seconds, minutes, hours, or perhaps daily).


In operation, during protracted date range analysis, a ground (GND) location (e.g., an AOI or GS) and a date range (per operation 2202) may be provided to the trained generative machine learning (ML) model (per operation 2204), which may perform one or more inferences and may generate a set of hypothetical TLEs for hypothetical transits/passages (per operation 2206) associated with specified GND locations. Additionally, an additional error comparison function (per operation 2203) may be employed to further determine an error tolerance between a prediction and a target before being passed to generative ML model (per operation 2204). It is to be appreciated that, over the course of processing, one or more hypothetical TLEs and/or hypothetical transits/passages (of the operation 2206) may not actually occur. Nevertheless, GND tracks (per operation 2208) may be calculated and a list of passages (per operation 2210) associated with GSs may be determined based on the hypothetical TLEs.


In a further embodiment, resulting data from operation 2010 may be fed as input to a predictive ML model 2212. In one embodiment, the resulting data from operation 2010 may be accompanied by customer order parameters, which may rank the AOI-to-transit combinations and ground station-to-transit/passage combinations in an effort determine the best candidate month/date (and time, optionally) combinations. As such, a prioritized list of candidate transits/passages (per operation 2214) may be created and provided to the mission planning and mission administration infrastructure (per operation 2216).


It should be noted that, in the case of a constellation of satellites, one additional degree of freedom that may be available for both the machine learning model and the mission planner is the ability to match satellites with one or more “best” transits (based on angle of elevation) or passage (over a ground station, for example, based on the longest and best adjusted duration of passage).


In a related embodiment, it is to be appreciated that the method 2200 may work in a variety of scenarios: (1) where there may be a list of transits/passages in the near future, and the predictive ML may be used to rank the transits/passages for best outcomes; and (2) where there is no passage list for a protracted date period (e.g., a few weeks to a few months into the future), wherein the generative ML model 2204 may generate hypothetical TLEs and may be based on which hypothetical ground tracks 2208 may be computed, which may also comprise possible/plausible transits/passages over GND locations (or AOIs) of interest using the generative ML model 2204 trained on historic data with possible angles of elevations, TLE, and other parameters. Thereafter, predictive ML may be used to rank the transits/passages and produce one or more “best” outcomes. It is envisioned that other scenarios may relate to the method 2200, and therefore the examples provided herein are intended merely as some examples (but not all).



FIG. 23 illustrates a method 2300 for parameter and command generation for flight control. As an option, the method 2300 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the method 2300 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the method 2300 may comprise parameter and command generation for flight control and telemetry, tracking, and command (TTC) of satellite(s) in a constellation using a recommendation engine embedded in a declarative infrastructure, which may be used by mission administrators on an expert system that recommends a checklist of operations. It should be noted that the method 2300 may be used by both mission administrator(s) and mission planner(s), both of whom may comprise mission experts. For example, a mission planner's task may be to plan missions to satisfy a customer's orders related to the customer's payload using one or more satellites, which may include aerial survey and/or remote sensing of an area among other capabilities and tasks. A mission administrator's task, on the other hand, may be to control and command one or more satellites for specific purposes and monitor the health and functioning of those satellite(s).


In various embodiments, the declarative infrastructure may include a “one-click” operation (where more than one actions may be connected in a manner to implement various functions). For example, a “one click” operation may entail a preconfigured set of intent-based instructions such as “manage a constellation of satellites and orientate the satellite(s) to capture the best image of a predetermined location.” Or, in another embodiment, a “one click” operation may include deployment of a satellite with a preconfigured set of settings (e.g. deploy satellite for surveillance, deploy satellite for communication, etc.). In another embodiment, the “one click” operation may include automation services, including if-this-then-that scenarios. In another embodiment, the “one click” operation may include deployment of containerized applications and virtual machines associated with the satellites, the mission control, the ground stations, etc. In short, therefore, the “one-click” operation may relate to configuration of the satellites in particular, and/or to management (such as via mission control, ground station, cloud datacenter, back-office, etc.) of the satellites in any manner.


In one embodiment, the method 2300 may comprise the process of receiving mission planning/mission administration transits and passages following ranking as produced in the method 2200. As such, the method 2300 begins with mission planning/mission administration receiving transits and passages known after ranking. See operation 2302.


Additionally, a rule based machine learning recommendation engine (per operation 2304) may be applied to the transits and passages. In one embodiment, the rule based machine learning recommendation engine may include an expert system trained by mission experts that may be used to automatically create commands designed to control and/or communicate with a satellite. In operation, commands may be created using templates based on checklist(s) of action(s) recommended by recommendation engine (per the operation 2304). Thereafter, the recommendation engine may produce one or more correct checklist(s) based on actions required to be communicated for flight parameters and/or flight/TTC commands per operation 2306, (e.g., action in the launch and early orbit phase (LEOP) phase of a satellite, actions for normal operation, actions to control payload, for some special payload handling, or for some exception handling, etc.)


In another embodiment, the data output of operation 2306 may then be associated with a declarative infrastructure that may receive flight control parameters generated and translate them to a fast data entry using “one click.” See operation 2308. In one embodiment, the commands may be transposed into smart micro command batches (per operation 2310) for deployment to the satellite (per operation 2312) via a suitable GS. It is to be appreciated that, during testing and simulation, commands may alternatively be uploaded into a virtual satellite in a virtualized simulation environment, also performed by deployment to the satellite per operation 2312.


In a related embodiment, the method 2300 may itself be embedded in a declarative infrastructure and framework (such as those exemplified in FIG. 24 and FIGS. 9A, 9B, and 9C, at a minimum) that may allow human operators to perform mission planning, administration, and control using simple commands.


In various embodiments, the method may also include a fast data entry subsystem with one-click declarative infrastructure that receives flight control parameters and/or Flight commands and/or TTC commands for a passage. The fast data entry subsystem may provide a user-friendly interface that allows operators to quickly and easily input the flight control parameters and/or Flight commands and/or TTC commands. The one-click declarative infrastructure may provide a simple and intuitive way for operators to specify the desired state of the satellites and the system, and to declare the actions or operations that are to be performed to achieve the desired state.


The one-click declarative infrastructure may use various techniques, such as form-based input, drag-and-drop input, voice input, or other suitable input techniques, to facilitate the fast data entry. The one-click declarative infrastructure may also provide various features, such as auto-completion, error checking, validation, or other suitable features, to assist the operators in inputting the flight control parameters and/or Flight commands and/or TTC commands.


In some aspects, the fast data entry subsystem with one-click declarative infrastructure may be integrated with the rule-based machine learning recommendation engine 2304. The rule-based machine learning recommendation engine 2304 may generate the recommended flight parameters and/or flight/TTC commands, and the fast data entry subsystem with one-click declarative infrastructure may allow the operators to quickly and easily input the recommended flight parameters and/or flight/TTC commands. This can help to streamline the process of determining and inputting the flight parameters and/or flight/TTC commands, and to improve the efficiency and effectiveness of the satellite constellation management and control system.



FIG. 24 illustrates a system 2400 for machine learning-based declarative infrastructure for automated mission planning, mission administration, and control, in accordance with one embodiment. As an option, the system 2400 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the system 2400 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, the system 2400 may comprise several capabilities including historic satellite mission planning, administration, control, and flight data for one or more satellites of a constellation controlled by high level operator commands 2402 (e.g., one or more UI/UX interfaces for human operators, etc.) and stored in a database such as a graph database 2404. The graph database 2404 may include remote sensing data (such as AOI, mineral data, industry data, cost/pricing data, etc.).


In one embodiment, the system 2400 may comprise an AOI simulation 2406. Such an AOI simulation 2406 may include a variety of user interface features and interactions, including the ability to view current and/or past AOI simulations, the ability to enter and search for an AOI ID (for previously generated simulations), and an interactive module (titled “ASK”) which may allow a user to request and/or ask questions and receive responses accordingly.


In another embodiment, AOI simulation 2406 may provide detailed reports 2410 of satellite missions and flights collated chronologically. Additionally, the system 2400 may further provide various data 2412 including TTC data and commands formatted for smart batching into micro-batches of appropriate sizes targeted for specific passages/transits over specific ground stations and for convenient and accurate data transmission to and from the satellite(s).


In various embodiments, the graph database data 2404 may be used to support various operations and functions of the system 2400. For example, the graph database 2404 may be used to provide data for visualizations, reports, alerts, and other information presented on the user interface. Additionally, the graph database 2404 may also be used to support search and query operations, data analysis operations, data mining operations, and other data-related operations.


The area of interest simulation 2406 may receive input from a machine learning-based one-click declarative infrastructure for automated mission planning, mission administration, and control 2408. The machine learning-based one-click declarative infrastructure may use machine learning algorithms to automate various aspects of mission planning, mission administration, and control. For example, the machine learning-based one-click declarative infrastructure may use machine learning algorithms to predict the future state of the satellites, optimize the scheduling of satellite operations, or detect anomalies in the satellite data.


In some cases, the machine learning-based one-click declarative infrastructure may include a user interface that allows operators to input commands and parameters using a one-click mechanism. The one-click mechanism may provide a simple and intuitive way for operators to specify the desired state of the satellites and the system, and to declare the actions or operations that are to be performed to achieve the desired state. The one-click mechanism may use various techniques, such as form-based input, drag-and-drop input, voice input, or other suitable input techniques, to facilitate the fast data entry.


In some aspects, the machine learning-based one-click declarative infrastructure may be integrated with the graph database 2404. For example, the graph database 2404 may provide the data for the machine learning algorithms, and the machine learning-based one-click declarative infrastructure may use the data to make predictions, optimize operations, and generate commands. This integrated approach can improve the efficiency and effectiveness of the satellite constellation management and control system.



FIG. 25 illustrates an intent-based satellite instruction system 2500, in accordance with one embodiment. As an option, the system 2500 may be implemented in the context of any one or more of the embodiments set forth in any previous and/or subsequent figure(s) and/or description thereof. Of course, however, the system 2500 may be implemented in the context of any desired environment. Further, the aforementioned definitions may equally apply to the description below.


As shown, an intent-based satellite instruction 2503 may be associated with machine learning models and predictive satellite transit 2505, as well as effective payload management 2507. In one embodiment, the effective payload management 2507 may include command and control (TTC) data as well.


In operation, the intent-based satellite instruction 2503 may include intended outcomes, states, tasks, etc. associated with a satellite to fulfill.


The machine learning models and predictive satellite transit 2505 may be used to train and use machine learning models to accurately predict satellite transit paths. Such prediction may be used to allocate one or more intent-based satellite instruction to an intended satellite. As such, a ground-based control station may allocate tasks (i.e. intent based instruction) to one or more satellites based on predictive transit paths.


The satellites, in turn, may receive the intent-based instruction for more minute implementation and execution. For example, real-time in-situ measurements (during actual satellite transit) may be used to determine and configure commands to implement and fulfill the intent-based instruction. In one embodiment, the intent-based instruction may include rules based expert systems.


For example, a rules-based expert system may be used to create commands for the one or more pre-determined outcome. Furthermore, the rules-based expert system may query one or more neural network based artificial intelligence agents to provide certain services or data automatically when queried using their knowledge or training of various environments. For example, a rules-based expert system may query about cloud cover conditions and the AI agent for real-time or predictive atmospheric conditions could provide data to the rules-based expert system.


After completing the intent-based instruction, the satellite will likely have obtained data (e.g. images, atmospheric measurements, etc.) to be delivered back to the ground-based control stations. The payload may be coordinated for delivery by: 1) segmenting the payload into multiple micro-batch packets; and 2) assigning the micro-batch packets for delivery to the ground-based control stations in an effective manner. For example, typical current payload delivery systems include having a single ground station communicate with a satellite. Even if the satellite were to segment the payload into micro-batches, the transmission to the one ground station could take several transit passes before completion. In contrast, the systems disclosed herein provide a mechanism for coordination amongst multiple ground-based control stations such that a first micro-batch packet may be sent to the first ground station to be passed by the satellite during the transit path, the second micro-batch packet may be sent to the second ground station to be passed by the satellite during the transit path, and so on and so forth. The ground-based control stations may then coordinate aggregating the micro-batches into one cohesive payload package.


In some aspects, the techniques described herein relate to an intent-based satellite management system, including one or more satellites in a constellation and a ground-based control system to manage the one or more satellites. Additionally, the system may include a communication module configured to transmit intent-based instruction from the ground-based control system to the one or more satellites, where the intent-based instruction includes one or more predetermined outcomes. Further an intent-based module may be included, located on each satellite of the one or more satellites, configured to receive the intent-based instruction and instruct a processor to generate and execute command sequences in order to fulfill the intent-based instruction.


In various embodiments, the intent-based module may use a neural network to generate the command sequences. Additionally, the intent-based instruction may include a set of high-level goals for the satellite mission.


In various embodiments, the intent-based instruction may be based on coarse-grained prediction and fine-grained in-flight measurements. Additionally, the coarse-grained prediction may include workflow-based instructions pertaining to at least an entire orbit, and the fine-grained prediction may include measurements to carry out the workflow-based instructions based on then-current information associated with at least one satellite of the one or more satellites. Further, the intent-based instruction may be associated with a state of each satellite of the one or more satellites, and the command sequences may be configured as real-time commands to achieve the state.


In various embodiments, the command sequences may be configured for future execution. Additionally, the intent-based instruction may be provided by a user through a user interface. The user interface may include a natural language processing module for interpreting the user's intent. Further, the natural language processing module may use a neural network to interpret the user's intent.


In various embodiments, the intent-based module may use one of a deep learning model, a reinforcement learning model, a supervised learning model, an unsupervised learning model, or a semi-supervised learning model to generate the command sequences. Additionally, the command sequences may include one of telemetry tracking and control (TTC) commands, payload delivery commands, and/or flight dynamics commands. Further, the command sequences may be executed in real-time or near real-time, and/or the command sequences may be executed based on a schedule.


In various embodiments, the intent-based instruction may include an if-this-then-that configuration based on in-situ real-time measurements provided by any satellite of the one or more satellites. Additionally, the intent-base instruction may include taking a predetermined action associated an area of interest. Further, the command sequences may be executed based on the current and predicted future state of any (or a combination of any) of the satellite(s), the ground station, and the mission control station.


The use of the terms “a” and “an” and “the” and similar referents in the context of describing the subject matter (particularly in the context of the following claims) are to be construed to cover both the singular and the plural, unless otherwise indicated herein or clearly contradicted by context. Recitation of ranges of values herein are merely intended to serve as a shorthand method of referring individually to each separate value falling within the range, unless otherwise indicated herein, and each separate value is incorporated into the specification as if it were individually recited herein. Furthermore, the foregoing description is for the purpose of illustration only, and not for the purpose of limitation, as the scope of protection sought is defined by the claims as set forth hereinafter together with any equivalents thereof entitled to. The use of any and all examples, or exemplary language (e.g., “such as”) provided herein, is intended merely to better illustrate the subject matter and does not pose a limitation on the scope of the subject matter unless otherwise claimed. The use of the term “based on” and other like phrases indicating a condition for bringing about a result, both in the claims and in the written description, is not intended to foreclose any other conditions that bring about that result. No language in the specification should be construed as indicating any non-claimed element as essential to the practice of the invention as claimed.


The embodiments described herein included the one or more modes known to the inventor for carrying out the claimed subject matter. Of course, variations of those embodiments will become apparent to those of ordinary skill in the art upon reading the foregoing description. The inventor expects skilled artisans to employ such variations as appropriate, and the inventor intends for the claimed subject matter to be practiced otherwise than as specifically described herein. Accordingly, this claimed subject matter includes all modifications and equivalents of the subject matter recited in the claims appended hereto as permitted by applicable law. Moreover, any combination of the above-described elements in all possible variations thereof is encompassed unless otherwise indicated herein or otherwise clearly contradicted by context.

Claims
  • 1. An intent-based satellite management system, comprising: one or more satellites in a constellation;a ground-based control system to manage the one or more satellites;a communication module configured to transmit intent-based instruction from the ground-based control system to the one or more satellites, wherein the intent-based instruction comprises one or more predetermined outcomes; andan intent-based module, located on each satellite of the one or more satellites, configured to receive the intent-based instruction and instruct a processor to generate and execute command sequences in order to fulfill the intent-based instruction, wherein the intent-based instruction is based on coarse-grained prediction and fine-grained in-flight measurements.
  • 2. The intent-based satellite management system of claim 1, wherein the intent-based module uses a neural network to generate the command sequences.
  • 3. The intent-based satellite management system of claim 1, wherein the coarse-grained prediction includes workflow-based instructions pertaining to at least an entire orbit, and the fine-grained prediction includes measurements to carry out the workflow-based instructions based on then-current information associated with at least one satellite of the one or more of satellites.
  • 4. The intent-based satellite management system of claim 1, wherein the intent-based instruction is associated with a state of each satellite of the one or more satellites, and the command sequences are configured as real-time commands to achieve the state.
  • 5. The intent-based satellite management system of claim 1, wherein the command sequences are configured for future execution.
  • 6. The intent-based satellite management system of claim 1, wherein the intent-based instruction comprises a set of high-level goals for the one or more satellites.
  • 7. The intent-based satellite management system of claim 6, wherein the intent-based instruction is provided by a user through a user interface, wherein the user interface includes a natural language processing module for interpreting an intent of the user.
  • 8. The intent-based satellite management system of claim 7, wherein the natural language processing module uses a neural network to interpret the intent.
  • 9. The intent-based satellite management system of claim 1, wherein the intent-based module uses one of a deep learning model, a reinforcement learning model, a supervised learning model, an unsupervised learning model, or a semi-supervised learning model to generate the command sequences.
  • 10. The intent-based satellite management system of claim 1, wherein the command sequences include telemetry tracking and control (TTC) commands.
  • 11. The intent-based satellite management system of claim 1, wherein the command sequences include payload delivery commands.
  • 12. The intent-based satellite management system of claim 1, wherein the command sequences include flight dynamics commands.
  • 13. The intent-based satellite management system of claim 1, wherein the command sequences are executed in real-time or near real-time.
  • 14. The intent-based satellite management system of claim 1, wherein the command sequences are executed based on a schedule.
  • 15. The intent-based satellite management system of claim 1, wherein the intent-based instruction includes an if-this-then-that configuration based on in-situ real-time measurements provided by any satellite of the one or more satellites.
  • 16. The intent-based satellite management system of claim 1, wherein the intent-base instruction includes taking a predetermined action associated an area of interest.
  • 17. The intent-based satellite management system of claim 1, wherein the command sequences are executed based on current and predicted future states of the satellite.
  • 18. The intent-based satellite management system of claim 1, wherein the command sequences are executed based on current and predicted future states of the satellite and the ground-based control system.
  • 19. The intent-based satellite management system of claim 1, wherein the command sequences are executed based on current and predicted future states of one or more of: a plurality of the one or more satellites, a ground station, or a mission control station.
  • 20. An intent-based satellite management system, comprising: one or more satellites in a constellation;a ground-based control system to manage the one or more satellites;a communication module configured to transmit intent-based instruction from the ground-based control system to the one or more satellites, wherein the intent-based instruction comprises one or more predetermined outcomes; andan intent-based module, located on each satellite of the one or more satellites, configured to receive the intent-based instruction and instruct a processor to generate and execute command sequences in order to fulfill the intent-based instruction, wherein the intent-based instruction is based on coarse-grained prediction and fine-grained in-flight measurements, wherein the coarse-grained prediction includes workflow-based instructions pertaining to at least an entire orbit, and the fine-grained prediction includes measurements to carry out the workflow-based instructions based on then-current information associated with at least one satellite of the one or more of satellites.
  • 21. An intent-based satellite management system, comprising: one or more satellites in a constellation;a ground-based control system to manage the one or more satellites;a communication module configured to transmit intent-based instruction from the ground-based control system to the one or more satellites, wherein the intent-based instruction comprises one or more predetermined outcomes; andan intent-based module, located on each satellite of the one or more satellites, configured to receive the intent-based instruction and instruct a processor to generate and execute command sequences in order to fulfill the intent-based instruction, wherein the intent-based instruction is based on a combination of model-based predictions and real-time measurements.
  • 22. The intent-based satellite management system of claim 21, wherein the model-based predictions generate workflow-based instructions covering extended operational periods, and the real-time measurements are used to execute the workflow-based instructions based on current satellite conditions.
  • 23. The intent-based satellite management system of claim 21, wherein the intent-based module uses a neural network to generate the command sequences.
  • 24. The intent-based satellite management system of claim 21, wherein at least one of: the extended operational periods comprise at least an entire orbit of at least one satellite of the one or more satellites; orthe intent-based instruction is associated with a state of each satellite of the one or more satellites, and the command sequences are configured as real-time commands to achieve the state.
  • 25. The intent-based satellite management system of claim 21, wherein the command sequences include at least one of: payload delivery commands, telemetry tracking and control (TTC) commands, or flight dynamics commands.
  • 26. The intent-based satellite management system of claim 21, wherein the intent-based instruction includes an if-this-then-that configuration based on in-situ real-time measurements provided by any satellite of the one or more satellites.
  • 27. The intent-based satellite management system of claim 21, wherein the command sequences are executed based on current and predicted future states of at least one of: the one or more satellites, the ground-based control system, a ground station, or a mission control station.
  • 28. The intent-based satellite management system of claim 21, wherein at least one of: the intent-based instruction comprises a set of high-level goals for the one or more satellites,the intent-based instruction is provided by a user through a user interface that includes a natural language processing module for interpreting an intent of the user, orthe intent-based module uses one of a deep learning model, a reinforcement learning model, a supervised learning model, an unsupervised learning model, or a semi-supervised learning model to generate the command sequences.
  • 29. An intent-based satellite management system, comprising: one or more satellites in a constellation;a ground-based control system to manage the one or more satellites;a communication module configured to transmit intent-based instruction from the ground-based control system to the one or more satellites, wherein the intent-based instruction comprises one or more predetermined outcomes; andan intent-based module, located on each satellite of the one or more satellites, configured to receive the intent-based instruction and instruct a processor to generate and execute command sequences in order to fulfill the intent-based instruction, wherein the intent-based instruction utilizes predictive modeling in combination with actual in-situ measurements.
CROSS-REFERENCE TO RELATED APPLICATIONS

This patent application claims the benefit of and priority to U.S. Provisional Patent Application No. 63/571,281, entitled “DISTRIBUTED SATELLITE CONSTELLATION MANAGEMENT AND CONTROL SYSTEM,” filed Mar. 28, 2024; and U.S. Provisional Patent Application No. 63/574,141, entitled “DISTRIBUTED SATELLITE CONSTELLATION MANAGEMENT AND CONTROL SYSTEM,” filed Apr. 3, 2024, all of which are assigned to the assignee hereof; the disclosures of all prior applications are considered part of and are incorporated by reference in this patent application. This patent application is a continuation-in-part of and claims the benefit of and priority to U.S. patent application Ser. No. 18/600,486, entitled “DEEP GENERATIVE MODELS FOR INVERSE DESIGN OF INORGANIC ATOMISTIC STRUCTURES,” filed Mar. 8, 2024; and U.S. patent application Ser. No. 18/397,993, entitled “GENERATIVE ATOMISTIC DESIGN OF MATERIALS,” filed Dec. 27, 2023, all of which are assigned to the assignee hereof; the disclosures of all prior applications are considered part of and are incorporated by reference in this patent application.

US Referenced Citations (1380)
Number Name Date Kind
3582016 Sherman Jun 1971 A
5434796 Weininger Jul 1995 A
5926113 Jones et al. Jul 1999 A
5986575 Jones et al. Nov 1999 A
6072433 Young et al. Jun 2000 A
6106562 Teter et al. Aug 2000 A
6243026 Jones et al. Jun 2001 B1
6287742 Yoon Sep 2001 B1
6295514 Agrafiotis et al. Sep 2001 B1
6355392 Yoon Mar 2002 B1
6387583 Yoon May 2002 B1
6421612 Agrafiotis et al. Jul 2002 B1
6432605 Yoon Aug 2002 B1
6587845 Braunheim Jul 2003 B1
6625585 MacCuish et al. Sep 2003 B1
6647342 Iglesia et al. Nov 2003 B2
6763309 Kieken et al. Jul 2004 B2
6813615 Colasanti et al. Nov 2004 B1
6839634 Satoh et al. Jan 2005 B1
6862533 Strehlau et al. Mar 2005 B2
6904423 Nicolaou et al. Jun 2005 B1
6988041 Benson et al. Jan 2006 B2
7024313 Lee et al. Apr 2006 B2
7054757 Agrafiotis et al. May 2006 B2
7072777 Wakui et al. Jul 2006 B1
7103434 Chernyak et al. Sep 2006 B2
7164117 Breed et al. Jan 2007 B2
7188055 Agrafiotis et al. Mar 2007 B2
7194359 Duffy et al. Mar 2007 B2
7246047 Ghaboussi et al. Jul 2007 B2
7272766 Sakezles Sep 2007 B2
7292958 Ceder et al. Nov 2007 B2
7299135 Thayer Nov 2007 B2
7319040 Vaidyanathan et al. Jan 2008 B2
7330784 Johnson et al. Feb 2008 B2
7386372 Breed et al. Jun 2008 B2
7440762 Maloney et al. Oct 2008 B2
7447614 Ghaboussi et al. Nov 2008 B2
7467057 Sheiretov et al. Dec 2008 B2
7482163 Kilic et al. Jan 2009 B1
7499841 Hoffman Mar 2009 B2
7523803 Breed Apr 2009 B2
7555566 Blumrich et al. Jun 2009 B2
7596242 Breed et al. Sep 2009 B2
7599822 Hearn et al. Oct 2009 B2
7663502 Breed Feb 2010 B2
7672826 Chen et al. Mar 2010 B2
7676329 Garczarek et al. Mar 2010 B2
7676352 Van Peursem et al. Mar 2010 B1
7687146 Freitas, Jr. Mar 2010 B1
7702467 Duffy Apr 2010 B2
7747391 Gustafsson et al. Jun 2010 B2
7751986 Gustafsson et al. Jul 2010 B2
7751988 Kita et al. Jul 2010 B2
7827129 Hu et al. Nov 2010 B2
7856321 Lanza et al. Dec 2010 B2
7882052 Szathmary et al. Feb 2011 B2
7925274 Anderson et al. Apr 2011 B2
7987082 Van Peursem et al. Jul 2011 B2
8036867 Prakash et al. Oct 2011 B2
8050883 Sheiretov et al. Nov 2011 B2
8054203 Breed et al. Nov 2011 B2
8082130 Guo et al. Dec 2011 B2
8082131 Kusakabe Dec 2011 B2
8095344 Ghaboussi et al. Jan 2012 B2
8209070 Hamilton Jun 2012 B2
8250133 Blumrich et al. Aug 2012 B2
8311955 Chimenti et al. Nov 2012 B2
8314245 Yaghi et al. Nov 2012 B2
8336826 Janson Dec 2012 B2
8346525 Chen et al. Jan 2013 B2
8375032 Birdwell et al. Feb 2013 B2
8392418 Birdwell et al. Mar 2013 B2
8396671 Jojic et al. Mar 2013 B2
8396870 Birdwell et al. Mar 2013 B2
8423307 Nakamura Apr 2013 B2
8423337 Hsu et al. Apr 2013 B2
8452716 Howley et al. May 2013 B2
8478535 Jojic et al. Jul 2013 B2
8498851 Ehrnsperger et al. Jul 2013 B2
8540802 Yaghi et al. Sep 2013 B2
8667049 Blumrich et al. Mar 2014 B2
8671369 Ahn Mar 2014 B2
8676556 Deffenbaugh et al. Mar 2014 B2
8713019 Birdwell et al. Apr 2014 B2
8762379 Birdwell et al. Jun 2014 B2
8775427 Birdwell et al. Jul 2014 B2
8775428 Birdwell et al. Jul 2014 B2
8780352 Freese et al. Jul 2014 B2
8809546 Yaghi et al. Aug 2014 B2
8843509 Csanyi et al. Sep 2014 B2
8849575 Gustafsson et al. Sep 2014 B2
8880246 Karpenko et al. Nov 2014 B1
8948442 Breed et al. Feb 2015 B2
8949157 Okuno et al. Feb 2015 B2
8954207 Anzalone et al. Feb 2015 B1
8965740 Safonov et al. Feb 2015 B2
8977576 Macready Mar 2015 B2
9009009 Oganov et al. Apr 2015 B2
9043052 So et al. May 2015 B2
9047513 Derzhi et al. Jun 2015 B2
9086383 Tunheim et al. Jul 2015 B2
9103767 Freese et al. Aug 2015 B2
9274036 Malik et al. Mar 2016 B2
9341687 Donnangelo et al. May 2016 B2
9384320 Church Jul 2016 B2
9395294 Tunheim et al. Jul 2016 B2
9401684 Ren et al. Jul 2016 B2
9542511 Chen et al. Jan 2017 B2
9557299 Salem et al. Jan 2017 B2
9557813 Yairi et al. Jan 2017 B2
9665694 Cope May 2017 B2
9672319 Cao et al. Jun 2017 B1
9684771 Cope et al. Jun 2017 B2
9727034 Ross et al. Aug 2017 B1
9727675 Liu et al. Aug 2017 B2
9727824 Rose et al. Aug 2017 B2
9757706 Cronin Sep 2017 B2
9771795 Knight et al. Sep 2017 B2
9782491 Khanna Oct 2017 B2
9811849 Bursey Nov 2017 B2
9836563 Liu et al. Dec 2017 B2
9881111 Liu et al. Jan 2018 B2
9962677 Cronin May 2018 B2
9967696 Agostinelli et al. May 2018 B2
9996661 Gustafsson et al. Jun 2018 B2
9996778 Church Jun 2018 B2
10002214 Thompson et al. Jun 2018 B2
10043261 Bhaskar et al. Aug 2018 B2
10049173 Liu et al. Aug 2018 B2
10061300 Coffman et al. Aug 2018 B1
10073440 Fenoglietto et al. Sep 2018 B1
10102476 Caraviello et al. Oct 2018 B2
10108754 Chen et al. Oct 2018 B2
10127342 Xin et al. Nov 2018 B2
10131583 Pearl, Jr. et al. Nov 2018 B2
10133852 Lyakhov et al. Nov 2018 B2
10194295 Agostinelli et al. Jan 2019 B2
10196555 Fathi Najafabadi Feb 2019 B2
10216910 Karthikeyan et al. Feb 2019 B2
10223499 Weaver et al. Mar 2019 B2
10241426 Tinnemans Mar 2019 B2
10274933 Coffman et al. Apr 2019 B2
10281902 Coffman et al. May 2019 B2
10295462 Yap et al. May 2019 B1
10311214 McLaughlin et al. Jun 2019 B2
10318881 Rose et al. Jun 2019 B2
10324475 Cui et al. Jun 2019 B2
10338565 Coffman et al. Jul 2019 B1
10345252 Vecchio et al. Jul 2019 B2
10353378 Shapiro et al. Jul 2019 B2
10360506 O'Brien et al. Jul 2019 B2
10366324 Riley et al. Jul 2019 B2
10366779 Hsu et al. Jul 2019 B2
10392669 Sowadski Aug 2019 B2
10401224 Bischoff et al. Sep 2019 B2
10401312 Takis et al. Sep 2019 B2
10402520 Oh et al. Sep 2019 B2
10409950 Dweik Sep 2019 B2
10415370 Pearl, Jr. et al. Sep 2019 B2
10430395 Botea et al. Oct 2019 B2
10434716 Morovic et al. Oct 2019 B2
10460220 Church Oct 2019 B2
10461815 Wang Oct 2019 B2
10467534 Brent et al. Nov 2019 B1
10489525 Joshi et al. Nov 2019 B2
10495590 Vecchio et al. Dec 2019 B2
10496781 Fang et al. Dec 2019 B2
10497464 Siva Kimar et al. Dec 2019 B2
10515715 Pappas et al. Dec 2019 B1
10516725 Moroz et al. Dec 2019 B2
10519770 Chen et al. Dec 2019 B2
10529444 Zhou et al. Jan 2020 B1
10532330 Diallo et al. Jan 2020 B2
10533937 Shehri et al. Jan 2020 B1
10535422 Lekivetz et al. Jan 2020 B2
10546072 Holland et al. Jan 2020 B2
10558195 Coffman et al. Feb 2020 B2
10558199 Fenoglietto et al. Feb 2020 B2
10566079 Martinis et al. Feb 2020 B2
10607109 Sagong et al. Mar 2020 B2
10614258 Ng et al. Apr 2020 B1
10616774 Narasimha et al. Apr 2020 B2
10628868 Bursey Apr 2020 B2
10636636 Tautenhahn et al. Apr 2020 B2
10637142 Tran et al. Apr 2020 B1
10643262 Bursey May 2020 B2
10643324 Al Shehri et al. May 2020 B2
10649440 Fenoglietto et al. May 2020 B2
10650114 Dweik May 2020 B2
10650427 Bursey May 2020 B2
10659148 Trutna et al. May 2020 B2
10665330 Cecchi et al. May 2020 B2
10684388 Perkins et al. Jun 2020 B2
10706626 Brent et al. Jul 2020 B1
10708718 Zavesky et al. Jul 2020 B1
10712727 Coffman et al. Jul 2020 B2
10748198 Bursey Aug 2020 B2
10769324 Matusik et al. Sep 2020 B2
10776560 Moroz et al. Sep 2020 B2
10776712 Oono et al. Sep 2020 B2
10779146 Agostinelli et al. Sep 2020 B2
10790045 Goyal et al. Sep 2020 B1
10803211 Dweik et al. Oct 2020 B2
10810469 Sunkavalli et al. Oct 2020 B2
10824909 Ros Sanchez et al. Nov 2020 B2
10831957 Liu et al. Nov 2020 B2
10837931 Donnangelo et al. Nov 2020 B2
10838939 Walder et al. Nov 2020 B2
10839941 Pappas et al. Nov 2020 B1
10839942 Pappas et al. Nov 2020 B1
10847254 Aykol Nov 2020 B2
10857736 Morovic et al. Dec 2020 B2
10860001 Fenoglietto et al. Dec 2020 B2
10866242 Farokhzad et al. Dec 2020 B2
10867085 Dweik et al. Dec 2020 B2
10871444 Al Shehri et al. Dec 2020 B2
10885231 Matsumura et al. Jan 2021 B2
10885383 Sohn et al. Jan 2021 B2
10891277 Botea et al. Jan 2021 B2
10896744 Maxson et al. Jan 2021 B2
10902238 Herring Jan 2021 B2
10902943 Zhang et al. Jan 2021 B2
10915808 Hara et al. Feb 2021 B2
10922617 Babbush et al. Feb 2021 B2
10923214 Fan et al. Feb 2021 B2
10929534 Chistyakov et al. Feb 2021 B2
10943701 Cole, Jr. et al. Mar 2021 B2
10957419 Yoo et al. Mar 2021 B2
10963599 Dweik Mar 2021 B2
10965529 Magzimof et al. Mar 2021 B2
10969773 Yennie et al. Apr 2021 B2
10977397 Dweik et al. Apr 2021 B2
10984145 Hutchinson et al. Apr 2021 B1
10998087 McNamara et al. May 2021 B2
11004568 Dweik et al. May 2021 B2
11009863 Bharadwaj et al. May 2021 B2
11010513 Weiss May 2021 B2
11010637 Visentini Scarzanella et al. May 2021 B2
11017314 Yoo et al. May 2021 B2
11023639 Stokbro et al. Jun 2021 B2
11023837 Furu et al. Jun 2021 B2
11036898 Chouaib et al. Jun 2021 B2
11048831 De Keyser et al. Jun 2021 B2
11048842 Dittel et al. Jun 2021 B2
11049590 Lee et al. Jun 2021 B1
11049605 Peters Jun 2021 B1
11055356 Ritchey et al. Jul 2021 B2
11055639 Cay et al. Jul 2021 B1
11068631 Oh et al. Jul 2021 B2
11070950 Zavesky et al. Jul 2021 B2
11080607 Demtchenko et al. Aug 2021 B1
11086292 Coffman et al. Aug 2021 B2
11087025 Santana de Oliveira et al. Aug 2021 B2
11087055 Hegde et al. Aug 2021 B2
11087861 Takeda et al. Aug 2021 B2
11092694 Cui et al. Aug 2021 B2
11105942 Alwon Aug 2021 B2
11106977 Khomami Abadi et al. Aug 2021 B2
11113611 Han et al. Sep 2021 B2
11113627 Levy Sep 2021 B2
11114183 McNamara et al. Sep 2021 B2
11120913 Dey et al. Sep 2021 B2
11120914 Dey et al. Sep 2021 B2
11126695 Minami et al. Sep 2021 B2
11127488 Bajpai et al. Sep 2021 B1
11128045 Tran et al. Sep 2021 B2
11132621 Botea et al. Sep 2021 B2
11144035 Gupta et al. Oct 2021 B2
11152125 Spiro et al. Oct 2021 B2
11158400 Nichols et al. Oct 2021 B2
11162888 Al Shehri et al. Nov 2021 B2
11162902 Ragan et al. Nov 2021 B2
11170141 Bai et al. Nov 2021 B2
11173477 Zhong et al. Nov 2021 B2
11175250 Vecchio et al. Nov 2021 B2
11176462 Bastas et al. Nov 2021 B1
11182361 Botea et al. Nov 2021 B2
11187826 Laugier et al. Nov 2021 B2
11189362 Liu et al. Nov 2021 B2
11193884 Frenkel et al. Dec 2021 B2
11196503 Lu et al. Dec 2021 B2
11205139 Woodbury Dec 2021 B2
11230741 Sowadski Jan 2022 B2
11232241 Narayanan et al. Jan 2022 B2
11240579 Jumbe et al. Feb 2022 B2
11256995 Bucher et al. Feb 2022 B1
11263534 Prat et al. Mar 2022 B1
11264140 Tal et al. Mar 2022 B1
11267972 Short et al. Mar 2022 B2
11281820 Roberts et al. Mar 2022 B2
11282269 Laugier et al. Mar 2022 B2
11288757 Lingras et al. Mar 2022 B2
11289178 Dey et al. Mar 2022 B2
11294367 Kludt et al. Apr 2022 B2
11294986 Mezzacapo et al. Apr 2022 B2
11301756 Yoon et al. Apr 2022 B2
11308055 Walder et al. Apr 2022 B2
11309063 Dey et al. Apr 2022 B2
11309753 Kaul Apr 2022 B2
11315663 Pappas et al. Apr 2022 B2
11317262 Agostinelli et al. Apr 2022 B2
11320506 Sun et al. May 2022 B2
11327201 Wood et al. May 2022 B2
11330264 Zhou et al. May 2022 B2
11338942 Blomquist May 2022 B2
11341305 Kim et al. May 2022 B2
11342046 Sarmiento et al. May 2022 B2
11342049 Pappas et al. May 2022 B2
11347201 Coffman et al. May 2022 B2
11347810 Kaufman et al. May 2022 B2
11347908 Matusik et al. May 2022 B2
11348664 Kaneko et al. May 2022 B1
11353394 Murphy et al. Jun 2022 B2
11355240 Hirsch et al. Jun 2022 B2
11367006 Kamuntavicius et al. Jun 2022 B1
11373732 Aliper et al. Jun 2022 B2
11379630 Dweik Jul 2022 B2
11379637 Collins et al. Jul 2022 B2
11385887 Schmit et al. Jul 2022 B2
11386541 Al Shehri et al. Jul 2022 B2
11392998 Kwak et al. Jul 2022 B1
11396806 Li et al. Jul 2022 B2
11397895 Lu et al. Jul 2022 B2
11398297 Chang Jul 2022 B2
11403496 Elenes et al. Aug 2022 B2
11404144 Kang et al. Aug 2022 B1
11408898 Farokhzad et al. Aug 2022 B2
11410752 Trice et al. Aug 2022 B2
11416683 Park et al. Aug 2022 B2
11423196 Herring Aug 2022 B2
11424008 Lee et al. Aug 2022 B2
11429662 Malkosh et al. Aug 2022 B2
11429822 Chae Aug 2022 B2
11435360 Farokhzad et al. Sep 2022 B2
11443417 Nipe et al. Sep 2022 B2
11446253 Mitragotri et al. Sep 2022 B2
11449462 Chen et al. Sep 2022 B2
11449708 Sohn et al. Sep 2022 B2
11450225 Kilari et al. Sep 2022 B1
11450407 Laniado et al. Sep 2022 B1
11450410 Yoo et al. Sep 2022 B2
11455439 Mailoa et al. Sep 2022 B2
11455440 Takeda Sep 2022 B2
11461519 Lu et al. Oct 2022 B2
11462303 Elemento et al. Oct 2022 B2
11462304 Lee et al. Oct 2022 B2
11475187 Teplinsky et al. Oct 2022 B2
11475340 Han et al. Oct 2022 B2
11476964 Lu et al. Oct 2022 B2
11481549 McCarthy et al. Oct 2022 B2
11488062 Earthman et al. Nov 2022 B1
11488226 Daware et al. Nov 2022 B2
11491729 Prabha Narra et al. Nov 2022 B2
11493475 Suram et al. Nov 2022 B2
11495326 Liu et al. Nov 2022 B2
11501037 Gecer Ulu et al. Nov 2022 B2
11501042 Steingrimsson et al. Nov 2022 B2
11501195 Rose et al. Nov 2022 B2
11501854 Morieux et al. Nov 2022 B2
11508463 Kubis et al. Nov 2022 B2
11510405 Grant Nov 2022 B2
11511491 Dheeradhada et al. Nov 2022 B2
11512345 Lee et al. Nov 2022 B1
11520310 Zubarev et al. Dec 2022 B2
11520953 Lill et al. Dec 2022 B2
11521711 Murthy Dec 2022 B2
11535954 Czinner et al. Dec 2022 B2
11537898 Hegde et al. Dec 2022 B2
11538591 Dweik Dec 2022 B2
11539587 Magzimof et al. Dec 2022 B2
11545238 Greving et al. Jan 2023 B2
11545239 Zhang et al. Jan 2023 B1
11551037 Gavranovic et al. Jan 2023 B2
11551083 Li et al. Jan 2023 B2
11553075 Hwang et al. Jan 2023 B2
11558451 Sgobba et al. Jan 2023 B2
11562226 Saito Jan 2023 B2
11562807 Maiti et al. Jan 2023 B2
11567086 Farokhzad et al. Jan 2023 B2
11570030 Sahin et al. Jan 2023 B2
11574168 Yan Feb 2023 B1
11574253 Santos et al. Feb 2023 B2
11574702 Jafri et al. Feb 2023 B2
11574703 Abeliuk et al. Feb 2023 B2
11578481 Kohut Feb 2023 B1
11581067 Kwon et al. Feb 2023 B2
11581965 O'Shea et al. Feb 2023 B2
11586161 Lammens Feb 2023 B2
11586172 Lobo Fenoglietto et al. Feb 2023 B2
11586968 King et al. Feb 2023 B2
11586982 Hegde Feb 2023 B2
11587643 Lee et al. Feb 2023 B2
11587645 Amimeur et al. Feb 2023 B2
11587646 Colby et al. Feb 2023 B2
11590634 Beacham, Jr. et al. Feb 2023 B2
11593814 Routray et al. Feb 2023 B2
11594305 Tregger et al. Feb 2023 B2
11596917 Woods et al. Mar 2023 B2
11599794 Yan Mar 2023 B1
11604984 Sharma et al. Mar 2023 B2
11610132 Hewage et al. Mar 2023 B2
11610139 Bucher et al. Mar 2023 B2
11610238 Kwak et al. Mar 2023 B1
11615324 Pabrinkis et al. Mar 2023 B2
11621059 Miao et al. Apr 2023 B2
11629593 Knight et al. Apr 2023 B2
11630057 Murphy et al. Apr 2023 B2
11636395 Dupont De Dinechin Apr 2023 B2
11645435 Van der Velden May 2023 B2
11650348 Perkins et al. May 2023 B2
11651122 Chen May 2023 B2
11651838 Narayanan et al. May 2023 B2
11651839 Sankaranarayanan et al. May 2023 B2
11651841 Oskooei et al. May 2023 B2
11651860 Oskooei et al. May 2023 B2
11663462 Wang et al. May 2023 B2
11664093 Denmark et al. May 2023 B2
11664094 Lin et al. May 2023 B2
11664690 Kaul May 2023 B2
11666598 Davenport Huyer et al. Jun 2023 B2
11669063 De Waele et al. Jun 2023 B2
11669781 Han Jun 2023 B2
11670042 Boubekeur et al. Jun 2023 B2
11670403 Kim et al. Jun 2023 B2
11675334 Zubarev et al. Jun 2023 B2
11680063 Polykovskiy et al. Jun 2023 B2
11681775 Babbush Jun 2023 B2
11681953 Drake et al. Jun 2023 B2
11693388 Coffman et al. Jul 2023 B2
11696735 Buckler et al. Jul 2023 B2
11698623 Coffman et al. Jul 2023 B2
11699505 Kanamarlapudi et al. Jul 2023 B2
11704541 Li et al. Jul 2023 B2
11710045 Lee Jul 2023 B2
11710049 Tal et al. Jul 2023 B2
11710542 Bowman Jul 2023 B2
11714933 Dweik Aug 2023 B2
11721413 Tagade et al. Aug 2023 B2
11727282 Feinberg et al. Aug 2023 B2
11728011 Tavernelli et al. Aug 2023 B2
11728012 Pappas et al. Aug 2023 B2
11731317 Stewart et al. Aug 2023 B1
11734387 Mezzacapo et al. Aug 2023 B2
11735291 Stober et al. Aug 2023 B2
11735292 Kishimoto et al. Aug 2023 B2
11742057 Laniado et al. Aug 2023 B2
11742060 Stec et al. Aug 2023 B2
11747314 Choi et al. Sep 2023 B2
11747480 Goldstein et al. Sep 2023 B2
11748640 Kudva et al. Sep 2023 B2
11754536 Kassis et al. Sep 2023 B2
11763181 Rothstein et al. Sep 2023 B2
11776666 Neukart et al. Oct 2023 B2
11782396 Lovell et al. Oct 2023 B2
11787947 Knowlton et al. Oct 2023 B2
11790044 Elenes et al. Oct 2023 B2
11790264 Duerig et al. Oct 2023 B2
11791018 Kolouri et al. Oct 2023 B1
11797744 Chuang et al. Oct 2023 B1
11798655 Hama Oct 2023 B2
11798657 Bhavnagri Oct 2023 B2
11798658 Song et al. Oct 2023 B2
11803522 Nishiuchi et al. Oct 2023 B2
11816122 He et al. Nov 2023 B1
11816578 Yoon et al. Nov 2023 B2
11823070 Zahn et al. Nov 2023 B2
11824275 Tran et al. Nov 2023 B2
11827381 Blomquist Nov 2023 B2
11829390 Fu Nov 2023 B2
11829692 Zorian et al. Nov 2023 B1
11836109 Chen et al. Dec 2023 B2
11836633 Nemirovsky et al. Dec 2023 B2
11837327 Westcott et al. Dec 2023 B2
11837333 Shuang et al. Dec 2023 B1
11842794 Luo et al. Dec 2023 B2
11842800 Das et al. Dec 2023 B2
11847532 Drake et al. Dec 2023 B2
11848076 Lee et al. Dec 2023 B2
11852598 Aguiar Dec 2023 B2
11853032 Chan et al. Dec 2023 B2
11854670 Georgopoulos et al. Dec 2023 B2
11854671 Rong et al. Dec 2023 B2
11854672 Kwon et al. Dec 2023 B2
11861880 Cebulski et al. Jan 2024 B2
11862300 Schmidt et al. Jan 2024 B1
11869629 Laniado et al. Jan 2024 B2
11869756 Shinagawa et al. Jan 2024 B2
11891882 Zhang Feb 2024 B2
11893326 Daware et al. Feb 2024 B2
11893498 Aliper et al. Feb 2024 B2
11894107 Setia et al. Feb 2024 B2
11896003 Grant Feb 2024 B2
11897818 Bauchy et al. Feb 2024 B2
11900191 Church Feb 2024 B2
11900225 Oono et al. Feb 2024 B2
11900277 Thomsen et al. Feb 2024 B2
11900582 Choi et al. Feb 2024 B2
11901045 Katsuki Feb 2024 B2
11906424 Jarrahi et al. Feb 2024 B2
11907812 Yang et al. Feb 2024 B2
11914931 Kumar et al. Feb 2024 B2
11915103 McClean Feb 2024 B2
11915105 Steingrimsson et al. Feb 2024 B2
11915108 Kabir et al. Feb 2024 B2
11915798 Jippo Feb 2024 B2
11915799 Minami et al. Feb 2024 B2
11923050 Pyzer-Knapp et al. Mar 2024 B2
11928182 Arici et al. Mar 2024 B1
11933453 Swift et al. Mar 2024 B2
11934360 Nishiuchi et al. Mar 2024 B2
11934929 Woodbury Mar 2024 B2
11934938 Hara et al. Mar 2024 B2
11940488 Chism, II Mar 2024 B2
11942191 Rong et al. Mar 2024 B2
11942192 Tavernelli et al. Mar 2024 B2
11945994 Jandhyala et al. Apr 2024 B1
11947882 Dweik et al. Apr 2024 B2
11948665 Madani et al. Apr 2024 B2
11955208 Elemento et al. Apr 2024 B2
11960518 Kappel Apr 2024 B2
11961595 Madrid et al. Apr 2024 B2
11967400 Lee et al. Apr 2024 B2
11967434 Dweik et al. Apr 2024 B2
20020081516 Yoon Jun 2002 A1
20030014191 Agrafiotis et al. Jan 2003 A1
20030171939 Yagesh et al. Sep 2003 A1
20040088118 Jensen et al. May 2004 A1
20040103218 Blumrich et al. May 2004 A1
20040117164 Elling et al. Jun 2004 A1
20050046584 Breed Mar 2005 A1
20050065732 Tilton et al. Mar 2005 A1
20050080502 Chernyak et al. Apr 2005 A1
20050089923 Levinson et al. Apr 2005 A9
20050118637 Levinson et al. Jun 2005 A9
20050148346 Maloney et al. Jul 2005 A1
20050228511 Das et al. Oct 2005 A1
20050240355 Brown et al. Oct 2005 A1
20050278124 Duffy et al. Dec 2005 A1
20060031027 Alman Feb 2006 A1
20060040322 Archetti et al. Feb 2006 A1
20060136186 Benight et al. Jun 2006 A1
20060167595 Breed et al. Jul 2006 A1
20060208169 Breed et al. Sep 2006 A1
20060217864 Johnson et al. Sep 2006 A1
20060218107 Young Sep 2006 A1
20070043511 Jensen et al. Feb 2007 A1
20070061120 Akkaram et al. Mar 2007 A1
20070085697 Breed Apr 2007 A1
20070086624 Breed et al. Apr 2007 A1
20070100565 Gosse et al. May 2007 A1
20070177437 Guo Aug 2007 A1
20070178561 Anderson et al. Aug 2007 A1
20070202038 Yaghi et al. Aug 2007 A1
20070208436 Das et al. Sep 2007 A1
20070235592 Horn et al. Oct 2007 A1
20070240242 Modiano et al. Oct 2007 A1
20070254307 Kita Nov 2007 A1
20070276610 Korenberg Nov 2007 A1
20080010027 Alman Jan 2008 A1
20080104001 Kipp May 2008 A1
20080157940 Breed et al. Jul 2008 A1
20080170338 Guo et al. Jul 2008 A1
20080248811 Maloney et al. Oct 2008 A1
20090089078 Bursey Apr 2009 A1
20090112489 Ghaboussi et al. Apr 2009 A1
20090157419 Bursey Jun 2009 A1
20090182542 Hilton et al. Jul 2009 A9
20090259607 Fukunishi et al. Oct 2009 A1
20090259713 Blumrich et al. Oct 2009 A1
20100010946 De Winter et al. Jan 2010 A1
20100132549 Yaghi et al. Jun 2010 A1
20100152953 Hamilton Jun 2010 A1
20100161531 Duffy Jun 2010 A1
20100179934 Howley et al. Jul 2010 A1
20110066414 Mills Mar 2011 A1
20110161361 Csanyi et al. Jun 2011 A1
20110166039 Tang et al. Jul 2011 A1
20110172931 Murthy Jul 2011 A1
20110257023 Gustafsson et al. Oct 2011 A1
20120013334 Sheiretov et al. Jan 2012 A1
20120023948 Janson Feb 2012 A1
20120116742 Prakash et al. May 2012 A1
20120221501 Duffy Aug 2012 A1
20120311299 Blumrich et al. Dec 2012 A1
20130023402 Yaghi et al. Jan 2013 A1
20130035923 Chen et al. Feb 2013 A1
20130073221 Attinger et al. Mar 2013 A1
20130112618 Diallo et al. May 2013 A1
20130138338 Behara et al. May 2013 A1
20130252280 Weaver et al. Sep 2013 A1
20130303387 Sander et al. Nov 2013 A1
20140100912 Bursey Apr 2014 A1
20140236548 Conduit et al. Aug 2014 A1
20140297201 Knorr et al. Oct 2014 A1
20140297546 Birdwell et al. Oct 2014 A1
20150120126 So et al. Apr 2015 A1
20150124999 Ren et al. May 2015 A1
20150134315 Sarmiento et al. May 2015 A1
20150142398 Miller, III et al. May 2015 A1
20150151000 Khanna Jun 2015 A1
20150177906 Yairi et al. Jun 2015 A1
20150269313 Church Sep 2015 A1
20150310162 Okuno et al. Oct 2015 A1
20150317344 Birdwell et al. Nov 2015 A1
20160034614 Wang et al. Feb 2016 A1
20160092660 Martinis et al. Mar 2016 A1
20160147936 Vendruscolo et al. May 2016 A1
20160188771 Michalski Jun 2016 A1
20160225370 Kannan Aug 2016 A1
20160358055 Church Dec 2016 A1
20170039469 Majumdar et al. Feb 2017 A1
20170069009 Bursey Mar 2017 A1
20170115646 Chee et al. Apr 2017 A1
20170116517 Chee et al. Apr 2017 A1
20170193200 Hsu et al. Jul 2017 A1
20170204405 Cope et al. Jul 2017 A1
20170211206 Cope Jul 2017 A1
20170300839 Bursey Oct 2017 A1
20170308856 Bursey Oct 2017 A1
20170308946 Bursey Oct 2017 A1
20180018408 Matsumura et al. Jan 2018 A1
20180071693 Diallo et al. Mar 2018 A1
20180113974 Boday et al. Apr 2018 A1
20180121478 Walder et al. May 2018 A1
20180157994 Levy Jun 2018 A1
20180172694 Farokhzad et al. Jun 2018 A1
20180181144 Steinmann Jun 2018 A1
20180196778 Glaser et al. Jul 2018 A1
20180252087 Dinariev et al. Sep 2018 A1
20180284815 Cui et al. Oct 2018 A1
20180373826 Klimeck et al. Dec 2018 A1
20190018933 Oono et al. Jan 2019 A1
20190064074 Ragan et al. Feb 2019 A1
20190064110 Timp et al. Feb 2019 A1
20190065968 Han et al. Feb 2019 A1
20190087529 Steingrimsson et al. Mar 2019 A1
20190121665 Clancy Apr 2019 A1
20190171928 Young Jun 2019 A1
20190189250 Eiler Jun 2019 A1
20190228304 Saito Jul 2019 A1
20190228843 Hou et al. Jul 2019 A1
20190236489 Koudal et al. Aug 2019 A1
20190250586 Fenoglietto et al. Aug 2019 A1
20190251459 Han et al. Aug 2019 A1
20190253900 Narasimha et al. Aug 2019 A1
20190258909 Church Aug 2019 A1
20190259474 Wang et al. Aug 2019 A1
20190278880 Ma et al. Sep 2019 A1
20190286169 Cui et al. Sep 2019 A1
20190295685 Elemento et al. Sep 2019 A1
20190303780 Spangler et al. Oct 2019 A1
20190304568 Wei et al. Oct 2019 A1
20190311781 Stratford et al. Oct 2019 A1
20190312779 Magzimof et al. Oct 2019 A1
20190315497 Blomquist Oct 2019 A1
20190333604 Weaver et al. Oct 2019 A1
20190340318 Melchionna Nov 2019 A1
20190347526 Sunkavalli et al. Nov 2019 A1
20200003678 Wolf et al. Jan 2020 A1
20200003682 Frenkel et al. Jan 2020 A1
20200058376 Dean et al. Feb 2020 A1
20200072744 Al Shehri et al. Mar 2020 A1
20200074616 Al Shehri et al. Mar 2020 A1
20200098449 Simonetta et al. Mar 2020 A1
20200098450 Uesawa Mar 2020 A1
20200104465 Martin et al. Apr 2020 A1
20200118650 Yamada et al. Apr 2020 A1
20200167439 Mailoa et al. May 2020 A1
20200168291 Chowdhury et al. May 2020 A1
20200168300 Goddard, III et al. May 2020 A1
20200168302 Isayev et al. May 2020 A1
20200176088 Kanamarlapudi et al. Jun 2020 A1
20200184381 Persikov et al. Jun 2020 A1
20200201952 Kim et al. Jun 2020 A1
20200210056 Steppan et al. Jul 2020 A1
20200210635 Washburn et al. Jul 2020 A1
20200217777 Al Shehri et al. Jul 2020 A1
20200224035 Knowlton et al. Jul 2020 A1
20200227143 Katsuki Jul 2020 A1
20200234789 DeGrado et al. Jul 2020 A1
20200243165 Katsuki Jul 2020 A1
20200243166 Tsumura et al. Jul 2020 A1
20200251941 Kaul Aug 2020 A1
20200257933 Steingrimsson et al. Aug 2020 A1
20200258598 Liu et al. Aug 2020 A1
20200272702 Takeda Aug 2020 A1
20200272872 Church Aug 2020 A1
20200279148 Motoki et al. Sep 2020 A1
20200283165 Krishnamoorthy et al. Sep 2020 A1
20200289421 Mitragotri et al. Sep 2020 A1
20200294630 Miller et al. Sep 2020 A1
20200302100 Teplinsky et al. Sep 2020 A1
20200303042 Fuji et al. Sep 2020 A1
20200304956 Zavesky et al. Sep 2020 A1
20200320386 Filippov et al. Oct 2020 A1
20200320402 Yoon et al. Oct 2020 A1
20200340970 Koseoglu et al. Oct 2020 A1
20200342511 Bursey Oct 2020 A1
20200342953 Morrone et al. Oct 2020 A1
20200349451 Suzuki et al. Nov 2020 A1
20200358187 Tran et al. Nov 2020 A1
20200372369 Gong et al. Nov 2020 A1
20200381085 Jippo Dec 2020 A1
20200387818 Chan et al. Dec 2020 A1
20200387831 Oono et al. Dec 2020 A1
20200395099 Meyer et al. Dec 2020 A1
20200401113 Yuan et al. Dec 2020 A1
20200410288 Capota et al. Dec 2020 A1
20200411140 Pappas et al. Dec 2020 A1
20210008100 Davenport Huyer et al. Jan 2021 A1
20210012862 Plumbley et al. Jan 2021 A1
20210027860 Zhang et al. Jan 2021 A1
20210027862 Wei et al. Jan 2021 A1
20210027864 Plumbley et al. Jan 2021 A1
20210045379 Grant Feb 2021 A1
20210056678 Al Shehri et al. Feb 2021 A1
20210057050 Zavoronkovs et al. Feb 2021 A1
20210064801 Dweik et al. Mar 2021 A1
20210065305 Stevenson et al. Mar 2021 A1
20210065844 Merril Mar 2021 A1
20210065853 Lyding et al. Mar 2021 A1
20210065913 Yuan et al. Mar 2021 A1
20210072255 Farokhzad et al. Mar 2021 A1
20210081804 Stojevic et al. Mar 2021 A1
20210081834 Hegde Mar 2021 A1
20210082542 Bhavnagri Mar 2021 A1
20210090690 Plumbley et al. Mar 2021 A1
20210097211 Beck et al. Apr 2021 A1
20210098074 Wu et al. Apr 2021 A1
20210098083 Ma et al. Apr 2021 A1
20210098084 Park et al. Apr 2021 A1
20210103822 Hegde et al. Apr 2021 A1
20210104302 Bochevarov et al. Apr 2021 A1
20210110307 Wakasugi et al. Apr 2021 A1
20210110892 Kwon et al. Apr 2021 A1
20210117869 Plumbley et al. Apr 2021 A1
20210119158 Novotny Apr 2021 A1
20210125691 Wlodarczyk-Pruszynski et al. Apr 2021 A1
20210129106 Tabbi et al. May 2021 A1
20210133590 Amroabadi et al. May 2021 A1
20210133635 Hagawa et al. May 2021 A1
20210150330 Sharma et al. May 2021 A1
20210150402 Lienhard et al. May 2021 A1
20210162390 Zhong et al. Jun 2021 A1
20210166194 Ling et al. Jun 2021 A1
20210166791 Hong et al. Jun 2021 A1
20210173117 Laugier et al. Jun 2021 A1
20210174903 Rothberg et al. Jun 2021 A1
20210174906 Ul Ain et al. Jun 2021 A1
20210174908 Benjamin et al. Jun 2021 A1
20210174909 Rothberg et al. Jun 2021 A1
20210174910 Kwon et al. Jun 2021 A1
20210183476 Mitarai et al. Jun 2021 A1
20210191381 Bharadwaj et al. Jun 2021 A1
20210193259 Bikard et al. Jun 2021 A1
20210194768 Magzimof et al. Jun 2021 A1
20210200915 Kumar et al. Jul 2021 A1
20210201090 Xu et al. Jul 2021 A1
20210202047 Kang et al. Jul 2021 A1
20210210202 Awiszus et al. Jul 2021 A1
20210216900 Higgott et al. Jul 2021 A1
20210217498 Pae et al. Jul 2021 A1
20210224970 Roffilli Jul 2021 A1
20210225455 Chowdhury et al. Jul 2021 A1
20210233618 Thompson-Colón et al. Jul 2021 A1
20210233620 Cronin Jul 2021 A1
20210233621 Zavoronkovs et al. Jul 2021 A1
20210241059 Church Aug 2021 A1
20210241176 Yoo et al. Aug 2021 A1
20210241858 Kurita et al. Aug 2021 A1
20210249104 Madani et al. Aug 2021 A1
20210249105 Madani et al. Aug 2021 A1
20210249108 Lee et al. Aug 2021 A1
20210256394 Tymoshenko et al. Aug 2021 A1
20210264080 Ramprasad et al. Aug 2021 A1
20210265023 Tabbi et al. Aug 2021 A1
20210279218 Walder et al. Sep 2021 A1
20210280277 Matsuda et al. Sep 2021 A1
20210284695 Rocklin et al. Sep 2021 A1
20210287137 Park et al. Sep 2021 A1
20210287762 Erez Sep 2021 A1
20210287763 Sharma Sep 2021 A1
20210293381 Vinod Muthachikavil et al. Sep 2021 A1
20210293801 Farokhzad et al. Sep 2021 A1
20210294301 Flitsch et al. Sep 2021 A1
20210295167 Hill Sep 2021 A1
20210303290 Schmit Sep 2021 A1
20210303757 Pandey et al. Sep 2021 A1
20210303762 Ristoski et al. Sep 2021 A1
20210303971 Ranade et al. Sep 2021 A1
20210304847 Senior et al. Sep 2021 A1
20210304851 Schlifke Sep 2021 A1
20210304852 Ristoski et al. Sep 2021 A1
20210304853 Branson et al. Sep 2021 A1
20210304854 Lee et al. Sep 2021 A1
20210311039 Farokhzad et al. Oct 2021 A1
20210311040 Farokhzad et al. Oct 2021 A1
20210311064 Farokhzad et al. Oct 2021 A1
20210313008 Senior et al. Oct 2021 A1
20210313015 Sukegawa et al. Oct 2021 A1
20210318321 Farokhzad et al. Oct 2021 A1
20210318670 Cunningham Oct 2021 A1
20210319098 Pogorelik et al. Oct 2021 A1
20210319146 Reinhart et al. Oct 2021 A1
20210319336 Yano Oct 2021 A1
20210319847 Min et al. Oct 2021 A1
20210326755 Hashimoto et al. Oct 2021 A1
20210334655 Obika et al. Oct 2021 A1
20210342508 Arroyave et al. Nov 2021 A1
20210345939 Jumbe et al. Nov 2021 A1
20210349041 Gettemy et al. Nov 2021 A1
20210350312 Swift et al. Nov 2021 A1
20210357555 Liu et al. Nov 2021 A1
20210358205 Laugier et al. Nov 2021 A1
20210358564 Feinberg et al. Nov 2021 A1
20210363183 Das et al. Nov 2021 A1
20210366580 Das et al. Nov 2021 A1
20210366581 Lee et al. Nov 2021 A1
20210372561 Swift et al. Dec 2021 A1
20210372994 Metzger et al. Dec 2021 A1
20210374295 Beck et al. Dec 2021 A1
20210374551 Vijil et al. Dec 2021 A1
20210375402 Jin et al. Dec 2021 A1
20210375403 Onishi et al. Dec 2021 A1
20210381992 Aguiar Dec 2021 A1
20210382184 Cui et al. Dec 2021 A1
20210383898 Kuznetsov et al. Dec 2021 A1
20210385865 Mueck et al. Dec 2021 A1
20210391037 Lotrich et al. Dec 2021 A1
20210391038 Sukegawa et al. Dec 2021 A1
20210397978 Pae et al. Dec 2021 A1
20210398018 Dao et al. Dec 2021 A1
20210398621 Stojevic et al. Dec 2021 A1
20210407625 Senior et al. Dec 2021 A1
20210409335 Zhu et al. Dec 2021 A1
20220004887 Spratt et al. Jan 2022 A1
20220005548 Redei et al. Jan 2022 A1
20220009966 Das et al. Jan 2022 A1
20220013197 Walsh et al. Jan 2022 A1
20220014946 Merwaday et al. Jan 2022 A1
20220014963 Yeh et al. Jan 2022 A1
20220020454 Pae et al. Jan 2022 A1
20220027374 Brown et al. Jan 2022 A1
20220027759 Tabbi et al. Jan 2022 A1
20220028499 Tsumura et al. Jan 2022 A1
20220032215 Blackman et al. Feb 2022 A1
20220032256 Lackey et al. Feb 2022 A1
20220038554 Merwaday et al. Feb 2022 A1
20220038902 Mueck Feb 2022 A1
20220044767 Rong et al. Feb 2022 A1
20220044769 Ramprasad et al. Feb 2022 A1
20220045425 Tran et al. Feb 2022 A1
20220051141 Kabir et al. Feb 2022 A1
20220051759 Brereton et al. Feb 2022 A1
20220052753 Speidel Feb 2022 A1
20220055997 Akabayov Feb 2022 A1
20220057519 Goldstein et al. Feb 2022 A1
20220058865 Beltrand Feb 2022 A1
20220059196 Lee et al. Feb 2022 A1
20220063986 Suresh et al. Mar 2022 A1
20220064634 Rickerby et al. Mar 2022 A1
20220067247 Suresh et al. Mar 2022 A1
20220067249 Steingrimsson Mar 2022 A1
20220068162 Thöne et al. Mar 2022 A1
20220068440 Mrziglod et al. Mar 2022 A1
20220068441 Tsumura et al. Mar 2022 A1
20220068442 Yang et al. Mar 2022 A1
20220072593 Fujita et al. Mar 2022 A1
20220076137 Hoffman et al. Mar 2022 A1
20220081472 Greving et al. Mar 2022 A1
20220083700 Takagi et al. Mar 2022 A1
20220084140 Daczko et al. Mar 2022 A1
20220084627 Roy et al. Mar 2022 A1
20220086218 Sabella et al. Mar 2022 A1
20220091571 Ivanov et al. Mar 2022 A1
20220100932 Nakatsuji et al. Mar 2022 A1
20220101276 Banatao et al. Mar 2022 A1
20220101277 Banatao et al. Mar 2022 A1
20220101954 Wang et al. Mar 2022 A1
20220101972 Bajpai et al. Mar 2022 A1
20220103922 Jumbe et al. Mar 2022 A1
20220108047 Cheng et al. Apr 2022 A1
20220108175 Lyske et al. Apr 2022 A1
20220108765 Teshima et al. Apr 2022 A1
20220119318 Kayello et al. Apr 2022 A1
20220121939 Evans et al. Apr 2022 A1
20220122697 Liu et al. Apr 2022 A1
20220129600 Roberts et al. Apr 2022 A1
20220130033 Rashidi et al. Apr 2022 A1
20220130490 Min et al. Apr 2022 A1
20220130494 Woodbury et al. Apr 2022 A1
20220130495 Li et al. Apr 2022 A1
20220130496 Li et al. Apr 2022 A1
20220139504 Wiltschko et al. May 2022 A1
20220156440 Masuko et al. May 2022 A1
20220157193 Winter et al. May 2022 A1
20220157403 Mason et al. May 2022 A1
20220157407 Akiyama et al. May 2022 A1
20220164501 Nosanow et al. May 2022 A1
20220164627 Friedensohn et al. May 2022 A1
20220164685 Shioga May 2022 A1
20220165359 Lee et al. May 2022 A1
20220165364 Qiao et al. May 2022 A1
20220165366 Zubarev et al. May 2022 A1
20220165367 Priyakumar et al. May 2022 A1
20220169865 Short et al. Jun 2022 A1
20220170900 Choi et al. Jun 2022 A1
20220171353 Ramsundar Jun 2022 A1
20220172803 Fuchiwaki et al. Jun 2022 A1
20220179400 Deodhar et al. Jun 2022 A1
20220180975 Regev et al. Jun 2022 A1
20220180977 Kim Jun 2022 A1
20220180978 Burnham et al. Jun 2022 A1
20220180991 Peters Jun 2022 A1
20220189578 Takeda Jun 2022 A1
20220190243 Bagheri et al. Jun 2022 A1
20220196620 Godin et al. Jun 2022 A1
20220198106 Montoya et al. Jun 2022 A1
20220198280 Yoon et al. Jun 2022 A1
20220198286 Prat et al. Jun 2022 A1
20220198330 Zhang et al. Jun 2022 A1
20220207218 Lu et al. Jun 2022 A1
20220207370 Motoki Jun 2022 A1
20220207393 Umezawa et al. Jun 2022 A1
20220208311 Kim Jun 2022 A1
20220208540 Behsaz et al. Jun 2022 A1
20220210626 Agostinelli et al. Jun 2022 A1
20220214810 Adams et al. Jul 2022 A1
20220215233 Buehler et al. Jul 2022 A1
20220223234 Asahara et al. Jul 2022 A1
20220226922 Albrecht et al. Jul 2022 A1
20220230712 Sheberla et al. Jul 2022 A1
20220230713 Maragakis et al. Jul 2022 A1
20220238179 Sarmiento et al. Jul 2022 A1
20220238189 Kim et al. Jul 2022 A1
20220238190 Spagnoli Jul 2022 A1
20220238191 Fan et al. Jul 2022 A1
20220242597 Mukae Aug 2022 A1
20220245188 Kappel Aug 2022 A1
20220246239 Cho et al. Aug 2022 A1
20220246244 Kappel Aug 2022 A1
20220246252 Stache et al. Aug 2022 A1
20220253669 Teramoto et al. Aug 2022 A1
20220254456 Lingenfelser et al. Aug 2022 A1
20220261510 Takemoto et al. Aug 2022 A1
20220262463 Thompson-Colón Aug 2022 A1
20220270705 Vijil et al. Aug 2022 A1
20220270706 Vijil et al. Aug 2022 A1
20220270711 Feala et al. Aug 2022 A1
20220270713 Spagnoli Aug 2022 A1
20220270714 Okamoto et al. Aug 2022 A1
20220272084 Hyatt Aug 2022 A1
20220275714 Madasu et al. Sep 2022 A1
20220277224 Akiyama et al. Sep 2022 A1
20220277815 Hosoumi et al. Sep 2022 A1
20220281619 Blomquist Sep 2022 A1
20220284990 Chi et al. Sep 2022 A1
20220284991 Tabbi et al. Sep 2022 A1
20220291405 Silveira de Albuquerque Martins et al. Sep 2022 A1
20220292229 Aonuma et al. Sep 2022 A1
20220292762 Boubekeur et al. Sep 2022 A1
20220293216 Park et al. Sep 2022 A1
20220293223 Ren et al. Sep 2022 A1
20220293225 Park et al. Sep 2022 A1
20220301662 Yamano et al. Sep 2022 A1
20220302776 Kaul Sep 2022 A1
20220306476 Cao et al. Sep 2022 A1
20220307997 Meijer et al. Sep 2022 A1
20220310211 Jippo et al. Sep 2022 A1
20220310213 Noh et al. Sep 2022 A1
20220318658 Ivankin et al. Oct 2022 A1
20220319634 Kleber Oct 2022 A1
20220323924 Lackey et al. Oct 2022 A1
20220323935 Fairen-Jimenez et al. Oct 2022 A1
20220328141 Gedeck et al. Oct 2022 A1
20220332350 Jha et al. Oct 2022 A1
20220335281 Spieker et al. Oct 2022 A1
20220336056 Hamp et al. Oct 2022 A1
20220336057 Hamp et al. Oct 2022 A1
20220348903 Ranganathan et al. Nov 2022 A1
20220351053 Norvaisas et al. Nov 2022 A1
20220351056 de Bayser et al. Nov 2022 A1
20220351808 Clyde et al. Nov 2022 A1
20220351809 Kim et al. Nov 2022 A1
20220358438 Asahara et al. Nov 2022 A1
20220359045 Manica et al. Nov 2022 A1
20220359046 Arneault et al. Nov 2022 A1
20220359047 Kanazawa et al. Nov 2022 A1
20220365096 Farokhzad et al. Nov 2022 A1
20220366232 Vija et al. Nov 2022 A1
20220372068 Kim et al. Nov 2022 A1
20220372643 Wang et al. Nov 2022 A1
20220374334 Brown et al. Nov 2022 A1
20220374336 Brown et al. Nov 2022 A1
20220374337 Brown Nov 2022 A1
20220374338 Brown et al. Nov 2022 A1
20220374339 Brown Nov 2022 A1
20220374344 Brown Nov 2022 A1
20220374721 Agarwal et al. Nov 2022 A1
20220375538 Das et al. Nov 2022 A1
20220382938 Ito et al. Dec 2022 A1
20220383064 Li et al. Dec 2022 A1
20220383989 Jonas Dec 2022 A1
20220383990 Zhang Dec 2022 A1
20220383992 Triendl et al. Dec 2022 A1
20220383993 Yoo et al. Dec 2022 A1
20220383994 Rabideau Dec 2022 A1
20220384058 Lee et al. Dec 2022 A1
20220389511 Kelley Dec 2022 A1
20220391699 Hanaoka Dec 2022 A1
20220392580 Elemento et al. Dec 2022 A1
20220392583 Godin et al. Dec 2022 A1
20220392584 Hanaoka Dec 2022 A1
20220392585 Zhang et al. Dec 2022 A1
20220397886 Hong et al. Dec 2022 A1
20220397917 Arksey et al. Dec 2022 A1
20220398806 Arksey et al. Dec 2022 A1
20220399082 Lee et al. Dec 2022 A1
20220399083 Ayral et al. Dec 2022 A1
20220399085 Bowden, Jr. et al. Dec 2022 A1
20220399936 Arksey et al. Dec 2022 A1
20220404361 Sabry et al. Dec 2022 A1
20220405563 Noh et al. Dec 2022 A1
20220405654 Komikawa et al. Dec 2022 A1
20220406403 Singh et al. Dec 2022 A1
20220406404 Kuznetsov et al. Dec 2022 A1
20220406412 Segler et al. Dec 2022 A1
20220406416 Muthiah Ravinson et al. Dec 2022 A1
20220406417 Kaneko et al. Dec 2022 A1
20220407001 Takeuchi et al. Dec 2022 A1
20220414499 Hosoumi et al. Dec 2022 A1
20220415433 Xu et al. Dec 2022 A1
20220415446 Lee et al. Dec 2022 A1
20220415450 Nguyen et al. Dec 2022 A1
20220415452 Ye et al. Dec 2022 A1
20220415453 Ronneberger et al. Dec 2022 A1
20230004142 Cetinkaya Jan 2023 A1
20230005128 Niederhoefer et al. Jan 2023 A1
20230005572 Chen et al. Jan 2023 A1
20230009725 McDaniel et al. Jan 2023 A1
20230018216 Lu Jan 2023 A1
20230018537 Brandsma et al. Jan 2023 A1
20230019202 Chen et al. Jan 2023 A1
20230023641 Rosenfeld et al. Jan 2023 A1
20230027514 Ma et al. Jan 2023 A1
20230027989 Takakuwa et al. Jan 2023 A1
20230028046 Xing et al. Jan 2023 A1
20230029474 Wade et al. Feb 2023 A1
20230032092 Teplinsky et al. Feb 2023 A1
20230034425 Laniado et al. Feb 2023 A1
20230037091 Jandhyala et al. Feb 2023 A1
20230037388 Sakhinana et al. Feb 2023 A1
20230038256 Tal et al. Feb 2023 A1
20230040576 Laniado et al. Feb 2023 A1
20230040805 Mitragotri et al. Feb 2023 A1
20230041431 Poon et al. Feb 2023 A1
20230043363 Neumann Barros Ferreira et al. Feb 2023 A1
20230043540 Yu et al. Feb 2023 A1
20230044622 Grant Feb 2023 A1
20230045690 Sakhinana et al. Feb 2023 A1
20230049157 Sawlani et al. Feb 2023 A1
20230050156 Yu et al. Feb 2023 A1
20230050627 Sattarov et al. Feb 2023 A1
20230051669 Johri et al. Feb 2023 A1
20230052677 Eser et al. Feb 2023 A1
20230054552 Yang et al. Feb 2023 A1
20230054582 Kishimoto et al. Feb 2023 A1
20230057311 Moeykens Feb 2023 A1
20230061483 Alexander et al. Mar 2023 A1
20230063171 Kwon et al. Mar 2023 A1
20230073351 Akiva et al. Mar 2023 A1
20230075100 Zavoronkovs et al. Mar 2023 A1
20230076608 Kajino Mar 2023 A1
20230076840 Farokhzad et al. Mar 2023 A1
20230078275 Kubis et al. Mar 2023 A1
20230081412 Fu et al. Mar 2023 A1
20230081583 Kanazawa et al. Mar 2023 A1
20230088979 Neogi et al. Mar 2023 A1
20230093875 Mitragotri et al. Mar 2023 A1
20230095631 Ganeshan et al. Mar 2023 A1
20230095685 Greving et al. Mar 2023 A1
20230098398 Xu et al. Mar 2023 A1
20230100584 Diedam et al. Mar 2023 A1
20230103487 Byrnes et al. Apr 2023 A1
20230104058 Hopfmueller et al. Apr 2023 A1
20230105422 Pickles et al. Apr 2023 A1
20230105998 Yakovenko et al. Apr 2023 A1
20230111521 Singh et al. Apr 2023 A1
20230113207 Woo et al. Apr 2023 A1
20230115171 Singh et al. Apr 2023 A1
20230115719 Sakhinana et al. Apr 2023 A1
20230115984 Chen et al. Apr 2023 A1
20230116680 Sakhinana et al. Apr 2023 A1
20230117325 Osakabe et al. Apr 2023 A1
20230118842 Jafri et al. Apr 2023 A1
20230122101 Kim et al. Apr 2023 A1
20230129485 Pereyaslavets et al. Apr 2023 A1
20230130619 Ma et al. Apr 2023 A1
20230131234 Jastrzebski et al. Apr 2023 A1
20230134595 Sakhinana et al. May 2023 A1
20230135041 Aykol et al. May 2023 A1
20230137741 Kassis et al. May 2023 A1
20230139766 Kang et al. May 2023 A1
20230141266 Alberts May 2023 A1
20230143768 Asahara et al. May 2023 A1
20230145099 Funakawa May 2023 A1
20230152823 Wiegman May 2023 A1
20230153491 Kanazawa et al. May 2023 A1
20230153976 Kiyokane et al. May 2023 A1
20230154571 Terreux et al. May 2023 A1
20230154573 Roy et al. May 2023 A1
20230158469 Lackey et al. May 2023 A1
20230160019 Armstrong et al. May 2023 A1
20230160097 Qi et al. May 2023 A1
20230161844 Lee et al. May 2023 A1
20230161996 Bepler May 2023 A1
20230162093 Dupont De Dinechin May 2023 A1
20230169751 Geurts Jun 2023 A1
20230170053 Gharakhanyan et al. Jun 2023 A1
20230170054 Kubis et al. Jun 2023 A1
20230170055 Qi et al. Jun 2023 A1
20230170056 Yang et al. Jun 2023 A1
20230170059 Gadhiya et al. Jun 2023 A1
20230170061 Tanaka et al. Jun 2023 A1
20230175062 Lackey et al. Jun 2023 A1
20230176058 Warsinske et al. Jun 2023 A1
20230177327 Pillai et al. Jun 2023 A1
20230177968 Arksey et al. Jun 2023 A1
20230178185 Gormley et al. Jun 2023 A1
20230178186 Amimeur et al. Jun 2023 A1
20230183867 Viswanathan et al. Jun 2023 A1
20230186057 Musaelian et al. Jun 2023 A1
20230186615 Cook et al. Jun 2023 A1
20230187016 Araya et al. Jun 2023 A1
20230187027 Liu et al. Jun 2023 A1
20230187029 Jandhyala et al. Jun 2023 A1
20230196075 Ishitani Jun 2023 A1
20230196132 Horowitz et al. Jun 2023 A1
20230196629 Teskey Jun 2023 A1
20230197209 Yu et al. Jun 2023 A1
20230205175 Zhao et al. Jun 2023 A1
20230207066 Lee et al. Jun 2023 A1
20230213504 Farokhzad et al. Jul 2023 A1
20230215278 Kanagarajan et al. Jul 2023 A1
20230217956 Navi et al. Jul 2023 A1
20230217957 Navi et al. Jul 2023 A1
20230223101 Navi et al. Jul 2023 A1
20230223112 Sun et al. Jul 2023 A1
20230223113 Ragan et al. Jul 2023 A1
20230230662 Sarshogh et al. Jul 2023 A1
20230234989 Liszka et al. Jul 2023 A1
20230237339 Hummelshøj Jul 2023 A1
20230237365 Hummelshøj Jul 2023 A1
20230238083 Liu et al. Jul 2023 A1
20230238084 Tsumura et al. Jul 2023 A1
20230238085 Jang et al. Jul 2023 A1
20230244833 Mechin et al. Aug 2023 A1
20230245003 Hummelshøj Aug 2023 A1
20230245110 Arneault et al. Aug 2023 A1
20230245725 Rousseau et al. Aug 2023 A1
20230245726 Fäcke Aug 2023 A1
20230245727 He et al. Aug 2023 A1
20230251226 Matsui et al. Aug 2023 A1
20230252355 Tao et al. Aug 2023 A1
20230253076 Safiulin et al. Aug 2023 A1
20230258838 Roy et al. Aug 2023 A1
20230260602 Sankaranarayanan et al. Aug 2023 A1
20230260603 Montoya et al. Aug 2023 A1
20230268035 Kim et al. Aug 2023 A1
20230274789 Li et al. Aug 2023 A1
20230274797 Bian et al. Aug 2023 A1
20230274803 Ueki et al. Aug 2023 A1
20230281465 Feinberg et al. Sep 2023 A1
20230281474 Steinmetz et al. Sep 2023 A1
20230282311 Behsaz et al. Sep 2023 A1
20230284178 Parker et al. Sep 2023 A1
20230285968 Bentwich et al. Sep 2023 A1
20230288907 Coffman et al. Sep 2023 A1
20230290114 Prat et al. Sep 2023 A1
20230290434 Castro et al. Sep 2023 A1
20230290435 Madhusudhanan et al. Sep 2023 A1
20230290444 Bronstein et al. Sep 2023 A1
20230290445 Choi et al. Sep 2023 A1
20230292075 Walther et al. Sep 2023 A1
20230297853 Bucher et al. Sep 2023 A1
20230298706 Vissers et al. Sep 2023 A1
20230302043 Huyer et al. Sep 2023 A1
20230304391 Sheng et al. Sep 2023 A1
20230315803 Babbush Oct 2023 A1
20230315924 Hummelshøj et al. Oct 2023 A1
20230317202 Stojevic et al. Oct 2023 A1
20230321706 Ojima et al. Oct 2023 A1
20230323503 Ojima et al. Oct 2023 A1
20230325687 Pabrinkis et al. Oct 2023 A1
20230325751 Clavero et al. Oct 2023 A1
20230326543 Ferguson et al. Oct 2023 A1
20230331723 Polykovskiy et al. Oct 2023 A1
20230331990 Knowlton et al. Oct 2023 A1
20230332967 Earthman et al. Oct 2023 A1
20230333127 Lenhert et al. Oct 2023 A1
20230334380 Ivankin et al. Oct 2023 A1
20230334991 Shapiro et al. Oct 2023 A1
20230335226 Yarimizu et al. Oct 2023 A1
20230335229 Li et al. Oct 2023 A1
20230335231 Abdallah et al. Oct 2023 A1
20230339185 Huang Oct 2023 A1
20230342525 Yavas et al. Oct 2023 A1
20230347512 Kwon Nov 2023 A1
20230350380 Coffman et al. Nov 2023 A1
20230350395 Winkler et al. Nov 2023 A1
20230350396 Rudolph et al. Nov 2023 A1
20230352118 Seif et al. Nov 2023 A1
20230352122 Mawlod et al. Nov 2023 A1
20230352123 Atkinson et al. Nov 2023 A1
20230359155 Schockaert et al. Nov 2023 A1
20230359929 Shmilovich et al. Nov 2023 A1
20230360736 Stober et al. Nov 2023 A1
20230360739 Kim et al. Nov 2023 A1
20230360743 Gedeck et al. Nov 2023 A1
20230360744 Sala et al. Nov 2023 A1
20230366863 Tate et al. Nov 2023 A1
20230376646 Krompiec Nov 2023 A1
20230376648 Khan et al. Nov 2023 A1
20230377681 Mukhopadhyay et al. Nov 2023 A1
20230377682 Min et al. Nov 2023 A1
20230377690 Anand et al. Nov 2023 A1
20230377693 Krompiec Nov 2023 A1
20230385666 Ghosh et al. Nov 2023 A1
20230385681 Montanaro et al. Nov 2023 A1
20230386604 Park et al. Nov 2023 A1
20230386616 Kondo et al. Nov 2023 A1
20230386617 Hagawa et al. Nov 2023 A1
20230386618 Thomas et al. Nov 2023 A1
20230390725 Winkler et al. Dec 2023 A1
20230393543 Nixon et al. Dec 2023 A1
20230393564 Nixon et al. Dec 2023 A1
20230394045 Nixon et al. Dec 2023 A1
20230394196 Liu et al. Dec 2023 A1
20230394283 Pang et al. Dec 2023 A1
20230395186 Kohl et al. Dec 2023 A1
20230395201 Pappas et al. Dec 2023 A1
20230395202 Das et al. Dec 2023 A1
20230401351 Galchenko et al. Dec 2023 A1
20230401361 Teskey et al. Dec 2023 A1
20230401430 Zheng et al. Dec 2023 A1
20230402125 Jin et al. Dec 2023 A1
20230402126 Cheng et al. Dec 2023 A1
20230402127 Altman et al. Dec 2023 A1
20230402134 Bhattacharya et al. Dec 2023 A1
20230402135 Wu et al. Dec 2023 A1
20230402136 Zheng et al. Dec 2023 A1
20230402137 Smith et al. Dec 2023 A1
20230406713 Li et al. Dec 2023 A1
20230409015 Winkler et al. Dec 2023 A1
20230409904 Birru et al. Dec 2023 A1
20230410940 Fonstein et al. Dec 2023 A1
20230410950 Godin et al. Dec 2023 A1
20230410953 Zhang et al. Dec 2023 A1
20230410970 Bugay et al. Dec 2023 A1
20230411222 Lee et al. Dec 2023 A1
20230416726 Baker et al. Dec 2023 A1
20230417919 Goldstein et al. Dec 2023 A1
20230418995 Li et al. Dec 2023 A1
20230419086 Pocajt et al. Dec 2023 A1
20230420069 Stojevic et al. Dec 2023 A1
20230420085 Mukherjee et al. Dec 2023 A1
20230420193 Bevan et al. Dec 2023 A1
20230420729 Yoon et al. Dec 2023 A1
20230420757 Garapati et al. Dec 2023 A1
20240005147 Hoseinabadi et al. Jan 2024 A1
20240005179 Yu et al. Jan 2024 A1
20240006017 Wang et al. Jan 2024 A1
20240006018 Knowles et al. Jan 2024 A1
20240012399 Stewart et al. Jan 2024 A1
20240012967 Jinguu et al. Jan 2024 A1
20240013866 Lee et al. Jan 2024 A1
20240013868 Bhavnagri Jan 2024 A1
20240013870 Jinguu et al. Jan 2024 A1
20240019600 Holmes et al. Jan 2024 A1
20240019845 Yoo et al. Jan 2024 A1
20240020433 Cordes et al. Jan 2024 A1
20240020437 Kubis et al. Jan 2024 A1
20240020968 Haskin et al. Jan 2024 A1
20240021275 Wiltschko et al. Jan 2024 A1
20240021276 Jiao et al. Jan 2024 A1
20240021277 Zaw et al. Jan 2024 A1
20240024839 Winkler et al. Jan 2024 A1
20240028882 Hopkins et al. Jan 2024 A1
20240028889 Mudassir et al. Jan 2024 A1
20240028928 Kudva et al. Jan 2024 A1
20240029833 Thiry Jan 2024 A1
20240029834 Nichita Jan 2024 A1
20240029836 Nie et al. Jan 2024 A1
20240033801 Kobayashi et al. Feb 2024 A1
20240034636 Roche et al. Feb 2024 A1
20240036034 Klie et al. Feb 2024 A1
20240037434 Boutin et al. Feb 2024 A1
20240038329 Abeliuk et al. Feb 2024 A1
20240038337 Laniado et al. Feb 2024 A1
20240038340 Maeda et al. Feb 2024 A1
20240038341 Gu et al. Feb 2024 A1
20240044884 Farokhzad et al. Feb 2024 A1
20240044885 Farokhzad et al. Feb 2024 A1
20240046123 Kim Feb 2024 A1
20240047006 Pan Feb 2024 A1
20240047014 Yang et al. Feb 2024 A1
20240047016 Kim Feb 2024 A1
20240047018 Hanaoka Feb 2024 A1
20240053524 Schweizer et al. Feb 2024 A1
20240054101 Chen et al. Feb 2024 A1
20240054184 Hummelshøj Feb 2024 A1
20240054328 Li et al. Feb 2024 A1
20240054531 Tagawa Feb 2024 A1
20240055071 Zhang et al. Feb 2024 A1
20240055080 Yang et al. Feb 2024 A1
20240061383 Lovell et al. Feb 2024 A1
20240061403 Winkler et al. Feb 2024 A1
20240062039 Liang et al. Feb 2024 A1
20240062131 Hajnal et al. Feb 2024 A1
20240065613 Kandlikar et al. Feb 2024 A1
20240070351 Hummelshøj Feb 2024 A1
20240070353 Wang et al. Feb 2024 A1
20240070422 Church Feb 2024 A1
20240071567 Westcott et al. Feb 2024 A1
20240071575 Neumann Barros Ferreira et al. Feb 2024 A1
20240071576 Neukart et al. Feb 2024 A1
20240071577 Kirkpatrick et al. Feb 2024 A1
20240071578 McGrath et al. Feb 2024 A1
20240077393 Shanai et al. Mar 2024 A1
20240078450 Rothstein et al. Mar 2024 A1
20240079084 Townshend et al. Mar 2024 A1
20240079099 Ishitani et al. Mar 2024 A1
20240085389 Shanai et al. Mar 2024 A1
20240086733 Imada Mar 2024 A1
20240087686 Pritzel et al. Mar 2024 A1
20240087688 Fain et al. Mar 2024 A1
20240093600 Li et al. Mar 2024 A1
20240096442 Bhavnagri Mar 2024 A1
20240096444 Laniado et al. Mar 2024 A1
20240096454 Schwartz et al. Mar 2024 A1
20240097184 Cross et al. Mar 2024 A1
20240099165 Yang et al. Mar 2024 A1
20240104387 Alesiani et al. Mar 2024 A1
20240105277 Kumar et al. Mar 2024 A1
20240105287 Pan Mar 2024 A1
20240105288 Takamoto et al. Mar 2024 A1
20240111931 Oka Hashimoto et al. Apr 2024 A1
20240112760 Frost et al. Apr 2024 A1
20240112762 Oh et al. Apr 2024 A1
20240112763 Garcia Perez et al. Apr 2024 A1
20240115742 Montclare et al. Apr 2024 A1
20240119211 Lee et al. Apr 2024 A1
20240119273 Banerjee et al. Apr 2024 A1
20240120022 Senior et al. Apr 2024 A1
20240120033 Suzuki et al. Apr 2024 A1
20240120034 Hajnal et al. Apr 2024 A1
20240120036 Yoshimoto et al. Apr 2024 A1
20240121719 Vidal et al. Apr 2024 A1
20240126942 Chen Apr 2024 A1
20240127121 Shinagawa et al. Apr 2024 A1
20240127533 Takamoto et al. Apr 2024 A1
20240127909 Pai et al. Apr 2024 A1
20240135141 Bae et al. Apr 2024 A1
20240136025 Xie et al. Apr 2024 A1
20240136026 Takemoto et al. Apr 2024 A1
20240136709 Tran et al. Apr 2024 A1
20240136710 Tran Apr 2024 A1
20240142394 Pan et al. May 2024 A1
20240144045 Amii et al. May 2024 A1
20240144046 Amii et al. May 2024 A1
20240152668 Yu et al. May 2024 A1
20240152750 Schockaert May 2024 A1
20240152756 Lakshmanan et al. May 2024 A1
20240152763 Aliper et al. May 2024 A1
20240153188 Wang et al. May 2024 A1
20240153595 Alampara et al. May 2024 A1
20240160858 Dai et al. May 2024 A1
20240267117 Guiney Aug 2024 A1
20240396626 Atungsiri Nov 2024 A1
Foreign Referenced Citations (112)
Number Date Country
1996056667 Jan 1997 AU
714247 Dec 1999 AU
2004311881 Jul 2008 AU
2220216 Nov 1996 CA
2548669 May 2014 CA
2821652 Jul 2014 CA
113434292 Sep 2021 CN
117639885 Mar 2024 CN
3430485 Aug 2021 DK
0826205 Feb 2003 EP
2600174 Jun 2013 EP
3468868 May 2021 EP
3430485 Jun 2021 EP
3889719 Oct 2021 EP
3965515 Mar 2022 EP
3968675 Mar 2022 EP
4002904 May 2022 EP
4019413 Jun 2022 EP
3830980 Aug 2022 EP
4292945 Dec 2023 EP
2426647 Feb 2008 GB
2597192 Jul 2023 GB
240069 Aug 2018 IL
3236DELNP2006 Aug 2007 IN
S608199 Jan 1985 JP
S60051383 Mar 1985 JP
4-78519 Dec 1992 JP
2009635 Apr 2014 NL
1996035197 Nov 1996 WO
2004015878 Aug 2004 WO
2005065320 Jul 2005 WO
2008138996 Nov 2008 WO
2014042718 Mar 2014 WO
2014042718 Jun 2014 WO
2017218696 Dec 2017 WO
2018098588 Jun 2018 WO
2018106289 Jun 2018 WO
2018106290 Jun 2018 WO
2018112460 Jun 2018 WO
2018145262 Aug 2018 WO
2019005908 Jan 2019 WO
2019060268 Mar 2019 WO
2019154246 Aug 2019 WO
2019199651 Oct 2019 WO
2019209888 Oct 2019 WO
2019244125 Dec 2019 WO
2019244125 Mar 2020 WO
2020047469 Mar 2020 WO
2020051508 Mar 2020 WO
2020056405 Mar 2020 WO
2020065462 Apr 2020 WO
2020065463 Apr 2020 WO
2020096774 May 2020 WO
2020123505 Jun 2020 WO
2020047469 Jul 2020 WO
2020148588 Jul 2020 WO
2020163967 Aug 2020 WO
2020188549 Sep 2020 WO
2020209591 Oct 2020 WO
2020215056 Oct 2020 WO
2020263358 Dec 2020 WO
2020263358 Feb 2021 WO
2021034590 Feb 2021 WO
2021034910 Feb 2021 WO
2021040743 Mar 2021 WO
2020188549 Apr 2021 WO
2021092039 May 2021 WO
2021113086 Jun 2021 WO
2021231457 Nov 2021 WO
2021252460 Dec 2021 WO
2022040366 Feb 2022 WO
2022067211 Mar 2022 WO
2022074643 Apr 2022 WO
2022090579 May 2022 WO
2021252460 Jun 2022 WO
2022117664 Jun 2022 WO
2022132050 Jun 2022 WO
2022182899 Sep 2022 WO
2022204682 Sep 2022 WO
2022212215 Oct 2022 WO
2022261674 Dec 2022 WO
2022261675 Dec 2022 WO
2022261676 Dec 2022 WO
2022261678 Dec 2022 WO
2022266002 Dec 2022 WO
2022266349 Dec 2022 WO
2022269613 Dec 2022 WO
2022266349 Jan 2023 WO
2023003726 Jan 2023 WO
2023003727 Jan 2023 WO
2023283437 Jan 2023 WO
2023012700 Feb 2023 WO
2023003727 Mar 2023 WO
2023031122 Mar 2023 WO
2023064999 Apr 2023 WO
2023081827 May 2023 WO
2023113874 Jun 2023 WO
2023115217 Jun 2023 WO
2023156620 Aug 2023 WO
2023164518 Aug 2023 WO
2023192428 Oct 2023 WO
2023205540 Oct 2023 WO
2023213821 Nov 2023 WO
2023242003 Dec 2023 WO
2023250152 Dec 2023 WO
2024018448 Jan 2024 WO
2024030920 Feb 2024 WO
2024042508 Feb 2024 WO
2024046603 Mar 2024 WO
2024047236 Mar 2024 WO
2024082694 Apr 2024 WO
2024091926 May 2024 WO
Non-Patent Literature Citations (133)
Entry
Zhang et al., “Equivariant analytical mapping of first principles Hamiltonians to accurate and transferable materials models,” npj Computational Materials, 2022, pp. 1-14.
Wan et al., “Machine Learning Paves the Way for High Entropy Compounds Exploration: Challenges, Progress, and Outlook,” Advanced Materials, 2023, pp. 1-26.
Hoja et al., “First-principles modeling of molecular crystals: structures and stabilities, temperature and pressure,” Advanced Reviews, vol. 7, 2017, pp. 1-26.
Non-Final Office Action from U.S. Appl. No. 18/397,993, dated Aug. 29, 2024.
Bogojeski et al., “Quantum Chemical Accuracy from Density Functional Approximations via Machine Learning,” Nature Communications, 2020, with supplementary information, 36 pages.
Antoniuk et al., “Predicting the Synthesizability of Crystalline Inorganic Materials from the Data of Known Material Compositions,” npj Computational Materials, 2023, pp. 1-11.
Fedik et al., “Extending Machine Learning beyond Interatomic Potentials for Predicting Molecular Properties,” Nature Reviews, vol. 6, Sep. 2022, pp. 653-672.
Ramprasad et al., “Machine Learning in Materials Informatics: Recent Applications and Prospects,” npj Computational Materials, 2017, pp. 1-13.
Ceriotti, M., “Beyond Potentials: Integrated Machine Learning Models for Materials,” MRS Bulletin, vol. 47, Oct. 2022, pp. 1045-1053.
Huang et al., “Application of Machine Learning in Material Synthesis and Property Prediction,” Materials, 2023, pp. 1-30.
Prasad et al., U.S. Appl. No. 18/889,200, filed Sep. 18, 2024.
Prasad et al., U.S. Appl. No. 18/889,213, filed Sep. 18, 2024.
Prasad et al., U.S. Appl. No. 18/889,237, filed Sep. 18, 2024.
Li et al., “A Machine Learning-based Approach for Improved Orbit Predictions of LEO Space Debris With Sparse Tracking Data From a Single Station,” IEEE Transactions on Aerospace and Electronic Systems, vol. 56, 2020, pp. 1-15.
Haidar-Ahmad et al., “A Hybrid Analytical-Machine Learning Approach for LEO Satellite Orbit Prediction,” IEEE 25th International Conference on Information Fusion (Fusion), 2022, 7 pages.
Wrona et al., “Artifcial Intelligence-Based Data Path Control in LEO Satellites-Driven Optical Communications,” International Journal of Satellite Communications and Networking, 2023, 24 pages.
Brenna, M., “CubeSat mission design for in-orbit environment characterisation,” Master Thesis, Politecnico di Milano, Dec. 2020, 150 pages.
Homssi et al., “Deep Learning Forecasting and Statistical Modeling for Q/V-Band LEO Satellite Channels,” IEEE Transactions on Machine Learning in Communications and Networking, vol. 1, Jun. 2023, pp. 78-89.
Gorooh et al., “Integrating LEO and GEO Observations: Toward Optimal Summertime Satellite Precipitation Retrieval,” Journal of Hydrometeorology, vol. 24, Nov. 2023, pp. 1939-1954.
Chen et al., “Orbit Manoeuvre Strategies for Very Low Earth Orbit (VLEO) Satellites,” 74th International Astronautical Congress (IAC), Oct. 2023, pp. 1-6.
Kim et al., “ARMA Prediction of SBAS Ephemeris and Clock Corrections for Low Earth Orbiting Satellites,” Hindawi International Journal of Aerospace Engineering, 2015, 8 pages.
Kozhaya et al., “Comparison of Neural Network Architectures for Simultaneous Tracking and Navigation with LEO Satellites,” Preprint of the 2021 ION GNSS+ Conference, Sep. 2021, 14 pages.
Lee et al., “Machine Learning Approach to Initial Orbit Determination of Unknown LEO Satellites,” SpaceOps Conferences, Jun. 2018, pp. 1-11.
Ge et al., “LEO Enhanced Global Navigation Satellite System (LeGNSS): progress, opportunities, and challenges,” Geo-spatial Information Science, vol. 25, Oct. 2021, pp. 1-13.
Mortlock et al., “Assessing Machine Learning for LEO Satellite Orbit Determination in Simultaneous Tracking and Navigation,” Ohio State University, 2022, 8 pages, retrieved from https://ece.osu.edu/sites/default/files/2022-09/Assessing_machine_learning_for_LEO_satellite_orbit_determination_in_simultaneous_tracking_and_navigation.pdf.
O'Meara et al., “Applications of Deep Learning Neural Networks to Satellite Telemetry Monitoring,” SpaceOps Conferences, Jun. 2018, pp. 1-16.
Ibrahim et al., “Anticipating Optical Availability in Hybrid RF/FSO Links Using RF Beacons and Deep Learning,” arXiv, 2024, 11 pages, retrieved from https://arxiv.org/abs/2405.13366.
Prol et al., “Position, Navigation, and Timing (PNT) Through Low Earth Orbit (LEO) Satellites: A Survey on Current Status, Challenges, and Opportunities,” IEEE Access, vol. 10, 2022, pp. 83971-84002.
Najder et al., “Quality of Orbit Predictions for Satellites Tracked by SLR Stations,” Remote Sensing, vol. 13, Apr. 3, 2021, pp. 1-20.
Carr et al., “Multi-LEO Satellite Stereo Winds,” Remote Sensing, vol. 15, pp. 1-31.
Hornillo-Mellado et al., “Prediction of Satellite Shadowing in Smart Cities with Application to IoT,” Sensors, vol. 20, 2020, pp. 1-19.
Celikbilek et al., “Survey on Optimization Methods for LEO-Satellite-Based Networks with Applications in Future Autonomous Transportation,” Sensors, vol. 22, 2022, pp. 1-52.
Na et al., “Distributed Routing Strategy Based on Machine Learning for LEO Satellite Network,” Hindawi Wireless Communications and Mobile Computing, Jun. 2018, pp. 1-10.
Non-Final Office Action from U.S. Appl. No. 18/889,237, dated Dec. 4, 2024.
Hsu et al., “Generative design, manufacturing, and molecular modeling of 3D architected materials based on natural language input,” APL Materials, vol. 10, Apr. 13, 2022, pp. 14 pages.
Hu et al., “Deep language models for interpretative and predictive materials science,” APL Machine Learning, vol. 1, Feb. 2023, 19 pages.
Liu et al., “Generative artificial intelligence and its applications in materials science: Current situation and future perspectives,” Journal of Materiomics, vol. 9, 2023, pp. 798-816.
Merchant et al., “Scaling deep learning for materials discovery,” Nature, vol. 624, Dec. 7, 2023, 11 pages.
Szymanski et al., “An autonomous laboratory for the accelerated synthesis of novel materials,” Nature, Nov. 2023, 12 pages.
Yang et al., “Scalable Diffusion for Materials Generation,” Google DeepMind, Oct. 17, 2023, pp. 1-18.
Zeni et al., “MatterGen: a generative model for inorganic materials design,” arXiv, 2023, 56 pages, retrieved from https://arxiv.org/abs/2312.03687#:˜:text=Here%2C%20we%20present%20MatterGen%2C%20a,broad%20range%20of%20property%20constraints.
Xin et al., “Active learning based generative design for the discovery of wide band gap materials,” arXiv, 2021, 16 pages, retrieved from https://arxiv.org/abs/2103.00608.
Anstine et al., “Generative Models as an Emerging Paradigm in the Chemical Sciences,” Journal of the American Chemical Society, vol. 145, 2023, pp. 8736-8750.
Agrawal et al., “Deep materials informatics: Applications of deep learning in materials science,” MRS Communications, vol. 9, 2019, pp. 779-792.
Chen et al., “Leveraging Large-scale Computational Database and Deep Learning for Accurate Prediction of Material Properties,” arXiv, 2021, 16 pages, retrieved from https://arxiv.org/abs/2112.14429.
Wang et al., “Inverse Design of Materials by Machine Learning,” Materials, vol. 15, 2022, pp. 1-19.
Chen et al., “Generative Deep Neural Networks for Inverse Materials Design Using Backpropagation and Active Learning,” Advanced Science News, vol. 7, 2020, pp. 1-10.
Weiss et al., “Guided diffusion for inverse molecular design,” Nature Computational Science, vol. 3, Oct. 2023, pp. 873-882.
Song et al., “Computational Discovery of New 2D Materials Using Deep Learning Generative Models,” Applied Materials & Interfaces, vol. 13, 2021, pp. 53303-53313.
Bajpai et al., “A scalable crystal representation for reverse engineering of novel inorganic materials using deep generative models,” ChemRxiv, Mar. 2023, 29 pages, retrieved from https://chemrxiv.org/engage/chemrxiv/article-details/641b37052bfb3dc25130e17d.
Barrett, R., “Artificial Intelligence and Augmented Intelligence for Automated Investigations for Scientific Discovery,” University of Warwick, Project Report, Sep. 15, 2021, 11 pages.
Song et al., “Predicting Material Structures and Properties Using Deep Learning and Machine Learning Algorithms,” University of South Carolina Scholar Commons, Theses and Dissertations, 2023, 137 pages.
Zhang et al., “Generating and screening de novo compounds against given targets using ultrafast deep learning models as core components,” Briefings in Bioinformatics, vol. 23, 2022, pp. 1-15.
Christensen et al., “Predictive and generative machine learning models for photonic crystals,” Nanophotonics, vol. 9, 2020, pp. 4183-4192.
Baillif et al., “Deep generative models for 3D molecular structure,” ScienceDirect, Current Opinion in Structural Biology, vol. 80, 2023, pp. 1-10.
Chen et al., “Generative models for inverse design of inorganic solid materials,” Journal of Materials Informatics, 2021, pp. 1-15.
Kadulkar et al., “Machine Learning-Assisted Design of Material Properties,” Annual Review of Chemical and Biomolecular Engineering, 2022, 23 pages.
Hu et al., “MaterialsAtlas.org: a materials informatics web app platform for materials discovery and survey of state-of-the-art,” NPJ Computational Materials, 2022, pp. 1-12.
Fu et al., “Materials Transformers Language Models for Generative Materials Design: a benchmark study,” 2022, pp. 1-19, retrieved from https://arxiv.org/abs/2206.13578.
Menon et al., “A Generative Approach to Materials Discovery, Design, and Optimization,” ACS Omega, vol. 7, 2022, pp. 25958-25973.
Manica et al., “Accelerating material design with the generative toolkit for scientific discovery,” NPJ Computational Materials, 2023, pp. 1-6.
Debnath et al., “Generative deep learning as a tool for inverse design of high-entropy refractory alloys,” arXiv, 2021, 20 pages, retrieved from https://arxiv.org/pdf/2108.12019.pdf.
Regenwetter et al., “Deep Generative Models in Engineering Design: A Review,” The Journal of Mechanical Design, vol. 144, Jul. 2022, 23 pages, retrieved from https://decode.mit.edu/assets/papers/2022_regenwetter_review.pdf.
Mamun et al., “Machine learning augmented predictive and generative model for rupture life in ferritic and austenitic steels,” NPJ Materials Degradation, 2021, pp. 1-10.
Wei et a., “Probabilistic generative transformer language models for generative design of molecules,” Journal of Cheminformatics, 2023, pp. 1-15.
Fuhr et al., “Deep Generative Models for Materials Discovery and Machine Learning-Accelerated Innovation,” Frontiers in Materials, vol. 9, Mar. 2022, pp. 1-13.
Zhang et al., “Multi-objective Generative Design of Three-Dimensional Composite Materials,” arXiv, 2023, 29 pages, retrieved from https://arxiv.org/abs/2302.13365.
Xue et al., “Machine learning generative models for automatic design of multi-material 3D printed composite solids,” Extreme Mechanics Letters, vol. 41, 2020, pp. 1-7.
New et al., “Evaluating the diversity and utility of materials proposed by generative models,” arXiv, 2023, 12 pages, retrieved from https://arxiv.org/abs/2309.12323.
Eguchi et al., “Ig-VAE: Generative modeling of protein structure by direct 3D coordinate generation,” PLOS Computational Biology, Jun. 27, 2022, pp. 1-18.
Chu et al., “An all-atom protein generative model,” bioRxiv, 2023, 20 pages, retrieved from https://www.biorxiv.org/content/10.1101/2023.05.24.542194v1.full.
Vasudevan et al., “Machine learning for materials design and discovery,” Journal of Applied Physics, vol. 129, Feb. 2021, pp. 1-8.
Shen et al., “Nature-inspired architected materials using unsupervised deep learning,” Communications Engineering, 2022, pp. 1-15.
Kong et al., “Materials representation and transfer learning for multi-property prediction,” Applied Physics Reviews, Jun. 2021, 15 pages.
Rajak et al,. “Predictive Synthesis of Quantum Materials by Probabilistic Reinforcement Learning,” arXiv, 2020, 16 pages, retrieved from https://arxiv.org/abs/2009.06739.
Ni et al., “Generative design of de novo proteins based on secondary-structure constraints using an attention-based diffusion model,” Chem, vol. 9, Jul. 13, 2023, pp. 1828-1849.
Jackson et al., “Recent advances in machine learning towards multiscale soft materials design,” Current Opinion in Chemical Engineering, vol. 23, 2019, pp. 106-114.
Choung et al., “Extracting medicinal chemistry intuition via preference machine learning,” Nature Communications, vol. 14, Oct. 31, 2023, pp. 1-10.
Dan et al., “Generative adversarial networks (GAN) based efficient sampling of chemical composition space for inverse design of inorganic materials,” NPJ Computational Materials, Jun. 26, 2020, pp. 1-7.
Iovanac et al., “Improving the generative performance of chemical autoencoders through transfer learning,” Machine Learning Science and Technology, vol. 1, 2020, 12 pages.
Liu et al., “Tackling Photonic Inverse Design with Machine Learning,” Advanced Science, vol. 8, 2021, pp. 1-15.
Hegde, R., “Deep learning: a new tool for photonic nanostructure design,” Nanoscale Advances, vol. 2, 2020, pp. 1007-1023.
Garland et al., “Pragmatic generative optimization of novel structural lattice metamaterials with machine learning,” Materials and Design, vol. 203, 2021, pp. 1-13.
Mobarak et al., “Scope of machine learning in materials research—A review,” Applied Surface Science Advances, vol. 18, 2023, pp. 1-24.
Lu et al., “Computational discovery of energy materials in the era of big data and machine learning: A critical review,” Materials Reports: Energy, vol. 1, 2021, pp. 1-18.
Yao et al., “Machine learning for a sustainable energy future,” Perspectives, vol. 8, Mar. 2023, pp. 202-215.
Bhowmik et al., “A perspective on inverse design of battery interphases using multi-scale modelling, experiments and generative deep learning,” Energy Storage Materials, vol. 21, 2019, pp. 446-456.
Willard et al., “Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems,” ACM Computing Surveys, vol. 55, No. 4, Nov. 2022, pp. 1-37.
Kaszuba et al., “Compositional Search of Stable Crystalline Structures in Multi-Component Alloys Using Generative Diffusion Models,” arXiv, 2023, 14 pages, retrieved from https://arxiv.org/abs/2312.16073.
Wei et al., “Perspective: Predicting and optimizing thermal transport properties with machine learning methods,” Energy and AI, vol. 8, 2022, pp. 1-14.
Vasudevan et al., “Materials Science in the AI age: high-throughput library generation, machine learning and a pathway from correlations to the underpinning physics,” Author Manuscript, MRS Comm., 2019, pp. 1-34.
Keith et al., “Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems,” Chemical Reviews, vol. 121, 2021, pp. 9816-9872.
Marani et al., “Predicting Ultra-High-Performance Concrete Compressive Strength Using Tabular Generative Adversarial Networks,” Materials, Oct. 24, 2020, vol. 13, pp. 1-24.
Noh et al., “Machine-enabled inverse design of inorganic solid materials: promises and challenges,” Chemical Science, vol. 11, 2020, pp. 4871-4881.
Nguyen et al., “Synthesizing controlled microstructures of porous media using generative adversarial networks and reinforcement learning,” Scientific Reports, 2022, pp. 1-16.
Bandi et al., “The Power of Generative AI: A Review of Requirements, Models, Input-Output Formats, Evaluation Metrics, and Challenges,” Future Internet, vol. 15, 2023, pp. 1-60.
Zhang et al., “An equivariant generative framework for molecular graph-structure Co-design,” Chemical Science, vol. 14, 2023, pp. 8380-8392.
Jablonka et al., “Big-Data Science in Porous Materials: Materials Genomics and Machine Learning,” Chemical Reviews, vol. 120, 2020, pp. 8066-8129.
Vlassis et al., “Denoising diffusion algorithm for inverse design of microstructures with fine-tuned nonlinear material properties,” arXiv, 2023, 21 pages, retrieved from https://arxiv.org/abs/2302.12881.
Bellovin et al., “Privacy and Synthetic Datasets,” Stanford Technology Law Review, Forthcoming, SSRN, 2018, 39 pages, retrieved from https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3255766.
Biron, L., “Google DeepMind Adds Nearly 400,000 New Compounds to Berkeley Lab's Materials Project,” News From Berkeley Lab, Nov. 29, 2023, 11 pages, retrieved from https://newscenter.lbl.gov/2023/11/29/google-deepmind-new-compounds-materials-project/.
Kim, J., “Google DeepMind's new AI tool helped create more than 700 new materials,” MIT Technology Review, Nov. 29, 2023, 10 pages, retrieved from https://www.technologyreview.com/2023/11/29/1084061/deepmind-ai-tool-for-new-materials-discovery/.
Berkley Lab, “The Materials Project,” Berkley Lab, 2023, 5 pages, retrieved from https://next-gen.materialsproject.org/.
Restriction Requirement from U.S. Appl. No. 18/397,993, dated May 3, 2024.
Vikoren et al., U.S. Appl. No. 18/397,993, filed Dec. 27, 2023.
Kulik et al., “Roadmap on Machine learning in electronic structure,” Electronic Structure, vol. 4, 2022, pp. 1-60.
Su et al. “Efficient determination of the Hamiltonian and electronic properties using graph neural network with complete local coordinates,” Machine Learning Science and Technology, vol. 04, 2023, pp. 1-13.
Yu et al., “QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Molecules,” 37th Conference on Neural Information Processing Systems (NeurIPS), 2023, 17 pages.
Garrity et al., “Database of Wannier tightbinding Hamiltonians using high-throughput density functional theory,” Scientific Data, 2021, pp. 1-10.
Mueller et al., “Machine learning for interatomic potential models,” The Journal of Chemical Physics, vol. 152, Feb. 5, 2020, pp. 1-13.
Bai et al., “Graph Neural Network for Hamiltonian-Based Material Property Prediction,” arXiv, 2020, pp. 1-9, retrieved from https://arxiv.org/pdf/2005.13352.
Rodriguez, A., “Development of Atomistic Machine Learning Approaches for Thermal Properties of Multi-Component Solids and Liquids,” Thesis, University of South Carolina, Summer 2023, 242 pages.
Reiser et al., “Graph neural networks for materials science and chemistry,” Communications Materials, 2022, pp. 1-18.
Bao et al., “Deep-Learning Database of Density Functional Theory Hamiltonians for Twisted Materials,” arXiv, 2024, pp. 1-12, retrieved from https://arxiv.org/pdf/2404.06449.
Khrabrov et al., “nablaDFT: Large-Scale Conformational Energy and Hamiltonian Prediction benchmark and dataset,” Physical Chemistry Chemical Physics, vol. 24, 2022, pp. 25853-25863.
Hegde et al., “Machine-learned approximations to Density Functional Theory Hamiltonians,” Scientific Reports, Feb. 15, 2017, pp. 1-11.
Anker et al., “Machine learning for analysis of experimental scattering and spectroscopy data in materials chemistry,” Chemical Science, vol. 14, 2023, pp. 14003-14019.
Ryu et al., “Quantum Graph Neural Network Models for Materials Search,” Materials, vol. 16, 2023, pp. 1-26.
Lu et al., “When Machine Learning Meets 2D Materials: A Review,” Advanced Science, vol. 11, 2024, pp. 1-40.
Zhong et al., “Universal Machine Learning Kohn-Sham Hamiltonian for Materials,” arXiv, 2024, 20 pages, retrieved from https://arxiv.org/abs/2402.09251.
Ojih et al., “Graph theory and graph neural network assisted high-throughput crystal structure prediction and screening for energy conversion and storage,” Journal of Materials Chemistry A, vol. 12, 2024, pp. 8502-8515.
Farahvash et al., “Machine learning Frenkel Hamiltonian parameters to accelerate simulations of exciton dynamics,” The Journal of Chemical Physics, vol. 153, 2020, 14 pages.
Conway et al., “3.12—First principles crystal structure prediction,” Comprehensive Inorganic Chemistry III (Third Edition), 2023, pp. 393-420.
Zhou et al., “Deep learning of dynamically responsive chemical Hamiltonians with semiempirical quantum mechanics,” PNAS, vol. 119, No. 27, 2022, pp. 1-10.
Yu et al., “Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltonian,” Proceedings of the 40 th International Conference on Machine Learning, 2023, pp. 1-13.
Alibakhshi et al., “Implicitly perturbed Hamiltonian as a class of versatile and general-purpose molecular representations for machine learning,” Nature Communications, 2022, pp. 1-10.
Lal et al., “AI-Based Nano-Scale Material Property Prediction for Li-Ion Batteries,” Batteries, vol. 10, pp. 1-13.
Cheng et al., “Revealing Topology in Metals using Experimental Protocols Inspired by K-Theory,” arXiv, 2023, 12 pages, retrieved from https://arxiv.org/pdf/2209.02891.
Schleder et al., “From DFT to machine learning: recent approaches to materials science—a review,” Journal of Physics: Materials, vol. 2, 2019, pp. 1-46.
Neves et al., “Crystal net catalog of model flat band materials,” npj Computational Materials, 2024, pp. 1-9.
Yin et al., “Harmonizing SO(3)-Equivariance with Neural Expressiveness: a Hybrid Deep Learning Framework Oriented to the Prediction of Electronic Structure Hamiltonian,” arXiv, 2024, 37 pages, retrieved from https://arxiv.org/pdf/2401.00744v9.
Beran, G., “Frontiers of molecular crystal structure prediction for pharmaceuticals and functional organic materials,” Chemical Science, vol. 14, 2023, pp. 13290-13312.
Sander et al., “Towards Hamiltonian Simulation with Decision Diagrams,” arXiv, 2024, 12 pages, retrieved from https://arxiv.org/pdf/2305.02337.
Related Publications (1)
Number Date Country
20250219720 A1 Jul 2025 US
Provisional Applications (2)
Number Date Country
63574141 Apr 2024 US
63571281 Mar 2024 US
Continuation in Parts (2)
Number Date Country
Parent 18600486 Mar 2024 US
Child 18889227 US
Parent 18397993 Dec 2023 US
Child 18889227 US