Andy Wagner

Person

Cupertino, CA, US

People

Patents Grantslast 30 patents

Information Patent Grant
Compressing and decompressing data for language models
- Patent number 12,182,716
- Issue date Dec 31, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Determining position values for transformer models
- Patent number 11,954,448
- Issue date Apr 9, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Token packing for sequence models
- Patent number 11,928,429
- Issue date Mar 12, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Position masking for transformer models
- Patent number 11,893,469
- Issue date Feb 6, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Reducing hardware resource utilization for residual neural networks
- Patent number 11,886,983
- Issue date Jan 30, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Pipelined neural network processing with continuous and asynchronou...
- Patent number 11,663,444
- Issue date May 30, 2023
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Systems and methods for training a neural network
- Patent number 11,610,120
- Issue date Mar 21, 2023
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Token-position handling for sequence based neural networks
- Patent number 11,544,537
- Issue date Jan 3, 2023
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Compressing weights for distributed neural networks
- Patent number 11,537,890
- Issue date Dec 27, 2022
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Spread neural networks
- Patent number 11,475,303
- Issue date Oct 18, 2022
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
System and method for gradient accumulation with free momentum
- Patent number 11,449,752
- Issue date Sep 20, 2022
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING

Patents Applicationslast 30 patents

Information Patent Application
Token Packing for Sequence Models
- Publication number 20240176953
- Publication date May 30, 2024
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
TRAINING MASKED LANGUAGE MODELS BASED ON PARTIAL SEQUENCES OF TOKENS
- Publication number 20220382978
- Publication date Dec 1, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EFFICIENT WEIGHT UPDATES
- Publication number 20220222521
- Publication date Jul 14, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DECIMATING HIDDEN LAYERS FOR TRAINING TRANSFORMER MODELS
- Publication number 20220108162
- Publication date Apr 7, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
COMPRESSING WEIGHTS FOR DISTRIBUTED NEURAL NETWORKS
- Publication number 20220076112
- Publication date Mar 10, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
FORCING WEIGHTS OF TRANSFORMER MODEL LAYERS
- Publication number 20220076127
- Publication date Mar 10, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Reducing Hardware Resource Utilization for Residual Neural Networks
- Publication number 20220067490
- Publication date Mar 3, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Compressing and Decompressing Data for Language Models
- Publication number 20220067529
- Publication date Mar 3, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
MULTI-TOKEN EMBEDDING AND CLASSIFIER FOR MASKED LANGUAGE MODELS
- Publication number 20220067280
- Publication date Mar 3, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DETERMINING POSITION VALUES FOR TRANSFORMER MODELS
- Publication number 20220027576
- Publication date Jan 27, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
COMPRESSING TOKENS BASED ON POSITIONS FOR TRANSFORMER MODELS
- Publication number 20220027719
- Publication date Jan 27, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Position Masking for Transformer Models
- Publication number 20210365723
- Publication date Nov 25, 2021
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Token Packing for Sequence Models
- Publication number 20210365633
- Publication date Nov 25, 2021
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Systems and Methods for Training a Neural Network
- Publication number 20210350226
- Publication date Nov 11, 2021
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SPREAD NEURAL NETWORKS
- Publication number 20210319309
- Publication date Oct 14, 2021
- Microsoft Technology Licensing, LLC
- Andrew WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
TOKEN-POSITION HANDLING FOR SEQUENCE BASED NEURAL NETWORKS
- Publication number 20210319288
- Publication date Oct 14, 2021
- Microsoft Technology Licensing, LLC
- Andrew WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SYSTEM AND METHOD FOR GRADIENT ACCUMULATION WITH FREE MOMENTUM
- Publication number 20210303991
- Publication date Sep 30, 2021
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
PIPELINED NEURAL NETWORK PROCESSING WITH CONTINUOUS AND ASYNCHRONOU...
- Publication number 20210097366
- Publication date Apr 1, 2021
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING

Andy Wagner

Person

Patents Grantslast 30 patents

Compressing and decompressing data for language models

Determining position values for transformer models

Token packing for sequence models

Position masking for transformer models

Reducing hardware resource utilization for residual neural networks

Pipelined neural network processing with continuous and asynchronou...

Systems and methods for training a neural network

Token-position handling for sequence based neural networks

Compressing weights for distributed neural networks

Spread neural networks

System and method for gradient accumulation with free momentum

Patents Applicationslast 30 patents

Token Packing for Sequence Models

TRAINING MASKED LANGUAGE MODELS BASED ON PARTIAL SEQUENCES OF TOKENS

EFFICIENT WEIGHT UPDATES

DECIMATING HIDDEN LAYERS FOR TRAINING TRANSFORMER MODELS

COMPRESSING WEIGHTS FOR DISTRIBUTED NEURAL NETWORKS

FORCING WEIGHTS OF TRANSFORMER MODEL LAYERS

Reducing Hardware Resource Utilization for Residual Neural Networks

Compressing and Decompressing Data for Language Models

MULTI-TOKEN EMBEDDING AND CLASSIFIER FOR MASKED LANGUAGE MODELS

DETERMINING POSITION VALUES FOR TRANSFORMER MODELS

COMPRESSING TOKENS BASED ON POSITIONS FOR TRANSFORMER MODELS

Position Masking for Transformer Models

Token Packing for Sequence Models

Systems and Methods for Training a Neural Network

SPREAD NEURAL NETWORKS

TOKEN-POSITION HANDLING FOR SEQUENCE BASED NEURAL NETWORKS

SYSTEM AND METHOD FOR GRADIENT ACCUMULATION WITH FREE MOMENTUM

PIPELINED NEURAL NETWORK PROCESSING WITH CONTINUOUS AND ASYNCHRONOU...