Marc R. Tremblay

Person

Mountain View, CA, US

People

Patents Grantslast 30 patents

Information Patent Grant
Compressing and decompressing data for language models
- Patent number 12,182,716
- Issue date Dec 31, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Determining position values for transformer models
- Patent number 11,954,448
- Issue date Apr 9, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Token packing for sequence models
- Patent number 11,928,429
- Issue date Mar 12, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Position masking for transformer models
- Patent number 11,893,469
- Issue date Feb 6, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Reducing hardware resource utilization for residual neural networks
- Patent number 11,886,983
- Issue date Jan 30, 2024
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Hardware-assisted gradient optimization using streamed gradients
- Patent number 11,681,905
- Issue date Jun 20, 2023
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Systems and methods for error recovery
- Patent number 11,675,654
- Issue date Jun 13, 2023
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Pipelined neural network processing with continuous and asynchronou...
- Patent number 11,663,444
- Issue date May 30, 2023
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Dual-momentum gradient optimization with reduced memory requirements
- Patent number 11,651,228
- Issue date May 16, 2023
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Lossless exponent and lossy mantissa weight compression for trainin...
- Patent number 11,615,301
- Issue date Mar 28, 2023
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Systems and methods for training a neural network
- Patent number 11,610,120
- Issue date Mar 21, 2023
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Accelerator for dense and sparse matrix computations
- Patent number 11,562,047
- Issue date Jan 24, 2023
- Microsoft Technology Licensing, LLC
- Layali Rashid
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Token-position handling for sequence based neural networks
- Patent number 11,544,537
- Issue date Jan 3, 2023
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Compressing weights for distributed neural networks
- Patent number 11,537,890
- Issue date Dec 27, 2022
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Executing large artificial intelligence models on memory-constraine...
- Patent number 11,520,592
- Issue date Dec 6, 2022
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Spread neural networks
- Patent number 11,475,303
- Issue date Oct 18, 2022
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
System and method for gradient accumulation with free momentum
- Patent number 11,449,752
- Issue date Sep 20, 2022
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
System and method for improving convolutional neural network-based...
- Patent number 11,436,491
- Issue date Sep 6, 2022
- Microsoft Technology Licensing, LLC
- Sujeeth S. Bharadwaj
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Data parallelism in distributed training of artificial intelligence...
- Patent number 11,436,019
- Issue date Sep 6, 2022
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Dynamic multi-layer execution for artificial intelligence modeling
- Patent number 11,354,579
- Issue date Jun 7, 2022
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Systems and methods for error recovery
- Patent number 11,226,859
- Issue date Jan 18, 2022
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Computer memory content movement
- Patent number 10,769,074
- Issue date Sep 8, 2020
- Microsoft Technology Licensing, LLC
- John G. Bennett
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Computing device performance of low precision arithmetic functions...
- Patent number 10,564,930
- Issue date Feb 18, 2020
- Microsoft Technology Licensing, LLC
- Saurabh Mohan Kulkarni
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Cost-effective mobile connectivity protocols
- Patent number 9,876,762
- Issue date Jan 23, 2018
- Elwha LLC
- Philip Lionel Barnes
- H04 - ELECTRIC COMMUNICATION TECHNIQUE
Information Patent Grant
Cost-effective mobile connectivity protocols
- Patent number 9,832,628
- Issue date Nov 28, 2017
- Elwha, LLC
- Philip Lionel Barnes
- H04 - ELECTRIC COMMUNICATION TECHNIQUE
Information Patent Grant
Energy management by dynamic functionality partitioning
- Patent number 9,785,225
- Issue date Oct 10, 2017
- Microsoft Technology Licensing, LLC
- Mats Eric Myrberg
- G05 - CONTROLLING REGULATING
Information Patent Grant
Cost-effective mobile connectivity protocols
- Patent number 9,781,664
- Issue date Oct 3, 2017
- Elwha LLC
- Philip Lionel Barnes
- H04 - ELECTRIC COMMUNICATION TECHNIQUE
Information Patent Grant
Systems and methods for acoustic wave enabled data storage
- Patent number 9,653,128
- Issue date May 16, 2017
- Elwha LLC
- Philip Lionel Barnes
- G11 - INFORMATION STORAGE
Information Patent Grant
Cost-effective mobile connectivity protocols
- Patent number 9,451,394
- Issue date Sep 20, 2016
- Elwha LLC
- Philip Lionel Barnes
- H04 - ELECTRIC COMMUNICATION TECHNIQUE
Information Patent Grant
Systems and methods for acoustic wave enabled data storage
- Patent number 9,424,893
- Issue date Aug 23, 2016
- Elwha LLC
- Philip Lionel Barnes
- G10 - MUSICAL INSTRUMENTS ACOUSTICS

Patents Applicationslast 30 patents

Information Patent Application
Token Packing for Sequence Models
- Publication number 20240176953
- Publication date May 30, 2024
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
HARDWARE-ASSISTED GRADIENT OPTIMIZATION USING STREAMED GRADIENTS
- Publication number 20230274130
- Publication date Aug 31, 2023
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DUAL-MOMENTUM GRADIENT OPTIMIZATION WITH REDUCED MEMORY REQUIREMENTS
- Publication number 20230244945
- Publication date Aug 3, 2023
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DATA PARALLELISM IN DISTRIBUTED TRAINING OF ARTIFICIAL INTELLIGENCE...
- Publication number 20220283820
- Publication date Sep 8, 2022
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EXECUTING LARGE ARTIFICIAL INTELLIGENCE MODELS ON MEMORY-CONSTRAINE...
- Publication number 20220276871
- Publication date Sep 1, 2022
- Microsoft Technology Licensing, LLC
- Bharadwaj PUDIPEDDI
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DECIMATING HIDDEN LAYERS FOR TRAINING TRANSFORMER MODELS
- Publication number 20220108162
- Publication date Apr 7, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SYSTEMS AND METHODS FOR ERROR RECOVERY
- Publication number 20220107864
- Publication date Apr 7, 2022
- Microsoft Technology Licensing, LLC
- Bharadwaj PUDIPEDDI
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
COMPRESSING WEIGHTS FOR DISTRIBUTED NEURAL NETWORKS
- Publication number 20220076112
- Publication date Mar 10, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
FORCING WEIGHTS OF TRANSFORMER MODEL LAYERS
- Publication number 20220076127
- Publication date Mar 10, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Reducing Hardware Resource Utilization for Residual Neural Networks
- Publication number 20220067490
- Publication date Mar 3, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Compressing and Decompressing Data for Language Models
- Publication number 20220067529
- Publication date Mar 3, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
MULTI-TOKEN EMBEDDING AND CLASSIFIER FOR MASKED LANGUAGE MODELS
- Publication number 20220067280
- Publication date Mar 3, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DETERMINING POSITION VALUES FOR TRANSFORMER MODELS
- Publication number 20220027576
- Publication date Jan 27, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
COMPRESSING TOKENS BASED ON POSITIONS FOR TRANSFORMER MODELS
- Publication number 20220027719
- Publication date Jan 27, 2022
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Position Masking for Transformer Models
- Publication number 20210365723
- Publication date Nov 25, 2021
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Token Packing for Sequence Models
- Publication number 20210365633
- Publication date Nov 25, 2021
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Systems and Methods for Training a Neural Network
- Publication number 20210350226
- Publication date Nov 11, 2021
- Microsoft Technology Licensing, LLC
- Andy WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DUAL-MOMENTUM GRADIENT OPTIMIZATION WITH REDUCED MEMORY REQUIREMENTS
- Publication number 20210326711
- Publication date Oct 21, 2021
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SPREAD NEURAL NETWORKS
- Publication number 20210319309
- Publication date Oct 14, 2021
- Microsoft Technology Licensing, LLC
- Andrew WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
TOKEN-POSITION HANDLING FOR SEQUENCE BASED NEURAL NETWORKS
- Publication number 20210319288
- Publication date Oct 14, 2021
- Microsoft Technology Licensing, LLC
- Andrew WAGNER
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SYSTEM AND METHOD FOR GRADIENT ACCUMULATION WITH FREE MOMENTUM
- Publication number 20210303991
- Publication date Sep 30, 2021
- Microsoft Technology Licensing, LLC
- Andrew Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
HARDWARE-ASSISTED GRADIENT OPTIMIZATION USING STREAMED GRADIENTS
- Publication number 20210295141
- Publication date Sep 23, 2021
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SYSTEM AND METHOD FOR IMPROVING CONVOLUTIONAL NEURAL NETWORK-BASED...
- Publication number 20210287083
- Publication date Sep 16, 2021
- Microsoft Technology Licensing, LLC
- Sujeeth S. Bharadwaj
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ACCELERATOR FOR DENSE AND SPARSE MATRIX COMPUTATIONS
- Publication number 20210240797
- Publication date Aug 5, 2021
- Microsoft Technology Licensing, LLC
- Layali RASHID
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SYSTEMS AND METHODS FOR ERROR RECOVERY
- Publication number 20210232451
- Publication date Jul 29, 2021
- Microsoft Technology Licensing, LLC
- Bharadwaj PUDIPEDDI
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
PIPELINED NEURAL NETWORK PROCESSING WITH CONTINUOUS AND ASYNCHRONOU...
- Publication number 20210097366
- Publication date Apr 1, 2021
- Microsoft Technology Licensing, LLC
- Andy Wagner
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
LOSSLESS EXPONENT AND LOSSY MANTISSA WEIGHT COMPRESSION FOR TRAININ...
- Publication number 20210064986
- Publication date Mar 4, 2021
- Microsoft Technology Licensing, LLC
- Jinwen Xi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EXECUTING LARGE ARTIFICIAL INTELLIGENCE MODELS ON MEMORY-CONSTRAINE...
- Publication number 20210019151
- Publication date Jan 21, 2021
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DYNAMIC MULTI-LAYER EXECUTION FOR ARTIFICIAL INTELLIGENCE MODELING
- Publication number 20210019634
- Publication date Jan 21, 2021
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DATA PARALLELISM IN DISTRIBUTED TRAINING OF ARTIFICIAL INTELLIGENCE...
- Publication number 20210019152
- Publication date Jan 21, 2021
- Microsoft Technology Licensing, LLC
- Bharadwaj Pudipeddi
- G06 - COMPUTING CALCULATING COUNTING

Marc R. Tremblay

Person

Patents Grantslast 30 patents

Compressing and decompressing data for language models

Determining position values for transformer models

Token packing for sequence models

Position masking for transformer models

Reducing hardware resource utilization for residual neural networks

Hardware-assisted gradient optimization using streamed gradients

Systems and methods for error recovery

Pipelined neural network processing with continuous and asynchronou...

Dual-momentum gradient optimization with reduced memory requirements

Lossless exponent and lossy mantissa weight compression for trainin...

Systems and methods for training a neural network

Accelerator for dense and sparse matrix computations

Token-position handling for sequence based neural networks

Compressing weights for distributed neural networks

Executing large artificial intelligence models on memory-constraine...

Spread neural networks

System and method for gradient accumulation with free momentum

System and method for improving convolutional neural network-based...

Data parallelism in distributed training of artificial intelligence...

Dynamic multi-layer execution for artificial intelligence modeling

Systems and methods for error recovery

Computer memory content movement

Computing device performance of low precision arithmetic functions...

Cost-effective mobile connectivity protocols

Cost-effective mobile connectivity protocols

Energy management by dynamic functionality partitioning

Cost-effective mobile connectivity protocols

Systems and methods for acoustic wave enabled data storage

Cost-effective mobile connectivity protocols

Systems and methods for acoustic wave enabled data storage

Patents Applicationslast 30 patents

Token Packing for Sequence Models

HARDWARE-ASSISTED GRADIENT OPTIMIZATION USING STREAMED GRADIENTS

DUAL-MOMENTUM GRADIENT OPTIMIZATION WITH REDUCED MEMORY REQUIREMENTS

DATA PARALLELISM IN DISTRIBUTED TRAINING OF ARTIFICIAL INTELLIGENCE...

EXECUTING LARGE ARTIFICIAL INTELLIGENCE MODELS ON MEMORY-CONSTRAINE...

DECIMATING HIDDEN LAYERS FOR TRAINING TRANSFORMER MODELS

SYSTEMS AND METHODS FOR ERROR RECOVERY

COMPRESSING WEIGHTS FOR DISTRIBUTED NEURAL NETWORKS

FORCING WEIGHTS OF TRANSFORMER MODEL LAYERS

Reducing Hardware Resource Utilization for Residual Neural Networks

Compressing and Decompressing Data for Language Models

MULTI-TOKEN EMBEDDING AND CLASSIFIER FOR MASKED LANGUAGE MODELS

DETERMINING POSITION VALUES FOR TRANSFORMER MODELS

COMPRESSING TOKENS BASED ON POSITIONS FOR TRANSFORMER MODELS

Position Masking for Transformer Models

Token Packing for Sequence Models

Systems and Methods for Training a Neural Network

DUAL-MOMENTUM GRADIENT OPTIMIZATION WITH REDUCED MEMORY REQUIREMENTS

SPREAD NEURAL NETWORKS

TOKEN-POSITION HANDLING FOR SEQUENCE BASED NEURAL NETWORKS

SYSTEM AND METHOD FOR GRADIENT ACCUMULATION WITH FREE MOMENTUM

HARDWARE-ASSISTED GRADIENT OPTIMIZATION USING STREAMED GRADIENTS

SYSTEM AND METHOD FOR IMPROVING CONVOLUTIONAL NEURAL NETWORK-BASED...

ACCELERATOR FOR DENSE AND SPARSE MATRIX COMPUTATIONS

SYSTEMS AND METHODS FOR ERROR RECOVERY

PIPELINED NEURAL NETWORK PROCESSING WITH CONTINUOUS AND ASYNCHRONOU...

LOSSLESS EXPONENT AND LOSSY MANTISSA WEIGHT COMPRESSION FOR TRAININ...

EXECUTING LARGE ARTIFICIAL INTELLIGENCE MODELS ON MEMORY-CONSTRAINE...

DYNAMIC MULTI-LAYER EXECUTION FOR ARTIFICIAL INTELLIGENCE MODELING

DATA PARALLELISM IN DISTRIBUTED TRAINING OF ARTIFICIAL INTELLIGENCE...