Pengcheng HE

Person

Sammamish, WA, US

People

Patents Grantslast 30 patents

Information Patent Grant
Efficient transformer language models with disentangled attention a...
- Patent number 12,061,876
- Issue date Aug 13, 2024
- Microsoft Technology Licensing, LLC
- Pengcheng He
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Multi-task machine learning architectures and training procedures
- Patent number 12,008,459
- Issue date Jun 11, 2024
- Microsoft Technology Licensing, LLC
- Weizhu Chen
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Adversarial pretraining of machine learning models
- Patent number 11,803,758
- Issue date Oct 31, 2023
- Microsoft Technology Licensing, LLC
- Xiaodong Liu
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Example based entity extraction, slot filling and value recommendation
- Patent number 11,720,757
- Issue date Aug 8, 2023
- Microsoft Technology Licensing, LLC
- Vikas Bahirwani
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Efficient transformer language models with disentangled attention a...
- Patent number 11,526,679
- Issue date Dec 13, 2022
- Microsoft Technology Licensing, LLC
- Pengcheng He
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Interactive dialog training and communication system using artifici...
- Patent number 11,003,863
- Issue date May 11, 2021
- Microsoft Technology Licensing, LLC
- Matthew Brigham Hall
- G06 - COMPUTING CALCULATING COUNTING

Patents Applicationslast 30 patents

Information Patent Application
Interacting with a Language Model using External Knowledge and Feed...
- Publication number 20240362418
- Publication date Oct 31, 2024
- Microsoft Technology Licensing, LLC
- Baolin PENG
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES
- Publication number 20240346295
- Publication date Oct 17, 2024
- Microsoft Technology Licensing, LLC
- Weizhu CHEN
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
LENGTH-CONTROLLED TEXT GENERATION USING A TEXT PROCESSING MODEL
- Publication number 20240193350
- Publication date Jun 13, 2024
- Microsoft Technology Licensing, LLC
- Yujia XIE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
UNIFIED NATURAL LANGUAGE MODEL WITH SEGMENTED AND AGGREGATE ATTENTION
- Publication number 20240062020
- Publication date Feb 22, 2024
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
PRE-TRAINING A UNIFIED NATURAL LANGUAGE MODEL WITH CORRUPTED SPAN A...
- Publication number 20240062018
- Publication date Feb 22, 2024
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS
- Publication number 20240013055
- Publication date Jan 11, 2024
- Microsoft Technology Licensing, LLC
- Xiaodong Liu
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...
- Publication number 20230222295
- Publication date Jul 13, 2023
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
LANGUAGE-MODEL PRETRAINING WITH GRADIENT-DISENTANGLED EMBEDDING SHA...
- Publication number 20230153532
- Publication date May 18, 2023
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...
- Publication number 20210334475
- Publication date Oct 28, 2021
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS
- Publication number 20210326751
- Publication date Oct 21, 2021
- Microsoft Technology Licensing, LLC
- Xiaodong Liu
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ADVERSARIAL TRAINING OF MACHINE LEARNING MODELS
- Publication number 20210142181
- Publication date May 13, 2021
- Microsoft Technology Licensing, LLC
- Xiaodong LIU
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EXAMPLE BASED ENTITY EXTRACTION, SLOT FILLING AND VALUE RECOMMENDATION
- Publication number 20210056169
- Publication date Feb 25, 2021
- Microsoft Technology Licensing, LLC
- Vikas Bahirwani
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES
- Publication number 20200334520
- Publication date Oct 22, 2020
- Microsoft Technology Licensing, LLC
- Weizhu CHEN
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
INTERACTIVE DIALOG TRAINING AND COMMUNICATION SYSTEM USING ARTIFICI...
- Publication number 20200302019
- Publication date Sep 24, 2020
- Microsoft Technology Licensing, LLC
- Matthew Brigham HALL
- G06 - COMPUTING CALCULATING COUNTING

Pengcheng HE

Person

Patents Grantslast 30 patents

Efficient transformer language models with disentangled attention a...

Multi-task machine learning architectures and training procedures

Adversarial pretraining of machine learning models

Example based entity extraction, slot filling and value recommendation

Efficient transformer language models with disentangled attention a...

Interactive dialog training and communication system using artifici...

Patents Applicationslast 30 patents

Interacting with a Language Model using External Knowledge and Feed...

MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES

LENGTH-CONTROLLED TEXT GENERATION USING A TEXT PROCESSING MODEL

UNIFIED NATURAL LANGUAGE MODEL WITH SEGMENTED AND AGGREGATE ATTENTION

PRE-TRAINING A UNIFIED NATURAL LANGUAGE MODEL WITH CORRUPTED SPAN A...

ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS

EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...

LANGUAGE-MODEL PRETRAINING WITH GRADIENT-DISENTANGLED EMBEDDING SHA...

EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...

ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS

ADVERSARIAL TRAINING OF MACHINE LEARNING MODELS

EXAMPLE BASED ENTITY EXTRACTION, SLOT FILLING AND VALUE RECOMMENDATION

MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES

INTERACTIVE DIALOG TRAINING AND COMMUNICATION SYSTEM USING ARTIFICI...