Xiaodong LIU

Person

Bellevue, WA, US

People

Patents Grantslast 30 patents

Information Patent Grant
Efficient transformer language models with disentangled attention a...
- Patent number 12,061,876
- Issue date Aug 13, 2024
- Microsoft Technology Licensing, LLC
- Pengcheng He
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Multi-task machine learning architectures and training procedures
- Patent number 12,008,459
- Issue date Jun 11, 2024
- Microsoft Technology Licensing, LLC
- Weizhu Chen
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Adversarial pretraining of machine learning models
- Patent number 11,803,758
- Issue date Oct 31, 2023
- Microsoft Technology Licensing, LLC
- Xiaodong Liu
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Learning graph representations using hierarchical transformers for...
- Patent number 11,676,001
- Issue date Jun 13, 2023
- Microsoft Technology Licensing, LLC
- Jian Jiao
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Efficient transformer language models with disentangled attention a...
- Patent number 11,526,679
- Issue date Dec 13, 2022
- Microsoft Technology Licensing, LLC
- Pengcheng He
- G06 - COMPUTING CALCULATING COUNTING

Patents Applicationslast 30 patents

Information Patent Application
MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES
- Publication number 20240346295
- Publication date Oct 17, 2024
- Microsoft Technology Licensing, LLC
- Weizhu CHEN
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Scalable and Resource-Efficient Knowledge-Graph Completion
- Publication number 20240311656
- Publication date Sep 19, 2024
- Microsoft Technology Licensing, LLC
- Xiaodong LIU
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DECOUPLED OPTIMIZATION OF MODELS DURING PRETRAINING
- Publication number 20240281705
- Publication date Aug 22, 2024
- Microsoft Technology Licensing, LLC
- Xiaodong LIU
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
LONG SEQUENCE MODELING VIA STATE SPACE MODEL (SSM)-ENHANCED TRANSFO...
- Publication number 20240202583
- Publication date Jun 20, 2024
- Microsoft Technology Licensing, LLC
- Xiaodong LIU
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
COMPUTERIZED QUESTION ANSWERING BASED ON EVIDENCE CHAINS
- Publication number 20240144049
- Publication date May 2, 2024
- Microsoft Technology Licensing, LLC
- Hao CHENG
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
TRANSFORMER-BASED TEXT ENCODER FOR PASSAGE RETRIEVAL
- Publication number 20240126993
- Publication date Apr 18, 2024
- Microsoft Technology Licensing, LLC
- Hao CHENG
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ML USING N-GRAM INDUCED INPUT REPRESENTATION
- Publication number 20240086619
- Publication date Mar 14, 2024
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS
- Publication number 20240013055
- Publication date Jan 11, 2024
- Microsoft Technology Licensing, LLC
- Xiaodong Liu
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
LEARNING GRAPH REPRESENTATIONS USING HIERARCHICAL TRANSFORMERS FOR...
- Publication number 20230267308
- Publication date Aug 24, 2023
- Microsoft Technology Licensing, LLC
- Jian JIAO
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...
- Publication number 20230222295
- Publication date Jul 13, 2023
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Training a Neural Network having Sparsely-Activated Sub-Networks us...
- Publication number 20230081624
- Publication date Mar 16, 2023
- Microsoft Technology Licensing, LLC
- Jian JIAO
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
LEARNING GRAPH REPRESENTATIONS USING HIERARCHICAL TRANSFORMERS FOR...
- Publication number 20220067030
- Publication date Mar 3, 2022
- Microsoft Technology Licensing, LLC
- Jian JIAO
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Hyperparameter Transfer Via the Theory of Infinite-Width Neural Net...
- Publication number 20220058477
- Publication date Feb 24, 2022
- Microsoft Technology Licensing, LLC
- Jingfeng HU
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...
- Publication number 20210334475
- Publication date Oct 28, 2021
- Microsoft Technology Licensing, LLC
- Pengcheng HE
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS
- Publication number 20210326751
- Publication date Oct 21, 2021
- Microsoft Technology Licensing, LLC
- Xiaodong Liu
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ADVERSARIAL TRAINING OF MACHINE LEARNING MODELS
- Publication number 20210142181
- Publication date May 13, 2021
- Microsoft Technology Licensing, LLC
- Xiaodong LIU
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES
- Publication number 20200334520
- Publication date Oct 22, 2020
- Microsoft Technology Licensing, LLC
- Weizhu CHEN
- G06 - COMPUTING CALCULATING COUNTING

Xiaodong LIU

Person

Patents Grantslast 30 patents

Efficient transformer language models with disentangled attention a...

Multi-task machine learning architectures and training procedures

Adversarial pretraining of machine learning models

Learning graph representations using hierarchical transformers for...

Efficient transformer language models with disentangled attention a...

Patents Applicationslast 30 patents

MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES

Scalable and Resource-Efficient Knowledge-Graph Completion

DECOUPLED OPTIMIZATION OF MODELS DURING PRETRAINING

LONG SEQUENCE MODELING VIA STATE SPACE MODEL (SSM)-ENHANCED TRANSFO...

COMPUTERIZED QUESTION ANSWERING BASED ON EVIDENCE CHAINS

TRANSFORMER-BASED TEXT ENCODER FOR PASSAGE RETRIEVAL

ML USING N-GRAM INDUCED INPUT REPRESENTATION

ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS

LEARNING GRAPH REPRESENTATIONS USING HIERARCHICAL TRANSFORMERS FOR...

EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...

Training a Neural Network having Sparsely-Activated Sub-Networks us...

LEARNING GRAPH REPRESENTATIONS USING HIERARCHICAL TRANSFORMERS FOR...

Hyperparameter Transfer Via the Theory of Infinite-Width Neural Net...

EFFICIENT TRANSFORMER LANGUAGE MODELS WITH DISENTANGLED ATTENTION A...

ADVERSARIAL PRETRAINING OF MACHINE LEARNING MODELS

ADVERSARIAL TRAINING OF MACHINE LEARNING MODELS

MULTI-TASK MACHINE LEARNING ARCHITECTURES AND TRAINING PROCEDURES