Noam Shazeer

Person

Palo Alto, CA, US

People

Patents Grantslast 30 patents

Information Patent Grant
Using large language model(s) in generating automated assistant res...
- Patent number 12,148,421
- Issue date Nov 19, 2024
- Google LLC
- Martin Baeuml
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based image generation neural networks
- Patent number 12,142,034
- Issue date Nov 12, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Speech recognition with attention-based recurrent neural networks
- Patent number 12,100,391
- Issue date Sep 24, 2024
- Google LLC
- William Chan
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Neural networks with switch layers
- Patent number 12,093,829
- Issue date Sep 17, 2024
- Google LLC
- William Bradley Fedus
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Evaluating output sequences using an auto-regressive language model...
- Patent number 12,086,713
- Issue date Sep 10, 2024
- Google LLC
- Daniel De Freitas Adiwardana
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Mixture of experts neural networks
- Patent number 12,067,476
- Issue date Aug 20, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Deterministic training of machine learning models
- Patent number 12,014,276
- Issue date Jun 18, 2024
- Google LLC
- Gaurav Mishra
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Machine-learned language models which generate intermediate textual...
- Patent number 11,960,848
- Issue date Apr 16, 2024
- Google LLC
- Noam Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Training recurrent neural networks to generate sequences
- Patent number 11,954,594
- Issue date Apr 9, 2024
- Google LLC
- Samy Bengio
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based sequence transduction neural networks
- Patent number 11,893,483
- Issue date Feb 6, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based decoder-only sequence transduction neural networks
- Patent number 11,886,998
- Issue date Jan 30, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based image generation neural networks
- Patent number 11,816,884
- Issue date Nov 14, 2023
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Modifying search result ranking based on implicit user feedback
- Patent number 11,816,114
- Issue date Nov 14, 2023
- Google LLC
- Hyung-Jin Kim
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Mixture of experts neural networks
- Patent number 11,790,214
- Issue date Oct 17, 2023
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Parallel decoding using transformer models
- Patent number 11,681,954
- Issue date Jun 20, 2023
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Machine-learned language models which generate intermediate textual...
- Patent number 11,574,131
- Issue date Feb 7, 2023
- Google LLC
- Noam Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based decoder-only sequence transduction neural networks
- Patent number 11,556,786
- Issue date Jan 17, 2023
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Multi-task multi-modal machine learning system
- Patent number 11,494,561
- Issue date Nov 8, 2022
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based image generation neural networks
- Patent number 11,392,790
- Issue date Jul 19, 2022
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Modifying search result ranking based on implicit user feedback
- Patent number 11,188,544
- Issue date Nov 30, 2021
- Google LLC
- Hyung-Jin Kim
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Speech recognition with attention-based recurrent neural networks
- Patent number 11,151,985
- Issue date Oct 19, 2021
- Google LLC
- William Chan
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based sequence transduction neural networks
- Patent number 11,113,602
- Issue date Sep 7, 2021
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Training recurrent neural networks to generate sequences
- Patent number 11,003,993
- Issue date May 11, 2021
- Google LLC
- Samy Bengio
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based sequence transduction neural networks
- Patent number 10,956,819
- Issue date Mar 23, 2021
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based image generation neural networks
- Patent number 10,839,259
- Issue date Nov 17, 2020
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Distributing tensor computations across computing devices
- Patent number 10,796,225
- Issue date Oct 6, 2020
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Multi-task multi-modal machine learning system
- Patent number 10,789,427
- Issue date Sep 29, 2020
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Mixture of experts neural networks
- Patent number 10,719,761
- Issue date Jul 21, 2020
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Attention-based sequence transduction neural networks
- Patent number 10,719,764
- Issue date Jul 21, 2020
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Grant
Generating feature embeddings from a co-occurrence matrix
- Patent number 10,685,012
- Issue date Jun 16, 2020
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING

Patents Applicationslast 30 patents

Information Patent Application
MIXTURE OF EXPERTS NEURAL NETWORKS
- Publication number 20250021799
- Publication date Jan 16, 2025
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
GRANULAR NEURAL NETWORK ARCHITECTURE SEARCH OVER LOW-LEVEL PRIMITIVES
- Publication number 20240428071
- Publication date Dec 26, 2024
- Google LLC
- David Richard So
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
EVALUATING OUTPUT SEQUENCES USING AN AUTO-REGRESSIVE LANGUAGE MODEL...
- Publication number 20240403639
- Publication date Dec 5, 2024
- Google LLC
- Daniel De Freitas Adiwardana
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Machine-Learned Language Models Which Generate Intermediate Textual...
- Publication number 20240256786
- Publication date Aug 1, 2024
- Google LLC
- Noam Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20240256859
- Publication date Aug 1, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Machine-Learned Language Models Which Generate Intermediate Textual...
- Publication number 20240220734
- Publication date Jul 4, 2024
- Google LLC
- Noam Shazeer
- G10 - MUSICAL INSTRUMENTS ACOUSTICS
Information Patent Application
ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20240220796
- Publication date Jul 4, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20240211751
- Publication date Jun 27, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20240211752
- Publication date Jun 27, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS
- Publication number 20240193926
- Publication date Jun 13, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20240144006
- Publication date May 2, 2024
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
MIXTURE OF EXPERTS NEURAL NETWORKS
- Publication number 20230419079
- Publication date Dec 28, 2023
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DETERMINISTIC TRAINING OF MACHINE LEARNING MODELS
- Publication number 20230351190
- Publication date Nov 2, 2023
- Google LLC
- Gaurav Mishra
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
NEURAL NETWORKS WITH SWITCH LAYERS
- Publication number 20230351188
- Publication date Nov 2, 2023
- Google LLC
- William Bradley Fedus
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
DETERMINISTIC TRAINING OF MACHINE LEARNING MODELS
- Publication number 20230316082
- Publication date Oct 5, 2023
- Google LLC
- Gaurav Mishra
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION NEURAL NETWORKS WITH CONDITIONAL COMPUTATION
- Publication number 20230222318
- Publication date Jul 13, 2023
- Google LLC
- Dmitry Lepikhin
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Machine-Learned Language Models Which Generate Intermediate Textual...
- Publication number 20230177276
- Publication date Jun 8, 2023
- Google LLC
- Noam Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20230153613
- Publication date May 18, 2023
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS
- Publication number 20230076971
- Publication date Mar 9, 2023
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
USING LARGE LANGUAGE MODEL(S) IN GENERATING AUTOMATED ASSISTANT RES...
- Publication number 20230074406
- Publication date Mar 9, 2023
- Google LLC
- Martin Baeuml
- G10 - MUSICAL INSTRUMENTS ACOUSTICS
Information Patent Application
EVALUATING OUTPUT SEQUENCES USING AN AUTO-REGRESSIVE LANGUAGE MODEL...
- Publication number 20230029590
- Publication date Feb 2, 2023
- Google LLC
- Daniel De Freitas Adiwardana
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
GRANULAR NEURAL NETWORK ARCHITECTURE SEARCH OVER LOW-LEVEL PRIMITIVES
- Publication number 20220383119
- Publication date Dec 1, 2022
- Google LLC
- David Richard So
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
Machine-Learned Language Models which Generate Intermediate Textual...
- Publication number 20220374608
- Publication date Nov 24, 2022
- Google LLC
- Noam Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20220051099
- Publication date Feb 17, 2022
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
SPEECH RECOGNITION WITH ATTENTION-BASED RECURRENT NEURAL NETWORKS
- Publication number 20220028375
- Publication date Jan 27, 2022
- Google LLC
- William Chan
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION NEURAL NETWORKS WITH TALKING HEADS ATTENTION
- Publication number 20210279576
- Publication date Sep 9, 2021
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION NEURAL NETWORKS WITH LINEAR UNITS
- Publication number 20210248473
- Publication date Aug 12, 2021
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS
- Publication number 20210064924
- Publication date Mar 4, 2021
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20210019624
- Publication date Jan 21, 2021
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING
Information Patent Application
ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS
- Publication number 20210019623
- Publication date Jan 21, 2021
- Google LLC
- Noam M. Shazeer
- G06 - COMPUTING CALCULATING COUNTING

Noam Shazeer

Person

Patents Grantslast 30 patents

Using large language model(s) in generating automated assistant res...

Attention-based image generation neural networks

Speech recognition with attention-based recurrent neural networks

Neural networks with switch layers

Evaluating output sequences using an auto-regressive language model...

Mixture of experts neural networks

Deterministic training of machine learning models

Machine-learned language models which generate intermediate textual...

Training recurrent neural networks to generate sequences

Attention-based sequence transduction neural networks

Attention-based decoder-only sequence transduction neural networks

Attention-based image generation neural networks

Modifying search result ranking based on implicit user feedback

Mixture of experts neural networks

Parallel decoding using transformer models

Machine-learned language models which generate intermediate textual...

Attention-based decoder-only sequence transduction neural networks

Multi-task multi-modal machine learning system

Attention-based image generation neural networks

Modifying search result ranking based on implicit user feedback

Speech recognition with attention-based recurrent neural networks

Attention-based sequence transduction neural networks

Training recurrent neural networks to generate sequences

Attention-based sequence transduction neural networks

Attention-based image generation neural networks

Distributing tensor computations across computing devices

Multi-task multi-modal machine learning system

Mixture of experts neural networks

Attention-based sequence transduction neural networks

Generating feature embeddings from a co-occurrence matrix

Patents Applicationslast 30 patents

MIXTURE OF EXPERTS NEURAL NETWORKS

GRANULAR NEURAL NETWORK ARCHITECTURE SEARCH OVER LOW-LEVEL PRIMITIVES

EVALUATING OUTPUT SEQUENCES USING AN AUTO-REGRESSIVE LANGUAGE MODEL...

Machine-Learned Language Models Which Generate Intermediate Textual...

ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS

Machine-Learned Language Models Which Generate Intermediate Textual...

ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS

ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS

ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS

ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS

ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS

MIXTURE OF EXPERTS NEURAL NETWORKS

DETERMINISTIC TRAINING OF MACHINE LEARNING MODELS

NEURAL NETWORKS WITH SWITCH LAYERS

DETERMINISTIC TRAINING OF MACHINE LEARNING MODELS

ATTENTION NEURAL NETWORKS WITH CONDITIONAL COMPUTATION

Machine-Learned Language Models Which Generate Intermediate Textual...

ATTENTION-BASED DECODER-ONLY SEQUENCE TRANSDUCTION NEURAL NETWORKS

ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS

USING LARGE LANGUAGE MODEL(S) IN GENERATING AUTOMATED ASSISTANT RES...

EVALUATING OUTPUT SEQUENCES USING AN AUTO-REGRESSIVE LANGUAGE MODEL...

GRANULAR NEURAL NETWORK ARCHITECTURE SEARCH OVER LOW-LEVEL PRIMITIVES

Machine-Learned Language Models which Generate Intermediate Textual...

ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS

SPEECH RECOGNITION WITH ATTENTION-BASED RECURRENT NEURAL NETWORKS

ATTENTION NEURAL NETWORKS WITH TALKING HEADS ATTENTION

ATTENTION NEURAL NETWORKS WITH LINEAR UNITS

ATTENTION-BASED IMAGE GENERATION NEURAL NETWORKS

ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS

ATTENTION-BASED SEQUENCE TRANSDUCTION NEURAL NETWORKS