LLMs

2020

GPT-3: Language Models are Few-Shot Learners

2020-05-28LLMsLLMs, GPTs

2019

T5: Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

2019-10-23LLMsLLMs, Sequence Packing

GPT-2: Language Models are Unsupervised Multitask Learners

2019-02-14LLMsLLMs, GPTs

BBPE: Byte-level Byte Pair Encoding

2019-02-14LLMsLLMs, Tokenizer

2018

GPT-1: Improving Language Understanding by Generative Pre-Training

2018-06-11LLMsLLMs, GPTs

2017

Transformer: Attention Is All You Need

2017-06-12LLMsLLMs, Transformer

Taxonomy of Natural Language Processing Tasks

2017-06-12LLMsLLMs

1
2
3