language-model
1.[Transformer] Attention Is All You Need
Attention Is All You Need, NIPS 2017
2023년 5월 31일
2.[GPT] Improving Language Understanding by Generative Pre-Training
Improving Language Understanding by Generative Pre-Training
2023년 7월 4일
3.BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding, arXiv 2018
2023년 7월 4일
4.RoBERTa: A Robustly Optimized BERT Pretraining Approach
RoBERTa: A Robustly Optimized BERT Pretraining Approach, Facebook AI
2023년 1월 25일
5.BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
2023년 7월 6일
6.[T0] Multitask Prompted Training Enables Zero-Shot Task Generalization
Multitask Prompted Training Enables Zero-Shot Task Generalization, ICLR 2022
2023년 5월 1일
7.LLaMA: Open and Efficient Foundation Language Models
LLaMA: Open and Efficient Foundation Language Models, arXiv 2023
2023년 5월 3일
8.Sparks of Artificial General Intelligence: Early experiments with GPT-4
Sparks of Artificial General Intelligence: Early experiments with GPT-4, arXiv 2023
2023년 5월 30일
9.OPT: Open Pre-trained Transformer Language Models
OPT: Open Pre-trained Transformer Language Models, arXiv 2022
2023년 9월 15일