ML/DL

1.NLP (Natural Language Processing)

post-thumbnail

2.[NLP] Attention & Transformer

post-thumbnail

3.[NLP] BERT

post-thumbnail

4.[NLP] Natural Language Generation

post-thumbnail

5.[Audio] OpenAI Jukebox

post-thumbnail

6.활성화 함수 (Activation Functions)

post-thumbnail

7.[Audio] STT 후처리

post-thumbnail

8.[NLP] GPT-J, GPT-NeoX

post-thumbnail

9.[분산학습] Multi-GPU 학습

post-thumbnail

10.[NLP] 챗봇 DPR 스키밍

post-thumbnail

11.[효율적 학습] Accelerate, DeepSpeed

post-thumbnail

12.[분산학습] accelerate에서 Weigths&Biases 쓰기

post-thumbnail

13.[분산학습 이슈] RuntimeError: Invalid mt19937 state

post-thumbnail

14.Batch size가 크면 Learning Rate도 커야 한다

post-thumbnail

15.ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 1

post-thumbnail

16.[분산학습] Data Parallelism과 Model Parallelism

post-thumbnail

17.GPT-3 vs ChatGPT vs GPT-4

post-thumbnail