UROP
1.[UROP #1] Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation (1)
Paper : https://arxiv.org/abs/2305.09651
2023년 9월 30일
2.[UROP #2] SCOTT: Self-Consistent Chain-of-Thought Distillation
Paper : SCOTT: Self-Consistent Chain-of-Thought Distillation
2023년 9월 30일
3.[UROP #3] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models (1)
Github : https://github.com/csarron/PuMer
2023년 10월 3일
4.[UROP #4] PuMer: Pruning and Merging Tokens for Efficient Vision Language Models (2)
Paper : https://aclanthology.org/2023.acl-long.721/
2023년 10월 4일
5.[UROP #5] Specializing Pre-trained Language Models for Better Relational Reasoning via Network Pruning
Github : https://github.com/DRSY/LAMP
2023년 10월 5일
6.[UROP #6] Understanding and Improving Knowledge Distillation for Quantization Aware Training of Large Transformer Encoders
Paper : https://aclanthology.org/2022.emnlp-main.450/
2023년 10월 9일
7.[UROP #7] Specializing Smaller Language Models towards Multi-Step ReasoningEncoders
Github : https://github.com/FranxYao/FlanT5-CoT-Specialization
2023년 10월 11일
8.[UROP #8] Deep Mutual Learning (1)
Paper : https://arxiv.org/abs/1706.00384
2023년 11월 19일
9.[UROP #9] Deep Mutual Learning (2)
Paper : https://arxiv.org/abs/1706.00384
2023년 11월 19일
10.[UROP #10] Dynamic Model Pruning with FeedBack
Paper : https://arxiv.org/abs/2006.07253
2023년 11월 21일
11.[UROP #11] Tailoring Instructions to Student’s Learning Levels Boosts Knowledge Distillation (2)
Github : https://github.com/twinkle0331/LGTM
2023년 12월 26일
12.[UROP #12] Movement Pruning: Adaptive Sparsity by Fine-Tuning
Paper : https://arxiv.org/abs/2005.07683
2023년 12월 31일
13.[UROP #13] Block Pruning For Faster Transformers
Paper : https://arxiv.org/abs/2109.04838
2024년 4월 12일
14.[UROP #14] Exploring Gender Bias in Pre-Trained Transformer-based Language Models Using Movement Pruning
Paper : https://arxiv.org/abs/2207.02463
2024년 5월 3일