Transfer-Learning vs Fine-tuning vs Domain-Adaptation

Yongsang Yoon·2021년 11월 30일
0

개인공부방

목록 보기
4/5

Transfer Learning

Using Transfer Learning you should freeze some layers, mainly the pre-trained ones and only train in the added ones,

In Transfer Learning or Domain Adaptation, we train the model with a dataset. Then, we train the same model with another dataset that has a different distribution of classes, or even with other classes than in the first training dataset

Domain adaptation

I think that "Transfer Learning" is a more general term, and "Domain Adaptation" is a scenario of "Transfer Learning". Link

Fine-Tuning

Fine-tuning means taking weights of a trained neural network and use it as initialization for a new model being trained on data from the same domain (often e.g. images).

profile
I'm a student

1개의 댓글

comment-user-thumbnail
2021년 11월 30일

비밀 댓글입니다.

답글 달기