Transformer survey

링크Transformers have achieved great success in many artificial intelligence fileds, such as natural language processing, computer vision,m and audio pr

Transformer is a prominent deep learning model that has been widely adopted in various filed, such as natural language processing(NLP), computer visio

The vansilla Trnsformer is a sequence-tosequence model and consists of an encoder and a decoder, each of which is a stack of $L$ identical blocks.바닐라

Since Transformer doesn't introduce recurrence or convolution, it is ignorant of positional information (especially for the encoder).intorduce : 도입하다T