Escaping the Big Data Paradigm with Compact Transformers

With the rise of Transformers as the standard for language processing, and their advancements in computer vision, there has been a corresponding growt

Introduction Convolutional neural networks (CNNs) [23] have been the standard for computer vision, since the success of AlexNet [22]. CNN(Convolution