Swin Transformer : Hierarchical Vision Transformer using Shifted Windows year : 2021 Code : https://github.com/microsoft/Swin-Transformer Method Over
Title : Masked Autoencoders Are Scalable Vision Learners Date : 19 Dec 2021 Keywords : Autoencoder, Self-Supervised, Vision Transformer, Asymmetric ar
Title : BEIT : Pre-Training of Image Transformer Date : 15 Jun 2021 Keywords : Autoencoder,Self-Supervsied, Vision Transformer, BERT, Tokenize Title
Title : IBOT : Image BERT Pre-Training with Online Tokenizer Date : 22 Jan 2022 Keywords : Self-Supervised, Vision Transformer, BERT, Tokenizer, DINO