Convolutional Embedding Makes Hierarchical Vision Transformer Stronger

no code implementations • 27 Jul 2022 • Cong Wang, Hongmin Xu, Xiong Zhang, Li Wang, Zhitong Zheng, Haifeng Liu

Vision Transformers (ViTs) have recently dominated a range of computer vision tasks, yet it suffers from low training data efficiency and inferior local semantic representation capability without appropriate inductive bias.

Inductive Bias