Introduction The vanilla ViT is problematic. If you take a look at the original ViT paper [1], you’ll notice that although this deep learning model proved to work extremely well, it requires hundreds of millions of labeled training images to achieve this.  Well, that’s a lot.  This requirement of an enormous amount of data is definitely […]

The post Vision Transformer on a Budget appeared first on Towards Data Science.