AI Model Develops Object Recognition Without Human Guidance

This paper shows that when Vision Transformers are trained without labels using self-supervision, they develop surprising abilities. Their attention maps reveal object boundaries, their features work exceptionally well with simple k-NN classifiers, and they outperform supervised ViTs on ImageNet. The authors introduce DINO, a label-free self-distillation method that unlocks these emergent properties.