arXiv 2301.08243
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
By Mahmoud Assran, Quentin Duval, et al.
Published 2023-01-19
Wiki summary
Explore the paper's summary, context, and related research on Papiers.
This paper demonstrates an approach for learning highly semantic image representations without relying on hand-crafted data-augmentations. We introduce the Image-based Joint-Embedding Predictive Architecture (I-JEPA), a non-generative approach for self-supervised learning from images. The idea behind I-JEPA is simple: from a single context block, predict the representations of various target blocks in the same image…