arXiv 2106.04619
Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style
By Julius von Kügelgen, Yash Sharma, et al.
Published 2021-06-08
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
Self-supervised representation learning has shown remarkable success in a number of domains. A common practice is to perform data augmentation via hand-crafted transformations intended to leave the semantics of the data invariant. We seek to understand the empirical success of this approach from a theoretical perspective. We formulate the augmentation process as a latent variable model by postulating a partition of…