arXiv 2106.04619
Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style
By Julius von Kügelgen, Yash Sharma, et al.
Published 2021-06-08
Citation lineage
Review the prior work and downstream research connected to this paper.
Self-supervised representation learning has shown remarkable success in a number of domains. A common practice is to perform data augmentation via hand-crafted transformations intended to leave the semantics of the data invariant. We seek to understand the empirical success of this approach from a theoretical perspective. We formulate the augmentation process as a latent variable model by postulating a partition of…