Symmetries in Overparametrized Neural Networks: A Mean Field View
Published in NeurIPS, 2024
This paper studies, under the Mean Field lens, how overparametrized neural networks behave when the data they are trained on satisfies simple symmetries and/or when symmetry-leveraging techniques (such as Data Augmentation, Feature Averaging or Equivariant Architectures) are used.