A Neural Tangent Kernel Perspective of GANs - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Poster De Conférence Année : 2022

A Neural Tangent Kernel Perspective of GANs

Résumé

We propose a novel theoretical framework of analysis for Generative Adversarial Networks (GANs). We reveal a fundamental flaw of previous analyses which, by incorrectly modeling GANs' training scheme, are subject to ill-defined discriminator gradients. We overcome this issue which impedes a principled study of GAN training, solving it within our framework by taking into account the discriminator's architecture. To this end, we leverage the theory of infinite-width neural networks for the discriminator via its Neural Tangent Kernel. We characterize the trained discriminator for a wide range of losses and establish general differentiability properties of the network. From this, we derive new insights about the convergence of the generated distribution, advancing our understanding of GANs' training dynamics. We empirically corroborate these results via an analysis toolkit based on our framework, unveiling intuitions that are consistent with GAN practice.
Fichier principal
Vignette du fichier
gantk2_poster.pdf (913.03 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03716574 , version 1 (07-07-2022)

Licence

Paternité - Pas d'utilisation commerciale - Partage selon les Conditions Initiales

Identifiants

  • HAL Id : hal-03716574 , version 1

Citer

Jean-Yves Franceschi, Emmanuel de Bézenac, Ibrahim Ayed, Mickaël Chen, Sylvain Lamprier, et al.. A Neural Tangent Kernel Perspective of GANs. Thirty-ninth International Conference on Machine Learning, Jul 2022, Baltimore, MD, United States. . ⟨hal-03716574⟩
69 Consultations
28 Téléchargements

Partager

Gmail Facebook X LinkedIn More