How to deal with missing data in supervised deep learning? - Laboratoire d'Informatique, Signaux et Systèmes de Sophia-Antipolis Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

How to deal with missing data in supervised deep learning?

Résumé

The issue of missing data in supervised learning has been largely overlooked, especially in the deep learning community. We investigate strategies to adapt neural architectures for handling missing values. Here, we focus on regression and classification problems where the features are assumed to be missing at random. Of particular interest are schemes that allow reusing as-is a neural discriminative architecture. To address supervised deep learning with missing values, we propose to marginalize over missing values in a joint model of covariates and outcomes. Thereby, we leverage both the flexibility of deep generative models to describe the distribution of the covariates and the power of purely discriminative models to make predictions. More precisely, a deep latent variable model can be learned jointly with the discriminative model, using importance-weighted variational inference, essentially using importance sampling to mimick averaging over multiple imputations. In low-capacity regimes, or when the discriminative model has a strong inductive bias, we find that our hybrid generative/discriminative approach generally outperforms single imputations methods.
Fichier principal
Vignette du fichier
how_to_deal_with_missing_data_ (1).pdf (4.58 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03044144 , version 1 (07-12-2020)
hal-03044144 , version 2 (23-03-2022)

Identifiants

  • HAL Id : hal-03044144 , version 2

Citer

Niels Bruun Ipsen, Pierre-Alexandre Mattei, Jes Frellsen. How to deal with missing data in supervised deep learning?. ICLR 2022 - 10th International Conference on Learning Representations, Apr 2022, Virtual conference, France. ⟨hal-03044144v2⟩
838 Consultations
2959 Téléchargements

Partager

Gmail Facebook X LinkedIn More