Pré-Publication, Document De Travail Année : 2025

On the Impact of the Utility in Semivalue-based Data Valuation

Benjamin Heymann
  • Fonction : Auteur
  • PersonId : 1390346
Maxime Vono
  • Fonction : Auteur
  • PersonId : 1390350

Résumé

Semivalue-based data valuation in machine learning (ML) quantifies the contribution of individual data points to a downstream ML task by leveraging principles from cooperative game theory and the notion of utility. While this framework has been used in practice for assessing data quality, our experiments reveal inconsistent valuation outcomes across different utilities, albeit all related to ML performance. Beyond raising concerns about the reliability of data valuation, this inconsistency is challenging to interpret, as it stems from the complex interaction of the utility with data points and semivalue weights, which has barely been studied in prior work. In this paper, we take a first step toward clarifying the utility impact on semivalue-based data valuation. Specifically, we provide geometric interpretations of this impact for a broad family of classification utilities, which includes the accuracy and the arithmetic mean. We introduce the notion of spatial signatures: given a semivalue, data points can be embedded into a two-dimensional space, and utility functions map to the dual of this space. This geometric perspective separates the influence of the dataset and semivalue from that of the utility, providing a theoretical explanation for the experimentally observed sensitivity of valuation outcomes to the utility choice.
Fichier principal
Vignette du fichier
utility_impact_2025.pdf (3) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04946103 , version 1 (13-02-2025)

Identifiants

Citer

Mélissa Tamine, Benjamin Heymann, Patrick Loiseau, Maxime Vono. On the Impact of the Utility in Semivalue-based Data Valuation. 2025. ⟨hal-04946103⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More