Large-scale Benchmarking of Metaphor-based Optimization Heuristics - Laboratoire d'Informatique de Paris 6 Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Large-scale Benchmarking of Metaphor-based Optimization Heuristics

Résumé

The number of proposed iterative optimization heuristics is growing steadily, and with this growth, there have been many points of discussion within the wider community. One particular criticism that is raised towards many new algorithms is their focus on metaphors used to present the method, rather than emphasizing their potential algorithmic contributions. Several studies into popular metaphor-based algorithms have highlighted these problems, even showcasing algorithms that are functionally equivalent to older existing methods. Unfortunately, this detailed approach is not scalable to the whole set of metaphor-based algorithms. Because of this, we investigate ways in which benchmarking can shed light on these algorithms. To this end, we run a set of $294$ algorithm implementations on the BBOB function suite. We investigate how the choice of the budget, the performance measure, or other aspects of experimental design impact the comparison of these algorithms. Our results emphasize why benchmarking is a key step in expanding our understanding of the algorithm space, and what challenges still need to be overcome to fully gauge the potential improvements to the state-of-the-art hiding behind the metaphors.

Mots clés

Fichier principal
Vignette du fichier
GECCO-2024-LargeScaleBenchmarking.pdf (1.26 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04580572 , version 1 (20-05-2024)

Identifiants

Citer

Diederick Vermetten, Carola Doerr, Hao Wang, Anna Kononova, Thomas Bäck. Large-scale Benchmarking of Metaphor-based Optimization Heuristics. GECCO '24: Proceedings of the Genetic and Evolutionary Computation Conference, Jul 2024, Melbourne, Australia. ⟨10.1145/3638529.3654122⟩. ⟨hal-04580572⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More