The BRaliBase dent - a tale of benchmark design and interpretation. - Laboratoire d'informatique de l'école polytechnique Accéder directement au contenu
Article Dans Une Revue Briefings in Bioinformatics Année : 2017

The BRaliBase dent - a tale of benchmark design and interpretation.

Résumé

BRaliBase is a widely used benchmark for assessing the accuracy of RNA secondary structure alignment methods. In most case studies based on the BRaliBase benchmark, one can observe a puzzling drop in accuracy in the 40-60% sequence identity range, the so-called 'BRaliBase Dent'. In this article, we show this dent is owing to a bias in the composition of the BRaliBase benchmark, namely the inclusion of a disproportionate number of transfer RNAs, which exhibit a conserved secondary structure. Our analysis, aside of its interest regarding the specific case of the BRaliBase benchmark, also raises important questions regarding the design and use of benchmarks in computational biology.
Fichier principal
Vignette du fichier
bbw022.pdf (435.19 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-01273406 , version 1 (16-01-2024)

Identifiants

Citer

Benedikt Löwes, Cedric Chauve, Yann Ponty, Robert Giegerich. The BRaliBase dent - a tale of benchmark design and interpretation.. Briefings in Bioinformatics, 2017, 18 (2), pp.306--311. ⟨10.1093/bib/bbw022⟩. ⟨hal-01273406⟩
367 Consultations
2 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More