A 2019-2020 Review of R Neural Network Packages with NNbenchmark - CNRS-INSMI - INstitut des Sciences Mathématiques et de leurs Interactions
Pré-Publication, Document De Travail Année : 2022

A 2019-2020 Review of R Neural Network Packages with NNbenchmark

Résumé

In the last three decades, neural networks have evolved from an academic topic to a common scientific computing tool. CRAN currently hosts around 80 packages (May 2020) that involve neural network modeling; some offering more than one algorithm. However, to our knowledge, there is no comprehensive study which tests the accuracy, the reliability, and the ease-of-use of those NN packages. In this paper, we test a large number of packages against a common set of datasets with varying levels of complexity to benchmark and rank them with statistical metrics. We restrict our evaluation to single hidden-layer perceptrons that perform regression. We ignore packages for classification and other specialized purposes. This leaves us with approximately 60 package:algorithm pairs to test. The criteria used in our benchmark were: (i) accuracy, i.e. the ability to find the global minima on 13 datasets, measured by the Root Mean Square Error (RMSE) in a fixed number of iterations; (ii) speed of the training algorithm; (iii) availability of helpful utilities; (iv) quality of the documentation. We have given a score for each evaluation criterion to compare all package:algorithm pairs in a global table. Overall, 15 pairs are considered accurate and reliable and are recommended for daily usage. Other packages are either less accurate, slow, difficult to use, or have poor or zero documentation.
Fichier principal
Vignette du fichier
gsoc1920_MVKDN_R1_Zenodo.pdf (640.04 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04732774 , version 1 (11-10-2024)

Identifiants

Citer

Salsabila Mahdi, Akshaj Verma, Christophe Dutang, Patrice Kiener, John C Nash. A 2019-2020 Review of R Neural Network Packages with NNbenchmark. 2024. ⟨hal-04732774⟩
71 Consultations
24 Téléchargements

Altmetric

Partager

More