Automated screening of COVID-19 preprints: Can we help authors to improve transparency and reproducibility? - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Poster De Conférence Année : 2020

Automated screening of COVID-19 preprints: Can we help authors to improve transparency and reproducibility?

Jennifer Byrne

Résumé

The COVID-19 pandemic has thrust preprints into the spotlight, highlighting their advantages and disadvantages. The lack of peer review allows publication to occur with unprecedented speed, but this has raised concerns among biomedical scientists about the quality of the reported research. The study had three primary objectives in regard to COVID-19 preprints: 1. Test the feasibility of automatically and publicly evaluating preprints on a large scale; 2. Assess the prevalence of common quality problems in preprints; and 3. Compare the quality of preprints to published papers. While a substantial fraction (36.2%) of preprints addressed study limitations, the proportion that met other quality criteria was much lower, with only 20% addressing sex as a variable, ~14% sharing open code or data, 7.6% including non-colorblind safe images, and 7.3% showing misleading bar graphs. Both authors and non-authors interacted with the automated Tweets containing reports for preprints. This project shows that it is feasible to conduct large-scale automated screening of preprints for common quality criteria and provide feedback to study authors and readers before publication. These reports can publicly raise awareness about factors that affect study quality and reproducibility, while helping authors to present their research in a more transparent and reproducible manner.
Fichier principal
Vignette du fichier
EckmannEtAl2020.pdf (842.32 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03078870 , version 1 (16-12-2020)

Identifiants

  • HAL Id : hal-03078870 , version 1

Citer

Peter Eckmann, Nico Riedel, Halil Kilicoglu, Gerben ter Riet, Cyril Labbé, et al.. Automated screening of COVID-19 preprints: Can we help authors to improve transparency and reproducibility?. Interdisciplinary Meta-research & Open Science Conference (AIMOS 2020), Dec 2020, Sydney, Australia. , 2020. ⟨hal-03078870⟩
283 Consultations
66 Téléchargements

Partager

Gmail Facebook X LinkedIn More