Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse - Institut du Cerveau et de la Moëlle Epinière Accéder directement au contenu
Article Dans Une Revue Medical Image Analysis Année : 2023

Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse

Résumé

A variety of algorithms have been proposed for computer-aided diagnosis of dementia from anatomical brain MRI. These approaches achieve high accuracy when applied to research data sets but their performance on real-life clinical routine data has not been evaluated yet. The aim of this work was to study the performance of such approaches on clinical routine data, based on a hospital data warehouse, and to compare the results to those obtained on a research data set. The clinical data set was extracted from the hospital data warehouse of the Greater Paris area, which includes 39 different hospitals. The research set was composed of data from the Alzheimer's Disease Neuroimaging Initiative data set. In the clinical set, the population of interest was identified by exploiting the diagnostic codes from the 10th revision of the International Classification of Diseases that are assigned to each patient. We studied how the imbalance of the training sets, in terms of contrast agent injection and image quality, may bias the results. We demonstrated that computer-aided diagnosis performance was strongly biased upwards (over 17 percent points of balanced accuracy) by the confounders of image quality and contrast agent injection, a phenomenon known as the Clever Hans effect or shortcut learning. When these biases were removed, the performance was very poor. In any case, the performance was considerably lower than on the research data set. Our study highlights that there are still considerable challenges for translating dementia computer-aided diagnosis systems to clinical routine.
Fichier principal
Vignette du fichier
6-Paper_NO_track_changes.pdf (465.98 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03656136 , version 1 (01-05-2022)
hal-03656136 , version 2 (04-06-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-03656136 , version 2

Citer

Simona Bottani, Ninon Burgos, Aurélien Maire, Dario Saracino, Sebastian Stroer, et al.. Evaluation of MRI-based machine learning approaches for computer-aided diagnosis of dementia in a clinical data warehouse. Medical Image Analysis, 2023, 89, pp.102903. ⟨hal-03656136v2⟩
234 Consultations
314 Téléchargements

Partager

Gmail Facebook X LinkedIn More