Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models - Laboratoire Parole et Langage Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models

Résumé

Head and Neck Cancers (HNC) significantly impact patients' ability to speak, affecting their quality of life. Commonly used metrics for assessing pathological speech are subjective, prompting the need for automated and unbiased evaluation methods. This study proposes a self-supervised Wav2Vec2-based model for phone classification with HNC patients, to enhance accuracy and improve the discrimination of phonetic features for subsequent interpretability purpose. The impact of pre-training datasets, model size, and fine-tuning datasets and parameters are explored. Evaluation on diverse corpora reveals the effectiveness of the Wav2Vec2 architecture, outperforming a CNN-based approach, used in previous work. Correlation with perceptual measures also affirms the model relevance for impaired speech analysis. This work paves the way for better understanding of pathological speech with interpretable approaches for clinicians, by leveraging complex self-learnt speech representations.
Fichier principal
Vignette du fichier
maisonneuve24.pdf (295.76 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04623180 , version 1 (25-06-2024)

Identifiants

Citer

Malo Maisonneuve, Corinne Fredouille, Muriel Lalain, Alain Ghio, Virginie Woisard. Towards objective and interpretable speech disorder assessment: a comparative analysis of CNN and transformer-based models. Interspeech 2024, Sep 2024, Kos Island, Greece. ⟨hal-04623180⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More