On the development of a avatar capable of speech and singing - Laboratoire sols, solides, structures - risques
Poster De Conférence Année : 2024

On the development of a avatar capable of speech and singing

Résumé

In the framework of a collaborative research project that aims to understand, reproduce and analyze voice in healthy and pathological cases using virtual and robotic avatars, we present the latest advances on the development of a mechatronic testbed named “Pinocchio”. Reproducing in vitro the dynamic movement of speech articulators, such as jaw, tongue, velum and larynx, together with phonation, remains a challenge. Design efforts were focused on three aspects: how to breath, how to phonate, how to articulate. Air supply is controlled through a valve opening linearly related to airflow rate at the device inlet, a settling chamber stabilizing upstream jet, and a long tube leading from the chamber to the laryngeal model. Phonation is controlled by acting on a flexible laryngeal envelope and 1:1 replica of vocal-folds replica through lateral compression and longitudinal stretching. Depending on the choice of folds geometry and material tensile stiffness, self-oscillations generate a voice source covering a pitch range from less than 110 Hz to more than 220 Hz. Adduction and abduction articulatory movements are implemented within the larynx. Two primary articulatory movements are implemented within a replica of the vocal-tract : mandibular motion and shaping of the oral cavity with the movement of tongue body and apex. F1-F2 vocalic space produced by movements of jaw and tongue was measured. At this early stage of his life, Pinocchio is able to produce vowels in the surrounding of an [a], with F1 between 500 and 700Hz and F2 between 1000 and 2000Hz.
Fichier principal
Vignette du fichier
2024_PEVOC_pinocchio_poster.pdf (2.75 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04729038 , version 1 (11-10-2024)

Licence

Identifiants

  • HAL Id : hal-04729038 , version 1

Citer

Nathalie Henrich Bernardoni, Arnaud Sylvain, Mounib Tlaidi, Julien Royer, Xavier Laval, et al.. On the development of a avatar capable of speech and singing. 15th Pan European Voice Conference (PEVoC), Sep 2024, Santander, France. ⟨hal-04729038⟩
48 Consultations
2 Téléchargements

Partager

More