Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Communication Dans Un Congrès Année : 2018

Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit

Résumé

This paper presents a web based toolkit for implementing Interactive Machine Learning (IML) dedicated to creative audio applications. The toolkit, composed of a main library and a template application , facilitates the creation of experiences on collective musical interactions with a strong emphasis on real-time movement processing and recognition. At its lower level, the mano-js library proposes a user-friendly API built on top of existing libraries. The library is designed to assist developers and creative coders in the appropriation and usage of the Interactive Machine Learning concepts and workflow, as well as to simplify development of new applications. The library is open-source, based on web standards and released under the BSD-3-Clause Licence. At its higher level, the toolkit proposes Elements, a template application designed towards non-developer users. The application specifically aims at providing a mean for researchers and designers to prototype new movement-based distributed Interactive Machine Learning scenarios. The application allows to create a new scenario by simply providing a JSON configuration file that defines the role and the abilities of each client. The application has been iteratively tested and developed in the context of several workshops.
Fichier principal
Vignette du fichier
2018-WAC - Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit.pdf (564.6 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01874966 , version 1 (30-07-2019)

Identifiants

  • HAL Id : hal-01874966 , version 1

Citer

Benjamin Matuszewski, Joseph Larralde, Frédéric Bevilacqua. Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit. Web Audio Conference (WAC), Sep 2018, Berlin, Germany. ⟨hal-01874966⟩
167 Consultations
120 Téléchargements

Partager

Gmail Facebook X LinkedIn More