Enhancing deep reinforcement learning with integral action to control tokamak safety factor - CNRS - Centre national de la recherche scientifique Accéder directement au contenu
Article Dans Une Revue Fusion Engineering and Design Année : 2023

Enhancing deep reinforcement learning with integral action to control tokamak safety factor

Améliorer l'apprentissage par renforcement profond avec une action intégrale pour contrôler le facteur de sécurité du tokamak

Résumé

Recent advances in the use of Artificial Intelligence to control complex systems make it suitable for profile plasma control. In this work, we propose an algorithm based on Deep Reinforcement Learning to control the safety factor profile with a feedback design. For this purpose, we first derive a device-specific control-oriented model with fast simulation time. Then, in order to enhance robustness with respect to external disturbances and model errors, we include an error time integrator into the controller. A cascade of the kinetic and magnetic models with the error time integrator is used in the learning procedure of the feedback controller. Finally, to illustrate the efficiency of the proposed design procedure, the obtained controller is tested in a reference plasma simulator, the Raptor simulator.
Fichier principal
Vignette du fichier
RL_tokamak (1).pdf (1.07 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04217005 , version 1 (25-09-2023)

Licence

Paternité

Identifiants

Citer

Andrea Mattioni, Samuele Zoboli, Bojan Mavkov, Daniele Astolfi, Vincent Andrieu, et al.. Enhancing deep reinforcement learning with integral action to control tokamak safety factor. Fusion Engineering and Design, 2023, 196, pp.114008. ⟨10.1016/j.fusengdes.2023.114008⟩. ⟨hal-04217005⟩
98 Consultations
157 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More