Robust Deep Reinforcement Learning Control for a Launcher Upper Stage Module with Stability Certificate - DTIS ONERA
Communication Dans Un Congrès Année : 2024

Robust Deep Reinforcement Learning Control for a Launcher Upper Stage Module with Stability Certificate

Résumé

This paper considers the design of an attitude controller of a launcher upper stage module during its exoatmospheric phase, where short boosts are performed to adapt the flight path. Those maneuvers can increase propellants' motion in the tanks, leading to the so-called sloshing phenomenon that may affect the stability of the vehicle.

A Deep Reinforcement Learning (DRL) algorithm is proposed to design the controller accounting for non linearities of the launcher and sloshing dynamics as well as presence of time-delay, bias and saturations on the actuation system. Based on Proximal Policy Optimization (PPO) and Almost Lyapunov functions in an actor-critic scheme, it allows to robustly learn a controller along with stability certificates, in presence of model uncertainties. Simulation results are proposed to illustrate the approach.

Fichier principal
Vignette du fichier
Robust Deep Reinforcement Learning Control for a Launcher.pdf (2.63 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04791018 , version 1 (19-11-2024)

Identifiants

Citer

Périclès Cocaul, Sylvain Bertrand, Hélène Piet-Lahanier, Martine Ganet, Lori Lemazurier. Robust Deep Reinforcement Learning Control for a Launcher Upper Stage Module with Stability Certificate. 2024 IEEE Conference on Control Technology and Applications (CCTA), Aug 2024, Newcastle upon Tyne, France. pp.171-177, ⟨10.1109/CCTA60707.2024.10666609⟩. ⟨hal-04791018⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More