A Piecewise Deterministic Markov Toy Model for Traffic/Maintenance and Associated Hamilton-Jacobi Integrodifferential Systems on Networks - Laboratoire d'Analyse et de Mathématiques Appliquées Accéder directement au contenu
Article Dans Une Revue Applied Mathematics and Optimization Année : 2016

A Piecewise Deterministic Markov Toy Model for Traffic/Maintenance and Associated Hamilton-Jacobi Integrodifferential Systems on Networks

Dan Goreac
  • Fonction : Auteur correspondant
  • PersonId : 930178

Connectez-vous pour contacter l'auteur
PS
Magdalena Kobylanski
  • Fonction : Auteur
  • PersonId : 863915
PS

Résumé

We study optimal control problems in infinite horizon when the dynamics belong to a specific class of piecewise deterministic Markov processes constrained to star-shaped networks (inspired by traffic models). We adapt the results in [H. M. Soner. Optimal control with state-space constraint. II. SIAM J. Control Optim., 24(6):1110.1122, 1986] to prove the regularity of the value function and the dynamic programming principle. Extending the networks and Krylov's "shaking the coefficients" method, we prove that the value function can be seen as the solution to a linearized optimization problem set on a convenient set of probability measures. The approach relies entirely on viscosity arguments. As a by-product, the dual formulation guarantees that the value function is the pointwise supremum over regular subsolutions of the associated Hamilton-Jacobi integrodifferential system. This ensures that the value function satisfies Perron's preconization for the (unique) candidate to viscosity solution. Finally, we prove that the same kind of linearization can be obtained by combining linearization for classical (unconstrained) problems and cost penalization. The latter method works for very general near-viable systems (possibly without further controllability) and discontinuous costs.
Fichier principal
Vignette du fichier
GKM_Traffic_Rev2.pdf (373.27 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00986382 , version 1 (02-05-2014)
hal-00986382 , version 2 (03-10-2015)

Identifiants

Citer

Dan Goreac, Magdalena Kobylanski, Miguel Martinez. A Piecewise Deterministic Markov Toy Model for Traffic/Maintenance and Associated Hamilton-Jacobi Integrodifferential Systems on Networks. Applied Mathematics and Optimization, 2016, 74 (2), pp.375-421. ⟨10.1007/s00245-015-9319-z⟩. ⟨hal-00986382v2⟩
174 Consultations
191 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More