Wasserstein Distributionally Robust Regret-Optimal Control over Infinite-Horizon
Abstract
We investigate the Distributionally Robust Regret-Optimal (DR-RO) control of discrete-time linear dynamical systems with quadratic cost over an infinite horizon. Regret is the difference in cost obtained by a causal controller and a clairvoyant controller with access to future disturbances. We focus on the infinite-horizon framework, which results in stability guarantees. In this DR setting, the probability distribution of the disturbances resides within a Wasserstein-2 ambiguity set centered at a specified nominal distribution. Our objective is to identify a control policy that minimizes the worst-case expected regret over an infinite horizon, considering all potential disturbance distributions within the ambiguity set. In contrast to prior works, which assume time-independent disturbances, we relax this constraint to allow for time-correlated disturbances, thus actual distributional robustness. While we show that the resulting optimal controller is non-rational and lacks a finite-dimensional state-space realization, we demonstrate that it can still be uniquely characterized by a finite dimensional parameter. Exploiting this fact, we introduce an efficient numerical method to compute the controller in the frequency domain using fixed-point iterations. This method circumvents the computational bottleneck associated with the finite-horizon problem, where the semi-definite programming (SDP) solution dimension scales with the time horizon. Numerical experiments demonstrate the effectiveness and performance of our framework.
Cite
Text
Kargin et al. "Wasserstein Distributionally Robust Regret-Optimal Control over Infinite-Horizon." Proceedings of the 6th Annual Learning for Dynamics & Control Conference, 2024.Markdown
[Kargin et al. "Wasserstein Distributionally Robust Regret-Optimal Control over Infinite-Horizon." Proceedings of the 6th Annual Learning for Dynamics & Control Conference, 2024.](https://mlanthology.org/l4dc/2024/kargin2024l4dc-wasserstein/)BibTeX
@inproceedings{kargin2024l4dc-wasserstein,
title = {{Wasserstein Distributionally Robust Regret-Optimal Control over Infinite-Horizon}},
author = {Kargin, Taylan and Hajar, Joudi and Malik, Vikrant and Hassibi, Babak},
booktitle = {Proceedings of the 6th Annual Learning for Dynamics & Control Conference},
year = {2024},
pages = {1688-1701},
volume = {242},
url = {https://mlanthology.org/l4dc/2024/kargin2024l4dc-wasserstein/}
}