An Approximate Inference Approach to Temporal Optimization in Optimal Control

Abstract

Algorithms based on iterative local approximations present a practical approach to optimal control in robotic systems. However, they generally require the temporal parameters (for e.g. the movement duration or the time point of reaching an intermediate goal) to be specified \textit{a priori}. Here, we present a methodology that is capable of jointly optimising the temporal parameters in addition to the control command profiles. The presented approach is based on a Bayesian canonical time formulation of the optimal control problem, with the temporal mapping from canonical to real time parametrised by an additional control variable. An approximate EM algorithm is derived that efficiently optimises both the movement duration and control commands offering, for the first time, a practical approach to tackling generic via point problems in a systematic way under the optimal control framework. The proposed approach is evaluated on simulations of a redundant robotic plant.

Cite

Text

Rawlik et al. "An Approximate Inference Approach to Temporal Optimization in Optimal Control." Neural Information Processing Systems, 2010.

Markdown

[Rawlik et al. "An Approximate Inference Approach to Temporal Optimization in Optimal Control." Neural Information Processing Systems, 2010.](https://mlanthology.org/neurips/2010/rawlik2010neurips-approximate/)

BibTeX

@inproceedings{rawlik2010neurips-approximate,
  title     = {{An Approximate Inference Approach to Temporal Optimization in Optimal Control}},
  author    = {Rawlik, Konrad and Toussaint, Marc and Vijayakumar, Sethu},
  booktitle = {Neural Information Processing Systems},
  year      = {2010},
  pages     = {2011-2019},
  url       = {https://mlanthology.org/neurips/2010/rawlik2010neurips-approximate/}
}