Feedforward Neural Networks in Reinforcement Learning Applied to High-Dimensional Motor Control
Abstract
Local linear function approximators are often preferred to feedforward neural networks to estimate value functions in reinforcement learning. Still, motor tasks usually solved by this kind of methods have a low-dimensional state space. This article demonstrates that feedforward neural networks can be applied successfully to high-dimensional problems. The main difficulties of using backpropagation networks in reinforcement learning are reviewed, and a simple method to perform gradient descent eficiently is proposed. It was tested successfully on an original task of learning to swim by a complex simulated articulated robot, with 4 control variables and 12 independent state variables.
Cite
Text
Coulom. "Feedforward Neural Networks in Reinforcement Learning Applied to High-Dimensional Motor Control." International Conference on Algorithmic Learning Theory, 2002. doi:10.1007/3-540-36169-3_32Markdown
[Coulom. "Feedforward Neural Networks in Reinforcement Learning Applied to High-Dimensional Motor Control." International Conference on Algorithmic Learning Theory, 2002.](https://mlanthology.org/alt/2002/coulom2002alt-feedforward/) doi:10.1007/3-540-36169-3_32BibTeX
@inproceedings{coulom2002alt-feedforward,
title = {{Feedforward Neural Networks in Reinforcement Learning Applied to High-Dimensional Motor Control}},
author = {Coulom, Rémi},
booktitle = {International Conference on Algorithmic Learning Theory},
year = {2002},
pages = {403-414},
doi = {10.1007/3-540-36169-3_32},
url = {https://mlanthology.org/alt/2002/coulom2002alt-feedforward/}
}