SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark
Abstract
Reproducibility has been a significant challenge in deep reinforcement learning and robotics research. Open-source frameworks and standardized benchmarks can serve an integral role in rigorous evaluation and reproducible research. We introduce SURREAL, an open-source scalable framework that supports state-of-the-art distributed reinforcement learning algorithms. We design a principled distributed learning formulation that accommodates both on-policy and off-policy learning. We demonstrate that SURREAL algorithms outperform existing open-source implementations in both agent performance and learning efficiency. We also introduce SURREAL Robotics Suite, an accessible set of benchmarking tasks in physical simulation for reproducible robot manipulation research. We provide extensive evaluations of SURREAL algorithms and establish strong baseline results.
Cite
Text
Fan et al. "SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark." Proceedings of The 2nd Conference on Robot Learning, 2018.Markdown
[Fan et al. "SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark." Proceedings of The 2nd Conference on Robot Learning, 2018.](https://mlanthology.org/corl/2018/fan2018corl-surreal/)BibTeX
@inproceedings{fan2018corl-surreal,
title = {{SURREAL: Open-Source Reinforcement Learning Framework and Robot Manipulation Benchmark}},
author = {Fan, Linxi and Zhu, Yuke and Zhu, Jiren and Liu, Zihua and Zeng, Orien and Gupta, Anchit and Creus-Costa, Joan and Savarese, Silvio and Fei-Fei, Li},
booktitle = {Proceedings of The 2nd Conference on Robot Learning},
year = {2018},
pages = {767-782},
volume = {87},
url = {https://mlanthology.org/corl/2018/fan2018corl-surreal/}
}