$\pi_0.5$: A Vision-Language-Action Model with Open-World Generalization
Abstract
In order for robots to be useful, they must perform practically relevant tasks in the real world, outside of the lab. While vision-language-action (VLA) models have demonstrated impressive results for end-to-end robot control, it remains an open question how far such models can generalize in the wild. We describe $\pi_{0.5}$, a new model based on $\pi_0$ that uses co-training on heterogeneous tasks to enable broad generalization. $\pi_{0.5}$ uses data from multiple robots, high-level semantic prediction, web data, and other sources to enable broadly generalizable real-world robotic manipulation. Our system uses a combination of co-training and hybrid multi-modal examples that combine image observations, language commands, object detections, semantic subtask prediction, and low-level actions. Our experiments show that this kind of knowledge transfer is essential for effective generalization, and we demonstrate for the first time that an end-to-end learning-enabled robotic system can perform long-horizon and dexterous manipulation skills, such as cleaning a kitchen or bedroom, in entirely new homes.
Cite
Text
Black et al. "$\pi_0.5$: A Vision-Language-Action Model with Open-World Generalization." Proceedings of The 9th Conference on Robot Learning, 2025.Markdown
[Black et al. "$\pi_0.5$: A Vision-Language-Action Model with Open-World Generalization." Proceedings of The 9th Conference on Robot Learning, 2025.](https://mlanthology.org/corl/2025/black2025corl-visionlanguageaction/)BibTeX
@inproceedings{black2025corl-visionlanguageaction,
title = {{$\pi_0.5$: A Vision-Language-Action Model with Open-World Generalization}},
author = {Black, Kevin and Brown, Noah and Darpinian, James and Dhabalia, Karan and Driess, Danny and Esmail, Adnan and Equi, Michael Robert and Finn, Chelsea and Fusai, Niccolo and Galliker, Manuel Y. and Ghosh, Dibya and Groom, Lachy and Hausman, Karol and Ichter, Brian and Jakubczak, Szymon and Jones, Tim and Ke, Liyiming and LeBlanc, Devin and Levine, Sergey and Li-Bell, Adrian and Mothukuri, Mohith and Nair, Suraj and Pertsch, Karl and Ren, Allen Z. and Shi, Lucy Xiaoyang and Smith, Laura and Springenberg, Jost Tobias and Stachowicz, Kyle and Tanner, James and Vuong, Quan and Walke, Homer and Walling, Anna and Wang, Haohuan and Yu, Lili and Zhilinsky, Ury},
booktitle = {Proceedings of The 9th Conference on Robot Learning},
year = {2025},
pages = {17-40},
volume = {305},
url = {https://mlanthology.org/corl/2025/black2025corl-visionlanguageaction/}
}