Li, Yunzhu

46 publications

ICLR 2025 BaB-ND: Long-Horizon Motion Planning with Branch-and-Bound and Neural Dynamics Keyi Shen, Jiangwei Yu, Jose Barreiros, Huan Zhang, Yunzhu Li

AAAI 2025 Learning Structured World Models from and for Physical Interactions Yunzhu Li

CVPR 2025 PhysGen3D: Crafting a Miniature Interactive World from a Single Image Boyuan Chen, Hanxiao Jiang, Shaowei Liu, Saurabh Gupta, Yunzhu Li, Hao Zhao, Shenlong Wang

ICCV 2025 PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos Hanxiao Jiang, Hao-Yu Hsu, Kaifeng Zhang, Hsin-Ni Yu, Shenlong Wang, Yunzhu Li

CoRL 2025 Tool-as-Interface: Learning Robot Policies from Observing Human Tool Use Haonan Chen, Cheng Zhu, Shuijing Liu, Yunzhu Li, Katherine Rose Driggs-Campbell

NeurIPS 2025 Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper Xinyue Zhu, Binghao Huang, Yunzhu Li

CoRL 2025 VT-Refine: Learning Bimanual Assembly with Visuo-Tactile Feedback via Simulation Fine-Tuning Binghao Huang, Jie Xu, Iretiayo Akinola, Wei Yang, Balakumar Sundaralingam, Rowland O’Flaherty, Dieter Fox, Xiaolong Wang, Arsalan Mousavian, Yu-Wei Chao, Yunzhu Li

CoRL 2024 3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing Binghao Huang, Yixuan Wang, Xinyi Yang, Yiyue Luo, Yunzhu Li

NeurIPSW 2024 3D-ViTac: Learning Fine-Grained Manipulation with Visuo-Tactile Sensing Binghao Huang, Yixuan Wang, Xinyi Yang, Yiyue Luo, Yunzhu Li

CVPR 2024 BEHAVIOR Vision Suite: Customizable Dataset Generation via Simulation Yunhao Ge, Yihe Tang, Jiashu Xu, Cem Gokmen, Chengshu Li, Wensi Ai, Benjamin Jose Martinez, Arman Aydin, Mona Anvari, Ayush K Chakravarthy, Hong-Xing Yu, Josiah Wong, Sanjana Srivastava, Sharon Lee, Shengxin Zha, Laurent Itti, Yunzhu Li, Roberto Martín-Martín, Miao Liu, Pengchuan Zhang, Ruohan Zhang, Li Fei-Fei, Jiajun Wu

CoRL 2024 D$^3$Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangement Yixuan Wang, Mingtong Zhang, Zhuoran Li, Tarik Kelestemur, Katherine Rose Driggs-Campbell, Jiajun Wu, Li Fei-Fei, Yunzhu Li

CoRL 2024 Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling Mingtong Zhang, Kaifeng Zhang, Yunzhu Li

ICML 2024 Executable Code Actions Elicit Better LLM Agents Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji

ICLRW 2024 Executable Code Actions Elicit Better LLM Agents Xingyao Wang, Yangyi Chen, Lifan Yuan, Yizhe Zhang, Yunzhu Li, Hao Peng, Heng Ji

CoRL 2024 GenDP: 3D Semantic Fields for Category-Level Generalizable Diffusion Policy Yixuan Wang, Guang Yin, Binghao Huang, Tarik Kelestemur, Jiuguang Wang, Yunzhu Li

CoRL 2024 ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation Wenlong Huang, Chen Wang, Yunzhu Li, Ruohan Zhang, Li Fei-Fei

ECCV 2024 Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians Licheng Zhong, Hong-Xing Yu, Jiajun Wu, Yunzhu Li

CoRL 2024 RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulation Hanxiao Jiang, Binghao Huang, Ruihai Wu, Zhuoran Li, Shubham Garg, Hooshang Nayyeri, Shenlong Wang, Yunzhu Li

NeurIPS 2023 3D-IntPhys: Towards More Generalized 3D-Grounded Visual Intuitive Physics Under Challenging Scenes Haotian Xue, Antonio Torralba, Josh Tenenbaum, Dan Yamins, Yunzhu Li, Hsiao-Yu Tung

CVPRW 2023 3D-IntPhys: Towards More Generalized 3D-Grounded Visual Intuitive Physics Under Challenging Scenes Haotian Xue, Antonio Torralba, Joshua B. Tenenbaum, Daniel Yamins, Yunzhu Li, Hsiao-Yu Tung

NeurIPSW 2023 D$^3$Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Robotic Manipulation Yixuan Wang, Zhuoran Li, Mingtong Zhang, Katherine Rose Driggs-Campbell, Jiajun Wu, Li Fei-Fei, Yunzhu Li

ICLR 2023 Does Learning from Decentralized Non-IID Unlabeled Data Benefit from Self Supervision? Lirui Wang, Kaiqing Zhang, Yunzhu Li, Yonglong Tian, Russ Tedrake

NeurIPS 2023 Model-Based Control with Sparse Neural Dynamics Ziang Liu, Genggeng Zhou, Jeff He, Tobia Marcucci, Fei-Fei Li, Jiajun Wu, Yunzhu Li

CVPR 2023 Multi-Object Manipulation via Object-Centric Neural Scattering Functions Stephen Tian, Yancheng Cai, Hong-Xing Yu, Sergey Zakharov, Katherine Liu, Adrien Gaidon, Yunzhu Li, Jiajun Wu

CoRL 2023 Predicting Object Interactions with Behavior Primitives: An Application in Stowing Tasks Haonan Chen, Yilong Niu, Kaiwen Hong, Shuijing Liu, Yixuan Wang, Yunzhu Li, Katherine Rose Driggs-Campbell

CoRL 2023 RoboCook: Long-Horizon Elasto-Plastic Object Manipulation with Diverse Tools Haochen Shi, Huazhe Xu, Samuel Clarke, Yunzhu Li, Jiajun Wu

CVPR 2023 The ObjectFolder Benchmark: Multisensory Learning with Neural and Real Objects Ruohan Gao, Yiming Dou, Hao Li, Tanmay Agarwal, Jeannette Bohg, Yunzhu Li, Li Fei-Fei, Jiajun Wu

CoRL 2023 VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models Wenlong Huang, Chen Wang, Ruohan Zhang, Yunzhu Li, Jiajun Wu, Li Fei-Fei

NeurIPSW 2023 VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Models Wenlong Huang, Chen Wang, Ruohan Zhang, Yunzhu Li, Jiajun Wu, Li Fei-Fei

NeurIPS 2022 ActionSense: A Multimodal Dataset and Recording Framework for Human Activities Using Wearable Sensors in a Kitchen Environment Joseph DelPreto, Chao Liu, Yiyue Luo, Michael Foshey, Yunzhu Li, Antonio Torralba, Wojciech Matusik, Daniela Rus

ICLR 2022 ComPhy: Compositional Physical Reasoning of Objects and Events from Videos Zhenfang Chen, Kexin Yi, Yunzhu Li, Mingyu Ding, Antonio Torralba, Joshua B. Tenenbaum, Chuang Gan

ICLR 2022 DiffSkill: Skill Abstraction from Differentiable Physics for Deformable Object Manipulations with Tools Xingyu Lin, Zhiao Huang, Yunzhu Li, Joshua B. Tenenbaum, David Held, Chuang Gan

CoRL 2022 Learning Multi-Object Dynamics with Compositional Neural Radiance Fields Danny Driess, Zhiao Huang, Yunzhu Li, Russ Tedrake, Marc Toussaint

CoRL 2022 Planning with Spatial-Temporal Abstraction from Point Clouds for Deformable Object Manipulation Xingyu Lin, Carl Qi, Yunchu Zhang, Zhiao Huang, Katerina Fragkiadaki, Yunzhu Li, Chuang Gan, David Held

NeurIPS 2022 Reinforcement Learning with Neural Radiance Fields Danny Driess, Ingmar Schubert, Pete Florence, Yunzhu Li, Marc Toussaint

CoRL 2021 3D Neural Scene Representations for Visuomotor Control Yunzhu Li, Shuang Li, Vincent Sitzmann, Pulkit Agrawal, Antonio Torralba

CVPR 2021 Intelligent Carpet: Inferring 3D Human Pose from Tactile Signals Yiyue Luo, Yunzhu Li, Michael Foshey, Wan Shou, Pratyusha Sharma, Tomas Palacios, Antonio Torralba, Wojciech Matusik

ICLR 2020 CLEVRER: CoLlision Events for Video REpresentation and Reasoning Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum

NeurIPS 2020 Causal Discovery in Physical Systems from Videos Yunzhu Li, Antonio Torralba, Anima Anandkumar, Dieter Fox, Animesh Garg

CoRL 2020 Keypoints into the Future: Self-Supervised Correspondence in Model-Based Reinforcement Learning Lucas Manuelli, Yunzhu Li, Pete Florence, Russ Tedrake

ICLR 2020 Learning Compositional Koopman Operators for Model-Based Control Yunzhu Li, Hao He, Jiajun Wu, Dina Katabi, Antonio Torralba

NeurIPS 2020 Learning Physical Graph Representations from Visual Scenes Daniel Bear, Chaofei Fan, Damian Mrowca, Yunzhu Li, Seth Alter, Aran Nayebi, Jeremy Schwartz, Li F Fei-Fei, Jiajun Wu, Josh Tenenbaum, Daniel L Yamins

ICML 2020 Visual Grounding of Learned Physical Models Yunzhu Li, Toru Lin, Kexin Yi, Daniel Bear, Daniel Yamins, Jiajun Wu, Joshua Tenenbaum, Antonio Torralba

ICLR 2019 Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids Yunzhu Li, Jiajun Wu, Russ Tedrake, Joshua B. Tenenbaum, Antonio Torralba

NeurIPS 2017 InfoGAIL: Interpretable Imitation Learning from Visual Demonstrations Yunzhu Li, Jiaming Song, Stefano Ermon

ECCV 2016 Face Detection with End-to-End Integration of a ConvNet and a 3D Model Yunzhu Li, Benyuan Sun, Tianfu Wu, Yizhou Wang