Shu, Tianmin

37 publications

TMLR 2026 Augmented Vision-Language Models: A Systematic Review Anthony C Davis, Burhan A. Sadiq, Tianmin Shu, Chien-Ming Huang

ICLRW 2025 AutoToM: Automated Bayesian Inverse Planning and Model Discovery for Open-Ended Theory of Mind Zhining Zhang, Chuanyang Jin, Mung Yao Jia, Tianmin Shu

NeurIPS 2025 AutoToM: Scaling Model-Based Mental Inference via Automated Agent Modeling Zhining Zhang, Chuanyang Jin, Mung Yao Jia, Shunchi Zhang, Tianmin Shu

ICLR 2025 COMBO: Compositional World Models for Embodied Multi-Agent Cooperation Hongxin Zhang, Zeyuan Wang, Qiushi Lyu, Zheyuan Zhang, Sunli Chen, Tianmin Shu, Behzad Dariush, Kwonjoon Lee, Yilun Du, Chuang Gan

ICLRW 2025 Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation Qiyue Gao, Xinyu Pi, Kevin Liu, Junrong Chen, Ruolan Yang, Xinqi Huang, Xinyu Fang, Lu Sun, Gautham Kishore, Bo Ai, Stone Tao, Mengyang Liu, Jiaxi Yang, Chao-Jung Lai, Chuanyang Jin, Jiannan Xiang, Benhao Huang, David Danks, Hao Su, Tianmin Shu, Ziqiao Ma, Lianhui Qin, Zhiting Hu

ICLR 2025 GenEx: Generating an Explorable World TaiMing Lu, Tianmin Shu, Alan Yuille, Daniel Khashabi, Jieneng Chen

AAAI 2025 MuMA-ToM: Multi-Modal Multi-Agent Theory of Mind Haojun Shi, Suyu Ye, Xinyu Fang, Chuanyang Jin, Leyla Isik, Yen-Ling Kuo, Tianmin Shu

ICLRW 2025 PartInstruct: Part-Level Instruction Following for Fine-Grained Robot Manipulation Yifan Yin, Zhengtao Han, Shivam Aarya, Shuhang Xu, Jianxin Wang, Jiawei Peng, Angtian Wang, Alan Yuille, Tianmin Shu

NeurIPS 2025 SimWorld-Robotics: Synthesizing Photorealistic and Dynamic Urban Environments for Multimodal Robot Navigation and Collaboration Yan Zhuang, Jiawei Ren, Xiaokang Ye, Jianzhi Shen, Ruixuan Zhang, Tianai Yue, Muhammad Faayez, Xuhong He, Xiyan Zhang, Ziqiao Ma, Lianhui Qin, Zhiting Hu, Tianmin Shu

NeurIPS 2025 SimWorld: An Open-Ended Simulator for Agents in Physical and Social Worlds Xiaokang Ye, Jiawei Ren, Yan Zhuang, Xuhong He, Yiming Liang, Yiqing Yang, Mrinaal Dogra, Xianrui Zhong, Eric Liu, Kevin Benavente, Rajiv Mandya Nagaraju, Dhruv Vivek Sharma, Ziqiao Ma, Tianmin Shu, Zhiting Hu, Lianhui Qin

ICLR 2024 Building Cooperative Embodied Agents Modularly with Large Language Models Hongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou, Yilun Du, Joshua B. Tenenbaum, Tianmin Shu, Chuang Gan

NeurIPS 2024 Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge Weihua Du, Qiushi Lyu, Jiaming Shan, Zhenting Qi, Hongxin Zhang, Sunli Chen, Andi Peng, Tianmin Shu, Kwonjoon Lee, Behzad Dariush, Chuang Gan

NeurIPS 2024 Few-Shot Task Learning Through Inverse Generative Modeling Aviv Netanyahu, Yilun Du, Antonia Bronars, Jyothish Pari, Joshua Tenenbaum, Tianmin Shu, Pulkit Agrawal

NeurIPSW 2024 MuMA-ToM: Multi-Modal Multi-Agent Theory of Mind Haojun Shi, Suyu Ye, Xinyu Fang, Chuanyang Jin, Leyla Isik, Yen-Ling Kuo, Tianmin Shu

NeurIPSW 2024 MuMA-ToM: Multi-Modal Multi-Agent Theory of Mind Haojun Shi, Suyu Ye, Xinyu Fang, Chuanyang Jin, Leyla Isik, Yen-Ling Kuo, Tianmin Shu

AAAI 2024 Neural Amortized Inference for Nested Multi-Agent Reasoning Kunal Jha, Tuan Anh Le, Chuanyang Jin, Yen-Ling Kuo, Joshua B. Tenenbaum, Tianmin Shu

ICML 2024 Pragmatic Feature Preferences: Learning Reward-Relevant Preferences from Human Input Andi Peng, Yuying Sun, Tianmin Shu, David Abel

NeurIPSW 2023 Building Cooperative Embodied Agents Modularly with Large Language Models Hongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou, Yilun Du, Joshua Tenenbaum, Tianmin Shu, Chuang Gan

ICML 2023 Diagnosis, Feedback, Adaptation: A Human-in-the-Loop Framework for Test-Time Policy Adaptation Andi Peng, Aviv Netanyahu, Mark K Ho, Tianmin Shu, Andreea Bobu, Julie Shah, Pulkit Agrawal

NeurIPS 2023 Language Models Meet World Models: Embodied Experiences Enhance Language Models Jiannan Xiang, Tianhua Tao, Yi Gu, Tianmin Shu, Zirui Wang, Zichao Yang, Zhiting Hu

NeurIPSW 2023 MMToM-QA: Multimodal Theory of Mind Question Answering Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer Ullman, Antonio Torralba, Joshua B. Tenenbaum, Tianmin Shu

ICLR 2023 Stateful Active Facilitator: Coordination and Environmental Heterogeneity in Cooperative Multi-Agent Reinforcement Learning Dianbo Liu, Vedant Shah, Oussama Boussif, Cristian Meo, Anirudh Goyal, Tianmin Shu, Michael Curtis Mozer, Nicolas Heess, Yoshua Bengio

AAAI 2023 Zero-Shot Linear Combinations of Grounded Social Interactions with Linear Social MDPs Ravi Tejwani, Yen-Ling Kuo, Tianmin Shu, Bennett Stankovits, Dan Gutfreund, Joshua B. Tenenbaum, Boris Katz, Andrei Barbu

ICML 2022 Discovering Generalizable Spatial Goal Representations via Graph-Based Active Reward Learning Aviv Netanyahu, Tianmin Shu, Joshua Tenenbaum, Pulkit Agrawal

ICLRW 2022 Discovering Generalizable Spatial Goal Representations via Graph-Based Active Reward Learning Aviv Netanyahu, Tianmin Shu, Joshua B. Tenenbaum, Pulkit Agrawal

ICML 2021 AGENT: A Benchmark for Core Psychological Reasoning Tianmin Shu, Abhishek Bhandwaldar, Chuang Gan, Kevin Smith, Shari Liu, Dan Gutfreund, Elizabeth Spelke, Joshua Tenenbaum, Tomer Ullman

AAAI 2021 PHASE: PHysically-Grounded Abstract Social Events for Machine Social Perception Aviv Netanyahu, Tianmin Shu, Boris Katz, Andrei Barbu, Joshua B. Tenenbaum

CoRL 2021 Social Interactions as Recursive MDPs Ravi Tejwani, Yen-Ling Kuo, Tianmin Shu, Boris Katz, Andrei Barbu

ICLR 2021 Watch-and-Help: A Challenge for Social Perception and Human-AI Collaboration Xavier Puig, Tianmin Shu, Shuang Li, Zilin Wang, Yuan-Hong Liao, Joshua B. Tenenbaum, Sanja Fidler, Antonio Torralba

ECCV 2020 Active Visual Information Gathering for Vision-Language Navigation Hanqing Wang, Wenguan Wang, Tianmin Shu, Wei Liang, Jianbing Shen

NeurIPSW 2020 PHASE: PHysically-Grounded Abstract Social Events for Machine Social Perception Aviv Netanyahu, Tianmin Shu, Boris Katz, Andrei Barbu, Joshua B. Tenenbaum

ICLR 2019 M^3RL: Mind-Aware Multi-Agent Management Reinforcement Learning Tianmin Shu, Yuandong Tian

ICMLW 2019 VRKitchen: An Interactive 3D Environment for Learning Real Life Cooking Tasks Xiaofeng Gao, Ran Gong, Tianmin Shu, Xu Xie, Shu Wang, Song-Chun Zhu

ICLR 2018 Hierarchical and Interpretable Skill Acquisition in Multi-Task Reinforcement Learning Tianmin Shu, Caiming Xiong, Richard Socher

CVPR 2017 CERN: Confidence-Energy Recurrent Network for Group Activity Recognition Tianmin Shu, Sinisa Todorovic, Song-Chun Zhu

IJCAI 2016 Learning Social Affordance for Human-Robot Interaction Tianmin Shu, Michael S. Ryoo, Song-Chun Zhu

CVPR 2015 Joint Inference of Groups, Events and Human Roles in Aerial Videos Tianmin Shu, Dan Xie, Brandon Rothrock, Sinisa Todorovic, Song Chun Zhu