Zhu, Song-Chun

217 publications

ICLR 2025 Building Interactable Replicas of Complex Articulated Objects via Gaussian Splatting Yu Liu, Baoxiong Jia, Ruijie Lu, Junfeng Ni, Song-Chun Zhu, Siyuan Huang

ICLRW 2025 ControlManip: Few-Shot Manipulation Fine-Tuning via Object-Centric Conditional Control Puhao Li, Yingying Wu, Wanlin Li, Yuzhe Huang, Zhiyuan Zhang, Yinghan Chen, Song-Chun Zhu, Tengyu Liu, Siyuan Huang

CoRL 2025 ControlVLA: Few-Shot Object-Centric Adaptation for Pre-Trained Vision-Language-Action Models Puhao Li, Yingying Wu, Ziheng Xi, Wanlin Li, Yuzhe Huang, Zhiyuan Zhang, Yinghan Chen, Jianan Wang, Song-Chun Zhu, Tengyu Liu, Siyuan Huang

CVPR 2025 Decompositional Neural Scene Reconstruction with Generative Diffusion Prior Junfeng Ni, Yu Liu, Ruijie Lu, Zirui Zhou, Song-Chun Zhu, Yixin Chen, Siyuan Huang

AAAI 2025 Differentiable Information Enhanced Model-Based Reinforcement Learning Xiaoyuan Zhang, Xinyan Cai, Bo Liu, Weidong Huang, Song-Chun Zhu, Siyuan Qi, Yaodong Yang

NeurIPS 2025 Iterative Tool Usage Exploration for Multimodal Agents via Step-Wise Preference Tuning Pengxiang Li, Zhi Gao, Bofei Zhang, Yapeng Mi, Xiaojian Ma, Chenrui Shi, Tao Yuan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li

CVPR 2025 METASCENES: Towards Automated Replica Creation for Real-World 3D Scans Huangyue Yu, Baoxiong Jia, Yixin Chen, Yandan Yang, Puhao Li, Rongpeng Su, Jiaxin Li, Qing Li, Wei Liang, Song-Chun Zhu, Tengyu Liu, Siyuan Huang

ICLR 2025 Multi-Modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage Zhi Gao, Bofei Zhang, Pengxiang Li, Xiaojian Ma, Tao Yuan, Yue Fan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li

ICLRW 2025 Multi-Modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usage Zhi Gao, Bofei Zhang, Pengxiang Li, Xiaojian Ma, Tao Yuan, Yue Fan, Yuwei Wu, Yunde Jia, Song-Chun Zhu, Qing Li

NeurIPS 2025 Social World Model-Augmented Mechanism Design Policy Learning Xiaoyuan Zhang, Yizhe Huang, Chengdong Ma, Zhixun Chen, Long Ma, Yali Du, Song-Chun Zhu, Yaodong Yang, Xue Feng

TMLR 2025 The AI Hippocampus: How Far Are We from Human Memory? Zixia Jia, Jiaqi Li, Yipeng Kang, Yuxuan Wang, Tong Wu, Quansen Wang, Xiaobo Wang, Shuyi Zhang, Junzhe Shen, Qing Li, Siyuan Qi, Yitao Liang, Di He, Zilong Zheng, Song-Chun Zhu

CVPR 2025 Unveiling the Mist over 3D Vision-Language Understanding: Object-Centric Evaluation with Chain-of-Analysis Jiangyong Huang, Baoxiong Jia, Yan Wang, Ziyu Zhu, Xiongkun Linghu, Qing Li, Song-Chun Zhu, Siyuan Huang

NeurIPS 2025 World Models Should Prioritize the Unification of Physical and Social Dynamics Xiaoyuan Zhang, Chengdong Ma, Yizhe Huang, Weidong Huang, Siyuan Qi, Song-Chun Zhu, Xue Feng, Yaodong Yang

NeurIPS 2024 AdaSociety: An Adaptive Environment with Social Structures for Multi-Agent Decision-Making Yizhe Huang, Xingbo Wang, Hao Liu, Fanqi Kong, Aoyang Qin, Min Tang, Song-Chun Zhu, Mingjie Bi, Siyuan Qi, Xue Feng

ICML 2024 An Embodied Generalist Agent in 3D World Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang

ICLRW 2024 An Embodied Generalist Agent in 3D World Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang

ICMLW 2024 An Embodied Generalist Agent in 3D World Jiangyong Huang, Silong Yong, Xiaojian Ma, Xiongkun Linghu, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang

ICLR 2024 Bongard-OpenWorld: Few-Shot Reasoning for Free-Form Visual Concepts in the Real World Rujie Wu, Xiaojian Ma, Zhenliang Zhang, Wei Wang, Qing Li, Song-Chun Zhu, Yizhou Wang

CVPR 2024 CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li

ICLR 2024 CivRealm: A Learning and Reasoning Odyssey in Civilization for Decision-Making Agents Siyuan Qi, Shuo Chen, Yexin Li, Xiangyu Kong, Junqi Wang, Bangcheng Yang, Pring Wong, Yifan Zhong, Xiaoyuan Zhang, Zhaowei Zhang, Nian Liu, Yaodong Yang, Song-Chun Zhu

ICML 2024 Efficient Adaptation in Mixed-Motive Environments via Hierarchical Opponent Modeling and Planning Yizhe Huang, Anji Liu, Fanqi Kong, Yaodong Yang, Song-Chun Zhu, Xue Feng

NeurIPS 2024 FIRE: A Dataset for Feedback Integration and Refinement Evaluation of Multimodal Models Pengxiang Li, Zhi Gao, Bofei Zhang, Tao Yuan, Yuwei Wu, Mehrtash Harandi, Yunde Jia, Song-Chun Zhu, Qing Li

ICML 2024 Fast Peer Adaptation with Context-Aware Exploration Long Ma, Yuanfei Wang, Fangwei Zhong, Song-Chun Zhu, Yizhou Wang

ICMLW 2024 LLM3: Large Language Model-Based Task and Motion Planning with Motion Failure Reasoning Shu Wang, Muzhi Han, Ziyuan Jiao, Zeyu Zhang, Ying Nian Wu, Song-Chun Zhu, Hangxin Liu

NeurIPS 2024 Learning to Balance Altruism and Self-Interest Based on Empathy in Mixed-Motive Games Fanqi Kong, Yizhe Huang, Song-Chun Zhu, Siyuan Qi, Xue Feng

NeurIPS 2024 Mars: Situated Inductive Reasoning in an Open-World Environment Xiaojuan Tang, Jiaqi Li, Yitao Liang, Song-chun Zhu, Muhan Zhang, Zilong Zheng

ICLR 2024 Neural-Symbolic Recursive Machine for Systematic Generalization Qing Li, Yixin Zhu, Yitao Liang, Ying Nian Wu, Song-Chun Zhu, Siyuan Huang

NeurIPS 2024 PhyRecon: Physically Plausible Neural Scene Reconstruction Junfeng Ni, Yixin Chen, Bohan Jing, Nan Jiang, Bin Wang, Bo Dai, Puhao Li, Yixin Zhu, Song-Chun Zhu, Siyuan Huang

AAAI 2024 ProAgent: Building Proactive Cooperative Agents with Large Language Models Ceyao Zhang, Kaijie Yang, Siyi Hu, Zihao Wang, Guanghe Li, Yihang Sun, Cheng Zhang, Zhaowei Zhang, Anji Liu, Song-Chun Zhu, Xiaojun Chang, Junge Zhang, Feng Yin, Yitao Liang, Yaodong Yang

ICLR 2023 A Minimalist Dataset for Systematic Generalization of Perception, Syntax, and Semantics Qing Li, Siyuan Huang, Yining Hong, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu

ICCV 2023 ARNOLD: A Benchmark for Language-Grounded Task Learning with Continuous States in Realistic 3D Scenes Ran Gong, Jiangyong Huang, Yizhou Zhao, Haoran Geng, Xiaofeng Gao, Qingyang Wu, Wensi Ai, Ziheng Zhou, Demetri Terzopoulos, Song-Chun Zhu, Baoxiong Jia, Siyuan Huang

NeurIPS 2023 Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao

NeurIPSW 2023 Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Jianfeng Gao

CVPR 2023 Diffusion-Based Generation, Optimization, and Planning in 3D Scenes Siyuan Huang, Zan Wang, Puhao Li, Baoxiong Jia, Tengyu Liu, Yixin Zhu, Wei Liang, Song-Chun Zhu

NeurIPS 2023 Diplomat: A Dialogue Dataset for Situated PragMATic Reasoning Hengli Li, Song-Chun Zhu, Zilong Zheng

ICLR 2023 Dynamic Prompt Learning via Policy Gradient for Semi-Structured Mathematical Reasoning Pan Lu, Liang Qiu, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, Tanmay Rajpurohit, Peter Clark, Ashwin Kalyan

NeurIPS 2023 Evaluating and Inducing Personality in Pre-Trained Language Models Guangyuan Jiang, Manjie Xu, Song-Chun Zhu, Wenjuan Han, Chi Zhang, Yixin Zhu

NeurIPS 2023 Learning Energy-Based Prior Model with Diffusion-Amortized MCMC Peiyu Yu, Yaxuan Zhu, Sirui Xie, Xiaojian Ma, Ruiqi Gao, Song-Chun Zhu, Ying Nian Wu

NeurIPS 2023 Learning Non-Markovian Decision-Making from State-Only Sequences Aoyang Qin, Feng Gao, Qing Li, Song-Chun Zhu, Sirui Xie

ICMLW 2023 MindDial: Belief Dynamics Tracking with Theory-of-Mind Modeling for Neural Dialogue Generation Shuwen Qiu, Song-Chun Zhu, Zilong Zheng

ICML 2023 On the Complexity of Bayesian Generalization Yu-Zhe Shi, Manjie Xu, John E. Hopcroft, Kun He, Joshua B. Tenenbaum, Song-Chun Zhu, Ying Nian Wu, Wenjuan Han, Yixin Zhu

ICLR 2023 SQA3D: Situated Question Answering in 3D Scenes Xiaojian Ma, Silong Yong, Zilong Zheng, Qing Li, Yitao Liang, Song-Chun Zhu, Siyuan Huang

ICCV 2023 X-VoE: Measuring eXplanatory Violation of Expectation in Physical Events Bo Dai, Linge Wang, Baoxiong Jia, Zeyu Zhang, Song-Chun Zhu, Chi Zhang, Yixin Zhu

ICML 2022 COAT: Measuring Object Compositionality in Emergent Representations Sirui Xie, Ari S Morcos, Song-Chun Zhu, Ramakrishna Vedantam

NeurIPS 2022 EgoTaskQA: Understanding Human Tasks in Egocentric Videos Baoxiong Jia, Ting Lei, Song-Chun Zhu, Siyuan Huang

NeurIPS 2022 Emergent Graphical Conventions in a Visual Communication Game Shuwen Qiu, Sirui Xie, Lifeng Fan, Tao Gao, Jungseock Joo, Song-Chun Zhu, Yixin Zhu

ICML 2022 Latent Diffusion Energy-Based Model for Interpretable Text Modelling Peiyu Yu, Sirui Xie, Xiaojian Ma, Baoxiong Jia, Bo Pang, Ruiqi Gao, Yixin Zhu, Song-Chun Zhu, Ying Nian Wu

NeurIPS 2022 Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering Pan Lu, Swaroop Mishra, Tanglin Xia, Liang Qiu, Kai-Wei Chang, Song-Chun Zhu, Oyvind Tafjord, Peter Clark, Ashwin Kalyan

ECCV 2022 Learning Algebraic Representation for Systematic Generalization in Abstract Reasoning Chi Zhang, Sirui Xie, Baoxiong Jia, Ying Nian Wu, Song-Chun Zhu, Yixin Zhu

NeurIPS 2022 Learning Probabilistic Models from Generator Latent Spaces with Hat EBM Mitch Hill, Erik Nijkamp, Jonathan Mitchell, Bo Pang, Song-Chun Zhu

AAAI 2022 Learning V1 Simple Cells with Vector Representation of Local Content and Matrix Representation of Local Motion Ruiqi Gao, Jianwen Xie, Siyuan Huang, Yufan Ren, Song-Chun Zhu, Ying Nian Wu

AAAI 2022 Learning from the Tangram to Solve Mini Visual Tasks Yizhou Zhao, Liang Qiu, Pan Lu, Feng Shi, Tian Han, Song-Chun Zhu

NeurIPS 2022 MATE: Benchmarking Multi-Agent Reinforcement Learning in Distributed Target Coverage Control Xuehai Pan, Mickel Liu, Fangwei Zhong, Yaodong Yang, Song-Chun Zhu, Yizhou Wang

ICLR 2022 MCMC Should Mix: Learning Energy-Based Model with Neural Transport Latent Space MCMC Erik Nijkamp, Ruiqi Gao, Pavel Sountsov, Srinivas Vasudevan, Bo Pang, Song-Chun Zhu, Ying Nian Wu

ICLR 2022 RelViT: Concept-Guided Vision Transformer for Visual Relational Reasoning Xiaojian Ma, Weili Nie, Zhiding Yu, Huaizu Jiang, Chaowei Xiao, Yuke Zhu, Song-Chun Zhu, Anima Anandkumar

NeurIPS 2022 Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learning Yuanpei Chen, Tianhao Wu, Shengjie Wang, Xidong Feng, Jiechuan Jiang, Zongqing Lu, Stephen McAleer, Hao Dong, Song-Chun Zhu, Yaodong Yang

AAAI 2022 ValueNet: A New Dataset for Human Value Driven Dialogue System Liang Qiu, Yizhou Zhao, Jinchao Li, Pan Lu, Baolin Peng, Jianfeng Gao, Song-Chun Zhu

CVPR 2021 ACRE: Abstract Causal REasoning Beyond Covariation Chi Zhang, Baoxiong Jia, Mark Edmonds, Song-Chun Zhu, Yixin Zhu

CVPR 2021 Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution Chi Zhang, Baoxiong Jia, Song-Chun Zhu, Yixin Zhu

CVPR 2021 Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classification Jianwen Xie, Yifei Xu, Zilong Zheng, Song-Chun Zhu, Ying Nian Wu

NeurIPS 2021 Iterative Teacher-Aware Learning Luyao Yuan, Dongruo Zhou, Junhong Shen, Jingdong Gao, Jeffrey L Chen, Quanquan Gu, Ying Nian Wu, Song-Chun Zhu

AAAI 2021 Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translation Jianwen Xie, Zilong Zheng, Xiaolin Fang, Song-Chun Zhu, Ying Nian Wu

CVPR 2021 Learning Neural Representation of Camera Pose with Matrix Representation of Pose Shift via View Synthesis Yaxuan Zhu, Ruiqi Gao, Siyuan Huang, Song-Chun Zhu, Ying Nian Wu

CVPR 2021 Learning Triadic Belief Dynamics in Nonverbal Communication from Videos Lifeng Fan, Shuwen Qiu, Zilong Zheng, Tao Gao, Song-Chun Zhu, Yixin Zhu

AAAI 2021 Learning by Fixing: Solving Math Word Problems with Weak Supervision Yining Hong, Qing Li, Daniel Ciao, Siyuan Huang, Song-Chun Zhu

NeurIPS 2021 On Path Integration of Grid Cells: Group Representation and Isotropic Scaling Ruiqi Gao, Jianwen Xie, Xue-Xin Wei, Song-Chun Zhu, Ying Nian Wu

NeurIPS 2021 Robust Visual Reasoning via Language Guided Neural Module Networks Arjun Akula, Varun Jampani, Soravit Changpinyo, Song-Chun Zhu

AAAI 2021 SMART: A Situation Model for Algebra Story Problems via Attributed Grammar Yining Hong, Qing Li, Ran Gong, Daniel Ciao, Siyuan Huang, Song-Chun Zhu

ICCV 2021 Spatio-Temporal Self-Supervised Representation Learning for 3D Point Clouds Siyuan Huang, Yichen Xie, Song-Chun Zhu, Yixin Zhu

ICLR 2021 Stochastic Security: Adversarial Defense Using Long-Run Dynamics of Energy-Based Models Mitch Hill, Jonathan Craig Mitchell, Song-Chun Zhu

NeurIPS 2021 Unsupervised Foreground Extraction via Deep Region Competition Peiyu Yu, Sirui Xie, Xiaojian Ma, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu

ICCV 2021 VLGrammar: Grounded Grammar Induction of Vision and Language Yining Hong, Qing Li, Song-Chun Zhu, Siyuan Huang

ICCV 2021 YouRefIt: Embodied Reference Understanding with Language and Gesture Yixin Chen, Qing Li, Deqian Kong, Yik Lun Kei, Song-Chun Zhu, Tao Gao, Yixin Zhu, Siyuan Huang

ECCV 2020 A Competence-Aware Curriculum for Visual Concepts Learning via Question Answering Qing Li, Siyuan Huang, Yining Hong, Song-Chun Zhu

ICML 2020 Closed Loop Neural-Symbolic Learning via Integrating Neural Perception, Grammar Parsing, and Symbolic Reasoning Qing Li, Siyuan Huang, Yining Hong, Yixin Chen, Ying Nian Wu, Song-Chun Zhu

AAAI 2020 CoCoX: Generating Conceptual and Counterfactual Explanations via Fault-Lines Arjun R. Akula, Shuai Wang, Song-Chun Zhu

ECCV 2020 LEMMA: A Multi-View Dataset for LEarning Multi-Agent Multi-Task Activities Baoxiong Jia, Yixin Chen, Siyuan Huang, Yixin Zhu, Song-Chun Zhu

NeurIPS 2020 Learning Latent Space Energy-Based Prior Model Bo Pang, Tian Han, Erik Nijkamp, Song-Chun Zhu, Ying Nian Wu

ECCV 2020 Learning Multi-Layer Latent Variable Model via Variational Optimization of Short Run MCMC for Approximate Inference Erik Nijkamp, Bo Pang, Tian Han, Linqi Zhou, Song-Chun Zhu, Ying Nian Wu

AAAI 2020 Machine Number Sense: A Dataset of Visual Arithmetic Problems for Abstract and Relational Reasoning Wenhe Zhang, Chi Zhang, Yixin Zhu, Song-Chun Zhu

AAAI 2020 Motion-Based Generator Model: Unsupervised Disentanglement of Appearance, Trackable and Intrackable Motions in Dynamic Patterns Jianwen Xie, Ruiqi Gao, Zilong Zheng, Song-Chun Zhu, Ying Nian Wu

AAAI 2020 On the Anatomy of MCMC-Based Maximum Likelihood Learning of Energy-Based Models Erik Nijkamp, Mitch Hill, Tian Han, Song-Chun Zhu, Ying Nian Wu

AAAI 2020 Theory-Based Causal Transfer: Integrating Instance-Level Induction and Abstract-Level Structure Learning Mark Edmonds, Xiaojian Ma, Siyuan Qi, Yixin Zhu, Hongjing Lu, Song-Chun Zhu

CVPRW 2019 Explainable AI as Collaborative Task Solving Arjun R. Akula, Changsong Liu, Sinisa Todorovic, Joyce Y. Chai, Song-Chun Zhu

AAAI 2019 Learning Dynamic Generator Model by Alternating Back-Propagation Through Time Jianwen Xie, Ruiqi Gao, Zilong Zheng, Song-Chun Zhu, Ying Nian Wu

ICLR 2019 Learning Grid Cells as Vector Representation of Self-Position Coupled with Matrix Representation of Self-Motion Ruiqi Gao, Jianwen Xie, Song-Chun Zhu, Ying Nian Wu

NeurIPS 2019 Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Model Erik Nijkamp, Mitch Hill, Song-Chun Zhu, Ying Nian Wu

NeurIPS 2019 Learning Perceptual Inference by Contrasting Chi Zhang, Baoxiong Jia, Feng Gao, Yixin Zhu, HongJing Lu, Song-Chun Zhu

AAAI 2019 MetaStyle: Three-Way Trade-Off Among Speed, Flexibility, and Quality in Neural Style Transfer Chi Zhang, Yixin Zhu, Song-Chun Zhu

AAAI 2019 Mirroring Without Overimitation: Learning Functionally Equivalent Manipulation Actions Hangxin Liu, Chi Zhang, Yixin Zhu, Chenfanfu Jiang, Song-Chun Zhu

CVPRW 2019 Natural Language Interaction with Explainable AI Models Arjun R. Akula, Sinisa Todorovic, Joyce Y. Chai, Song-Chun Zhu

NeurIPS 2019 PerspectiveNet: 3D Object Detection from a Single RGB Image via Perspective Points Siyuan Huang, Yixin Chen, Tao Yuan, Siyuan Qi, Yixin Zhu, Song-Chun Zhu

AAAI 2019 Recognizing Unseen Attribute-Object Pair with Generative Model Zhixiong Nan, Yang Liu, Nanning Zheng, Song-Chun Zhu

ICMLW 2019 VRKitchen: An Interactive 3D Environment for Learning Real Life Cooking Tasks Xiaofeng Gao, Ran Gong, Tianmin Shu, Xu Xie, Shu Wang, Song-Chun Zhu

NeurIPS 2018 Cooperative Holistic Scene Understanding: Unifying 3D Object, Layout, and Camera Pose Estimation Siyuan Huang, Siyuan Qi, Yinxue Xiao, Yixin Zhu, Ying Nian Wu, Song-Chun Zhu

AAAI 2018 Examining CNN Representations with Respect to Dataset Bias Quanshi Zhang, Wenguan Wang, Song-Chun Zhu

ICML 2018 Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction Siyuan Qi, Baoxiong Jia, Song-Chun Zhu

ECCV 2018 Holistic 3D Scene Parsing and Reconstruction from a Single RGB Image Siyuan Huang, Siyuan Qi, Yixin Zhu, Yinxue Xiao, Yuanlu Xu, Song-Chun Zhu

AAAI 2018 Interpreting CNN Knowledge via an Explanatory Graph Quanshi Zhang, Ruiming Cao, Feng Shi, Ying Nian Wu, Song-Chun Zhu

ECCV 2018 Learning Human-Object Interactions by Graph Parsing Neural Networks Siyuan Qi, Wenguan Wang, Baoxiong Jia, Jianbing Shen, Song-Chun Zhu

AAAI 2018 Learning Pose Grammar to Encode Human Body Configuration for 3D Pose Estimation Haoshu Fang, Yuanlu Xu, Wenguan Wang, Xiaobai Liu, Song-Chun Zhu

AAAI 2018 Scene-Centric Joint Parsing of Cross-View Videos Hang Qi, Yuanlu Xu, Tao Yuan, Tianfu Wu, Song-Chun Zhu

AAAI 2018 Tracking Occluded Objects and Recovering Incomplete Trajectories by Reasoning About Containment Relations and Human Actions Wei Liang, Yixin Zhu, Song-Chun Zhu

AAAI 2017 Alternating Back-Propagation for Generator Network Tian Han, Yang Lu, Song-Chun Zhu, Ying Nian Wu

CVPR 2017 CERN: Confidence-Energy Recurrent Network for Group Activity Recognition Tianmin Shu, Sinisa Todorovic, Song-Chun Zhu

AAAI 2017 Cross-View People Tracking by Scene-Centered Spatio-Temporal Parsing Yuanlu Xu, Xiaobai Liu, Lei Qin, Song-Chun Zhu

CVPR 2017 Generative Hierarchical Learning of Sparse FRAME Models Jianwen Xie, Yifei Xu, Erik Nijkamp, Ying Nian Wu, Song-Chun Zhu

AAAI 2017 Growing Interpretable Part Graphs on ConvNets via Multi-Shot Learning Quanshi Zhang, Ruiming Cao, Ying Nian Wu, Song-Chun Zhu

CVPRW 2017 Inferring Hidden Statuses and Actions in Video by Causal Reasoning Amy Sue Fire, Song-Chun Zhu

IJCAI 2017 Inferring Human Attention by Learning Latent Intentions Ping Wei, Dan Xie, Nanning Zheng, Song-Chun Zhu

ICCV 2017 Jointly Recognizing Object Fluents and Tasks in Egocentric Videos Yang Liu, Ping Wei, Song-Chun Zhu

CoRL 2017 Learning Human Utility from Video Demonstrations for Deductive Planning in Robotics Nishant Shukla, Yunzhong He, Frank Chen, Song-Chun Zhu

CVPR 2017 Mining Object Parts from CNNs via Active Question-Answering Quanshi Zhang, Ruiming Cao, Ying Nian Wu, Song-Chun Zhu

ICCV 2017 Monocular 3D Human Pose Estimation by Predicting Depth on Joints Bruce Xiaohan Nie, Ping Wei, Song-Chun Zhu

ICCV 2017 Predicting Human Activities Using Stochastic Grammar Siyuan Qi, Siyuan Huang, Ping Wei, Song-Chun Zhu

IJCAI 2017 Single-Image 3D Scene Parsing Using Geometric Commonsense Chengcheng Yu, Xiaobai Liu, Song-Chun Zhu

CVPR 2017 Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet Jianwen Xie, Song-Chun Zhu, Ying Nian Wu

ICML 2016 A Theory of Generative ConvNet Jianwen Xie, Yang Lu, Song-Chun Zhu, Yingnian Wu

CVPR 2016 Inferring Forces and Learning Human Utilities from Videos Yixin Zhu, Chenfanfu Jiang, Yibiao Zhao, Demetri Terzopoulos, Song-Chun Zhu

AAAI 2016 Learning FRAME Models Using CNN Filters Yang Lu, Song-Chun Zhu, Ying Nian Wu

IJCAI 2016 Learning Social Affordance for Human-Robot Interaction Tianmin Shu, Michael S. Ryoo, Song-Chun Zhu

CVPR 2016 Multi-View People Tracking via Hierarchical Trajectory Composition Yuanlu Xu, Xiaobai Liu, Yang Liu, Song-Chun Zhu

CVPR 2016 Recognizing Car Fluents from Video Bo Li, Tianfu Wu, Caiming Xiong, Song-Chun Zhu

IJCAI 2016 What Is Where: Inferring Containment Relations from Videos Wei Liang, Yibiao Zhao, Yixin Zhu, Song-Chun Zhu

ICCV 2015 Attributed Grammars for Joint Estimation of Human Attributes, Part and Pose Seyoung Park, Song-Chun Zhu

ICCV 2015 Automated Facial Trait Judgment and Election Outcome Prediction: Social Dimensions of Face Jungseock Joo, Francis F. Steen, Song-Chun Zhu

CVPR 2015 Joint Action Recognition and Pose Estimation from Video Bruce Xiaohan Nie, Caiming Xiong, Song-Chun Zhu

CVPR 2015 Joint Inference of Groups, Events and Human Roles in Aerial Videos Tianmin Shu, Dan Xie, Brandon Rothrock, Sinisa Todorovic, Song Chun Zhu

ICCV 2015 Mining And-or Graphs for Graph Matching and Object Discovery Quanshi Zhang, Ying Nian Wu, Song-Chun Zhu

CVPR 2015 Understanding Tools: Task-Oriented Object Modeling, Learning and Recognition Yixin Zhu, Yibiao Zhao, Song Chun Zhu

CVPR 2014 Cross-View Action Modeling, Learning and Recognition Jiang Wang, Xiaohan Nie, Yin Xia, Ying Wu, Song-Chun Zhu

ECCV 2014 Integrating Context and Occlusion for Car Detection by Hierarchical And-or Model Bo Li, Tianfu Wu, Song-Chun Zhu

CVPR 2014 Learning Inhomogeneous FRAME Models for Object Patterns Jianwen Xie, Wenze Hu, Song-Chun Zhu, Ying Nian Wu

CVPR 2014 Online Object Tracking, Learning and Parsing with And-or Graphs Yang Lu, Tianfu Wu, Song Chun Zhu

CVPR 2014 Single-View 3D Scene Parsing by Attributed Grammar Xiaobai Liu, Yibiao Zhao, Song-Chun Zhu

CVPR 2014 Unsupervised Learning of Dictionaries of Hierarchical Compositional Models Jifeng Dai, Yi Hong, Wenze Hu, Song-Chun Zhu, Ying Nian Wu

CVPR 2014 Visual Persuasion: Inferring Communicative Intents of Images Jungseock Joo, Weixin Li, Francis F. Steen, Song-Chun Zhu

CVPR 2013 Beyond Point Clouds: Scene Understanding by Reasoning Geometry and Physics Bo Zheng, Yibiao Zhao, Joey C. Yu, Katsushi Ikeuchi, Song-Chun Zhu

ICCV 2013 Concurrent Action Detection with Structural Prediction Ping Wei, Nanning Zheng, Yibiao Zhao, Song-Chun Zhu

ICCV 2013 Cosegmentation and Cosketch by Unsupervised Learning Jifeng Dai, Ying Nian Wu, Jie Zhou, Song-Chun Zhu

CVPR 2013 Discriminatively Trained And-or Tree Models for Object Detection Xi Song, Tianfu Wu, Yunde Jia, Song-Chun Zhu

ICCV 2013 Human Attribute Recognition by Rich Appearance Dictionary Jungseock Joo, Shuo Wang, Song-Chun Zhu

ICCV 2013 Inferring "Dark Matter" and "Dark Energy" from Videos Dan Xie, Sinisa Todorovic, Song-Chun Zhu

CVPR 2013 Integrating Grammar and Segmentation for Human Pose Estimation Brandon Rothrock, Seyoung Park, Song-Chun Zhu

ICCV 2013 Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection Tianfu Wu, Song-Chun Zhu

ICCV 2013 Modeling 4D Human-Object Interactions for Event and Object Recognition Ping Wei, Yibiao Zhao, Nanning Zheng, Song-Chun Zhu

ICCV 2013 Modeling Occlusion by Discriminative AND-OR Structures Bo Li, Wenze Hu, Tianfu Wu, Song-Chun Zhu

ICCV 2013 Monte Carlo Tree Search for Scheduling Activity Recognition Mohamed R. Amer, Sinisa Todorovic, Alan Fern, Song-Chun Zhu

CVPR 2013 Scene Parsing by Integrating Function, Geometry and Appearance Models Yibiao Zhao, Song-Chun Zhu

NeurIPS 2013 Unsupervised Structure Learning of Stochastic And-or Grammars Kewei Tu, Maria Pavlovskaia, Song-Chun Zhu

CVPR 2013 Weakly Supervised Learning for Attribute Localization in Outdoor Scenes Shuo Wang, Jungseock Joo, Yizhou Wang, Song-Chun Zhu

ECCV 2012 Cost-Sensitive Top-Down/Bottom-up Inference for Multiscale Activity Recognition Mohamed R. Amer, Dan Xie, Mingtian Zhao, Sinisa Todorovic, Song Chun Zhu

WACV 2012 Learning Reconfigurable Scene Representation by Tangram Model Jun Zhu, Tianfu Wu, Song-Chun Zhu, Xiaokang Yang, Wenjun Zhang

WACV 2012 Reconfigurable Templates for Robust Vehicle Detection and Classification Yang Lv, Benjamin Z. Yao, Yongtian Wang, Song-Chun Zhu

NeurIPS 2011 Image Parsing with Stochastic Scene Grammar Yibiao Zhao, Song-chun Zhu

ICCV 2011 Image Representation by Active Curves Wenze Hu, Ying Nian Wu, Song-Chun Zhu

ICCV 2011 Parsing Video Events with Goal Inference and Intent Prediction Mingtao Pei, Yunde Jia, Song-Chun Zhu

ICCV 2011 Unsupervised Learning of Event AND-OR Grammar and Semantics from Video Zhangzhang Si, Mingtao Pei, Benjamin Z. Yao, Song-Chun Zhu

ICCV 2011 Video Primal Sketch: A Generic Middle-Level Representation of Video Zhi Han, Zongben Xu, Song-Chun Zhu

CVPR 2010 Discovering Scene Categories by Information Projection and Cluster Sampling Dengxin Dai, Tianfu Wu, Song Chun Zhu

ECCV 2010 Learning Artistic Lighting Template from Portrait Photographs Xin Jin, Mingtian Zhao, Xiaowu Chen, Qinping Zhao, Song Chun Zhu

CVPR 2010 Learning a Probabilistic Model Mixing 3D and 2D Primitives for View Invariant Object Recognition Wenze Hu, Song Chun Zhu

ICCV 2009 Evaluating Information Contributions of Bottom-up and Top-Down Processes Xiong Yang, Tianfu Wu, Song Chun Zhu

CVPR 2009 Flow Mosaicking: Real-Time Pedestrian Counting Without Scene-Specific Learning Yang Cong, Haifeng Gong, Song Chun Zhu, Yandong Tang

CVPR 2009 Layered Graph Matching by Composite Cluster Sampling with Collaborative and Competitive Interactions Liang Lin, Kun Zeng, Xiaobai Liu, Song Chun Zhu

ICCV 2009 Learning Deformable Action Templates from Cluttered Videos Benjamin Z. Yao, Song Chun Zhu

CVPR 2009 Learning Mixed Templates for Object Recognition Zhangzhang Si, Haifeng Gong, Ying Nian Wu, Song Chun Zhu

CVPR 2009 Trajectory Parsing by Cluster Sampling in Spatio-Temporal Graph Xiaobai Liu, Liang Lin, Song Chun Zhu, Hai Jin

CVPR 2008 A Hierarchical and Contextual Model for Aerial Image Understanding Jake Porway, Kristy Wang, Benjamin Z. Yao, Song Chun Zhu

CVPR 2008 An Integrated Background Model for Video Surveillance Based on Primal Sketch and 3D Scene Geometry Wenze Hu, Haifeng Gong, Song Chun Zhu, Yongtian Wang

CVPRW 2008 Learning a Scene Contextual Model for Tracking and Abnormality Detection Benjamin Z. Yao, Liang Wang, Song-Chun Zhu

CVPRW 2008 SAVE: A Framework for Semantic Annotation of Visual Events Mun Wai Lee, Asaad Hakeem, Niels Haering, Song-Chun Zhu

CVPR 2007 A Multi-Resolution Dynamic Model for Face Aging Simulation Jin-Li Suo, Feng Min, Song Chun Zhu, Shiguang Shan, Xilin Chen

ICCV 2007 An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples Liang Lin, Shaowu Peng, Jake Porway, Song Chun Zhu, Yongtian Wang

CVPR 2007 Compositional Boosting for Computing Hierarchical Image Structures Tianfu Wu, Gui-Song Xia, Song Chun Zhu

ICCV 2007 Deformable Template as Active Basis Ying Nian Wu, Zhangzhang Si, Chuck Fleming, Song Chun Zhu

CVPR 2007 Layered Graph Match with Graph Editing Liang Lin, Song Chun Zhu, Yongtian Wang

CVPR 2007 Mapping Natural Image Patches by Explicit and Implicit Manifolds Kent Shi, Song Chun Zhu

CVPR 2006 Composite Templates for Cloth Modeling and Sketching Hong Chen, Zi Jian Xu, Ziqiang Liu, Song Chun Zhu

CVPR 2005 A Generative Model of Human Hair for Hair Sketching Hong Chen, Song Chun Zhu

CVPR 2005 A High Resolution Grammatical Model for Face Representation and Sketching Zijian Xu, Hong Chen, Song Chun Zhu

ICCV 2005 Bottom-up/Top-Down Image Parsing by Attribute Graph Grammar Feng Han, Song Chun Zhu

CVPR 2005 Cloth Representation by Shape from Shading with Shading Primitives Feng Han, Song Chun Zhu

ICCV 2005 Incorporating Visual Knowledge Representation in Stereo Reconstruction Adrian Barbu, Song Chun Zhu

ICCV 2005 Perceptual Scale Space and Its Applications Yizhou Wang, Siavosh Bahrami, Song Chun Zhu

CVPR 2004 Automatic Single View Building Reconstruction by Integrating Segmentation Feng Han, Song-Chun Zhu

CVPRW 2004 Automatic Single View Building Reconstruction by Integrating Segmentation Feng Han, Song-Chun Zhu

CVPR 2004 Information Scaling Laws in Natural Scenes Cheng-en Guo, Ying Nian Wu, Song Chun Zhu

CVPRW 2004 Information Scaling Laws in Natural Scenes Cheng-en Guo, Ying Nian Wu, Song Chun Zhu

CVPR 2004 Modeling Complex Motion by Tracking and Editing Hidden Markov Graphs Yizhou Wang, Song Chun Zhu

CVPR 2004 Multigrid and Multi-Level Swendsen-Wang Cuts for Hierarchic Graph Partition Adrian Barbu, Song Chun Zhu

ICCV 2003 A Multi-Scale Generative Model for Animate Shapes and Parts Aleksandr Dubinskiy, Song Chun Zhu

ICCV 2003 Graph Partition by Swendsen-Wang Cuts Adrian Barbu, Song Chun Zhu

ICCV 2003 Image Parsing: Unifying Segmentation, Detection, and Recognition Zhuowen Tu, Xiangrong Chen, Alan L. Yuille, Song Chun Zhu

ICCV 2003 Modeling Textured Motion : Particle, Wave and Sketch Yizhou Wang, Song Chun Zhu

ICCV 2003 Towards a Mathematical Theory of Primal Sketch and Sketchability Cheng-en Guo, Song Chun Zhu, Ying Nian Wu

ECCV 2002 A Generative Method for Textured Motion: Analysis and Synthesis Yizhou Wang, Song Chun Zhu

ECCV 2002 A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction Feng Han, Zhuowen Tu, Song Chun Zhu

ECCV 2002 Parsing Images into Region and Curve Processes Zhuowen Tu, Song Chun Zhu

ECCV 2002 Statistical Modeling of Texture Sketch Ying Nian Wu, Song Chun Zhu, Cheng-en Guo

ECCV 2002 What Are Textons? Song Chun Zhu, Cheng-en Guo, Ying Nian Wu, Yizhou Wang

ICCV 2001 Example-Based Facial Sketch Generation with Non-Parametric Sampling Hong Chen, Ying-Qing Xu, Heung-Yeung Shum, Song Chun Zhu, Nanning Zheng

ICCV 2001 Image Segmentation by Data Driven Markov Chain Monte Carlo Zhuowen Tu, Song Chun Zhu, Heung-Yeung Shum

ICCV 2001 Learning Inhomogeneous Gibbs Model of Faces by Minimax Entropy Ce Liu, Song Chun Zhu, Heung-Yeung Shum

ICCV 2001 Visual Learning by Integrating Descriptive and Generative Methods Cheng-en Guo, Song Chun Zhu, Ying Nian Wu

CVPR 2000 Integrating Bottom-Up/Top-Down for Object Recognition by Data Driven Markov Chain Monte Carlo Song Chun Zhu, Rong Zhang, Zhuowen Tu

CVPR 2000 Learning in Gibbsian Fields: How Accurate and How Fast Can It Be? Song Chun Zhu, Xiuwen Liu

CVPR 2000 Order Parameters for Minimax Entropy Distributions: When Does High Level Knowledge Help? Alan L. Yuille, James M. Coughlan, Song Chun Zhu, Ying Nian Wu

ICCV 1999 Equivalence of Julesz and Gibbs Texture Ensembles Ying Nian Wu, Song Chun Zhu, Xiuwen Liu

CVPR 1999 Fundamental Bounds on Edge Detection: An Information Theoretic Evaluation of Different Edge Cues Scott Konishi, Alan L. Yuille, James M. Coughlan, Song Chun Zhu

ICCV 1998 GRADE: Gibbs Reaction and Diffusion Equation Song Chun Zhu, David Mumford

CVPR 1998 Stochastic Computation of Medial Axis in Markov Random Fields Song Chun Zhu

CVPR 1997 Learning Generic Prior Models for Visual Computation Song Chun Zhu, David Mumford

NeCo 1997 Minimax Entropy Principle and Its Application to Texture Modeling Song Chun Zhu, Ying Nian Wu, David Mumford

CVPR 1996 FRAME: Filters, Random Fields, and Minimax Entropy - Towards a Unified Theory for Texture Modeling Song Chun Zhu, Ying Nian Wu, David Mumford

ICCV 1995 FORMS: A Flexible Object Recognition and Modelling System Song Chun Zhu, Alan L. Yuille

ICCV 1995 Region Competition: Unifying Snakes, Region Growing, Energy/Bayes/MDL for Multi-Band Image Segmentation Song Chun Zhu, Tai Sing Lee, Alan L. Yuille