Liu, Sifei

67 publications

ICLR 2026 3D Aware Region Prompted Vision Language Model An-Chieh Cheng, Yang Fu, Yukang Chen, Zhijian Liu, Xiaolong Li, Subhashree Radhakrishnan, Song Han, Yao Lu, Jan Kautz, Pavlo Molchanov, Hongxu Yin, Xiaolong Wang, Sifei Liu

ICLR 2026 OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLM Hanrong Ye, Chao-Han Huck Yang, Arushi Goel, Wei Huang, Zhen Wan, Jinchuan Tian, An-Chieh Cheng, Ligeng Zhu, Yuanhang Su, Yuming Lou, Yong-Xiang Lin, Dong Yang, Sreyan Ghosh, Zhijian Liu, Yukang Chen, Ehsan Jahangiri, Ambrish Dantrey, Daguang Xu, Ehsan Hosseini-Asl, Seyed Danial Mohseni Taheri, Vidya Nariyambut Murali, Sifei Liu, Yao Lu, Oluwatobi Olabiyi, Yu-Chiang Frank Wang, Rafael Valle, Bryan Catanzaro, Andrew Tao, Song Han, Jan Kautz, Hongxu Yin, Pavlo Molchanov

ICLR 2026 QeRL: Beyond Efficiency - Quantization-Enhanced Reinforcement Learning for LLMs Wei Huang, Yi Ge, Shuai Yang, Yicheng Xiao, Huizi Mao, Yujun Lin, Hanrong Ye, Sifei Liu, Ka Chun Cheung, Hongxu Yin, Yao Lu, Xiaojuan Qi, Song Han, Yukang Chen

ICLR 2025 3D-Spatial Multimodal Memory Xueyan Zou, Yuchen Song, Ri-Zhao Qiu, Xuanbin Peng, Jianglong Ye, Sifei Liu, Xiaolong Wang

CVPR 2025 BlobGEN-Vid: Compositional Text-to-Video Generation with Blob Video Representations Weixi Feng, Chao Liu, Sifei Liu, William Yang Wang, Arash Vahdat, Weili Nie

ICCV 2025 Describe Anything: Detailed Localized Image and Video Captioning Long Lian, Yifan Ding, Yunhao Ge, Sifei Liu, Hanzi Mao, Boyi Li, Marco Pavone, Ming-Yu Liu, Trevor Darrell, Adam Yala, Yin Cui

NeurIPS 2025 GSPN-2: Efficient Parallel Sequence Modeling Hongjun Wang, Yitong Jiang, Collin McCarthy, David Wehr, Hanrong Ye, Xinhao Li, Ka Chun Cheung, Wonmin Byeon, Jinwei Gu, Ke Chen, Kai Han, Hongxu Yin, Pavlo Molchanov, Jan Kautz, Sifei Liu

CVPR 2025 NVILA: Efficient Frontier Visual Language Models Zhijian Liu, Ligeng Zhu, Baifeng Shi, Zhuoyang Zhang, Yuming Lou, Shang Yang, Haocheng Xi, Shiyi Cao, Yuxian Gu, Dacheng Li, Xiuyu Li, Haotian Tang, Yunhao Fang, Yukang Chen, Cheng-Yu Hsieh, De-An Huang, An-Chieh Cheng, Jinyi Hu, Sifei Liu, Ranjay Krishna, Pavlo Molchanov, Jan Kautz, Hongxu Yin, Song Han, Yao Lu

ICLR 2025 No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images Botao Ye, Sifei Liu, Haofei Xu, Xueting Li, Marc Pollefeys, Ming-Hsuan Yang, Songyou Peng

CVPR 2025 Omni-RGPT: Unifying Image and Video Region-Level Understanding via Token Marks Miran Heo, Min-Hung Chen, De-An Huang, Sifei Liu, Subhashree Radhakrishnan, Seon Joo Kim, Yu-Chiang Frank Wang, Ryo Hachiuma

CVPR 2025 Parallel Sequence Modeling via Generalized Spatial Propagation Network Hongjun Wang, Wonmin Byeon, Jiarui Xu, Jinwei Gu, Ka Chun Cheung, Xiaolong Wang, Kai Han, Jan Kautz, Sifei Liu

NeurIPS 2025 Scaling RL to Long Videos Yukang Chen, Wei Huang, Baifeng Shi, Qinghao Hu, Hanrong Ye, Ligeng Zhu, Zhijian Liu, Pavlo Molchanov, Jan Kautz, Xiaojuan Qi, Sifei Liu, Hongxu Yin, Yao Lu, Song Han

CVPR 2025 Scaling Vision Pre-Training to 4k Resolution Baifeng Shi, Boyi Li, Han Cai, Yao Lu, Sifei Liu, Marco Pavone, Jan Kautz, Song Han, Trevor Darrell, Pavlo Molchanov, Hongxu Yin

ICCV 2025 Token-Efficient VLM: High-Resolution Image Understanding via Dynamic Region Proposal Yitong Jiang, Jinwei Gu, Tianfan Xue, Ka Chun Cheung, Pavlo Molchanov, Hongxu Yin, Sifei Liu

ICLR 2024 3D Reconstruction with Generalizable Neural Fields Using Scene Priors Yang Fu, Shalini De Mello, Xueting Li, Amey Kulkarni, Jan Kautz, Xiaolong Wang, Sifei Liu

CVPR 2024 A Unified Approach for Text- and Image-Guided 4D Scene Generation Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Otmar Hilliges, Shalini De Mello

TMLR 2024 AGG: Amortized Generative 3D Gaussians for Single Image to 3D Dejia Xu, Ye Yuan, Morteza Mardani, Sifei Liu, Jiaming Song, Zhangyang Wang, Arash Vahdat

CVPR 2024 COLMAP-Free 3D Gaussian Splatting Yang Fu, Sifei Liu, Amey Kulkarni, Jan Kautz, Alexei A. Efros, Xiaolong Wang

CVPR 2024 Communication-Efficient Collaborative Perception via Information Filling with Codebook Yue Hu, Juntong Peng, Sifei Liu, Junhao Ge, Si Liu, Siheng Chen

ICML 2024 Compositional Text-to-Image Generation with Dense Blob Representations Weili Nie, Sifei Liu, Morteza Mardani, Chao Liu, Benjamin Eckart, Arash Vahdat

ECCVW 2024 Compositional Text-to-Image Generation with Feedforward Layout Generation Sifei Liu, Weili Nie, An-Chieh Cheng, Morteza Mardani, Chao Liu, Benjamin Eckart, Arash Vahdat

NeurIPS 2024 CosAE: Learnable Fourier Series for Image Restoration Sifei Liu, Shalini De Mello, Jan Kautz

CVPR 2024 HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data Mengqi Zhang, Yang Fu, Zheng Ding, Sifei Liu, Zhuowen Tu, Xiaolong Wang

CVPR 2024 RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videos Hongchi Xia, Yang Fu, Sifei Liu, Xiaolong Wang

CVPR 2024 RegionGPT: Towards Region Understanding Vision Language Model Qiushan Guo, Shalini De Mello, Hongxu Yin, Wonmin Byeon, Ka Chun Cheung, Yizhou Yu, Ping Luo, Sifei Liu

NeurIPS 2024 SpatialRGPT: Grounded Spatial Reasoning in Vision-Language Models An-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo, Ruihan Yang, Jan Kautz, Xiaolong Wang, Sifei Liu

ICLR 2024 TUVF: Learning Generalizable Texture UV Radiance Fields An-Chieh Cheng, Xueting Li, Sifei Liu, Xiaolong Wang

CVPR 2023 Affordance Diffusion: Synthesizing Hand-Object Interactions Yufei Ye, Xueting Li, Abhinav Gupta, Shalini De Mello, Stan Birchfield, Jiaming Song, Shubham Tulsiani, Sifei Liu

NeurIPS 2023 Generalizable One-Shot 3D Neural Head Avatar Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, Jan Kautz

CVPR 2023 Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models Jiarui Xu, Sifei Liu, Arash Vahdat, Wonmin Byeon, Xiaolong Wang, Shalini De Mello

CVPR 2023 Self-Supervised Super-Plane for Neural 3D Reconstruction Botao Ye, Sifei Liu, Xueting Li, Ming-Hsuan Yang

CVPR 2023 Zero-Shot Pose Transfer for Unrigged Stylized 3D Characters Jiashun Wang, Xueting Li, Sifei Liu, Shalini De Mello, Orazio Gallo, Xiaolong Wang, Jan Kautz

ECCV 2022 Autoregressive 3D Shape Generation via Canonical Mapping An-Chieh Cheng, Xueting Li, Sifei Liu, Min Sun, Ming-Hsuan Yang

CVPR 2022 CoordGAN: Self-Supervised Dense Correspondences Emerge from GANs Jiteng Mu, Shalini De Mello, Zhiding Yu, Nuno Vasconcelos, Xiaolong Wang, Jan Kautz, Sifei Liu

CVPR 2022 GroupViT: Semantic Segmentation Emerges from Text Supervision Jiarui Xu, Shalini De Mello, Sifei Liu, Wonmin Byeon, Thomas Breuel, Jan Kautz, Xiaolong Wang

ICLR 2022 Learning Continuous Environment Fields via Implicit Functions Xueting Li, Shalini De Mello, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz, Sifei Liu

ECCV 2022 Scraping Textures from Natural Images for Synthesis and Editing Xueting Li, Xiaolong Wang, Ming-Hsuan Yang, Alexei A. Efros, Sifei Liu

ICLR 2021 Contrastive Syn-to-Real Generalization Wuyang Chen, Zhiding Yu, Shalini De Mello, Sifei Liu, Jose M. Alvarez, Zhangyang Wang, Anima Anandkumar

NeurIPS 2021 Coupled Segmentation and Edge Learning via Dynamic Graph Propagation Zhiding Yu, Rui Huang, Wonmin Byeon, Sifei Liu, Guilin Liu, Thomas Breuel, Anima Anandkumar, Jan Kautz

NeurIPS 2021 Learning 3D Dense Correspondence via Canonical Point Autoencoder An-Chieh Cheng, Xueting Li, Min Sun, Ming-Hsuan Yang, Sifei Liu

CVPR 2021 Learning Continuous Image Representation with Local Implicit Image Function Yinbo Chen, Sifei Liu, Xiaolong Wang

CVPR 2021 Learning to Track Instances Without Video Annotations Yang Fu, Sifei Liu, Umar Iqbal, Shalini De Mello, Humphrey Shi, Jan Kautz

ICCV 2021 Self-Supervised Object Detection via Generative Image Synthesis Siva Karthik Mustikovela, Shalini De Mello, Aayush Prakash, Umar Iqbal, Sifei Liu, Thu Nguyen-Phuoc, Carsten Rother, Jan Kautz

CVPR 2021 Semi-Supervised 3D Hand-Object Poses Estimation with Interactions in Time Shaowei Liu, Hanwen Jiang, Jiarui Xu, Sifei Liu, Xiaolong Wang

CVPR 2021 Synthesizing Long-Term 3D Human Motion and Interaction in 3D Scenes Jiashun Wang, Huazhe Xu, Jingwei Xu, Sifei Liu, Xiaolong Wang

ICCV 2021 Video Autoencoder: Self-Supervised Disentanglement of Static 3D Structure and Motion Zihang Lai, Sifei Liu, Alexei A. Efros, Xiaolong Wang

ICCV 2021 Video Matting via Consistency-Regularized Graph Neural Networks Tiantian Wang, Sifei Liu, Yapeng Tian, Kai Li, Ming-Hsuan Yang

NeurIPS 2020 Online Adaptation for Consistent Mesh Reconstruction in the Wild Xueting Li, Sifei Liu, Shalini De Mello, Kihwan Kim, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz

ECCV 2020 Self-Supervised Single-View 3D Reconstruction via Semantic Consistency Xueting Li, Sifei Liu, Kihwan Kim, Shalini De Mello, Varun Jampani, Ming-Hsuan Yang, Jan Kautz

CVPR 2020 Self-Supervised Viewpoint Learning from Image Collections Siva Karthik Mustikovela, Varun Jampani, Shalini De Mello, Sifei Liu, Umar Iqbal, Carsten Rother, Jan Kautz

NeurIPS 2019 Joint-Task Self-Supervised Learning for Temporal Correspondence Xueting Li, Sifei Liu, Shalini De Mello, Xiaolong Wang, Jan Kautz, Ming-Hsuan Yang

CVPR 2019 Learning Linear Transformations for Fast Image and Video Style Transfer Xueting Li, Sifei Liu, Jan Kautz, Ming-Hsuan Yang

ICCV 2019 Learning Propagation for Arbitrarily-Structured Data Sifei Liu, Xueting Li, Varun Jampani, Shalini De Mello, Jan Kautz

CVPR 2019 Putting Humans in a Scene: Learning Affordance in 3D Indoor Environments Xueting Li, Sifei Liu, Kihwan Kim, Xiaolong Wang, Ming-Hsuan Yang, Jan Kautz

CVPR 2019 SCOPS: Self-Supervised Co-Part Segmentation Wei-Chih Hung, Varun Jampani, Sifei Liu, Pavlo Molchanov, Ming-Hsuan Yang, Jan Kautz

NeurIPS 2018 Context-Aware Synthesis and Placement of Object Instances Donghoon Lee, Sifei Liu, Jinwei Gu, Ming-Yu Liu, Ming-Hsuan Yang, Jan Kautz

CVPR 2018 Learning Dual Convolutional Neural Networks for Low-Level Vision Jinshan Pan, Sifei Liu, Deqing Sun, Jiawei Zhang, Yang Liu, Jimmy Ren, Zechao Li, Jinhui Tang, Huchuan Lu, Yu-Wing Tai, Ming-Hsuan Yang

WACV 2018 Learning Video-Story Composition via Recurrent Neural Network Guangyu Zhong, Yi-Hsuan Tsai, Sifei Liu, Zhixun Su, Ming-Hsuan Yang

ECCV 2018 Rendering Portraitures from Monocular Camera and Beyond Xiangyu Xu, Deqing Sun, Sifei Liu, Wenqi Ren, Yu-Jin Zhang, Ming-Hsuan Yang, Jian Sun

ECCV 2018 Switchable Temporal Propagation Network Sifei Liu, Guangyu Zhong, Shalini De Mello, Jinwei Gu, Varun Jampani, Ming-Hsuan Yang, Jan Kautz

CVPR 2017 Generative Face Completion Yijun Li, Sifei Liu, Jimei Yang, Ming-Hsuan Yang

NeurIPS 2017 Learning Affinity via Spatial Propagation Networks Sifei Liu, Shalini De Mello, Jinwei Gu, Guangyu Zhong, Ming-Hsuan Yang, Jan Kautz

ICCV 2017 Unsupervised Domain Adaptation for Face Recognition in Unlabeled Videos Kihyuk Sohn, Sifei Liu, Guangyu Zhong, Xiang Yu, Ming-Hsuan Yang, Manmohan Chandraker

ECCV 2016 Deep Cascaded Bi-Network for Face Hallucination Shizhan Zhu, Sifei Liu, Chen Change Loy, Xiaoou Tang

ECCV 2016 Learning Recursive Filters for Low-Level Vision via a Hybrid Neural Network Sifei Liu, Jin-shan Pan, Ming-Hsuan Yang

CVPR 2015 Multi-Objective Convolutional Learning for Face Labeling Sifei Liu, Jimei Yang, Chang Huang, Ming-Hsuan Yang

CVPR 2013 Structured Face Hallucination Chih-Yuan Yang, Sifei Liu, Ming-Hsuan Yang