Zhu, Siyu

32 publications

AAAI 2025 4D Diffusion for Dynamic Protein Structure Prediction with Reference and Motion Guidance Kaihui Cheng, Ce Liu, Qingkun Su, Jun Wang, Liwei Zhang, Yining Tang, Yao Yao, Siyu Zhu, Yuan Qi

ICML 2025 AlphaPO: Reward Shape Matters for LLM Alignment Aman Gupta, Shao Tang, Qingquan Song, Sirou Zhu, Jiwoo Hong, Ankan Saha, Viral Gupta, Noah Lee, Eunki Kim, Siyu Zhu, Parag Agrawal, Natesh S. Pillai, Sathiya Keerthi

NeurIPS 2025 Direct3D-S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attention Shuang Wu, Youtian Lin, Feihu Zhang, Yifei Zeng, Yikang Yang, Yajie Bao, Jiachen Qian, Siyu Zhu, Xun Cao, Philip Torr, Yao Yao

ICCV 2025 Dirichlet-Constrained Variational Codebook Learning for Temporally Coherent Video Face Restoration Baoyou Chen, Ce Liu, Weihao Yuan, Zilong Dong, Siyu Zhu

ICLR 2025 Flow Distillation Sampling: Regularizing 3D Gaussians with Pre-Trained Matching Priors Lin-Zhuo Chen, Kangjie Liu, Youtian Lin, Zhihao Li, Siyu Zhu, Xun Cao, Yao Yao

ICLR 2025 Hallo2: Long-Duration and High-Resolution Audio-Driven Portrait Image Animation Jiahao Cui, Hui Li, Yao Yao, Hao Zhu, Hanlin Shang, Kaihui Cheng, Hang Zhou, Siyu Zhu, Jingdong Wang

CVPR 2025 Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer Jiahao Cui, Hui Li, Yun Zhan, Hanlin Shang, Kaihui Cheng, Yuqi Ma, Shan Mu, Hang Zhou, Jingdong Wang, Siyu Zhu

CVPR 2025 OpenHumanVid: A Large-Scale High-Quality Dataset for Enhancing Human-Centric Video Generation Hui Li, Mingwang Xu, Yun Zhan, Shan Mu, Jiaye Li, Kaihui Cheng, Yuxuan Chen, Tan Chen, Mao Ye, Jingdong Wang, Siyu Zhu

CVPR 2025 Retaining Knowledge and Enhancing Long-Text Representations in CLIP Through Dual-Teacher Distillation Yuheng Feng, Changsong Wen, Zelin Peng, Li Jiaye, Siyu Zhu

CVPR 2025 Tora: Trajectory-Oriented Diffusion Transformer for Video Generation Zhenghao Zhang, Junchao Liao, Menghao Li, ZuoZhuo Dai, Bingxue Qiu, Siyu Zhu, Long Qin, Weizhi Wang

ECCV 2024 Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance Shenhao Zhu, Junming Leo Chen, Zuozhuo Dai, Zilong Dong, Yinghui Xu, Xun Cao, Yao Yao, Hao Zhu, Siyu Zhu

ECCV 2024 EmoTalk3D: High-Fidelity Free-View Synthesis of Emotional 3D Talking Head Qianyun He, Xinya Ji, Yicheng Gong, Yuanxun Lu, Zhengyu Diao, Linjia Huang, Yao Yao, Siyu Zhu, Zhan Ma, Songcen Xu, Xiaofei Wu, Zixiao Zhang, Xun Cao, Hao Zhu

CVPR 2024 Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle Youtian Lin, Zuozhuo Dai, Siyu Zhu, Yao Yao

ECCV 2024 Head360: Learning a Parametric 3D Full-Head for Free-View Synthesis in 360° Yuxiao He, Yiyu Zhuang, Yanwen Wang, Yao Yao, Siyu Zhu, Xiaoyu Li, Qi Zhang, Xun Cao, Hao Zhu

ECCV 2024 High-Fidelity and Transferable NeRF Editing by Frequency Decomposition Yisheng He, Weihao Yuan, Siyu Zhu, Zilong Dong, Liefeng Bo, Qixing Huang

ICLRW 2024 Neural ODE for Multi-Channel Attribution Yudi Zhang, Oshry Ben-Harush, Xin Liang, Siyu Zhu

ECCV 2024 STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians Yifei Zeng, Yanqin Jiang, Siyu Zhu, Yuanxun Lu, Youtian Lin, Hao Zhu, Weiming Hu, Xun Cao, Yao Yao

ICLR 2023 Monocular Scene Reconstruction with 3D SDF Transformers Weihao Yuan, Xiaodong Gu, Heng Li, Zilong Dong, Siyu Zhu

CVPR 2022 Neural Window Fully-Connected CRFs for Monocular Depth Estimation Weihao Yuan, Xiaodong Gu, Zuozhuo Dai, Siyu Zhu, Ping Tan

ICLR 2022 Quadtree Attention for Vision Transformers Shitao Tang, Jiahui Zhang, Siyu Zhu, Ping Tan

CVPR 2022 RCP: Recurrent Closest Point for Point Cloud Xiaodong Gu, Chengzhou Tang, Weihao Yuan, Zuozhuo Dai, Siyu Zhu, Ping Tan

ICCV 2021 CondLaneNet: A Top-to-Down Lane Detection Framework Based on Conditional Convolution Lizhe Liu, Xiaohao Chen, Siyu Zhu, Ping Tan

ICCV 2021 FloorPlanCAD: A Large-Scale CAD Drawing Dataset for Panoptic Symbol Spotting Zhiwen Fan, Lingjie Zhu, Honghua Li, Xiaohao Chen, Siyu Zhu, Ping Tan

CVPR 2021 Learning Camera Localization via Dense Scene Matching Shitao Tang, Chengzhou Tang, Rui Huang, Siyu Zhu, Ping Tan

ECCV 2018 GeoDesc: Learning Local Descriptors by Integrating Geometry Constraints Zixin Luo, Tianwei Shen, Lei Zhou, Siyu Zhu, Runze Zhang, Yao Yao, Tian Fang, Long Quan

ECCV 2018 Learning and Matching Multi-View Descriptors for Registration of Point Clouds Lei Zhou, Siyu Zhu, Zixin Luo, Tianwei Shen, Runze Zhang, Mingmin Zhen, Tian Fang, Long Quan

ICCV 2017 Distributed Very Large Scale Bundle Adjustment by Global Camera Consensus Runze Zhang, Siyu Zhu, Tian Fang, Long Quan

ICCV 2017 Progressive Large Scale-Invariant Image Matching in Scale Space Lei Zhou, Siyu Zhu, Tianwei Shen, Jinglu Wang, Tian Fang, Long Quan

CVPR 2016 A Text Detection System for Natural Scenes with Convolutional Feature Learning and Cascaded Classification Siyu Zhu, Richard Zanibbi

ECCV 2016 Graph-Based Consistent Matching for Structure-from-Motion Tianwei Shen, Siyu Zhu, Tian Fang, Runze Zhang, Long Quan

ICCV 2015 Joint Camera Clustering and Surface Segmentation for Large-Scale Multi-View Stereo Runze Zhang, Shiwei Li, Tian Fang, Siyu Zhu, Long Quan

CVPR 2014 Local Readjustment for High-Resolution 3D Reconstruction Siyu Zhu, Tian Fang, Jianxiong Xiao, Long Quan