Zhou, Pan

102 publications

CVPR 2025 BadToken: Token-Level Backdoor Attacks to Multi-Modal Large Language Models Zenghui Yuan, Jiawen Shi, Pan Zhou, Neil Zhenqiang Gong, Lichao Sun

NeurIPS 2025 BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization Xueyang Zhou, Guiyao Tie, Guowen Zhang, Hecheng Wang, Pan Zhou, Lichao Sun

ICLR 2025 CaPo: Cooperative Plan Optimization for Efficient Embodied Multi-Agent Cooperation Jie Liu, Pan Zhou, Yingjun Du, Ah-Hwee Tan, Cees G. M. Snoek, Jan-Jakob Sonke, Efstratios Gavves

NeurIPS 2025 Can LLMs Correct Themselves? a Benchmark of Self-Correction in LLMs Guiyao Tie, Zenghui Yuan, Zeli Zhao, Chaoran Hu, Tianhe Gu, Ruihang Zhang, Sizhe Zhang, Junran Wu, Xiaoyue Tu, Ming Jin, Qingsong Wen, Lixing Chen, Pan Zhou, Lichao Sun

CVPR 2025 Collaborative Tree Search for Enhancing Embodied Multi-Agent Collaboration Lizheng Zu, Lin Lin, Song Fu, Na Zhao, Pan Zhou

NeurIPS 2025 EAP-GP: Mitigating Saturation Effect in Gradient-Based Automated Circuit Identification Lin Zhang, Wenshuo Dong, Zhuoran Zhang, Shu Yang, Lijie Hu, Ninghao Liu, Pan Zhou, Di Wang

NeurIPS 2025 Fit the Distribution: Cross-Image/Prompt Adversarial Attacks on Multimodal Large Language Models Hai Yan, Haijian Ma, Xiaowen Cai, Daizong Liu, Zenghui Yuan, Xiaoye Qu, Jianfeng Dong, Runwei Guan, Xiang Fang, Hongyang He, Yulai Xie, Pan Zhou

NeurIPS 2025 GRIFFIN: Effective Token Alignment for Faster Speculative Decoding Shijing Hu, Jingyang Li, Xingyu Xie, Zhihui Lu, Kim-chuan Toh, Pan Zhou

ICLR 2025 GUI-World: A Video Benchmark and Dataset for Multimodal GUI-Oriented Understanding Dongping Chen, Yue Huang, Siyuan Wu, Jingyu Tang, Huichi Zhou, Qihui Zhang, Zhigang He, Yilin Bai, Chujie Gao, Liuyi Chen, Yiqiang Li, Chenlong Wang, Yue Yu, Tianshuo Zhou, Zhen Li, Yi Gui, Yao Wan, Pan Zhou, Jianfeng Gao, Lichao Sun

AAAI 2025 Graph Agent Network: Empowering Nodes with Inference Capabilities for Adversarial Resilience Ao Liu, Wenshan Li, Tao Li, Beibei Li, Guangquan Xu, Pan Zhou, Wengang Ma, Hanyuan Huang

AAAI 2025 Grimm: A Plug-and-Play Perturbation Rectifier for Graph Neural Networks Defending Against Poisoning Attacks Ao Liu, Wenshan Li, Beibei Li, Wengang Ma, Tao Li, Pan Zhou

ICML 2025 HPS: Hard Preference Sampling for Human Preference Alignment Xiandong Zou, Wanyu Lin, Yuchen Li, Pan Zhou

ICLR 2025 Interleaved Scene Graphs for Interleaved Text-and-Image Generation Assessment Dongping Chen, Ruoxi Chen, Shu Pu, Zhaoyi Liu, Yanru Wu, Caixi Chen, Benlin Liu, Yue Huang, Yao Wan, Pan Zhou, Ranjay Krishna

ICCV 2025 Memory-Efficient 4-Bit Preconditioned Stochastic Optimization Jingyang Li, Kuangyu Ding, Kim-Chuan Toh, Pan Zhou

AAAI 2025 Multi-Pair Temporal Sentence Grounding via Multi-Thread Knowledge Transfer Network Xiang Fang, Wanlong Fang, Changshuo Wang, Daizong Liu, Keke Tang, Jianfeng Dong, Pan Zhou, Beibei Li

ICML 2025 Probabilistic Interactive 3D Segmentation with Hierarchical Neural Processes Jie Liu, Pan Zhou, Zehao Xiao, Jiayi Shen, Wenzhe Yin, Jan-Jakob Sonke, Efstratios Gavves

ICCV 2025 Probabilistic Prototype Calibration of Vision-Language Models for Generalized Few-Shot Semantic Segmentation Jie Liu, Jiayi Shen, Pan Zhou, Jan-Jakob Sonke, Efstratios Gavves

NeurIPS 2025 SoPo: Text-to-Motion Generation Using Semi-Online Preference Optimization Xiaofeng Tan, Hongsong Wang, Xin Geng, Pan Zhou

NeurIPS 2025 Towards Building Model/Prompt-Transferable Attackers Against Large Vision-Language Models Xiaowen Cai, Daizong Liu, Xiaoye Qu, Xiang Fang, Jianfeng Dong, Keke Tang, Pan Zhou, Lichao Sun, Wei Hu

ICLR 2025 Towards Understanding Why FixMatch Generalizes Better than Supervised Learning Jingyang Li, Jiachun Pan, Vincent Y. F. Tan, Kim-chuan Toh, Pan Zhou

ICCV 2025 Zeroth-Order Fine-Tuning of LLMs in Random Subspaces Ziming Yu, Pan Zhou, Sike Wang, Jia Li, Mi Tian, Hua Huang

NeurIPS 2024 4-Bit Shampoo for Memory-Efficient Network Training Sike Wang, Pan Zhou, Jia Li, Hua Huang

CVPR 2024 Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Prior Zike Wu, Pan Zhou, Xuanyu Yi, Xiaoding Yuan, Hanwang Zhang

CVPR 2024 Diffusion Time-Step Curriculum for One Image to 3D Generation Xuanyu Yi, Zike Wu, Qingshan Xu, Pan Zhou, Joo-Hwee Lim, Hanwang Zhang

ECCV 2024 Efficient Cascaded Multiscale Adaptive Network for Image Restoration Yichen Zhou, Pan Zhou, Teck Khim Ng

CVPR 2024 Few-Shot Learner Parameterization by Diffusion Time-Steps Zhongqi Yue, Pan Zhou, Richang Hong, Hanwang Zhang, Qianru Sun

AAAI 2024 Fewer Steps, Better Performance: Efficient Cross-Modal CLIP Trimming for Video Moment Retrieval Using Language Xiang Fang, Daizong Liu, Wanlong Fang, Pan Zhou, Zichuan Xu, Wenzheng Xu, Junyang Chen, Renfu Li

CVPR 2024 Friendly Sharpness-Aware Minimization Tao Li, Pan Zhou, Zhengbao He, Xinwen Cheng, Xiaolin Huang

ECCV 2024 GENIXER: Empowering Multimodal Large Language Models as a Powerful Data Generator Henry Hengyuan Zhao, Pan Zhou, Mike Zheng Shou

NeurIPSW 2024 GUI-WORLD: A GUI-Oriented Video Dataset for Multimodal LLM-Based Agents Dongping Chen, Yue Huang, Siyuan Wu, Jingyu Tang, Huichi Zhou, Qihui Zhang, Zhigang He, Yilin Bai, Chujie Gao, Liuyi Chen, Yiqiang Li, Chenlong Wang, Yue Yu, Tianshuo Zhou, Zhen Li, Yi Gui, Yao Wan, Pan Zhou, Jianfeng Gao, Lichao Sun

ECCV 2024 Hiding Imperceptible Noise in Curvature-Aware Patches for 3D Point Cloud Attack Mingyu Yang, Daizong Liu, Keke Tang, Pan Zhou, Lixing Chen, Junyang Chen

CVPR 2024 InceptionNeXt: When Inception Meets ConvNeXt Weihao Yu, Pan Zhou, Shuicheng Yan, Xinchao Wang

NeurIPS 2024 LOVA3: Learning to Visual Question Answering, Asking and Assessment Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Zechen Bai, Mike Zheng Shou

CVPR 2024 Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generation Shanshan Zhong, Zhongzhan Huang, Shanghua Gao, Wushao Wen, Liang Lin, Marinka Zitnik, Pan Zhou

ICML 2024 MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark Dongping Chen, Ruoxi Chen, Shilin Zhang, Yaochen Wang, Yinuo Liu, Huichi Zhou, Qihui Zhang, Yao Wan, Pan Zhou, Lichao Sun

NeurIPS 2024 MVGamba: Unify 3D Content Generation as State Space Sequence Modeling Xuanyu Yi, Zike Wu, Qiuhong Shen, Qingshan Xu, Pan Zhou, Joo-Hwee Lim, Shuicheng Yan, Xinchao Wang, Hanwang Zhang

AAAI 2024 Manifold Constraints for Imperceptible Adversarial Attacks on Point Clouds Keke Tang, Xu He, Weilong Peng, Jianpeng Wu, Yawen Shi, Daizong Liu, Pan Zhou, Wenping Wang, Zhihong Tian

CVPR 2024 MetaCloak: Preventing Unauthorized Subject-Driven Text-to-Image Diffusion-Based Synthesis via Meta-Learning Yixin Liu, Chenrui Fan, Yutong Dai, Xun Chen, Pan Zhou, Lichao Sun

ICLR 2024 MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use Yue Huang, Jiawen Shi, Yuan Li, Chenrui Fan, Siyuan Wu, Qihui Zhang, Yixin Liu, Pan Zhou, Yao Wan, Neil Zhenqiang Gong, Lichao Sun

NeurIPS 2024 Pandora's Box: Towards Building Universal Attackers Against Real-World Large Vision-Language Models Daizong Liu, Mingyu Yang, Xiaoye Qu, Pan Zhou, Xiang Fang, Keke Tang, Yao Wan, Lichao Sun

CVPR 2024 Physical Backdoor: Towards Temperature-Based Backdoor Attacks in the Physical World Wen Yin, Jian Lou, Pan Zhou, Yulai Xie, Dan Feng, Yuhua Sun, Tailai Zhang, Lichao Sun

ICML 2024 Position: Exploring the Robustness of Pipeline-Parallelism-Based Decentralized Training Lin Lu, Chenxi Dai, Wangcheng Tao, Binhang Yuan, Yanan Sun, Pan Zhou

ECCV 2024 Rethinking Weakly-Supervised Video Temporal Grounding from a Game Perspective Xiang Fang, Zeyu Xiong, Wanlong Fang, Xiaoye Qu, Chen Chen, Jianfeng Dong, Keke Tang, Pan Zhou, Yu Cheng, Daizong Liu

ICMLW 2024 Self-Cognition in Large Language Models: An Exploratory Study Dongping Chen, Jiawen Shi, Neil Zhenqiang Gong, Yao Wan, Pan Zhou, Lichao Sun

AAAI 2024 Sparse Enhanced Network: An Adversarial Generation Method for Robust Augmentation in Sequential Recommendation Junyang Chen, Guoxuan Zou, Pan Zhou, Yirui Wu, Zhenghan Chen, Houcheng Su, Huan Wang, Zhiguo Gong

NeurIPSW 2024 The Impact of Large Language Models in Academia: From Writing to Speaking Mingmeng Geng, Caixi Chen, Yanru Wu, Dongping Chen, Yao Wan, Pan Zhou

AAAI 2024 Towards Inductive Robustness: Distilling and Fostering Wave-Induced Resonance in Transductive GCNs Against Graph Adversarial Attacks Ao Liu, Wenshan Li, Tao Li, Beibei Li, Hanyuan Huang, Pan Zhou

AAAI 2024 Unsupervised Domain Adaptative Temporal Sentence Localization with Mutual Information Maximization Daizong Liu, Xiang Fang, Xiaoye Qu, Jianfeng Dong, He Yan, Yang Yang, Pan Zhou, Yu Cheng

NeurIPS 2024 Unsupervised Modality Adaptation with Text-to-Image Diffusion Models for Semantic Segmentation Ruihao Xia, Yu Liang, Peng-Tao Jiang, Hao Zhang, Bo Li, Yang Tang, Pan Zhou

AAAI 2024 What Makes Good Collaborative Views? Contrastive Mutual Information Maximization for Multi-Agent Perception Wanfang Su, Lixing Chen, Yang Bai, Xi Lin, Gaolei Li, Zhe Qu, Pan Zhou

JMLR 2024 Win: Weight-Decay-Integrated Nesterov Acceleration for Faster Network Training Pan Zhou, Xingyu Xie, Zhouchen Lin, Kim-Chuan Toh, Shuicheng Yan

ICCV 2023 3DHacker: Spectrum-Based Decision Boundary Generation for Hard-Label 3D Point Cloud Attack Yunbo Tao, Daizong Liu, Pan Zhou, Yulai Xie, Wei Du, Wei Hu

AAAI 2023 Distantly-Supervised Named Entity Recognition with Adaptive Teacher Learning and Fine-Grained Student Ensemble Xiaoye Qu, Jun Zeng, Daizong Liu, Zhefeng Wang, Baoxing Huai, Pan Zhou

AAAI 2023 Hypotheses Tree Building for One-Shot Temporal Sentence Localization Daizong Liu, Xiang Fang, Pan Zhou, Xing Di, Weining Lu, Yu Cheng

ICLR 2023 LPT: Long-Tailed Prompt Tuning for Image Classification Bowen Dong, Pan Zhou, Shuicheng Yan, Wangmeng Zuo

ICCV 2023 Masked Diffusion Transformer Is a Strong Image Synthesizer Shanghua Gao, Pan Zhou, Ming-Ming Cheng, Shuicheng Yan

CVPR 2023 Position-Guided Text Prompt for Vision-Language Pre-Training Jinpeng Wang, Pan Zhou, Mike Zheng Shou, Shuicheng Yan

ICCV 2023 STPrivacy: Spatio-Temporal Privacy-Preserving Action Recognition Ming Li, Xiangyu Xu, Hehe Fan, Pan Zhou, Jun Liu, Jia-Wei Liu, Jiahe Li, Jussi Keppo, Mike Zheng Shou, Shuicheng Yan

NeurIPS 2023 ScaleLong: Towards More Stable Training of Diffusion Model via Scaling Network Long Skip Connection Zhongzhan Huang, Pan Zhou, Shuicheng Yan, Liang Lin

ICLR 2023 Towards Understanding Why Mask Reconstruction Pretraining Helps in Downstream Tasks Jiachun Pan, Pan Zhou, Shuicheng Yan

ICLR 2023 Win: Weight-Decay-Integrated Nesterov Acceleration for Adaptive Gradient Algorithms Pan Zhou, Xingyu Xie, Shuicheng Yan

CVPR 2023 You Are Catching My Attention: Are Vision Transformers Bad Learners Under Backdoor Attacks? Zenghui Yuan, Pan Zhou, Kai Zou, Yu Cheng

CVPR 2023 You Can Ground Earlier than See: An Effective and Efficient Pipeline for Temporal Sentence Grounding in Compressed Videos Xiang Fang, Daizong Liu, Pan Zhou, Guoshun Nan

NeurIPSW 2022 Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models Xingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan

CVPR 2022 Bandits for Structure Perturbation-Based Black-Box Attacks to Graph Neural Networks with Theoretical Guarantees Binghui Wang, Youqi Li, Pan Zhou

NeurIPSW 2022 Dimension-Reduced Adaptive Gradient Method Jingyang Li, Pan Zhou, Kuangyu Ding, Kim-Chuan Toh, Yinyu Ye

ECCV 2022 DualFormer: Local-Global Stratified Transformer for Efficient Video Recognition Yuxuan Liang, Pan Zhou, Roger Zimmermann, Shuicheng Yan

AAAI 2022 Exploring Motion and Appearance Information for Temporal Sentence Grounding Daizong Liu, Xiaoye Qu, Pan Zhou, Yang Liu

NeurIPS 2022 Inception Transformer Chenyang Si, Weihao Yu, Pan Zhou, Yichen Zhou, Xinchao Wang, Shuicheng Yan

AAAI 2022 Memory-Guided Semantic Learning Network for Temporal Sentence Grounding Daizong Liu, Xiaoye Qu, Xing Di, Yu Cheng, Zichuan Xu, Pan Zhou

CVPR 2022 MetaFormer Is Actually What You Need for Vision Weihao Yu, Mi Luo, Pan Zhou, Chenyang Si, Yichen Zhou, Xinchao Wang, Jiashi Feng, Shuicheng Yan

ECCV 2022 Self-Promoted Supervision for Few-Shot Transformer Bowen Dong, Pan Zhou, Shuicheng Yan, Wangmeng Zuo

AAAI 2022 Unsupervised Temporal Video Grounding with Deep Semantic Clustering Daizong Liu, Xiaoye Qu, Yinzhen Wang, Xing Di, Kai Zou, Yu Cheng, Zichuan Xu, Pan Zhou

ECCV 2022 Video Graph Transformer for Video Question Answering Junbin Xiao, Pan Zhou, Tat-Seng Chua, Shuicheng Yan

NeurIPSW 2022 Win: Weight-Decay-Integrated Nesterov Acceleration for Adaptive Gradient Algorithms Pan Zhou, Xingyu Xie, Shuicheng Yan

NeurIPS 2021 A Theory-Driven Self-Labeling Refinement Method for Contrastive Representation Learning Pan Zhou, Caiming Xiong, Xiaotong Yuan, Steven Chu Hong Hoi

AAAI 2021 Adversarial Meta Sampling for Multilingual Low-Resource Speech Recognition Yubei Xiao, Ke Gong, Pan Zhou, Guolin Zheng, Xiaodan Liang, Liang Lin

CVPR 2021 Context-Aware Biaffine Localizing Network for Temporal Sentence Grounding Daizong Liu, Xiaoye Qu, Jianfeng Dong, Pan Zhou, Yu Cheng, Wei Wei, Zichuan Xu, Yulai Xie

AAAI 2021 F2Net: Learning to Focus on the Foreground for Unsupervised Video Object Segmentation Daizong Liu, Dongdong Yu, Changhu Wang, Pan Zhou

AAAI 2021 Graph-Evolving Meta-Learning for Low-Resource Medical Dialogue Generation Shuai Lin, Pan Zhou, Xiaodan Liang, Jianheng Tang, Ruihui Zhao, Ziliang Chen, Liang Lin

ICML 2021 How Important Is the Train-Validation Split in Meta-Learning? Yu Bai, Minshuo Chen, Pan Zhou, Tuo Zhao, Jason Lee, Sham Kakade, Huan Wang, Caiming Xiong

ICLR 2021 Prototypical Contrastive Learning of Unsupervised Representations Junnan Li, Pan Zhou, Caiming Xiong, Steven Hoi

AAAI 2021 Spatiotemporal Graph Neural Network Based Mask Reconstruction for Video Object Segmentation Daizong Liu, Shuangjie Xu, Xiao-Yang Liu, Zichuan Xu, Wei Wei, Pan Zhou

NeurIPS 2021 TRS: Transferability Reduced Ensemble via Promoting Gradient Diversity and Model Smoothness Zhuolin Yang, Linyi Li, Xiaojun Xu, Shiliang Zuo, Qian Chen, Pan Zhou, Benjamin I. Rubinstein, Ce Zhang, Bo Li

UAI 2021 Task Similarity Aware Meta Learning: Theory-Inspired Improvement on MAML Pan Zhou, Yingtian Zou, Xiao-Tong Yuan, Jiashi Feng, Caiming Xiong, Steven Hoi

NeurIPS 2021 Towards Understanding Why Lookahead Generalizes Better than SGD and Beyond Pan Zhou, Hanshu Yan, Xiaotong Yuan, Jiashi Feng, Shuicheng Yan

ICLR 2020 A Stochastic Trust Region Method for Non-Convex Minimization Zebang Shen, Pan Zhou, Cong Fang, Alejandro Ribeiro

IJCAI 2020 Generating Robust Audio Adversarial Examples with Temporal Dependency Hongting Zhang, Pan Zhou, Qiben Yan, Xiao-Yang Liu

ICML 2020 Hybrid Stochastic-Deterministic Minibatch Proximal Gradient: Less-than-Single-Pass Optimization with Nearly Optimal Generalization Pan Zhou, Xiao-Tong Yuan

NeurIPS 2020 Improving GAN Training with Probability Ratio Clipping and Sample Reweighting Yue Wu, Pan Zhou, Andrew G Wilson, Eric P. Xing, Zhiting Hu

NeurIPS 2020 Theory-Inspired Path-Regularized Differential Network Architecture Search Pan Zhou, Caiming Xiong, Richard Socher, Steven Chu Hong Hoi

NeurIPS 2020 Towards Theoretically Understanding Why SGD Generalizes Better than Adam in Deep Learning Pan Zhou, Jiashi Feng, Chao Ma, Caiming Xiong, Steven Chu Hong Hoi, Weinan E

NeurIPS 2019 Efficient Meta Learning via Minibatch Proximal Update Pan Zhou, Xiaotong Yuan, Huan Xu, Shuicheng Yan, Jiashi Feng

AISTATS 2019 Faster First-Order Methods for Stochastic Non-Convex Optimization on Riemannian Manifolds Pan Zhou, Xiao-Tong Yuan, Jiashi Feng

IJCAI 2019 Generalized Majorization-Minimization for Non-Convex Optimization Hu Zhang, Pan Zhou, Yi Yang, Jiashi Feng

WACV 2019 Task Relation Networks Jianshu Li, Pan Zhou, Yunpeng Chen, Jian Zhao, Sujoy Roy, Shuicheng Yan, Jiashi Feng, Terence Sim

NeurIPS 2018 Efficient Stochastic Gradient Hard Thresholding Pan Zhou, Xiaotong Yuan, Jiashi Feng

ICLR 2018 Empirical Risk Landscape Analysis for Understanding Deep Neural Networks Pan Zhou, Jiashi Feng

NeurIPS 2018 New Insight into Hybrid Stochastic Gradient Descent: Beyond With-Replacement Sampling and Convexity Pan Zhou, Xiaotong Yuan, Jiashi Feng

ICML 2018 Understanding Generalization and Optimization Performance of Deep CNNs Pan Zhou, Jiashi Feng

ICCV 2017 Jointly Attentive Spatial-Temporal Pooling Networks for Video-Based Person Re-Identification Shuangjie Xu, Yu Cheng, Kang Gu, Yang Yang, Shiyu Chang, Pan Zhou

CVPR 2017 Outlier-Robust Tensor PCA Pan Zhou, Jiashi Feng