Gao, Shangqian

33 publications

TMLR 2026 ToMoE: Converting Dense Large Language Models to Mixture-of-Experts Through Dynamic Structural Pruning Shangqian Gao, Ting Hua, Reza Shirkavand, Chi-Heng Lin, Zheng Tang, Zhengao Li, Longge Yuan, Fangyi Li, Zeyu Zhang, Alireza Ganjdanesh, Qian Lou, Jie Xu, Yen-Chang Hsu

NeurIPS 2025 ALTER: All-in-One Layer Pruning and Temporal Expert Routing for Efficient Diffusion Generation Xiaomeng Yang, Lei Lu, Qihui Fan, Changdi Yang, Juyi Lin, Yanzhi Wang, Xuan Zhang, Shangqian Gao

NeurIPS 2025 Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-Based Bias Detector Haoyan Yang, Runxue Bao, Cao Xiao, Jun Ma, Parminder Bhatia, Shangqian Gao, Taha Kass-Hout

NeurIPS 2025 Cost-Aware Contrastive Routing for LLMs Reza Shirkavand, Shangqian Gao, Peiran Yu, Heng Huang

NeurIPS 2025 DictPFL: Efficient and Private Federated Learning on Encrypted Gradients Jiaqi Xue, Mayank Kumar, Yuzhang Shang, Shangqian Gao, Rui Ning, Mengxin Zheng, Xiaoqian Jiang, Qian Lou

CVPR 2025 Efficient Fine-Tuning and Concept Suppression for Pruned Diffusion Models Reza Shirkavand, Peiran Yu, Shangqian Gao, Gowthami Somepalli, Tom Goldstein, Heng Huang

ICLR 2025 MoDeGPT: Modular Decomposition for Large Language Model Compression Chi-Heng Lin, Shangqian Gao, James Seale Smith, Abhishek Patel, Shikhar Tuli, Yilin Shen, Hongxia Jin, Yen-Chang Hsu

ICLR 2025 Not All Prompts Are Made Equal: Prompt-Based Pruning of Text-to-Image Diffusion Models Alireza Ganjdanesh, Reza Shirkavand, Shangqian Gao, Heng Huang

CVPR 2024 Auto-Train-Once: Controller Network Guided Automatic Network Pruning from Scratch Xidong Wu, Shangqian Gao, Zeyu Zhang, Zhenzhen Li, Runxue Bao, Yanfu Zhang, Xiaoqian Wang, Heng Huang

CVPR 2024 BilevelPruning: Unified Dynamic and Static Channel Pruning for Convolutional Neural Networks Shangqian Gao, Yanfu Zhang, Feihu Huang, Heng Huang

AAAI 2024 Compressing Image-to-Image Translation GANs Using Local Density Structures on Their Learned Manifold Alireza Ganjdanesh, Shangqian Gao, Hirad Alipanah, Heng Huang

NeurIPS 2024 DISP-LLM: Dimension-Independent Structural Pruning for Large Language Models Shangqian Gao, Chi-Heng Lin, Ting Hua, Tang Zheng, Yilin Shen, Hongxia Jin, Yen-Chang Hsu

CVPR 2024 Device-Wise Federated Network Pruning Shangqian Gao, Junyi Li, Zeyu Zhang, Yanfu Zhang, Weidong Cai, Heng Huang

CVPR 2024 Jointly Training and Pruning CNNs via Learnable Agent Guidance and Alignment Alireza Ganjdanesh, Shangqian Gao, Heng Huang

WACV 2024 Token Fusion: Bridging the Gap Between Token Pruning and Token Merging Minchul Kim, Shangqian Gao, Yen-Chang Hsu, Yilin Shen, Hongxia Jin

AAAI 2023 EffConv: Efficient Learning of Kernel Sizes for Convolution Layers of CNNs Alireza Ganjdanesh, Shangqian Gao, Heng Huang

ICLR 2023 Learning to Jointly Share and Prune Weights for Grounding Based Vision and Language Models Shangqian Gao, Burak Uzkent, Yilin Shen, Heng Huang, Hongxia Jin

ICCV 2023 Structural Alignment for Network Pruning Through Partial Regularization Shangqian Gao, Zeyu Zhang, Yanfu Zhang, Feihu Huang, Heng Huang

JMLR 2022 Accelerated Zeroth-Order and First-Order Momentum Methods from Mini to Minimax Optimization Feihu Huang, Shangqian Gao, Jian Pei, Heng Huang

ICLR 2022 Bregman Gradient Policy Optimization Feihu Huang, Shangqian Gao, Heng Huang

ECCV 2022 Disentangled Differentiable Network Pruning Shangqian Gao, Feihu Huang, Yanfu Zhang, Heng Huang

NeurIPS 2022 Enhanced Bilevel Optimization via Bregman Distance Feihu Huang, Junyi Li, Shangqian Gao, Heng Huang

ECCV 2022 Interpretations Steered Network Pruning via Amortized Inferred Saliency Maps Alireza Ganjdanesh, Shangqian Gao, Heng Huang

ECCV 2022 Recover Fair Deep Classification Models via Altering Pre-Trained Structure Yanfu Zhang, Shangqian Gao, Heng Huang

ICCV 2021 Adversarial Attack on Deep Cross-Modal Hamming Retrieval Chao Li, Shangqian Gao, Cheng Deng, Wei Liu, Heng Huang

JMLR 2021 Black-Box Reductions for Zeroth-Order Gradient Algorithms to Achieve Lower Query Complexity Bin Gu, Xiyuan Wei, Shangqian Gao, Ziran Xiong, Cheng Deng, Heng Huang

ICCV 2021 Exploration and Estimation for Model Compression Yanfu Zhang, Shangqian Gao, Heng Huang

CVPR 2021 Network Pruning via Performance Maximization Shangqian Gao, Feihu Huang, Weidong Cai, Heng Huang

ICML 2020 Momentum-Based Policy Gradient Methods Feihu Huang, Shangqian Gao, Jian Pei, Heng Huang

NeurIPS 2019 Cross-Modal Learning with Adversarial Samples Chao Li, Shangqian Gao, Cheng Deng, De Xie, Wei Liu

IJCAI 2019 Zeroth-Order Stochastic Alternating Direction Method of Multipliers for Nonconvex Nonsmooth Optimization Feihu Huang, Shangqian Gao, Songcan Chen, Heng Huang

AAAI 2018 Action Prediction from Videos via Memorizing Hard-to-Predict Samples Yu Kong, Shangqian Gao, Bin Sun, Yun Fu

AAAI 2017 Video Recovery via Learning Variation and Consistency of Images Zhouyuan Huo, Shangqian Gao, Weidong Cai, Heng Huang