Sun, Shengjie

3 publications

ICML 2025 Delta Decompression for MoE-Based LLMs Compression Hao Gu, Wei Li, Lujun Li, Zhu Qiyuan, Mark G. Lee, Shengjie Sun, Wei Xue, Yike Guo

ICML 2025 MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition Wei Li, Lujun Li, Hao Gu, You-Liang Huang, Mark G. Lee, Shengjie Sun, Wei Xue, Yike Guo

NeurIPS 2024 Adaptive Layer Sparsity for Large Language Models via Activation Correlation Assessment Wei Li, Lujun Li, Mark Lee, Shengjie Sun