Li, Lujun

25 publications

ICCV 2025 AIRA: Activation-Informed Low-Rank Adaptation for Large Models Lujun Li, Dezhi Li, Cheng Lin, Wei Li, Wei Xue, Sirui Han, Yike Guo

ICML 2025 Can Compressed LLMs Truly Act? an Empirical Evaluation of Agentic Capabilities in LLM Compression Peijie Dong, Zhenheng Tang, Xiang Liu, Lujun Li, Xiaowen Chu, Bo Li

ICML 2025 Delta Decompression for MoE-Based LLMs Compression Hao Gu, Wei Li, Lujun Li, Zhu Qiyuan, Mark G. Lee, Shengjie Sun, Wei Xue, Yike Guo

ICCV 2025 Efficient Fine-Tuning of Large Models via Nested Low-Rank Adaptation Lujun Li, Cheng Lin, Dezhi Li, You-Liang Huang, Wei Li, Tianyu Wu, Jie Zou, Wei Xue, Sirui Han, Yike Guo

ICML 2025 MoE-SVD: Structured Mixture-of-Experts LLMs Compression via Singular Value Decomposition Wei Li, Lujun Li, Hao Gu, You-Liang Huang, Mark G. Lee, Shengjie Sun, Wei Xue, Yike Guo

AAAI 2025 ParZC: Parametric Zero-Cost Proxies for Efficient NAS Peijie Dong, Lujun Li, Zhenheng Tang, Xiang Liu, Zimian Wei, Qiang Wang, Xiaowen Chu

ICLR 2025 STBLLM: Breaking the 1-Bit Barrier with Structured Binary LLMs Peijie Dong, Lujun Li, Yuedong Zhong, DaYou Du, Ruibo Fan, Yuhan Chen, Zhenheng Tang, Qiang Wang, Wei Xue, Yike Guo, Xiaowen Chu

NeurIPS 2024 Adaptive Layer Sparsity for Large Language Models via Activation Correlation Assessment Wei Li, Lujun Li, Mark Lee, Shengjie Sun

ECCV 2024 AttnZero: Efficient Attention Discovery for Vision Transformers Lujun Li, Zimian Wei, Peijie Dong, Wenhan Luo, Wei Xue, Qifeng Liu, Yike Guo

ECCV 2024 Auto-DAS: Automated Proxy Discovery for Training-Free Distillation-Aware Architecture Search Haosen Sun, Lujun Li, Peijie Dong, Zimian Wei, Shitong Shao

ECCV 2024 Auto-GAS: Automated Proxy Discovery for Training-Free Generative Architecture Search Lujun Li, Haosen Sun, Shiwen Li, Peijie Dong, Wenhan Luo, Wei Xue, Qifeng Liu, Yike Guo

AAAI 2024 Auto-Prox: Training-Free Vision Transformer Architecture Search via Automatic Proxy Discovery Zimian Wei, Peijie Dong, Zheng Hui, Anggeng Li, Lujun Li, Menglong Lu, Hengyue Pan, Dongsheng Li

ICML 2024 DetKDS: Knowledge Distillation Search for Object Detectors Lujun Li, Yufan Bao, Peijie Dong, Chuanguang Yang, Anggeng Li, Wenhan Luo, Qifeng Liu, Wei Xue, Yike Guo

NeurIPS 2024 Discovering Sparsity Allocation for Layer-Wise Pruning of Large Language Models Lujun Li, Peijie Dong, Zhenheng Tang, Xiang Liu, Qiang Wang, Wenhan Luo, Wei Xue, Qifeng Liu, Xiaowen Chu, Yike Guo

ICML 2024 Pruner-Zero: Evolving Symbolic Pruning Metric from Scratch for Large Language Models Peijie Dong, Lujun Li, Zhenheng Tang, Xiang Liu, Xinglin Pan, Qiang Wang, Xiaowen Chu

AAAI 2024 SasWOT: Real-Time Semantic Segmentation Architecture Search WithOut Training Chendi Zhu, Lujun Li, Yuli Wu, Zhengxing Sun

AAAI 2024 UniADS: Universal Architecture-Distiller Search for Distillation Gap Liming Lu, Zhenghan Chen, Xiaoyu Lu, Yihang Rao, Lujun Li, Shuchao Pang

CVPRW 2023 A2-Aug: Adaptive Automated Data Augmentation Lujun Li, Anggeng Li

ICCV 2023 Automated Knowledge Distillation via Monte Carlo Tree Search Lujun Li, Peijie Dong, Zimian Wei, Ya Yang

CVPR 2023 DisWOT: Student Architecture Search for Distillation WithOut Training Peijie Dong, Lujun Li, Zimian Wei

ICCV 2023 EMQ: Evolving Training-Free Proxies for Automated Mixed Precision Quantization Peijie Dong, Lujun Li, Zimian Wei, Xin Niu, Zhiliang Tian, Hengyue Pan

NeurIPS 2023 KD-Zero: Evolving Knowledge Distiller for Any Teacher-Student Pairs Lujun Li, Peijie Dong, Anggeng Li, Zimian Wei, Ya Yang

AAAI 2022 Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentation Jie Qin, Jie Wu, Xuefeng Xiao, Lujun Li, Xingang Wang

ECCV 2022 Self-Regulated Feature Learning via Teacher-Free Feature Distillation Lujun Li

NeurIPS 2022 Shadow Knowledge Distillation: Bridging Offline and Online Knowledge Transfer Lujun Li, Zhe Jin