Thangarasa, Vithursan

8 publications

ICLR 2026 CodeQuant: Unified Clustering and Quantization for Enhanced Outlier Smoothing in Low-Precision Mixture-of-Experts Xiangyang Yin, Xingyu Liu, Tianhua Xia, Bo Bao, Vithursan Thangarasa, Valavan Manohararajah, Eric Sather, Sai Qian Zhang
ICLR 2026 REAP the Experts: Why Pruning Prevails for One-Shot MoE Compression Mike Lasby, Ivan Lazarevich, Nish Sinnadurai, Sean Lie, Yani Ioannou, Vithursan Thangarasa
NeurIPS 2025 DREAM: Drafting with Refined Target Features and Entropy-Adaptive Cross-Attention Fusion for Multimodal Speculative Decoding Yunhai Hu, Tianhua Xia, Zining Liu, Rahul Raman, Xingyu Liu, Bo Bao, Eric Sather, Vithursan Thangarasa, Sai Qian Zhang
NeurIPSW 2024 Self-Data Distillation for Recovering Quality in Pruned Large Language Models Vithursan Thangarasa, Ganesh Venkatesh, Nish Sinnadurai, Sean Lie
ICML 2024 Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa, Shreyas Saxena, Abhay Gupta, Sean Lie
UAI 2023 SPDF: Sparse Pre-Training and Dense Fine-Tuning for Large Language Models Vithursan Thangarasa, Abhay Gupta, William Marshall, Tianda Li, Kevin Leong, Dennis DeCoste, Sean Lie, Shreyas Saxena
NeurIPSW 2023 Sparse Iso-FLOP Transformations for Maximizing Training Efficiency Vithursan Thangarasa, Shreyas Saxena, Abhay Gupta, Sean Lie
ICMLW 2019 Differentiable Hebbian Plasticity for Continual Learning Vithursan Thangarasa, Thomas Miconi, Graham W. Taylor