Teo, Rachel S.Y.

7 publications

ICLRW 2025 CAMEx: Curvature-Aware Merging of Experts Dung Viet Nguyen, Minh Hoang Nguyen, Luc Nguyen, Rachel S.Y. Teo, Tan Minh Nguyen, Linh Duy Tran

ICLRW 2025 MoLEx: Mixture of Layer Experts for Finetuning with Sparse Upcycling Rachel S.Y. Teo, Tan Minh Nguyen

ICLRW 2025 Tight Clusters Make Specialized Experts Stefan Nielsen, Rachel S.Y. Teo, Laziz Abdullaev, Tan Minh Nguyen

ICLRW 2025 Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis Rachel S.Y. Teo, Tan Minh Nguyen

NeurIPS 2024 Elliptical Attention Stefan K. Nielsen, Laziz U. Abdullaev, Rachel S.Y. Teo, Tan M. Nguyen

NeurIPS 2024 MomentumSMoE: Integrating Momentum into Sparse Mixture of Experts Rachel S.Y. Teo, Tan M. Nguyen

NeurIPS 2024 Unveiling the Hidden Structure of Self-Attention via Kernel Principal Component Analysis Rachel S.Y. Teo, Tan M. Nguyen