Yang, Songlin

13 publications

ICML 2025 Adaptive Median Smoothing: Adversarial Defense for Unlearned Text-to-Image Diffusion Models at Inference Time Xiaoxuan Han, Songlin Yang, Wei Wang, Yang Li, Jing Dong

NeurIPS 2025 Gated Attention for Large Language Models: Non-Linearity, Sparsity, and Attention-Sink-Free Zihan Qiu, Zekun Wang, Bo Zheng, Zeyu Huang, Kaiyue Wen, Songlin Yang, Rui Men, Le Yu, Fei Huang, Suozhi Huang, Dayiheng Liu, Jingren Zhou, Junyang Lin

ICLR 2025 Gated Delta Networks: Improving Mamba2 with Delta Rule Songlin Yang, Jan Kautz, Ali Hatamizadeh

NeurIPS 2025 PaTH Attention: Position Encoding via Accumulating Householder Transformations Songlin Yang, Yikang Shen, Kaiyue Wen, Shawn Tan, Mayank Mishra, Liliang Ren, Rameswar Panda, Yoon Kim

NeurIPS 2025 Radial Attention: $\mathcal{O}(n\log N)$ Sparse Attention with Energy Decay for Long Video Generation Xingyang Li, Muyang Li, Tianle Cai, Haocheng Xi, Shuo Yang, Yujun Lin, Lvmin Zhang, Songlin Yang, Jinbo Hu, Kelly Peng, Maneesh Agrawala, Ion Stoica, Kurt Keutzer, Song Han

ICLR 2025 Scaling Stick-Breaking Attention: An Efficient Implementation and In-Depth Study Shawn Tan, Songlin Yang, Aaron Courville, Rameswar Panda, Yikang Shen

ICCV 2025 Textured 3D Regenerative Morphing with 3D Diffusion Prior Songlin Yang, Yushi Lan, Honghua Chen, Xingang Pan

ICML 2024 Gated Linear Attention Transformers with Hardware-Efficient Training Songlin Yang, Bailin Wang, Yikang Shen, Rameswar Panda, Yoon Kim

NeurIPS 2024 Gated Slot Attention for Efficient Linear-Time Sequence Modeling Yu Zhang, Songlin Yang, Ruijie Zhu, Yue Zhang, Leyang Cui, Yiqiao Wang, Bolun Wang, Freda Shi, Bailin Wang, Wei Bi, Peng Zhou, Guohong Fu

AAAI 2024 Learning Dense Correspondence for NeRF-Based Face Reenactment Songlin Yang, Wei Wang, Yushi Lan, Xiangyu Fan, Bo Peng, Lei Yang, Jing Dong

NeurIPS 2024 Parallelizing Linear Transformers with the Delta Rule over Sequence Length Songlin Yang, Bailin Wang, Yu Zhang, Yikang Shen, Yoon Kim

CVPRW 2023 Exposing Fine-Grained Adversarial Vulnerability of Face Anti-Spoofing Models Songlin Yang, Wei Wang, Chenye Xu, Ziwen He, Bo Peng, Jing Dong

NeurIPS 2023 Hierarchically Gated Recurrent Neural Network for Sequence Modeling Zhen Qin, Songlin Yang, Yiran Zhong