Xu, Zhi-Qin John

6 publications

NeurIPS 2025 Achilles' Heel of Mamba: Essential Difficulties of the Mamba Architecture Demonstrated by Synthetic Data Tianyi Chen, Pengxiao Lin, Zhiwei Wang, Zhi-Qin John Xu

ICML 2025 An Analysis for Reasoning Bias of Language Models with Small Initialization Junjie Yao, Zhongwang Zhang, Zhi-Qin John Xu

NeurIPS 2024 Initialization Is Critical to Whether Transformers Fit Composite Functions by Reasoning or Memorizing Zhongwang Zhang, Pengxiao Lin, Zhiwei Wang, Yaoyu Zhang, Zhi-Qin John Xu

ICLR 2024 Stochastic Modified Equations and Dynamics of Dropout Algorithm Zhongwang Zhang, Yuqing Li, Tao Luo, Zhi-Qin John Xu

TMLR 2023 Limitation of Characterizing Implicit Regularization by Data-Independent Functions Leyang Zhang, Zhi-Qin John Xu, Tao Luo, Yaoyu Zhang

JMLR 2021 Phase Diagram for Two-Layer ReLU Neural Networks at Infinite-Width Limit Tao Luo, Zhi-Qin John Xu, Zheng Ma, Yaoyu Zhang