Qin, Zhen

39 publications

CPAL 2025 A Validation Approach to Over-Parameterized Matrix and Image Recovery Lijun Ding, Zhen Qin, Liwei Jiang, Jinxin Zhou, Zhihui Zhu

ICLR 2025 Building Math Agents with Multi-Turn Iterative Preference Learning Wei Xiong, Chengshuai Shi, Jiaming Shen, Aviv Rosenberg, Zhen Qin, Daniele Calandriello, Misha Khalman, Rishabh Joshi, Bilal Piot, Mohammad Saleh, Chi Jin, Tong Zhang, Tianqi Liu

ICLR 2025 DUET: Decentralized Bilevel Optimization Without Lower-Level Strong Convexity Zhen Qin, Zhuqing Liu, Songtao Lu, Yingbin Liang, Jia Liu

AAAI 2025 Deep Non-Rigid Structure-from-Motion Revisited: Canonicalization and Sequence Modeling Hui Deng, Jiawei Shi, Zhen Qin, Yiran Zhong, Yuchao Dai

NeurIPS 2025 Hybrid Latent Reasoning via Reinforcement Learning Zhenrui Yue, Bowen Jin, Huimin Zeng, Honglei Zhuang, Zhen Qin, Jinsung Yoon, Lanyu Shang, Jiawei Han, Dong Wang

ICLR 2025 Inference Scaling for Long-Context Retrieval Augmented Generation Zhenrui Yue, Honglei Zhuang, Aijun Bai, Kai Hui, Rolf Jagerman, Hansi Zeng, Zhen Qin, Dong Wang, Xuanhui Wang, Michael Bendersky

TMLR 2025 LASP: Linear Attention Sequence Parallelism Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

ICML 2025 LLM Alignment as Retriever Optimization: An Information Retrieval Perspective Bowen Jin, Jinsung Yoon, Zhen Qin, Ziqi Wang, Wei Xiong, Yu Meng, Jiawei Han, Sercan O Arik

ICML 2025 MVA: Linear Attention with High-Order Query-Keys Integration and Multi-Level Vocabulary Decomposition Wang Ning, Zekun Li, Tongxin Bai, Man Yao, Zhen Qin, Guoqi Li

ICLRW 2025 RMBoost: Reward Model Training with Preference-Conditional Multi-Aspect Synthetic Data Generation Jiaming Shen, Ran Xu, Yennie Jun, Zhen Qin, Tianqi Liu, Carl Yang, Yi Liang, Simon Baumgartner, Michael Bendersky

ICLR 2025 RRM: Robust Reward Model Training Mitigates Reward Hacking Tianqi Liu, Wei Xiong, Jie Ren, Lichang Chen, Junru Wu, Rishabh Joshi, Yang Gao, Jiaming Shen, Zhen Qin, Tianhe Yu, Daniel Sohn, Anastasia Makarova, Jeremiah Zhe Liu, Yuan Liu, Bilal Piot, Abe Ittycheriah, Aviral Kumar, Mohammad Saleh

NeurIPS 2025 Tensor Product Attention Is All You Need Yifan Zhang, Yifeng Liu, Huizhuo Yuan, Zhen Qin, Yang Yuan, Quanquan Gu, Andrew C Yao

ICLR 2024 CO2: Efficient Distributed Training with Full Communication-Computation Overlap Weigao Sun, Zhen Qin, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

AAAI 2024 Exploring Transformer Extrapolation Zhen Qin, Yiran Zhong, Hui Deng

ICML 2024 Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost Under 18 Kilobytes Zhen Qin, Daoyuan Chen, Bingchen Qian, Bolin Ding, Yaliang Li, Shuiguang Deng

JMLR 2024 Guaranteed Nonconvex Factorization Approach for Tensor Train Recovery Zhen Qin, Michael B. Wakin, Zhihui Zhu

NeurIPSW 2024 Linear Attention Sequence Parallelism Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong

AAAI 2024 Resisting Backdoor Attacks in Federated Learning via Bidirectional Elections and Individual Perspective Zhen Qin, Feiyi Chen, Chen Zhi, Xueqiang Yan, Shuiguang Deng

ICML 2024 Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong

ICCVW 2023 All-Pairs Consistency Learning for Weakly Supervised Semantic Segmentation Weixuan Sun, Yanhao Zhang, Zhen Qin, Zheyuan Liu, Lin Cheng, Fanyi Wang, Yiran Zhong, Nick Barnes

ICLR 2023 Encoding Recurrence into Transformers Feiqing Huang, Kexin Lu, Yuxi Cai, Zhen Qin, Yanwen Fang, Guangjian Tian, Guodong Li

CVPR 2023 Fine-Grained Audible Video Description Xuyang Shen, Dong Li, Jinxing Zhou, Zhen Qin, Bowen He, Xiaodong Han, Aixuan Li, Yuchao Dai, Lingpeng Kong, Meng Wang, Yu Qiao, Yiran Zhong

NeurIPS 2023 Hierarchically Gated Recurrent Neural Network for Sequence Modeling Zhen Qin, Songlin Yang, Yiran Zhong

NeurIPS 2023 Learning List-Level Domain-Invariant Representations for Ranking Ruicheng Xian, Honglei Zhuang, Zhen Qin, Hamed Zamani, Jing Lu, Ji Ma, Kai Hui, Han Zhao, Xuanhui Wang, Michael Bendersky

TMLR 2023 Linearized Relative Positional Encoding Zhen Qin, Weixuan Sun, Kaiyue Lu, Hui Deng, Dongxu Li, Xiaodong Han, Yuchao Dai, Lingpeng Kong, Yiran Zhong

NeurIPS 2023 RD-Suite: A Benchmark for Ranking Distillation Zhen Qin, Rolf Jagerman, Rama Kumar Pasumarthi, Honglei Zhuang, He Zhang, Aijun Bai, Kai Hui, Le Yan, Xuanhui Wang

ICLR 2023 Toeplitz Neural Network for Sequence Modeling Zhen Qin, Xiaodong Han, Weixuan Sun, Bowen He, Dong Li, Dongxu Li, Yuchao Dai, Lingpeng Kong, Yiran Zhong

AISTATS 2022 On the Value of Prior in Online Learning to Rank Branislav Kveton, Ofer Meshi, Masrour Zoghi, Zhen Qin

ICLR 2022 Charformer: Fast Character Transformers via Gradient-Based Subword Tokenization Yi Tay, Vinh Q. Tran, Sebastian Ruder, Jai Gupta, Hyung Won Chung, Dara Bahri, Zhen Qin, Simon Baumgartner, Cong Yu, Donald Metzler

NeurIPS 2022 Error Analysis of Tensor-Train Cross Approximation Zhen Qin, Alexander Lidiak, Zhexuan Gong, Gongguo Tang, Michael B Wakin, Zhihui Zhu

NeurIPS 2022 Transformer Memory as a Differentiable Search Index Yi Tay, Vinh Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Gupta, Tal Schuster, William W. Cohen, Donald Metzler

ICLR 2022 cosFormer: Rethinking SoftMax in Attention Zhen Qin, Weixuan Sun, Hui Deng, Dongxu Li, Yunshen Wei, Baohong Lv, Junjie Yan, Lingpeng Kong, Yiran Zhong

ICLR 2021 Are Neural Rankers Still Outperformed by Gradient Boosted Decision Trees? Zhen Qin, Le Yan, Honglei Zhuang, Yi Tay, Rama Kumar Pasumarthi, Xuanhui Wang, Michael Bendersky, Marc Najork

ICML 2021 OmniNet: Omnidirectional Representations from Transformers Yi Tay, Mostafa Dehghani, Vamsi Aribandi, Jai Gupta, Philip M Pham, Zhen Qin, Dara Bahri, Da-Cheng Juan, Donald Metzler

ICML 2020 Do RNN and LSTM Have Long Memory? Jingyu Zhao, Feiqing Huang, Jia Lv, Yanjie Duan, Zhen Qin, Guodong Li, Guangjian Tian

AAAI 2018 Hawkes Process Inference with Missing Data Christian R. Shelton, Zhen Qin, Chandini Shetty

UAI 2015 Auxiliary Gibbs Sampling for Inference in Piecewise-Constant Conditional Intensity Models Zhen Qin, Christian R. Shelton

CVPR 2014 An Online Learned Elementary Grouping Model for Multi-Target Tracking Xiaojing Chen, Zhen Qin, Le An, Bir Bhanu

CVPR 2012 Improving Multi-Target Tracking via Social Grouping Zhen Qin, Christian R. Shelton