Lin, Zhenghao

3 publications

ICLR 2026 Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data Haoran Deng, Yingyu Lin, Zhenghao Lin, Xiao Liu, Yizhou Sun, Yian Ma, Yeyun Gong

NeurIPS 2024 Not All Tokens Are What You Need for Pretraining Zhenghao Lin, Zhibin Gou, Yeyun Gong, Xiao Liu, Yelong Shen, Ruochen Xu, Chen Lin, Yujiu Yang, Jian Jiao, Nan Duan, Weizhu Chen

ICML 2023 Text Generation with Diffusion Language Models: A Pre-Training Approach with Continuous Paragraph Denoise Zhenghao Lin, Yeyun Gong, Yelong Shen, Tong Wu, Zhihao Fan, Chen Lin, Nan Duan, Weizhu Chen