Liu, Tieyan

5 publications

ICML 2020 On Layer Normalization in the Transformer Architecture Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, Tieyan Liu

ICML 2020 Sequence Generation with Mixed Representations Lijun Wu, Shufang Xie, Yingce Xia, Yang Fan, Jian-Huang Lai, Tao Qin, Tieyan Liu

ICML 2019 Efficient Training of BERT by Progressively Stacking Linyuan Gong, Di He, Zhuohan Li, Tao Qin, Liwei Wang, Tieyan Liu

ICLR 2019 Representation Degeneration Problem in Training Natural Language Generation Models Jun Gao, Di He, Xu Tan, Tao Qin, Liwei Wang, Tieyan Liu

ICML 2018 Towards Binary-Valued Gates for Robust LSTM Training Zhuohan Li, Di He, Fei Tian, Wei Chen, Tao Qin, Liwei Wang, Tieyan Liu