Bao, Hangbo

7 publications

TMLR 2023 A Unified View of Masked Image Modeling Zhiliang Peng, Li Dong, Hangbo Bao, Furu Wei, Qixiang Ye

ICLR 2023 Corrupted Image Modeling for Self-Supervised Visual Pre-Training Yuxin Fang, Li Dong, Hangbo Bao, Xinggang Wang, Furu Wei

CVPR 2023 Image as a Foreign Language: BEiT Pretraining for Vision and Vision-Language Tasks Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei

ICLR 2022 BEiT: BERT Pre-Training of Image Transformers Hangbo Bao, Li Dong, Songhao Piao, Furu Wei

NeurIPS 2022 VLMo: Unified Vision-Language Pre-Training with Mixture-of-Modality-Experts Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Subhojit Som, Songhao Piao, Furu Wei

NeurIPS 2020 MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers Wenhui Wang, Furu Wei, Li Dong, Hangbo Bao, Nan Yang, Ming Zhou

ICML 2020 UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training Hangbo Bao, Li Dong, Furu Wei, Wenhui Wang, Nan Yang, Xiaodong Liu, Yu Wang, Jianfeng Gao, Songhao Piao, Ming Zhou, Hsiao-Wuen Hon