Gotmare, Akhilesh

2 publications

NeurIPS 2021 Align Before Fuse: Vision and Language Representation Learning with Momentum Distillation Junnan Li, Ramprasaath Selvaraju, Akhilesh Gotmare, Shafiq Joty, Caiming Xiong, Steven Chu Hong Hoi

ICLR 2019 A Closer Look at Deep Learning Heuristics: Learning Rate Restarts, Warmup and Distillation Akhilesh Gotmare, Nitish Shirish Keskar, Caiming Xiong, Richard Socher