Roller, Stephen

6 publications

ICML 2023 Scaling Laws for Generative Mixed-Modal Language Models Armen Aghajanyan, Lili Yu, Alexis Conneau, Wei-Ning Hsu, Karen Hambardzumyan, Susan Zhang, Stephen Roller, Naman Goyal, Omer Levy, Luke Zettlemoyer

NeurIPS 2022 Staircase Attention for Recurrent Processing of Sequences Da Ju, Stephen Roller, Sainbayar Sukhbaatar, Jason E Weston

NeurIPS 2021 Hash Layers for Large Sparse Models Stephen Roller, Sainbayar Sukhbaatar, Arthur Szlam, Jason Weston

ICML 2021 Not All Memories Are Created Equal: Learning to Forget by Expiring Sainbayar Sukhbaatar, Da Ju, Spencer Poff, Stephen Roller, Arthur Szlam, Jason Weston, Angela Fan

ICLR 2020 Neural Text Generation with Unlikelihood Training Sean Welleck, Ilia Kulikov, Stephen Roller, Emily Dinan, Kyunghyun Cho, Jason Weston

ICLR 2019 Wizard of Wikipedia: Knowledge-Powered Conversational Agents Emily Dinan, Stephen Roller, Kurt Shuster, Angela Fan, Michael Auli, Jason Weston