Singh, Amanpreet

21 publications

ICLR 2026 AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite Jonathan Bragg, Mike D'Arcy, Nishant Balepur, Dan Bareket, Bhavana Dalvi Mishra, Sergey Feldman, Dany Haddad, Jena D. Hwang, Peter Jansen, Varsha Kishore, Bodhisattwa Prasad Majumder, Aakanksha Naik, Sigal Rahamimov, Kyle Richardson, Amanpreet Singh, Harshit Surana, Aryeh Tiktinsky, Rosni Vasu, Guy Wiener, Chloe Anastasiades, Stefanus Candra, Jason Dunkelberger, Daniel Emery, Rob Evans, Malachi Hamada, Regan Huff, Rodney Kinney, Matt Latzke, Jaron Lochner, Ruben Lozano-Aguilera, Ngoc-Uyen Nguyen, Smita Rao, Amber Tanaka, Brooke Vlahos, Peter Clark, Doug Downey, Yoav Goldberg, Ashish Sabharwal, Daniel S Weld

ICLR 2025 Generative Representational Instruction Tuning Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela

ICLR 2025 OLMoE: Open Mixture-of-Experts Language Models Niklas Muennighoff, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Jacob Morrison, Sewon Min, Weijia Shi, Evan Pete Walsh, Oyvind Tafjord, Nathan Lambert, Yuling Gu, Shane Arora, Akshita Bhagia, Dustin Schwenk, David Wadden, Alexander Wettig, Binyuan Hui, Tim Dettmers, Douwe Kiela, Ali Farhadi, Noah A. Smith, Pang Wei Koh, Amanpreet Singh, Hannaneh Hajishirzi

NeurIPSW 2024 Anchored Optimization and Contrastive Revisions: Addressing Reward Hacking in Alignment Karel D'Oosterlinck, Winnie Xu, Chris Develder, Thomas Demeester, Amanpreet Singh, Christopher Potts, Douwe Kiela, Shikib Mehri

ICLRW 2024 Generative Representational Instruction Tuning Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela

NeurIPS 2023 OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents Hugo Laurençon, Lucile Saulnier, Leo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander Rush, Douwe Kiela, Matthieu Cord, Victor Sanh

CVPR 2022 FLAVA: A Foundational Language and Vision Alignment Model Amanpreet Singh, Ronghang Hu, Vedanuj Goswami, Guillaume Couairon, Wojciech Galuba, Marcus Rohrbach, Douwe Kiela

CVPR 2022 Unsupervised Vision-and-Language Pre-Training via Retrieval-Based Multi-Granular Alignment Mingyang Zhou, Licheng Yu, Amanpreet Singh, Mengjiao Wang, Zhou Yu, Ning Zhang

CVPR 2022 Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross

NeurIPS 2021 Human-Adversarial Visual Question Answering Sasha Sheng, Amanpreet Singh, Vedanuj Goswami, Jose Magana, Tristan Thrush, Wojciech Galuba, Devi Parikh, Douwe Kiela

CVPR 2021 TextOCR: Towards Large-Scale End-to-End Reasoning for Arbitrary-Shaped Scene Text Amanpreet Singh, Guan Pang, Mandy Toh, Jing Huang, Wojciech Galuba, Tal Hassner

ICCV 2021 UniT: Multimodal Multitask Learning with a Unified Transformer Ronghang Hu, Amanpreet Singh

CVPR 2020 Iterative Answer Prediction with Pointer-Augmented Multimodal Transformers for TextVQA Ronghang Hu, Amanpreet Singh, Trevor Darrell, Marcus Rohrbach

ECCV 2020 Seeing the Un-Scene: Learning Amodal Semantic Maps for Room Navigation Medhini Narasimhan, Erik Wijmans, Xinlei Chen, Trevor Darrell, Dhruv Batra, Devi Parikh, Amanpreet Singh

ECCV 2020 TextCaps: A Dataset for Image Captioning with Reading Comprehension Oleksii Sidorov, Ronghang Hu, Marcus Rohrbach, Amanpreet Singh

NeurIPS 2020 The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes Douwe Kiela, Hamed Firooz, Aravind Mohan, Vedanuj Goswami, Amanpreet Singh, Pratik Ringshia, Davide Testuggine

ICLR 2019 GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding Alex Wang, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel R. Bowman

ICLR 2019 Learning When to Communicate at Scale in Multiagent Cooperative and Competitive Tasks Amanpreet Singh, Tushar Jain, Sainbayar Sukhbaatar

ICLR 2019 Modeling the Long Term Future in Model-Based Reinforcement Learning Nan Rosemary Ke, Amanpreet Singh, Ahmed Touati, Anirudh Goyal, Yoshua Bengio, Devi Parikh, Dhruv Batra

NeurIPS 2019 SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems Alex Wang, Yada Pruksachatkun, Nikita Nangia, Amanpreet Singh, Julian Michael, Felix Hill, Omer Levy, Samuel Bowman

CVPR 2019 Towards VQA Models That Can Read Amanpreet Singh, Vivek Natarajan, Meet Shah, Yu Jiang, Xinlei Chen, Dhruv Batra, Devi Parikh, Marcus Rohrbach