Lee, Stefan

53 publications

ICCV 2025 Calibrating MLLM-as-a-Judge via Multimodal Bayesian Prompt Ensembles Eric Slyman, Mehrab Tanjim, Kushal Kafle, Stefan Lee

CVPR 2025 Do Visual Imaginations Improve Vision-and-Language Navigation Agents? Akhil Perincherry, Jacob Krantz, Stefan Lee

NeurIPS 2025 Graph Neural Network Based Action Ranking for Planning Rajesh Devaraddi Mangannavar, Stefan Lee, Alan Fern, Prasad Tadepalli

ICCV 2025 Harnessing Input-Adaptive Inference for Efficient VLN Dongwoo Kang, Akhil Perincherry, Zachary Coalson, Aiden Gabriel, Stefan Lee, Sanghyun Hong

WACV 2025 Hijacking Vision-and-Language Navigation Agents with Adversarial Environmental Attacks Zijiao Yang, Xiangxi Shi, Eric Slyman, Stefan Lee

CoRL 2025 Non-Conflicting Energy Minimization in Reinforcement Learning Based Robot Control Skand Peri, Akhil Perincherry, Bikram Pandit, Stefan Lee

WACV 2024 Benchmarking Out-of-Distribution Detection in Visual Question Answering Xiangxi Shi, Stefan Lee

CVPR 2024 FairDeDup: Detecting and Mitigating Vision-Language Fairness Disparities in Semantic Dataset Deduplication Eric Slyman, Stefan Lee, Scott Cohen, Kushal Kafle

CoRL 2024 Simple Masked Training Strategies Yield Control Policies That Are Robust to Sensor Failure Skand Skand, Bikram Pandit, Chanho Kim, Li Fuxin, Stefan Lee

CVPR 2024 Viewpoint-Aware Visual Grounding in 3D Scenes Xiangxi Shi, Zhonghua Wu, Stefan Lee

NeurIPSW 2024 You Never Know: Quantization Induces Inconsistent Biases in Vision-Language Foundation Models Eric Slyman, Anirudh Kanneganti, Sanghyun Hong, Stefan Lee

CVPR 2023 Behavioral Analysis of Vision-and-Language Navigation Agents Zijiao Yang, Arjun Majumdar, Stefan Lee

ICLR 2023 Emergence of Maps in the Memories of Blind Navigation Agents Erik Wijmans, Manolis Savva, Irfan Essa, Stefan Lee, Ari S. Morcos, Dhruv Batra

NeurIPSW 2023 Generating Data Augmentation Queries Using Large Language Models Christopher Buss, Jasmin Mousavi, Mikhail Tokarev, Arash Termehchy, David Maier, Stefan Lee

CVPR 2023 Iterative Vision-and-Language Navigation Jacob Krantz, Shurjo Banerjee, Wang Zhu, Jason Corso, Peter Anderson, Stefan Lee, Jesse Thomason

ICCV 2023 Navigating to Objects Specified by Images Jacob Krantz, Theophile Gervet, Karmesh Yadav, Austin Wang, Chris Paxton, Roozbeh Mottaghi, Dhruv Batra, Jitendra Malik, Stefan Lee, Devendra Singh Chaplot

ICCV 2023 VLSlice: Interactive Vision-and-Language Slice Discovery Eric Slyman, Minsuk Kahng, Stefan Lee

ECCV 2022 Sim-2-Sim Transfer for Vision-and-Language Navigation in Continuous Environments Jacob Krantz, Stefan Lee

WACV 2021 Auxiliary Tasks for Efficient Learning of Point-Goal Navigation Saurabh Satish Desai, Stefan Lee

ICLR 2021 DeepAveragers: Offline Reinforcement Learning by Solving Derived Non-Parametric MDPs Aayam Kumar Shrestha, Stefan Lee, Prasad Tadepalli, Alan Fern

NeurIPS 2021 SOAT: A Scene- and Object-Aware Transformer for Vision-and-Language Navigation Abhinav Moudgil, Arjun Majumdar, Harsh Agrawal, Stefan Lee, Dhruv Batra

AAAI 2021 Semantic MapNet: Building Allocentric Semantic Maps and Representations from Egocentric Views Vincent Cartillier, Zhile Ren, Neha Jain, Stefan Lee, Irfan Essa, Dhruv Batra

ICCV 2021 THDA: Treasure Hunt Data Augmentation for Semantic Navigation Oleksandr Maksymets, Vincent Cartillier, Aaron Gokaslan, Erik Wijmans, Wojciech Galuba, Stefan Lee, Dhruv Batra

ICCV 2021 Waypoint Models for Instruction-Guided Navigation in Continuous Environments Jacob Krantz, Aaron Gokaslan, Dhruv Batra, Stefan Lee, Oleksandr Maksymets

ECCV 2020 Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments Jacob Krantz, Erik Wijmans, Arjun Majumdar, Dhruv Batra, Stefan Lee

ICMLW 2020 Beyond the Nav-Graph: Vision-and-Language Navigation in Continuous Environments – Extended Abstract Jacob Krantz, Erik Wijmans, Arjun Majumdar, Dhruv Batra, Stefan Lee

ICLR 2020 DD-PPO: Learning Near-Perfect PointGoal Navigators from 2.5 Billion Frames Erik Wijmans, Abhishek Kadian, Ari Morcos, Stefan Lee, Irfan Essa, Devi Parikh, Manolis Savva, Dhruv Batra

NeurIPS 2020 Dialog Without Dialog Data: Learning Visual Dialog Agents from VQA Data Michael Cogswell, Jiasen Lu, Rishabh Jain, Stefan Lee, Devi Parikh, Dhruv Batra

ICLR 2020 Emergence of Compositional Language with Deep Generational Transmission Michael Cogswell, Jiasen Lu, Stefan Lee, Devi Parikh, Dhruv Batra

ICMLW 2020 Extended Abstract: Improving Vision-and-Language Navigation with Image-Text Pairs from the Web Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson, Devi Parikh, Dhruv Batra

ECCV 2020 Improving Vision-and-Language Navigation with Image-Text Pairs from the Web Arjun Majumdar, Ayush Shrivastava, Stefan Lee, Peter Anderson, Devi Parikh, Dhruv Batra

CoRL 2020 Integrating Egocentric Localization for More Realistic Point-Goal Navigation Agents Samyak Datta, Oleksandr Maksymets, Judy Hoffman, Stefan Lee, Dhruv Batra, Devi Parikh

NeurIPS 2020 Language-Conditioned Imitation Learning for Robot Manipulation Tasks Simon Stepputtis, Joseph P. Campbell, Mariano Phielipp, Stefan Lee, Chitta Baral, Heni Ben Amor

CoRL 2020 Sim-to-Real Transfer for Vision-and-Language Navigation Peter Anderson, Ayush Shrivastava, Joanne Truong, Arjun Majumdar, Devi Parikh, Dhruv Batra, Stefan Lee

NeurIPS 2019 Chasing Ghosts: Instruction Following as Bayesian State Tracking Peter Anderson, Ayush Shrivastava, Devi Parikh, Dhruv Batra, Stefan Lee

ICML 2019 Counterfactual Visual Explanations Yash Goyal, Ziyan Wu, Jan Ernst, Dhruv Batra, Devi Parikh, Stefan Lee

ICML 2019 Probabilistic Neural Symbolic Models for Interpretable Visual Question Answering Ramakrishna Vedantam, Karan Desai, Stefan Lee, Marcus Rohrbach, Dhruv Batra, Devi Parikh

ICML 2019 Trainable Decoding of Sets of Sequences for Neural Sequence Models Ashwin Kalyan, Peter Anderson, Stefan Lee, Dhruv Batra

NeurIPS 2019 ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks Jiasen Lu, Dhruv Batra, Devi Parikh, Stefan Lee

ECCV 2018 Choose Your Neuron: Incorporating Domain Knowledge Through Neuron-Importance Ramprasaath R. Selvaraju, Prithvijit Chattopadhyay, Mohamed Elhoseiny, Tilak Sharma, Dhruv Batra, Devi Parikh, Stefan Lee

AAAI 2018 Diverse Beam Search for Improved Description of Complex Scenes Ashwin K. Vijayakumar, Michael Cogswell, Ramprasaath R. Selvaraju, Qing Sun, Stefan Lee, David J. Crandall, Dhruv Batra

CVPRW 2018 Embodied Question Answering Abhishek Das, Samyak Datta, Georgia Gkioxari, Stefan Lee, Devi Parikh, Dhruv Batra

ECCV 2018 Graph R-CNN for Scene Graph Generation Jianwei Yang, Jiasen Lu, Stefan Lee, Dhruv Batra, Devi Parikh

ICML 2018 Learn from Your Neighbor: Learning Multi-Modal Mappings from Sparse Annotations Ashwin Kalyan, Stefan Lee, Anitha Kannan, Dhruv Batra

CoRL 2018 Neural Modular Control for Embodied Question Answering Abhishek Das, Georgia Gkioxari, Stefan Lee, Devi Parikh, Dhruv Batra

NeurIPS 2018 Overcoming Language Priors in Visual Question Answering with Adversarial Regularization Sainandan Ramakrishnan, Aishwarya Agrawal, Stefan Lee

CoRL 2018 Visual Curiosity: Learning to Ask Questions to Learn Visual Recognition Jianwei Yang, Jiasen Lu, Stefan Lee, Dhruv Batra, Devi Parikh

CVPR 2017 Bidirectional Beam Search: Forward-Backward Inference in Neural Sequence Models for Fill-in-the-Blank Image Captioning Qing Sun, Stefan Lee, Dhruv Batra

ICCV 2017 Learning Cooperative Visual Dialog Agents with Deep Reinforcement Learning Abhishek Das, Satwik Kottur, Jose M. F. Moura, Stefan Lee, Dhruv Batra

NeurIPS 2016 Stochastic Multiple Choice Learning for Training Diverse Deep Ensembles Stefan Lee, Senthil Purushwalkam Shiva Prakash, Michael Cogswell, Viresh Ranjan, David Crandall, Dhruv Batra

ICCV 2015 Lending a Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions Sven Bambach, Stefan Lee, David J. Crandall, Chen Yu

WACV 2015 Predicting Geo-Informative Attributes in Large-Scale Image Collections Using Convolutional Neural Networks Stefan Lee, Haipeng Zhang, David J. Crandall

CVPRW 2014 This Hand Is My Hand: A Probabilistic Approach to Hand Disambiguation in Egocentric Video Stefan Lee, Sven Bambach, David J. Crandall, John M. Franchak, Chen Yu