Agrawal, Pulkit

86 publications

ICLRW 2025 Bridging the Sim-to-Real Gap for Athletic Loco-Manipulation Nolan Fey, Gabriel B. Margolis, Martin Peticco, Pulkit Agrawal

ICLRW 2025 Collective Model Intelligence Requires Compatible Specialization Jyothish Pari, Samy Jelassi, Pulkit Agrawal

ICLR 2025 Diffusion Policy Policy Optimization Allen Z. Ren, Justin Lidard, Lars Lien Ankile, Anthony Simeonov, Pulkit Agrawal, Anirudha Majumdar, Benjamin Burchfiel, Hongkai Dai, Max Simchowitz

ICLR 2025 Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learning Moritz Reuss, Jyothish Pari, Pulkit Agrawal, Rudolf Lioutikov

ICLRW 2025 Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learning Moritz Reuss, Jyothish Pari, Pulkit Agrawal, Rudolf Lioutikov

ICML 2025 Emergence and Effectiveness of Task Vectors in In-Context Learning: An Encoder Decoder Perspective Seungwook Han, Jinyeop Song, Jeff Gore, Pulkit Agrawal

ICLR 2025 ORSO: Accelerating Reward Design via Online Reward Selection and Policy Optimization Chen Bo Calvin Zhang, Zhang-Wei Hong, Aldo Pacchiano, Pulkit Agrawal

ICML 2025 Position: General Intelligence Requires Reward-Based Pretraining Seungwook Han, Jyothish Pari, Samuel J. Gershman, Pulkit Agrawal

NeurIPS 2025 Self-Adapting Language Models Adam Zweiger, Jyothish Pari, Han Guo, Yoon Kim, Pulkit Agrawal

CoRL 2024 Action Space Design in Reinforcement Learning for Robot Motor Skills Julian Eßer, Gabriel B. Margolis, Oliver Urbann, Sören Kerner, Pulkit Agrawal

NeurIPSW 2024 Curiosity-Driven Red Teaming for Large Language Models Zhang-Wei Hong, Idan Shenfeld, Tsun-Hsuan Wang, Yung-Sung Chuang, Aldo Pareja, James R. Glass, Akash Srivastava, Pulkit Agrawal

ICLR 2024 Curiosity-Driven Red-Teaming for Large Language Models Zhang-Wei Hong, Idan Shenfeld, Tsun-Hsuan Wang, Yung-Sung Chuang, Aldo Pareja, James R. Glass, Akash Srivastava, Pulkit Agrawal

NeurIPS 2024 Few-Shot Task Learning Through Inverse Generative Modeling Aviv Netanyahu, Yilun Du, Antonia Bronars, Jyothish Pari, Joshua Tenenbaum, Tianmin Shu, Pulkit Agrawal

NeurIPS 2024 Going Beyond Heuristics by Imposing Policy Improvement as a Constraint Chi-Chang Lee, Zhang-Wei Hong, Pulkit Agrawal

TMLR 2024 Grid Cell-Inspired Fragmentation and Recall for Efficient mAP Building Jaedong Hwang, Zhang-Wei Hong, Eric R Chen, Akhilan Boopathy, Pulkit Agrawal, Ila R Fiete

NeurIPSW 2024 Grid Cell-Inspired Fragmentation and Recall for Efficient mAP Building Jaedong Hwang, Zhang-Wei Hong, Eric R Chen, Akhilan Boopathy, Pulkit Agrawal, Ila R Fiete

NeurIPSW 2024 ImageNet-RIB Benchmark: Large Pre-Training Datasets Don't Guarantee Robustness After Fine-Tuning Jaedong Hwang, Brian Cheung, Zhang-Wei Hong, Akhilan Boopathy, Pulkit Agrawal, Ila R Fiete

NeurIPSW 2024 Known Unknowns: Out-of-Distribution Property Prediction in Materials and Molecules Nofit Segal, Aviv Netanyahu, Kevin P. Greenman, Pulkit Agrawal, Rafael Gomez-Bombarelli

NeurIPS 2024 Learning Multimodal Behaviors from Scratch with Diffusion Policy Gradient Zechu Li, Rickmer Krohn, Tao Chen, Anurag Ajay, Pulkit Agrawal, Georgia Chalvatzaki

ICMLW 2024 ORSO: Accelerating Reward Design via Online Reward Selection and Policy Optimization Chen Bo Calvin Zhang, Zhang-Wei Hong, Aldo Pacchiano, Pulkit Agrawal

CVPR 2024 OpenEQA: Embodied Question Answering in the Era of Foundation Models Arjun Majumdar, Anurag Ajay, Xiaohan Zhang, Pranav Putta, Sriram Yenamandra, Mikael Henaff, Sneha Silwal, Paul Mcvay, Oleksandr Maksymets, Sergio Arnaud, Karmesh Yadav, Qiyang Li, Ben Newman, Mohit Sharma, Vincent Berges, Shiqi Zhang, Pulkit Agrawal, Yonatan Bisk, Dhruv Batra, Mrinal Kalakrishnan, Franziska Meier, Chris Paxton, Alexander Sax, Aravind Rajeswaran

ICML 2024 Position: Automatic Environment Shaping Is the Next Frontier in RL Younghyo Park, Gabriel B. Margolis, Pulkit Agrawal

ICML 2024 Random Latent Exploration for Deep Reinforcement Learning Srinath V. Mahankali, Zhang-Wei Hong, Ayush Sekhari, Alexander Rakhlin, Pulkit Agrawal

NeurIPSW 2024 Red Teaming Language-Conditioned Robot Models via Vision Language Models Sathwik Karnik, Zhang-Wei Hong, Nishant Abhangi, Yen-Chen Lin, Tsun-Hsuan Wang, Pulkit Agrawal

ICLRW 2024 Value Augmented Sampling: Predict Your Rewards to Align Language Models Seungwook Han, Idan Shenfeld, Akash Srivastava, Yoon Kim, Pulkit Agrawal

CoRL 2023 Autonomous Robotic Reinforcement Learning with Asynchronous Human Feedback Max Balsells, Marcel Torne Villasevil, Zihan Wang, Samedh Desai, Pulkit Agrawal, Abhishek Gupta

NeurIPS 2023 Beyond Uniform Sampling: Offline Reinforcement Learning with Imbalanced Datasets Zhang-Wei Hong, Aviral Kumar, Sathwik Karnik, Abhishek Bhandwaldar, Akash Srivastava, Joni K. Pajarinen, Romain Laroche, Abhishek Gupta, Pulkit Agrawal

NeurIPS 2023 Breadcrumbs to the Goal: Goal-Conditioned Exploration from Human-in-the-Loop Feedback Marcel Torne Villasevil, Max Balsells I Pamies, Zihan Wang, Samedh Desai, Tao Chen, Pulkit Agrawal, Abhishek Gupta

NeurIPS 2023 Compositional Foundation Models for Hierarchical Planning Anurag Ajay, Seungwook Han, Yilun Du, Shuang Li, Abhi Gupta, Tommi Jaakkola, Josh Tenenbaum, Leslie P. Kaelbling, Akash Srivastava, Pulkit Agrawal

NeurIPSW 2023 Compositional Foundation Models for Hierarchical Planning Anurag Ajay, Seungwook Han, Yilun Du, Shuang Li, Abhi Gupta, Tommi Jaakkola, Joshua Tenenbaum, Leslie Kaelbling, Akash Srivastava, Pulkit Agrawal

ICML 2023 Diagnosis, Feedback, Adaptation: A Human-in-the-Loop Framework for Test-Time Policy Adaptation Andi Peng, Aviv Netanyahu, Mark K Ho, Tianmin Shu, Andreea Bobu, Julie Shah, Pulkit Agrawal

ICLR 2023 Harnessing Mixed Offline Reinforcement Learning Datasets via Trajectory Weighting Zhang-Wei Hong, Pulkit Agrawal, Remi Tachet des Combes, Romain Laroche

NeurIPS 2023 Human-Guided Complexity-Controlled Abstractions Andi Peng, Mycal Tucker, Eoin Kenny, Noga Zaslavsky, Pulkit Agrawal, Julie A Shah

ICLR 2023 Is Conditional Generative Modeling All You Need for Decision Making? Anurag Ajay, Yilun Du, Abhi Gupta, Joshua B. Tenenbaum, Tommi S. Jaakkola, Pulkit Agrawal

ICLR 2023 Learning to Extrapolate: A Transductive Approach Aviv Netanyahu, Abhishek Gupta, Max Simchowitz, Kaiqing Zhang, Pulkit Agrawal

CoRL 2023 Learning to See Physical Properties with Active Sensing Motor Policies Gabriel B. Margolis, Xiang Fu, Yandong Ji, Pulkit Agrawal

NeurIPSW 2023 Neuro-Inspired Fragmentation and Recall to Overcome Catastrophic Forgetting in Curiosity Jaedong Hwang, Zhang-Wei Hong, Eric Chen, Akhilan Boopathy, Pulkit Agrawal, Ila Fiete

ICML 2023 Parallel $q$-Learning: Scaling Off-Policy Reinforcement Learning Under Massively Parallel Simulation Zechu Li, Tao Chen, Zhang-Wei Hong, Anurag Ajay, Pulkit Agrawal

NeurIPS 2023 Self-Supervised Reinforcement Learning That Transfers Using Random Features Boyuan Chen, Chuning Zhu, Pulkit Agrawal, Kaiqing Zhang, Abhishek Gupta

CoRL 2023 Shelving, Stacking, Hanging: Relational Pose Diffusion for Multi-Modal Rearrangement Anthony Simeonov, Ankit Goyal, Lucas Manuelli, Yen-Chen Lin, Alina Sarmiento, Alberto Rodriguez Garcia, Pulkit Agrawal, Dieter Fox

ICML 2023 Statistical Learning Under Heterogeneous Distribution Shift Max Simchowitz, Anurag Ajay, Pulkit Agrawal, Akshay Krishnamurthy

ICML 2023 Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networks Minyoung Huh, Brian Cheung, Pulkit Agrawal, Phillip Isola

ICML 2023 TGRL: An Algorithm for Teacher Guided Reinforcement Learning Idan Shenfeld, Zhang-Wei Hong, Aviv Tamar, Pulkit Agrawal

ICLRW 2023 TGRL: Teacher Guided Reinforcement Learning Algorithm for POMDPs Idan Shenfeld, Zhang-Wei Hong, Aviv Tamar, Pulkit Agrawal

TMLR 2023 The Low-Rank Simplicity Bias in Deep Networks Minyoung Huh, Hossein Mobahi, Richard Zhang, Brian Cheung, Pulkit Agrawal, Phillip Isola

ICMLW 2023 Visual Dexterity: In-Hand Dexterous Manipulation from Depth Tao Chen, Megha Tippur, Siyang Wu, Vikash Kumar, Edward Adelson, Pulkit Agrawal

NeurIPSW 2022 Aligning Robot Representations with Humans Andreea Bobu, Andi Peng, Pulkit Agrawal, Julie Shah, Anca Dragan

ICLR 2022 Bi-Linear Value Networks for Multi-Goal Reinforcement Learning Zhang-Wei Hong, Ge Yang, Pulkit Agrawal

ICML 2022 Discovering Generalizable Spatial Goal Representations via Graph-Based Active Reward Learning Aviv Netanyahu, Tianmin Shu, Joshua Tenenbaum, Pulkit Agrawal

ICLRW 2022 Discovering Generalizable Spatial Goal Representations via Graph-Based Active Reward Learning Aviv Netanyahu, Tianmin Shu, Joshua B. Tenenbaum, Pulkit Agrawal

NeurIPS 2022 Distributionally Adaptive Meta Reinforcement Learning Anurag Ajay, Abhishek Gupta, Dibya Ghosh, Sergey Levine, Pulkit Agrawal

ICMLW 2022 Distributionally Adaptive Meta Reinforcement Learning Anurag Ajay, Dibya Ghosh, Sergey Levine, Pulkit Agrawal, Abhishek Gupta

CoRL 2022 Efficient Tactile Simulation with Differentiability for Robotic Manipulation Jie Xu, Sangwoon Kim, Tao Chen, Alberto Rodriguez Garcia, Pulkit Agrawal, Wojciech Matusik, Shinjiro Sueda

ICLR 2022 Equivariant Self-Supervised Learning: Encouraging Equivariance in Representations Rumen Dangovski, Li Jing, Charlotte Loh, Seungwook Han, Akash Srivastava, Brian Cheung, Pulkit Agrawal, Marin Soljacic

NeurIPSW 2022 Is Conditional Generative Modeling All You Need for Decision-Making? Anurag Ajay, Yilun Du, Abhi Gupta, Joshua B. Tenenbaum, Tommi S. Jaakkola, Pulkit Agrawal

NeurIPSW 2022 Learning to Extrapolate: A Transductive Approach Aviv Netanyahu, Abhishek Gupta, Max Simchowitz, Kaiqing Zhang, Pulkit Agrawal

ICML 2022 Offline RL Policies Should Be Trained to Be Adaptive Dibya Ghosh, Anurag Ajay, Pulkit Agrawal, Sergey Levine

ICLR 2022 Overcoming the Spectral Bias of Neural Value Approximation Ge Yang, Anurag Ajay, Pulkit Agrawal

NeurIPS 2022 Redeeming Intrinsic Rewards via Constrained Optimization Eric Chen, Zhang-Wei Hong, Joni K. Pajarinen, Pulkit Agrawal

CoRL 2022 SE(3)-Equivariant Relational Rearrangement with Neural Descriptor Fields Anthony Simeonov, Yilun Du, Yen-Chen Lin, Alberto Rodriguez Garcia, Leslie Pack Kaelbling, Tomás Lozano-Pérez, Pulkit Agrawal

ICLR 2022 Topological Experience Replay Zhang-Wei Hong, Tao Chen, Yen-Chen Lin, Joni Pajarinen, Pulkit Agrawal

NeurIPSW 2022 Visual Pre-Training for Navigation: What Can We Learn from Noise? Yanwei Wang, Ching-Yun Ko, Pulkit Agrawal

CoRL 2022 Walk These Ways: Tuning Robot Control for Generalization with Multiplicity of Behavior Gabriel B. Margolis, Pulkit Agrawal

CoRL 2021 3D Neural Scene Representations for Visuomotor Control Yunzhu Li, Shuang Li, Vincent Sitzmann, Pulkit Agrawal, Antonio Torralba

CoRL 2021 A System for General In-Hand Object Re-Orientation Tao Chen, Jie Xu, Pulkit Agrawal

ICML 2021 Learning Task Informed Abstractions Xiang Fu, Ge Yang, Pulkit Agrawal, Tommi Jaakkola

CoRL 2021 Learning to Jump from Pixels Gabriel B Margolis, Tao Chen, Kartik Paigwar, Xiang Fu, Donghyun Kim, Sang bae Kim, Pulkit Agrawal

ICLR 2021 OPAL: Offline Primitive Discovery for Accelerating Offline Reinforcement Learning Anurag Ajay, Aviral Kumar, Pulkit Agrawal, Sergey Levine, Ofir Nachum

CoRL 2021 The Task Specification Problem Pulkit Agrawal

CoRL 2020 A Long Horizon Planning Framework for Manipulating Rigid Pointcloud Objects Anthony Simeonov, Yilun Du, Beomjoon Kim, Francois Hogan, Joshua Tenenbaum, Pulkit Agrawal, Alberto Rodriguez

ICML 2020 AdaScale SGD: A User-Friendly Algorithm for Distributed Training Tyler Johnson, Pulkit Agrawal, Haijie Gu, Carlos Guestrin

NeurIPS 2019 Superposition of Many Models into One Brian Cheung, Alexander Terekhov, Yubei Chen, Pulkit Agrawal, Bruno Olshausen

ICML 2018 Investigating Human Priors for Playing Video Games Rachit Dubey, Pulkit Agrawal, Deepak Pathak, Tom Griffiths, Alexei Efros

CVPRW 2018 Learning Instance Segmentation by Interaction Deepak Pathak, Yide Shentu, Dian Chen, Pulkit Agrawal, Trevor Darrell, Sergey Levine, Jitendra Malik

ICLR 2018 Zero-Shot Visual Imitation Deepak Pathak, Parsa Mahmoudieh, Guanghao Luo, Pulkit Agrawal, Dian Chen, Yide Shentu, Evan Shelhamer, Jitendra Malik, Alexei A. Efros, Trevor Darrell

CVPRW 2018 Zero-Shot Visual Imitation Deepak Pathak, Parsa Mahmoudieh, Guanghao Luo, Pulkit Agrawal, Dian Chen, Yide Shentu, Evan Shelhamer, Jitendra Malik, Alexei A. Efros, Trevor Darrell

ICML 2017 Curiosity-Driven Exploration by Self-Supervised Prediction Deepak Pathak, Pulkit Agrawal, Alexei A. Efros, Trevor Darrell

CVPRW 2017 Curiosity-Driven Exploration by Self-Supervised Prediction Deepak Pathak, Pulkit Agrawal, Alexei A. Efros, Trevor Darrell

ICLR 2017 Learning to Perform Physics Experiments via Deep Reinforcement Learning Misha Denil, Pulkit Agrawal, Tejas D. Kulkarni, Tom Erez, Peter W. Battaglia, Nando de Freitas

ICCV 2017 What Will Happen Next? Forecasting Player Moves in Sports Videos Panna Felsen, Pulkit Agrawal, Jitendra Malik

ECCV 2016 Generic 3D Representation via Pose Estimation and Matching Amir R. Zamir, Tilman Wekel, Pulkit Agrawal, Colin Wei, Jitendra Malik, Silvio Savarese

CVPR 2016 Human Pose Estimation with Iterative Error Feedback Joao Carreira, Pulkit Agrawal, Katerina Fragkiadaki, Jitendra Malik

ICLR 2016 Learning Visual Predictive Models of Physics for Playing Billiards Katerina Fragkiadaki, Pulkit Agrawal, Sergey Levine, Jitendra Malik

NeurIPS 2016 Learning to Poke by Poking: Experiential Learning of Intuitive Physics Pulkit Agrawal, Ashvin V Nair, Pieter Abbeel, Jitendra Malik, Sergey Levine

ICCV 2015 Learning to See by Moving Pulkit Agrawal, Joao Carreira, Jitendra Malik

ECCV 2014 Analyzing the Performance of Multilayer Neural Networks for Object Recognition Pulkit Agrawal, Ross B. Girshick, Jitendra Malik