Pinto, Lerrel

53 publications

ICLR 2025 BALROG: Benchmarking Agentic LLM and VLM Reasoning on Games Davide Paglieri, Bartłomiej Cupiał, Samuel Coward, Ulyana Piterbarg, Maciej Wolczyk, Akbir Khan, Eduardo Pignatelli, Łukasz Kuciński, Lerrel Pinto, Rob Fergus, Jakob Nicolaus Foerster, Jack Parker-Holder, Tim Rocktäschel

ICLRW 2025 D3: A Large Dataset for Training Code Language Models to Act Diff-by-Diff Ulyana Piterbarg, Kanishk Gandhi, Lerrel Pinto, Noah Goodman, Rob Fergus

ICML 2025 DINO-WM: World Models on Pre-Trained Visual Features Enable Zero-Shot Planning Gaoyue Zhou, Hengkai Pan, Yann Lecun, Lerrel Pinto

CoRL 2025 Point Policy: Unifying Observations and Actions with Key Points for Robot Manipulation Siddhant Haldar, Lerrel Pinto

ICLR 2025 Training Language Models on Synthetic Edit Sequences Improves Code Synthesis Ulyana Piterbarg, Lerrel Pinto, Rob Fergus

ICML 2024 Adaptive Sampling of K-Space in Magnetic Resonance for Rapid Pathology Prediction Chen-Yu Yen, Raghav Singhal, Umang Sharma, Rajesh Ranganath, Sumit Chopra, Lerrel Pinto

NeurIPSW 2024 AnySkin: Plug-and-Play Skin Sensing for Robotic Touch Raunaq Bhirangi, Venkatesh Pattabiraman, Mehmet Enes Erciyes, Yifeng Cao, Tess Hellebrekers, Lerrel Pinto

NeurIPS 2024 BAKU: An Efficient Transformer for Multi-Task Policy Learning Siddhant Haldar, Zhuoran Peng, Lerrel Pinto

ICML 2024 Behavior Generation with Latent Actions Seungjae Lee, Yibin Wang, Haritheja Etukuru, H. Jin Kim, Nur Muhammad Mahi Shafiullah, Lerrel Pinto

ICMLW 2024 Behavior Generation with Latent Actions Seungjae Lee, Yibin Wang, Haritheja Etukuru, H. Jin Kim, Nur Muhammad Mahi Shafiullah, Lerrel Pinto

ICML 2024 Diff History for Neural Language Agents Ulyana Piterbarg, Lerrel Pinto, Rob Fergus

NeurIPS 2024 DynaMo: In-Domain Dynamics Pretraining for Visuo-Motor Control Zichen Jeff Cui, Hengkai Pan, Aadhithya Iyer, Siddhant Haldar, Lerrel Pinto

ICML 2024 Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling Raunaq Bhirangi, Chenyu Wang, Venkatesh Pattabiraman, Carmel Majidi, Abhinav Gupta, Tess Hellebrekers, Lerrel Pinto

ICMLW 2024 Hierarchical State Space Models for Continuous Sequence-to-Sequence Modeling Raunaq Bhirangi, Chenyu Wang, Venkatesh Pattabiraman, Carmel Majidi, Abhinav Gupta, Tess Hellebrekers, Lerrel Pinto

NeurIPSW 2024 Learning Precise, Contact-Rich Manipulation Through Uncalibrated Tactile Skins Venkatesh Pattabiraman, Yifeng Cao, Siddhant Haldar, Lerrel Pinto, Raunaq Bhirangi

CoRL 2024 OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulation Aadhithya Iyer, Zhuoran Peng, Yinlong Dai, Irmak Guzey, Siddhant Haldar, Soumith Chintala, Lerrel Pinto

CoRL 2023 Dexterity from Touch: Self-Supervised Pre-Training of Tactile Representations with Robotic Play Irmak Guzey, Ben Evans, Soumith Chintala, Lerrel Pinto

ICLR 2023 From Play to Policy: Conditional Behavior Generation from Uncurated Robot Data Zichen Jeff Cui, Yibin Wang, Nur Muhammad Mahi Shafiullah, Lerrel Pinto

AAAI 2023 Improving Long-Horizon Imitation Through Instruction Prediction Joey Hejna, Pieter Abbeel, Lerrel Pinto

ICLR 2023 Learning Simultaneous Navigation and Construction in Grid Worlds Wenyu Han, Haoran Wu, Eisuke Hirota, Alexander Gao, Lerrel Pinto, Ludovic Righetti, Chen Feng

NeurIPS 2023 NetHack Is Hard to Hack Ulyana Piterbarg, Lerrel Pinto, Rob Fergus

CoRL 2023 That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulation Abitha Thankaraj, Lerrel Pinto

NeurIPS 2022 Behavior Transformers: Cloning $k$ Modes with One Stone Nur Muhammad Shafiullah, Zichen Cui, Ariuntuya Altanzaya, Lerrel Pinto

ICLRW 2022 Don't Change the Algorithm, Change the Data: Exploratory Data for Offline Reinforcement Learning Denis Yarats, David Brandfonbrener, Hao Liu, Michael Laskin, Pieter Abbeel, Alessandro Lazaric, Lerrel Pinto

ICLR 2022 Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learning Denis Yarats, Rob Fergus, Alessandro Lazaric, Lerrel Pinto

ICLR 2022 One After Another: Learning Incremental Skills for a Changing World Nur Muhammad Mahi Shafiullah, Lerrel Pinto

NeurIPSW 2022 Train Offline, Test Online: A Real Robot Learning Benchmark Gaoyue Zhou, Victoria Dean, Mohan Kumar Srirama, Aravind Rajeswaran, Jyothish Pari, Kyle Beltran Hatch, Aryan Jain, Tianhe Yu, Pieter Abbeel, Lerrel Pinto, Chelsea Finn, Abhinav Gupta

NeurIPSW 2022 Train Offline, Test Online: A Real Robot Learning Benchmark Gaoyue Zhou, Victoria Dean, Mohan Kumar Srirama, Aravind Rajeswaran, Jyothish Pari, Kyle Beltran Hatch, Aryan Jain, Tianhe Yu, Pieter Abbeel, Lerrel Pinto, Chelsea Finn, Abhinav Gupta

NeurIPSW 2022 Train Offline, Test Online: A Real Robot Learning Benchmark Gaoyue Zhou, Victoria Dean, Mohan Kumar Srirama, Aravind Rajeswaran, Jyothish Pari, Kyle Beltran Hatch, Aryan Jain, Tianhe Yu, Pieter Abbeel, Lerrel Pinto, Chelsea Finn, Abhinav Gupta

NeurIPSW 2022 Train Offline, Test Online: A Real Robot Learning Benchmark Gaoyue Zhou, Victoria Dean, Mohan Kumar Srirama, Aravind Rajeswaran, Jyothish Pari, Kyle Beltran Hatch, Aryan Jain, Tianhe Yu, Pieter Abbeel, Lerrel Pinto, Chelsea Finn, Abhinav Gupta

CoRL 2022 Watch and Match: Supercharging Imitation with Regularized Optimal Transport Siddhant Haldar, Vaibhav Mathur, Denis Yarats, Lerrel Pinto

NeurIPSW 2021 A Framework for Efficient Robotic Manipulation Albert Zhan, Ruihan Zhao, Lerrel Pinto, Pieter Abbeel, Michael Laskin

ICLR 2021 Learning Cross-Domain Correspondence for Control with Dynamics Cycle-Consistency Qiang Zhang, Tete Xiao, Alexei A Efros, Lerrel Pinto, Xiaolong Wang

NeurIPSW 2021 Mastering Visual Continuous Control: Improved Data-Augmented Reinforcement Learning Denis Yarats, Rob Fergus, Alessandro Lazaric, Lerrel Pinto

ICML 2021 Reinforcement Learning with Prototypical Representations Denis Yarats, Rob Fergus, Alessandro Lazaric, Lerrel Pinto

ICLRW 2021 Reinforcement Learning with Prototypical Representations Denis Yarats, Rob Fergus, Alessandro Lazaric, Lerrel Pinto

ICLR 2021 Self-Supervised Policy Adaptation During Deployment Nicklas Hansen, Rishabh Jangir, Yu Sun, Guillem Alenyà, Pieter Abbeel, Alexei A Efros, Lerrel Pinto, Xiaolong Wang

ICLR 2021 Task-Agnostic Morphology Evolution Donald Joseph Hejna Iii, Pieter Abbeel, Lerrel Pinto

NeurIPSW 2021 URLB: Unsupervised Reinforcement Learning Benchmark Michael Laskin, Denis Yarats, Hao Liu, Kimin Lee, Albert Zhan, Kevin Lu, Catherine Cang, Lerrel Pinto, Pieter Abbeel

NeurIPS 2020 Automatic Curriculum Learning Through Value Disagreement Yunzhi Zhang, Pieter Abbeel, Lerrel Pinto

ICLR 2020 Discovering Motor Programs by Recomposing Demonstrations Tanmay Shankar, Shubham Tulsiani, Lerrel Pinto, Abhinav Gupta

NeurIPS 2020 Generalized Hindsight for Reinforcement Learning Alexander Li, Lerrel Pinto, Pieter Abbeel

ICML 2020 Hierarchically Decoupled Imitation for Morphological Transfer Donald Hejna, Lerrel Pinto, Pieter Abbeel

CoRL 2020 Learning Predictive Representations for Deformable Objects Using Contrastive Estimation Wilson Yan, Ashwin Vangipuram, Pieter Abbeel, Lerrel Pinto

NeurIPS 2020 Reinforcement Learning with Augmented Data Misha Laskin, Kimin Lee, Adam Stooke, Lerrel Pinto, Pieter Abbeel, Aravind Srinivas

CoRL 2020 Robust Policies via Mid-Level Visual Representations: An Experimental Study in Manipulation and Navigation Bryan Chen, Alexander Sax, Francis Lewis, Iro Armeni, Silvio Savarese, Amir Zamir, Jitendra Malik, Lerrel Pinto

CoRL 2020 Visual Imitation Made Easy Sarah Young, Dhiraj Gandhi, Shubham Tulsiani, Abhinav Gupta, Pieter Abbeel, Lerrel Pinto

ICLR 2019 Environment Probing Interaction Policies Wenxuan Zhou, Lerrel Pinto, Abhinav Gupta

CoRL 2018 Multiple Interactions Made Easy (MIME): Large Scale Demonstrations Data for Imitation Pratyusha Sharma, Lekha Mohan, Lerrel Pinto, Abhinav Gupta

NeurIPS 2018 Robot Learning in Homes: Improving Generalization and Reducing Dataset Bias Abhinav Gupta, Adithyavairavan Murali, Dhiraj Prakashchand Gandhi, Lerrel Pinto

NeurIPS 2017 Predictive-State Decoders: Encoding the Future into Recurrent Networks Arun Venkatraman, Nicholas Rhinehart, Wen Sun, Lerrel Pinto, Martial Hebert, Byron Boots, Kris Kitani, J. Bagnell

ICML 2017 Robust Adversarial Reinforcement Learning Lerrel Pinto, James Davidson, Rahul Sukthankar, Abhinav Gupta

ECCV 2016 The Curious Robot: Learning Visual Representations via Physical Interactions Lerrel Pinto, Dhiraj Gandhi, Yuanfeng Han, Yong-Lae Park, Abhinav Gupta