Jain, Naman

14 publications

ICLR 2025 BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions Terry Yue Zhuo, Vu Minh Chien, Jenny Chim, Han Hu, Wenhao Yu, Ratnadira Widyasari, Imam Nur Bani Yusuf, Haolan Zhan, Junda He, Indraneil Paul, Simon Brunner, Chen Gong, James Hoang, Armel Randy Zebaze, Xiaoheng Hong, Wen-Ding Li, Jean Kaddour, Ming Xu, Zhihan Zhang, Prateek Yadav, Naman Jain, Alex Gu, Zhoujun Cheng, Jiawei Liu, Qian Liu, Zijian Wang, Binyuan Hui, Niklas Muennighoff, David Lo, Daniel Fried, Xiaoning Du, Harm de Vries, Leandro Von Werra

ICML 2025 Copilot Arena: A Platform for Code LLM Evaluation in the Wild Wayne Chi, Valerie Chen, Anastasios Nikolas Angelopoulos, Wei-Lin Chiang, Aditya Mittal, Naman Jain, Tianjun Zhang, Ion Stoica, Chris Donahue, Ameet Talwalkar

NeurIPS 2025 GSO: Challenging Software Optimization Tasks for Evaluating SWE-Agents Manish Shetty, Naman Jain, Jinjian Liu, Vijay Kethanaboyina, Koushik Sen, Ion Stoica

ICLR 2025 LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code Naman Jain, King Han, Alex Gu, Wen-Ding Li, Fanjia Yan, Tianjun Zhang, Sida Wang, Armando Solar-Lezama, Koushik Sen, Ion Stoica

ICML 2025 Position: Future Research and Challenges Remain Towards AI for Software Engineering Alex Gu, Naman Jain, Wen-Ding Li, Manish Shetty, Kevin Ellis, Koushik Sen, Armando Solar-Lezama

ICLRW 2025 Tasks, Challenges, and Paths Towards AI for Software Engineering Alex Gu, Naman Jain, Wen-Ding Li, Manish Shetty, Kevin Ellis, Koushik Sen, Armando Solar-Lezama

ICLRW 2025 Tasks, Challenges, and Paths Towards AI for Software Engineering Alex Gu, Naman Jain, Wen-Ding Li, Manish Shetty, Yijia Shao, Ziyang Li, Diyi Yang, Koushik Sen, Kevin Ellis, Armando Solar-Lezama

ICLR 2024 LLM-Assisted Code Cleaning for Training Accurate Code Generators Naman Jain, Tianjun Zhang, Wei-Lin Chiang, Joseph E. Gonzalez, Koushik Sen, Ion Stoica

ICML 2024 R2E: Turning Any GitHub Repository into a Programming Agent Environment Naman Jain, Manish Shetty, Tianjun Zhang, King Han, Koushik Sen, Ion Stoica

ICLRW 2024 R2E: Turning Any GitHub Repository into a Programming Agent Environment Naman Jain, Manish Shetty, Tianjun Zhang, King Han, Koushik Sen, Ion Stoica

NeurIPS 2024 SelfCodeAlign: Self-Alignment for Code Generation Yuxiang Wei, Federico Cassano, Jiawei Liu, Yifeng Ding, Naman Jain, Zachary Mueller, Harm de Vries, Leandro von Werra, Arjun Guha, Lingming Zhang

NeurIPSW 2023 Improving Code Style for Accurate Code Generation Naman Jain, Tianjun Zhang, Wei-Lin Chiang, Joseph E. Gonzalez, Koushik Sen, Ion Stoica

TMLR 2022 Learning Accurate Decision Trees with Bandit Feedback via Quantized Gradient Descent Ajaykrishna Karthikeyan, Naman Jain, Nagarajan Natarajan, Prateek Jain

CVPRW 2019 On the Robustness of Human Pose Estimation Naman Jain, Sahil Shah, Abhishek Kumar, Arjun Jain