Dooley, Samuel

17 publications

ICLR 2025 LiveBench: A Challenging, Contamination-Limited LLM Benchmark Colin White, Samuel Dooley, Manley Roberts, Arka Pal, Benjamin Feuer, Siddhartha Jain, Ravid Shwartz-Ziv, Neel Jain, Khalid Saifullah, Sreemanti Dey, Shubh-Agrawal, Sandeep Singh Sandha, Siddartha Venkat Naidu, Chinmay Hegde, Yann LeCun, Tom Goldstein, Willie Neiswanger, Micah Goldblum

ICLR 2025 Multi-Objective Differentiable Neural Architecture Search Rhea Sanjay Sukthanker, Arber Zela, Benedikt Staffler, Samuel Dooley, Josif Grabocka, Frank Hutter

ICLR 2025 Style Outweighs Substance: Failure Modes of LLM Judges in Alignment Benchmarking Benjamin Feuer, Micah Goldblum, Teresa Datta, Sanjana Nambiar, Raz Besaleli, Samuel Dooley, Max Cembalest, John P Dickerson

NeurIPS 2024 Large Language Models Must Be Taught to Know What They Don’t Know Sanyam Kapoor, Nate Gruver, Manley Roberts, Katherine Collins, Arka Pal, Umang Bhatt, Adrian Weller, Samuel Dooley, Micah Goldblum, Andrew Gordon Wilson

ICMLW 2024 Multi-Objective Differentiable Neural Architecture Search Rhea Sanjay Sukthanker, Arber Zela, Benedikt Staffler, Samuel Dooley, Josif Grabocka, Frank Hutter

ICLR 2024 To the Cutoff... and Beyond? a Longitudinal Perspective on LLM Data Contamination Manley Roberts, Himanshu Thakur, Christine Herlihy, Colin White, Samuel Dooley

NeurIPSW 2023 A Natural Experiment on LLM Data Contamination in Code Generation Manley Roberts, Himanshu Thakur, Christine Herlihy, Colin White, Samuel Dooley

NeurIPS 2023 ForecastPFN: Synthetically-Trained Zero-Shot Forecasting Samuel Dooley, Gurnoor Singh Khurana, Chirag Mohapatra, Siddartha V Naidu, Colin White

ICLRW 2023 ForecastPFN: Universal Forecasting for Healthcare Gurnoor Singh Khurana, Samuel Dooley, Siddartha Venkat Naidu, Colin White

NeurIPS 2023 Rethinking Bias Mitigation: Fairer Architectures Make for Fairer Face Recognition Samuel Dooley, Rhea Sukthanker, John Dickerson, Colin White, Frank Hutter, Micah Goldblum

NeurIPSW 2022 A Deep Dive into Dataset Imbalance and Bias in Face Identification Valeriia Cherepanova, Steven Reich, Samuel Dooley, Hossein Souri, John P Dickerson, Micah Goldblum, Tom Goldstein

NeurIPSW 2022 A Deep Dive into Dataset Imbalance and Bias in Face Identification Valeriia Cherepanova, Steven Reich, Samuel Dooley, Hossein Souri, John P Dickerson, Micah Goldblum, Tom Goldstein

NeurIPSW 2022 On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Samuel Dooley, Rhea Sanjay Sukthanker, John P Dickerson, Colin White, Frank Hutter, Micah Goldblum

NeurIPSW 2022 On the Importance of Architectures and Hyperparameters for Fairness in Face Recognition Samuel Dooley, Rhea Sanjay Sukthanker, John P Dickerson, Colin White, Frank Hutter, Micah Goldblum

NeurIPS 2022 Robustness Disparities in Face Detection Samuel Dooley, George Z Wei, Tom Goldstein, John Dickerson

IJCAI 2022 The Dichotomous Affiliate Stable Matching Problem: Approval-Based Matching with Applicant-Employer Relations Marina Knittel, Samuel Dooley, John P. Dickerson

NeurIPS 2021 PreferenceNet: Encoding Human Preferences in Auction Design with Deep Learning Neehar Peri, Michael Curry, Samuel Dooley, John Dickerson