Re, Christopher

149 publications

ICLR 2025 Aioli: A Unified Optimization Framework for Language Model Data Mixing Mayee F Chen, Michael Y. Hu, Nicholas Lourie, Kyunghyun Cho, Christopher Re

ICLRW 2025 Aioli: A Unified Optimization Framework for Language Model Data Mixing Mayee F Chen, Michael Y. Hu, Nicholas Lourie, Kyunghyun Cho, Christopher Re

ICML 2025 An Architecture Search Framework for Inference-Time Techniques Jon Saad-Falcon, Adrian Gamarra Lafuente, Shlok Natarajan, Nahum Maru, Hristo Todorov, Etash Kumar Guha, E. Kelly Buchanan, Mayee F Chen, Neel Guha, Christopher Re, Azalia Mirhoseini

ICLRW 2025 An Architecture Search Framework for Inference-Time Techniques Jon Saad-Falcon, Adrian Gamarra Lafuente, Shlok Natarajan, Nahum Maru, Hristo Todorov, Etash Kumar Guha, E. Kelly Buchanan, Mayee F Chen, Neel Guha, Christopher Re, Azalia Mirhoseini

ICLR 2025 Context Clues: Evaluating Long Context Models for Clinical Prediction Tasks on EHR Data Michael Wornow, Suhana Bedi, Miguel Angel Fuentes Hernandez, Ethan Steinberg, Jason Alan Fries, Christopher Re, Sanmi Koyejo, Nigam Shah

ICML 2025 Cost-Efficient Collaboration Between On-Device and Cloud Language Models Avanika Narayan, Dan Biderman, Sabri Eyuboglu, Avner May, Scott Linderman, James Zou, Christopher Re

ICLRW 2025 Cost-Efficient Collaboration Between On-Device and Cloud Language Models Avanika Narayan, Sabri Eyuboglu, Dan Biderman, Avner May, Scott Linderman, James Zou, Christopher Re

CVPR 2025 HMAR: Efficient Hierarchical Masked Auto-Regressive Image Generation Hermann Kumbong, Xian Liu, Tsung-Yi Lin, Ming-Yu Liu, Xihui Liu, Ziwei Liu, Daniel Y. Fu, Christopher Re, David W. Romero

ICML 2025 KernelBench: Can LLMs Write Efficient GPU Kernels? Anne Ouyang, Simon Guo, Simran Arora, Alex L Zhang, William Hu, Christopher Re, Azalia Mirhoseini

ICLRW 2025 KernelBench: Can LLMs Write Efficient GPU Kernels? Anne Ouyang, Simon Guo, Simran Arora, Alex L Zhang, William Hu, Christopher Re, Azalia Mirhoseini

ICLR 2025 LoLCATs: On Low-Rank Linearizing of Large Language Models Michael Zhang, Simran Arora, Rahul Chalamala, Benjamin Frederick Spector, Alan Wu, Krithik Ramesh, Aaryan Singhal, Christopher Re

JMLR 2025 Precise High-Dimensional Asymptotics for Quantifying Heterogeneous Transfers Fan Yang, Hongyang R. Zhang, Sen Wu, Christopher Re, Weijie J. Su

ICLR 2025 Restructuring Vector Quantization with the Rotation Trick Christopher Fifty, Ronald Guenther Junkins, Dennis Duan, Aniketh Iyengar, Jerry Weihong Liu, Ehsan Amid, Sebastian Thrun, Christopher Re

ICLR 2025 Scaling Laws for Precision Tanishq Kumar, Zachary Ankner, Benjamin Frederick Spector, Blake Bordelon, Niklas Muennighoff, Mansheej Paul, Cengiz Pehlevan, Christopher Re, Aditi Raghunathan

ICLR 2025 ThunderKittens: Simple, Fast, and $\textit{Adorable}$ Kernels Benjamin Frederick Spector, Simran Arora, Aaryan Singhal, Arjun Parthasarathy, Daniel Y Fu, Christopher Re

ICLR 2025 Towards Learning High-Precision Least Squares Algorithms with Sequence Models Jerry Weihong Liu, Jessica Grogan, Owen M Dugan, Ashish Rao, Simran Arora, Atri Rudra, Christopher Re

NeurIPS 2025 Weaver: Shrinking the Generation-Verification Gap by Scaling Compute for Verification Jon Saad-Falcon, E. Kelly Buchanan, Mayee F Chen, Tzu-Heng Huang, Brendan McLaughlin, Tanvir Bhathal, Shang Zhu, Ben Athiwaratkun, Frederic Sala, Scott Linderman, Azalia Mirhoseini, Christopher Re

NeurIPSW 2024 A Hessian View of Grokking in Mathematical Reasoning Zhenshuo Zhang, Jerry Weihong Liu, Christopher Re, Hongyang R. Zhang

ICML 2024 Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT Jon Saad-Falcon, Daniel Y Fu, Simran Arora, Neel Guha, Christopher Re

ICMLW 2024 Can Transformers Solve Least Squares to High Precision? Jerry Weihong Liu, Jessica Grogan, Owen M Dugan, Simran Arora, Atri Rudra, Christopher Re

WACV 2024 Collage Diffusion Vishnu Sarukkai, Linden Li, Arden Ma, Christopher Ré, Kayvon Fatahalian

ICLR 2024 Context-Aware Meta-Learning Christopher Fifty, Dennis Duan, Ronald Guenther Junkins, Ehsan Amid, Jure Leskovec, Christopher Re, Sebastian Thrun

ICLRW 2024 Cookbook: A Framework for Improving LLM Generative Abilities via Programmatic Data Generating Templates Avanika Narayan, Mayee F Chen, Kush Bhatia, Christopher Re

ICLR 2024 FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores Daniel Y Fu, Hermann Kumbong, Eric Nguyen, Christopher Re

ICMLW 2024 Hydragen: High-Throughput LLM Inference with Shared Prefixes Jordan Juravsky, Bradley Brown, Ryan Saul Ehrlich, Daniel Y Fu, Christopher Re, Azalia Mirhoseini

ICMLW 2024 Just Read Twice: Closing the Recall Gap for Recurrent Language Models Simran Arora, Aman Timalsina, Aaryan Singhal, Sabri Eyuboglu, Xinyi Zhao, Ashish Rao, Atri Rudra, Christopher Re

ICMLW 2024 Low-Rank Linearization of Large Language Models Michael Zhang, Aaryan Singhal, Benjamin Frederick Spector, Simran Arora, Christopher Re

ICML 2024 Mechanistic Design and Scaling of Hybrid Architectures Michael Poli, Armin W Thomas, Eric Nguyen, Pragaash Ponnusamy, Björn Deiseroth, Kristian Kersting, Taiji Suzuki, Brian Hie, Stefano Ermon, Christopher Re, Ce Zhang, Stefano Massaroli

ICML 2024 Prospector Heads: Generalized Feature Attribution for Large Models & Data Gautam Machiraju, Alexander Derry, Arjun D Desai, Neel Guha, Amir-Hossein Karimi, James Zou, Russ B Altman, Christopher Re, Parag Mallick

NeurIPS 2024 RedPajama: An Open Dataset for Training Large Language Models Maurice Weber, Daniel Y. Fu, Quentin Anthony, Yonatan Oren, Shane Adams, Anton Alexandrov, Xiaozhong Lyu, Huu Nguyen, Xiaozhe Yao, Virginia Adams, Ben Athiwaratkun, Rahul Chalamala, Kezhen Chen, Max Ryabinin, Tri Dao, Percy Liang, Christopher Ré, Irina Rish, Ce Zhang

ICML 2024 Simple Linear Attention Language Models Balance the Recall-Throughput Tradeoff Simran Arora, Sabri Eyuboglu, Michael Zhang, Aman Timalsina, Silas Alberti, James Zou, Atri Rudra, Christopher Re

ICMLW 2024 Simple Linear Attention Language Models Balance the Recall-Throughput Tradeoff Simran Arora, Sabri Eyuboglu, Michael Zhang, Aman Timalsina, Silas Alberti, Dylan Zinsley, James Zou, Atri Rudra, Christopher Re

NeurIPS 2024 Smoothie: Label Free Language Model Routing Neel Guha, Mayee F. Chen, Trevor Chow, Ishan S. Khare, Christopher Ré

ICML 2024 State-Free Inference of State-Space Models: The *Transfer Function* Approach Rom Parnichkun, Stefano Massaroli, Alessandro Moro, Jimmy T.H. Smith, Ramin Hasani, Mathias Lechner, Qi An, Christopher Re, Hajime Asama, Stefano Ermon, Taiji Suzuki, Michael Poli, Atsushi Yamashita

ICLR 2024 The Hedgehog & the Porcupine: Expressive Linear Attentions with SoftMax Mimicry Michael Zhang, Kush Bhatia, Hermann Kumbong, Christopher Re

ICMLW 2024 Towards Smaller Language Models via Layer Looping Sabri Eyuboglu, Dylan Zinsley, Jon Saad-Falcon, Simran Arora, Atri Rudra, James Zou, Christopher Re

NeurIPS 2024 WONDERBREAD: A Benchmark for Evaluating Multimodal Foundation Models on Business Process Management Tasks Michael Wornow, Avanika Narayan, Ben Viggiano, Ishan S. Khare, Tathagat Verma, Tibor Thompson, Miguel Angel Fuentes Hernandez, Sudharsan Sundar, Chloe Trujillo, Krrish Chawla, Rongfei Lu, Justin Shen, Divya Nagaraj, Joshua Martinez, Vardhan Agrawal, Althea Hudson, Nigam H. Shah, Christopher Ré

ICLR 2024 Zoology: Measuring and Improving Recall in Efficient Language Models Simran Arora, Sabri Eyuboglu, Aman Timalsina, Isys Johnson, Michael Poli, James Zou, Atri Rudra, Christopher Re

NeurIPS 2023 A Case for Reframing Automated Medical Image Classification as Segmentation Sarah Hooper, Mayee Chen, Khaled Saab, Kush Bhatia, Curtis Langlotz, Christopher Ré

ICMLW 2023 Accelerating LLM Inference with Staged Speculative Decoding Benjamin Frederick Spector, Christopher Re

ICLR 2023 Ask Me Anything: A Simple Strategy for Prompting Language Models Simran Arora, Avanika Narayan, Mayee F Chen, Laurel Orr, Neel Guha, Kush Bhatia, Ines Chami, Christopher Re

ICML 2023 CocktailSGD: Fine-Tuning Foundation Models over 500Mbps Networks Jue Wang, Yucheng Lu, Binhang Yuan, Beidi Chen, Percy Liang, Christopher De Sa, Christopher Re, Ce Zhang

NeurIPSW 2023 Context-Aware Meta-Learning Christopher Fifty, Dennis Duan, Ronald Guenther Junkins, Ehsan Amid, Jure Leskovec, Christopher Re, Sebastian Thrun

ICML 2023 Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time Zichang Liu, Jue Wang, Tri Dao, Tianyi Zhou, Binhang Yuan, Zhao Song, Anshumali Shrivastava, Ce Zhang, Yuandong Tian, Christopher Re, Beidi Chen

NeurIPSW 2023 Does In-Context Operator Learning Generalize to Domain-Shifted Settings? Jerry Weihong Liu, N. Benjamin Erichson, Kush Bhatia, Michael W. Mahoney, Christopher Re

ICLR 2023 Effectively Modeling Time Series with Simple Discrete State Spaces Michael Zhang, Khaled Kamal Saab, Michael Poli, Tri Dao, Karan Goel, Christopher Re

NeurIPS 2023 Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification Neel Guha, Mayee Chen, Kush Bhatia, Azalia Mirhoseini, Frederic Sala, Christopher Ré

COLT 2023 Fast Algorithms for a New Relaxation of Optimal Transport Moses Charikar, Beidi Chen, Christopher Ré, Erik Waingarten

ICML 2023 FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Re, Ion Stoica, Ce Zhang

NeurIPS 2023 H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Ré, Clark Barrett, Zhangyang "Atlas" Wang, Beidi Chen

ICMLW 2023 H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models Zhenyu Zhang, Ying Sheng, Tianyi Zhou, Tianlong Chen, Lianmin Zheng, Ruisi Cai, Zhao Song, Yuandong Tian, Christopher Re, Clark Barrett, Zhangyang Wang, Beidi Chen

AAAI 2023 HAPI Explorer: Comprehension, Discovery, and Explanation on History of ML APIs Lingjiao Chen, Zhihua Jin, Sabri Eyuboglu, Huamin Qu, Christopher Ré, Matei Zaharia, James Zou

TMLR 2023 Holistic Evaluation of Language Models Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Kumar, Benjamin Newman, Binhang Yuan, Bobby Yan, Ce Zhang, Christian Cosgrove, Christopher D Manning, Christopher Re, Diana Acosta-Navas, Drew A. Hudson, Eric Zelikman, Esin Durmus, Faisal Ladhak, Frieda Rong, Hongyu Ren, Huaxiu Yao, Jue Wang, Keshav Santhanam, Laurel Orr, Lucia Zheng, Mert Yuksekgonul, Mirac Suzgun, Nathan Kim, Neel Guha, Niladri S. Chatterji, Omar Khattab, Peter Henderson, Qian Huang, Ryan Andrew Chi, Sang Michael Xie, Shibani Santurkar, Surya Ganguli, Tatsunori Hashimoto, Thomas Icard, Tianyi Zhang, Vishrav Chaudhary, William Wang, Xuechen Li, Yifan Mai, Yuhui Zhang, Yuta Koreeda

ICLR 2023 How to Train Your HIPPO: State Space Models with Generalized Orthogonal Basis Projections Albert Gu, Isys Johnson, Aman Timalsina, Atri Rudra, Christopher Re

ICLR 2023 Hungry Hungry Hippos: Towards Language Modeling with State Space Models Daniel Y Fu, Tri Dao, Khaled Kamal Saab, Armin W Thomas, Atri Rudra, Christopher Re

ICML 2023 Hyena Hierarchy: Towards Larger Convolutional Language Models Michael Poli, Stefano Massaroli, Eric Nguyen, Daniel Y Fu, Tri Dao, Stephen Baccus, Yoshua Bengio, Stefano Ermon, Christopher Re

NeurIPS 2023 HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolution Eric Nguyen, Michael Poli, Marjan Faizi, Armin Thomas, Michael Wornow, Callum Birch-Sykes, Stefano Massaroli, Aman Patel, Clayton Rabideau, Yoshua Bengio, Stefano Ermon, Christopher Ré, Stephen Baccus

NeurIPS 2023 Laughing Hyena Distillery: Extracting Compact Recurrences from Convolutions Stefano Massaroli, Michael Poli, Dan Fu, Hermann Kumbong, Rom Parnichkun, David Romero, Aman Timalsina, Quinn McIntyre, Beidi Chen, Atri Rudra, Ce Zhang, Christopher Ré, Stefano Ermon, Yoshua Bengio

NeurIPS 2023 LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language Models Neel Guha, Julian Nyarko, Daniel Ho, Christopher Ré, Adam Chilton, Aditya K, Alex Chohlas-Wood, Austin Peters, Brandon Waldon, Daniel Rockmore, Diego Zambrano, Dmitry Talisman, Enam Hoque, Faiz Surani, Frank Fagan, Galit Sarfaty, Gregory Dickinson, Haggai Porat, Jason Hegland, Jessica Wu, Joe Nudell, Joel Niklaus, John Nay, Jonathan Choi, Kevin Tobia, Margaret Hagan, Megan Ma, Michael Livermore, Nikon Rasumov-Rahe, Nils Holzenberger, Noam Kolt, Peter Henderson, Sean Rehaag, Sharad Goel, Shang Gao, Spencer Williams, Sunny Gandhi, Tom Zur, Varun Iyer, Zehua Li

NeurIPS 2023 Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture Dan Fu, Simran Arora, Jessica Grogan, Isys Johnson, Evan Sabri Eyuboglu, Armin Thomas, Benjamin Spector, Michael Poli, Atri Rudra, Christopher Ré

ICMLW 2023 Prospectors: Leveraging Short Contexts to Mine Salient Objects in High-Dimensional Imagery Gautam Machiraju, Arjun D Desai, James Zou, Christopher Re, Parag Mallick

NeurIPSW 2023 Scalable Deep Potentials as Implicit Hierarchical Semi-Separable Operators Michael Poli, Stefano Massaroli, Christopher Re, Stefano Ermon

ICML 2023 Simple Hardware-Efficient Long Convolutions for Sequence Modeling Daniel Y Fu, Elliot L Epstein, Eric Nguyen, Armin W Thomas, Michael Zhang, Tri Dao, Atri Rudra, Christopher Re

ICLRW 2023 Simple Hardware-Efficient Long Convolutions for Sequence Modeling Daniel Y Fu, Elliot L Epstein, Eric Nguyen, Armin W Thomas, Michael Zhang, Tri Dao, Atri Rudra, Christopher Re

NeurIPS 2023 Skill-It! a Data-Driven Skills Framework for Understanding and Training Language Models Mayee Chen, Nicholas Roberts, Kush Bhatia, Jue Wang, Ce Zhang, Frederic Sala, Christopher Ré

NeurIPS 2023 TART: A Plug-and-Play Transformer Module for Task-Agnostic Reasoning Kush Bhatia, Avanika Narayan, Christopher M De Sa, Christopher Ré

NeurIPSW 2023 TART: A Plug-and-Play Transformer Module for Task-Agnostic Reasoning Kush Bhatia, Avanika Narayan, Christopher De Sa, Christopher Re

MIDL 2023 VORTEX: Physics-Driven Data Augmentations Using Consistency Training for Robust Accelerated MRI Reconstruction Arjun D. Desai, Beliz Gunel, Batu M. Ozturkler, Harris Beg, Shreyas Vasanawala, Brian A. Hargreaves, Christopher Ré, John M Pauly, Akshay S. Chaudhari

ICMLW 2022 BARACK: Partially Supervised Group Robustness with Guarantees Nimit Sharad Sohoni, Maziar Sanjabi, Nicolas Ballas, Aditya Grover, Shaoliang Nie, Hamed Firooz, Christopher Re

NeurIPS 2022 Contrastive Adapters for Foundation Model Group Robustness Michael Zhang, Christopher Ré

ICMLW 2022 Contrastive Adapters for Foundation Model Group Robustness Michael Zhang, Christopher Re

ICML 2022 Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlations Michael Zhang, Nimit S Sohoni, Hongyang R Zhang, Chelsea Finn, Christopher Re

NeurIPS 2022 Decentralized Training of Foundation Models in Heterogeneous Environments Binhang Yuan, Yongjun He, Jared Davis, Tianyi Zhang, Tri Dao, Beidi Chen, Percy Liang, Christopher Ré, Ce Zhang

ICLR 2022 Domino: Discovering Systematic Errors with Cross-Modal Embeddings Sabri Eyuboglu, Maya Varma, Khaled Kamal Saab, Jean-Benoit Delbrouck, Christopher Lee-Messer, Jared Dunnmon, James Zou, Christopher Re

ICLR 2022 Efficiently Modeling Long Sequences with Structured State Spaces Albert Gu, Karan Goel, Christopher Re

NeurIPS 2022 Fine-Tuning Language Models over Slow Networks Using Activation Quantization with Guarantees Jue Wang, Binhang Yuan, Luka Rimanic, Yongjun He, Tri Dao, Beidi Chen, Christopher Ré, Ce Zhang

NeurIPS 2022 FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness Tri Dao, Dan Fu, Stefano Ermon, Atri Rudra, Christopher Ré

NeurIPS 2022 HAPI: A Large-Scale Longitudinal Dataset of Commercial ML API Predictions Lingjiao Chen, Zhihua Jin, Evan Sabri Eyuboglu, Christopher Ré, Matei Zaharia, James Y Zou

ICML 2022 It’s Raw! Audio Generation with State-Space Models Karan Goel, Albert Gu, Chris Donahue, Christopher Re

JMLR 2022 Machine Learning on Graphs: A Model and Comprehensive Taxonomy Ines Chami, Sami Abu-El-Haija, Bryan Perozzi, Christopher Ré, Kevin Murphy

ICML 2022 Monarch: Expressive Structured Matrices for Efficient and Accurate Training Tri Dao, Beidi Chen, Nimit S Sohoni, Arjun Desai, Michael Poli, Jessica Grogan, Alexander Liu, Aniruddh Rao, Atri Rudra, Christopher Re

NeurIPS 2022 On the Parameterization and Initialization of Diagonal State Space Models Albert Gu, Karan Goel, Ankit Gupta, Christopher Ré

ICML 2022 Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning Mayee Chen, Daniel Y Fu, Avanika Narayan, Michael Zhang, Zhao Song, Kayvon Fatahalian, Christopher Re

ICLR 2022 Pixelated Butterfly: Simple and Efficient Sparse Training for Neural Network Models Beidi Chen, Tri Dao, Kaizhao Liang, Jiaming Yang, Zhao Song, Atri Rudra, Christopher Re

MLHC 2022 Reducing Reliance on Spurious Features in Medical Image Classification with Spatial Specificity Khaled Saab, Sarah Hooper, Mayee Chen, Michael Zhang, Daniel Rubin, Christopher Re

NeurIPS 2022 S4ND: Modeling Images and Videos as Multidimensional Signals with State Spaces Eric Nguyen, Karan Goel, Albert Gu, Gordon Downs, Preey Shah, Tri Dao, Stephen Baccus, Christopher Ré

NeurIPS 2022 Self-Supervised Learning of Brain Dynamics from Broad Neuroimaging Data Armin Thomas, Christopher Ré, Russell Poldrack

UAI 2022 Shoring up the Foundations: Fusing Model Embeddings and Weak Supervision Mayee F. Chen, Daniel Y. Fu, Dyah Adila, Michael Zhang, Frederic Sala, Kayvon Fatahalian, Christopher Ré

ICMLW 2022 The Importance of Background Information for Out of Distribution Generalization Jupinder Parmar, Khaled Kamal Saab, Brian Pogatchnik, Daniel Rubin, Christopher Ré

NeurIPS 2022 Transform Once: Efficient Operator Learning in Frequency Domain Michael Poli, Stefano Massaroli, Federico Berto, Jinkyoo Park, Tri Dao, Christopher Ré, Stefano Ermon

ICMLW 2022 Transform Once: Efficient Operator Learning in Frequency Domain Michael Poli, Stefano Massaroli, Federico Berto, Jinkyoo Park, Tri Dao, Christopher Re, Stefano Ermon

AISTATS 2021 Comparing the Value of Labeled and Unlabeled Data in Method-of-Moments Latent Variable Estimation Mayee Chen, Benjamin Cohen-Wang, Stephen Mussmann, Frederic Sala, Christopher Re

ICML 2021 Catformer: Designing Stable Transformers via Sensitivity Analysis Jared Q Davis, Albert Gu, Krzysztof Choromanski, Tri Dao, Christopher Re, Chelsea Finn, Percy Liang

NeurIPS 2021 Combining Recurrent, Convolutional, and Continuous-Time Models with Linear State Space Layers Albert Gu, Isys Johnson, Karan Goel, Khaled Saab, Tri Dao, Atri Rudra, Christopher Ré

NeurIPSW 2021 Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlations Michael Zhang, Nimit Sharad Sohoni, Hongyang R. Zhang, Chelsea Finn, Christopher Ré

ICLR 2021 Cut Out the Annotator, Keep the Cutout: Better Segmentation with Weak Supervision Sarah Hooper, Michael Wornow, Ying Hang Seah, Peter Kellman, Hui Xue, Frederic Sala, Curtis Langlotz, Christopher Re

ICML 2021 HoroPCA: Hyperbolic Dimensionality Reduction via Horospherical Projections Ines Chami, Albert Gu, Dat P Nguyen, Christopher Re

ICLR 2021 MONGOOSE: A Learnable LSH Framework for Efficient Neural Network Training Beidi Chen, Zichang Liu, Binghui Peng, Zhaozhuo Xu, Jonathan Lingjie Li, Tri Dao, Zhao Song, Anshumali Shrivastava, Christopher Re

ICML 2021 Mandoline: Model Evaluation Under Distribution Shift Mayee Chen, Karan Goel, Nimit S Sohoni, Fait Poms, Kayvon Fatahalian, Christopher Re

ICLR 2021 Model Patching: Closing the Subgroup Performance Gap with Data Augmentation Karan Goel, Albert Gu, Yixuan Li, Christopher Re

NeurIPS 2021 Rethinking Neural Operations for Diverse Tasks Nicholas Roberts, Mikhail Khodak, Tri Dao, Liam Li, Christopher Ré, Ameet Talwalkar

NeurIPS 2021 Scatterbrain: Unifying Sparse and Low-Rank Attention Beidi Chen, Tri Dao, Eric Winsor, Zhao Song, Atri Rudra, Christopher Ré

ICML 2020 Fast and Three-Rious: Speeding up Weak Supervision with Triplet Methods Daniel Fu, Mayee Chen, Frederic Sala, Sarah Hooper, Kayvon Fatahalian, Christopher Re

NeurIPS 2020 From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clustering Ines Chami, Albert Gu, Vaggos Chatziafratis, Christopher Ré

NeurIPS 2020 HiPPO: Recurrent Memory with Optimal Polynomial Projections Albert Gu, Tri Dao, Stefano Ermon, Atri Rudra, Christopher Ré

AISTATS 2020 Ivy: Instrumental Variable Synthesis for Causal Inference Zhaobin Kuang, Frederic Sala, Nimit Sohoni, Sen Wu, Aldo Córdova-Palomera, Jared Dunnmon, James Priest, Christopher Re

ICLR 2020 Kaleidoscope: An Efficient, Learnable Representation for All Structured Linear Maps Tri Dao, Nimit Sohoni, Albert Gu, Matthew Eichhorn, Amit Blonder, Megan Leszczynski, Atri Rudra, Christopher Ré

NeurIPS 2020 No Subclass Left Behind: Fine-Grained Robustness in Coarse-Grained Classification Problems Nimit Sohoni, Jared Dunnmon, Geoffrey Angus, Albert Gu, Christopher Ré

ICML 2020 On the Generalization Effects of Linear Transformations in Data Augmentation Sen Wu, Hongyang Zhang, Gregory Valiant, Christopher Re

ICLR 2020 Understanding and Improving Information Transfer in Multi-Task Learning Sen Wu, Hongyang R. Zhang, Christopher Ré

ICML 2019 A Kernel Theory of Modern Data Augmentation Tri Dao, Albert Gu, Alexander Ratner, Virginia Smith, Chris De Sa, Christopher Re

NeurIPS 2019 Hyperbolic Graph Convolutional Neural Networks Ines Chami, Zhitao Ying, Christopher Ré, Jure Leskovec

ICLRW 2019 Improving Sample Complexity with Observational Supervision Khaled Saab, Jared Dunnmon, Alexander Ratner, Daniel Rubin, Christopher Re

ICML 2019 Learning Dependency Structures for Weak Supervision Models Paroma Varma, Frederic Sala, Ann He, Alexander Ratner, Christopher Re

ICML 2019 Learning Fast Algorithms for Linear Transforms Using Butterfly Factorizations Tri Dao, Albert Gu, Matthew Eichhorn, Atri Rudra, Christopher Re

ICLR 2019 Learning Mixed-Curvature Representations in Product Spaces Albert Gu, Frederic Sala, Beliz Gunel, Christopher Ré

AISTATS 2019 Low-Precision Random Fourier Features for Memory-Constrained Kernel Approximation Jian Zhang, Avner May, Tri Dao, Christopher Re

NeurIPS 2019 Multi-Resolution Weak Supervision for Sequential Data Paroma Varma, Frederic Sala, Shiori Sagawa, Jason Fries, Daniel Fu, Saelig Khattar, Ashwini Ramamoorthy, Ke Xiao, Kayvon Fatahalian, James Priest, Christopher Ré

NeurIPS 2019 On the Downstream Performance of Compressed Word Embeddings Avner May, Jian Zhang, Tri Dao, Christopher Ré

ICCVW 2019 Scene Graph Prediction with Limited Labels Vincent S. Chen, Paroma Varma, Ranjay Krishna, Michael S. Bernstein, Christopher Ré, Li Fei-Fei

NeurIPS 2019 Slice-Based Learning: A Programming Model for Residual Learning in Critical Data Slices Vincent Chen, Sen Wu, Alexander J Ratner, Jen Weng, Christopher Ré

AAAI 2019 Training Complex Models with Multi-Task Weak Supervision Alexander Ratner, Braden Hancock, Jared Dunnmon, Frederic Sala, Shreyash Pandey, Christopher Ré

AISTATS 2018 Accelerated Stochastic Power Iteration Peng Xu, Bryan D. He, Christopher De Sa, Ioannis Mitliagkas, Christopher Ré

NeurIPS 2018 Learning Compressed Transforms with Low Displacement Rank Anna Thomas, Albert Gu, Tri Dao, Atri Rudra, Christopher Ré

ICML 2018 Representation Tradeoffs for Hyperbolic Embeddings Frederic Sala, Chris De Sa, Albert Gu, Christopher Re

IJCAI 2017 Ensuring Rapid Mixing and Low Bias for Asynchronous Gibbs Sampling Christopher De Sa, Kunle Olukotun, Christopher Ré

NeurIPS 2017 Gaussian Quadrature for Kernel Features Tri Dao, Christopher M De Sa, Christopher Ré

NeurIPS 2017 Inferring Generative Model Structure with Static Analysis Paroma Varma, Bryan D He, Payal Bajaj, Nishith Khandwala, Imon Banerjee, Daniel Rubin, Christopher Ré

ICML 2017 Learning the Structure of Generative Models Without Labeled Data Stephen H. Bach, Bryan He, Alexander Ratner, Christopher Ré

NeurIPS 2017 Learning to Compose Domain-Specific Transformations for Data Augmentation Alexander J Ratner, Henry Ehrenberg, Zeshan Hussain, Jared Dunnmon, Christopher Ré

MLHC 2017 ShortFuse: Biomedical Time Series Representations in the Presence of Structured Information Madalina Fiterau, Suvrat Bhooshan, Jason Fries, Charles Bournhonesque, Jennifer Hicks, Eni Halilaj, Christopher Re, Scott Delp

UAI 2017 Snorkel: Beyond Hand-Labeled Data Christopher Ré

NeurIPS 2016 Cyclades: Conflict-Free Asynchronous Machine Learning Xinghao Pan, Maximilian Lam, Stephen Tu, Dimitris Papailiopoulos, Ce Zhang, Michael I Jordan, Kannan Ramchandran, Christopher Ré

NeurIPS 2016 Data Programming: Creating Large Training Sets, Quickly Alexander J Ratner, Christopher M De Sa, Sen Wu, Daniel Selsam, Christopher Ré

NeurIPS 2016 Scan Order in Gibbs Sampling: Models in Which It Matters and Bounds on How Much Bryan D He, Christopher M De Sa, Ioannis Mitliagkas, Christopher Ré

NeurIPS 2016 Sub-Sampled Newton Methods with Non-Uniform Sampling Peng Xu, Jiyan Yang, Fred Roosta, Christopher Ré, Michael W. Mahoney

JMLR 2015 An Asynchronous Parallel Stochastic Coordinate Descent Algorithm Ji Liu, Stephen J. Wright, Christopher Ré, Victor Bittorf, Srikrishna Sridhar

NeurIPS 2015 Asynchronous Stochastic Convex Optimization: The Noise Is in the Noise and SGD Don't Care Sorathan Chaturapruek, John C. Duchi, Christopher Ré

ICML 2015 Global Convergence of Stochastic Gradient Descent for Some Non-Convex Matrix Problems Christopher De Sa, Christopher Re, Kunle Olukotun

NeurIPS 2015 Rapidly Mixing Gibbs Sampling for a Class of Factor Graphs Using Hierarchy Width Christopher M De Sa, Ce Zhang, Kunle Olukotun, Christopher Ré

NeurIPS 2015 Taming the Wild: A Unified Analysis of Hogwild-Style Algorithms Christopher M De Sa, Ce Zhang, Kunle Olukotun, Christopher Ré, Christopher Ré

ICML 2014 An Asynchronous Parallel Stochastic Coordinate Descent Algorithm Ji Liu, Steve Wright, Christopher Re, Victor Bittorf, Srikrishna Sridhar

NeurIPS 2014 Parallel Feature Selection Inspired by Group Testing Yingbo Zhou, Utkarsh Porwal, Ce Zhang, Hung Q Ngo, Xuanlong Nguyen, Christopher Ré, Venu Govindaraju

NeurIPS 2013 An Approximate, Efficient LP Solver for LP Rounding Srikrishna Sridhar, Stephen Wright, Christopher Re, Ji Liu, Victor Bittorf, Ce Zhang

NeurIPS 2012 Factoring Nonnegative Matrices with Linear Programs Ben Recht, Christopher Re, Joel Tropp, Victor Bittorf

COLT 2012 Toward a Noncommutative Arithmetic-Geometric Mean Inequality: Conjectures, Case-Studies, and Consequences Benjamin Recht, Christopher Re

NeurIPS 2011 Hogwild!: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent Benjamin Recht, Christopher Re, Stephen Wright, Feng Niu