Zhang, Michael

29 publications

ICLR 2025 LoLCATs: On Low-Rank Linearizing of Large Language Models Michael Zhang, Simran Arora, Rahul Chalamala, Benjamin Frederick Spector, Alan Wu, Krithik Ramesh, Aaryan Singhal, Christopher Re

ICMLW 2024 Low-Rank Linearization of Large Language Models Michael Zhang, Aaryan Singhal, Benjamin Frederick Spector, Simran Arora, Christopher Re

ICML 2024 Simple Linear Attention Language Models Balance the Recall-Throughput Tradeoff Simran Arora, Sabri Eyuboglu, Michael Zhang, Aman Timalsina, Silas Alberti, James Zou, Atri Rudra, Christopher Re

ICMLW 2024 Simple Linear Attention Language Models Balance the Recall-Throughput Tradeoff Simran Arora, Sabri Eyuboglu, Michael Zhang, Aman Timalsina, Silas Alberti, Dylan Zinsley, James Zou, Atri Rudra, Christopher Re

ICLR 2024 The Hedgehog & the Porcupine: Expressive Linear Attentions with SoftMax Mimicry Michael Zhang, Kush Bhatia, Hermann Kumbong, Christopher Re

ICLR 2023 Effectively Modeling Time Series with Simple Discrete State Spaces Michael Zhang, Khaled Kamal Saab, Michael Poli, Tri Dao, Karan Goel, Christopher Re

NeurIPSW 2023 Online Student-$t$ Processes with an Overall-Local Scale Structure for Modelling Non-Stationary Data Taole Sha, Michael Zhang

NeurIPS 2023 Propagating Knowledge Updates to LMs Through Distillation Shankar Padmanabhan, Yasumasa Onoe, Michael Zhang, Greg Durrett, Eunsol Choi

ICML 2023 Simple Hardware-Efficient Long Convolutions for Sequence Modeling Daniel Y Fu, Elliot L Epstein, Eric Nguyen, Armin W Thomas, Michael Zhang, Tri Dao, Atri Rudra, Christopher Re

ICLRW 2023 Simple Hardware-Efficient Long Convolutions for Sequence Modeling Daniel Y Fu, Elliot L Epstein, Eric Nguyen, Armin W Thomas, Michael Zhang, Tri Dao, Atri Rudra, Christopher Re

NeurIPS 2022 Contrastive Adapters for Foundation Model Group Robustness Michael Zhang, Christopher Ré

ICMLW 2022 Contrastive Adapters for Foundation Model Group Robustness Michael Zhang, Christopher Re

ICML 2022 Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlations Michael Zhang, Nimit S Sohoni, Hongyang R Zhang, Chelsea Finn, Christopher Re

ICMLW 2022 Deep Learning and Symbolic Regression for Discovering Parametric Equations Samuel Kim, Michael Zhang, Peter Y Lu, Marin Soljacic

ICML 2022 Perfectly Balanced: Improving Transfer and Robustness of Supervised Contrastive Learning Mayee Chen, Daniel Y Fu, Avanika Narayan, Michael Zhang, Zhao Song, Kayvon Fatahalian, Christopher Re

MLHC 2022 Reducing Reliance on Spurious Features in Medical Image Classification with Spatial Specificity Khaled Saab, Sarah Hooper, Mayee Chen, Michael Zhang, Daniel Rubin, Christopher Re

UAI 2022 Shoring up the Foundations: Fusing Model Embeddings and Weak Supervision Mayee F. Chen, Daniel Y. Fu, Dyah Adila, Michael Zhang, Frederic Sala, Kayvon Fatahalian, Christopher Ré

ICLR 2022 Triangle and Four Cycle Counting with Predictions in Graph Streams Justin Y Chen, Talya Eden, Piotr Indyk, Honghao Lin, Shyam Narayanan, Ronitt Rubinfeld, Sandeep Silwal, Tal Wagner, David Woodruff, Michael Zhang

AISTATS 2021 Latent Variable Modeling with Random Features Gregory Gundersen, Michael Zhang, Barbara Engelhardt

NeurIPSW 2021 Correct-N-Contrast: A Contrastive Approach for Improving Robustness to Spurious Correlations Michael Zhang, Nimit Sharad Sohoni, Hongyang R. Zhang, Chelsea Finn, Christopher Ré

NeurIPS 2021 Learning Domain Invariant Representations in Goal-Conditioned Block MDPs Beining Han, Chongyi Zheng, Harris Chan, Keiran Paster, Michael Zhang, Jimmy Ba

ICLR 2021 Personalized Federated Learning with First Order Model Optimization Michael Zhang, Karan Sapra, Sanja Fidler, Serena Yeung, Jose M. Alvarez

AISTATS 2020 Distributed, Partially Collapsed MCMC for Bayesian Nonparametrics Kumar Avinava Dubey, Michael Zhang, Eric Xing, Sinead Williamson

AISTATS 2020 Patient-Specific Effects of Medication Using Latent Force Models with Gaussian Processes Li-Fang Cheng, Bianca Dumitrascu, Michael Zhang, Corey Chivers, Michael Draugelis, Kai Li, Barbara Engelhardt

AAAI 2020 Reinforcement Mechanism Design: With Applications to Dynamic Pricing in Sponsored Search Auctions Weiran Shen, Binghui Peng, Hanpeng Liu, Michael Zhang, Ruohan Qian, Yan Hong, Zhi Guo, Zongyao Ding, Pengjun Lu, Pingzhong Tang

CoRL 2020 Soft Multicopter Control Using Neural Dynamics Identification Yitong Deng, Yaorui Zhang, Xingzhe He, Shuqi Yang, Yunjin Tong, Michael Zhang, Daniel DiPietro, Bo Zhu

NeurIPS 2019 Lookahead Optimizer: K Steps Forward, 1 Step Back Michael Zhang, James Lucas, Jimmy Ba, Geoffrey E. Hinton

NeurIPS 2018 Communication Efficient Parallel Algorithms for Optimization on Manifolds Bayan Saparbayeva, Michael Zhang, Lizhen Lin

CoRL 2017 Reverse Curriculum Generation for Reinforcement Learning Carlos Florensa, David Held, Markus Wulfmeier, Michael Zhang, Pieter Abbeel