Sardana, Nikhil

4 publications

ICML 2024 Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws Nikhil Sardana, Jacob Portes, Sasha Doubov, Jonathan Frankle

NeurIPS 2023 MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining Jacob Portes, Alexander Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle

ICMLW 2023 MosaicBERT: How to Train BERT with a Lunch Money Budget Jacob Portes, Alexander R Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle

ICLR 2022 Autonomous Reinforcement Learning: Formalism and Benchmarking Archit Sharma, Kelvin Xu, Nikhil Sardana, Abhishek Gupta, Karol Hausman, Sergey Levine, Chelsea Finn