Portes, Jacob

8 publications

ICML 2024 Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws Nikhil Sardana, Jacob Portes, Sasha Doubov, Jonathan Frankle

TMLR 2024 LoRA Learns Less and Forgets Less Dan Biderman, Jacob Portes, Jose Javier Gonzalez Ortiz, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John Patrick Cunningham

NeurIPSW 2024 Long Context RAG Performance of Large Language Models Quinn Leng, Jacob Portes, Sam Havens, Matei Zaharia, Michael Carbin

NeurIPSW 2023 LIMIT: Less Is More for Instruction Tuning Across Evaluation Paradigms Aditi Jha, Sam Havens, Jeremy Dohmann, Alexander Trott, Jacob Portes

NeurIPS 2023 MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining Jacob Portes, Alexander Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle

ICMLW 2023 MosaicBERT: How to Train BERT with a Lunch Money Budget Jacob Portes, Alexander R Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle

NeurIPS 2022 Distinguishing Learning Rules with Brain Machine Interfaces Jacob Portes, Christian Schmid, James M Murray

NeurIPSW 2022 Fast Benchmarking of Accuracy vs. Training Time with Cyclic Learning Rates Jacob Portes, Davis Blalock, Cory Stephenson, Jonathan Frankle