ML Anthology
Authors
Search
About
Nadeem, Moin
2 publications
NeurIPS
2023
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining
Jacob Portes
,
Alexander Trott
,
Sam Havens
,
Daniel King
,
Abhinav Venigalla
,
Moin Nadeem
,
Nikhil Sardana
,
Daya Khudia
,
Jonathan Frankle
ICMLW
2023
MosaicBERT: How to Train BERT with a Lunch Money Budget
Jacob Portes
,
Alexander R Trott
,
Sam Havens
,
Daniel King
,
Abhinav Venigalla
,
Moin Nadeem
,
Nikhil Sardana
,
Daya Khudia
,
Jonathan Frankle