ML Anthology
Authors
Search
About
Donchev, Yani
1 publications
ICMLW
2024
DiLoCo: Distributed Low-Communication Training of Language Models
Arthur Douillard
,
Qixuan Feng
,
Andrei Alex Rusu
,
Rachita Chhaparia
,
Yani Donchev
,
Adhiguna Kuncoro
,
MarcAurelio Ranzato
,
Arthur Szlam
,
Jiajun Shen