Borzunov, Alexander

6 publications

ICLR 2024 SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression Tim Dettmers, Ruslan A. Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh

NeurIPS 2023 Distributed Inference and Fine-Tuning of Large Language Models over the Internet Alexander Borzunov, Max Ryabinin, Artem Chumachenko, Dmitry Baranchuk, Tim Dettmers, Younes Belkada, Pavel Samygin, Colin A Raffel

ICML 2023 SWARM Parallelism: Training Large Models Can Be Surprisingly Communication-Efficient Max Ryabinin, Tim Dettmers, Michael Diskin, Alexander Borzunov

NeurIPSW 2022 Petals: Collaborative Inference and Fine-Tuning of Large Models Alexander Borzunov, Dmitry Baranchuk, Tim Dettmers, Max Ryabinin, Younes Belkada, Artem Chumachenko, Pavel Samygin, Colin Raffel

ICML 2022 Secure Distributed Training at Scale Eduard Gorbunov, Alexander Borzunov, Michael Diskin, Max Ryabinin

NeurIPS 2021 Distributed Deep Learning in Open Collaborations Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, Quentin Lhoest, Anton Sinitsin, Dmitry Popov, Dmitry V. Pyrkin, Maxim Kashirin, Alexander Borzunov, Albert Villanova del Moral, Denis Mazur, Ilia Kobelev, Yacine Jernite, Thomas Wolf, Gennady Pekhimenko