Stich, Sebastian

16 publications

NeurIPS 2024 Universality of AdaGrad Stepsizes for Stochastic Optimization: Inexact Oracle, Acceleration and Variance Reduction Anton Rodomanov, Xiaowen Jiang, Sebastian Stich

AISTATS 2022 Masked Training of Neural Networks with Partial Gradients Amirkeivan Mohtashami, Martin Jaggi, Sebastian Stich

ICML 2022 ProgFed: Effective, Communication, and Computation Efficient Federated Learning by Progressive Training Hui-Po Wang, Sebastian Stich, Yang He, Mario Fritz

ICML 2022 ProxSkip: Yes! Local Gradient Steps Provably Lead to Communication Acceleration! Finally! Konstantin Mishchenko, Grigory Malinovsky, Sebastian Stich, Peter Richtarik

AISTATS 2021 A Linearly Convergent Algorithm for Decentralized Optimization: Sending Less Bits for Free! Dmitry Kovalev, Anastasia Koloskova, Martin Jaggi, Peter Richtarik, Sebastian Stich

AISTATS 2021 Critical Parameters for Scalable Distributed Learning with Large Batches and Asynchronous Updates Sebastian Stich, Amirkeivan Mohtashami, Martin Jaggi

AISTATS 2021 LENA: Communication-Efficient Distributed Learning with Self-Triggered Gradient Uploads Hossein Shokri Ghadikolaei, Sebastian Stich, Martin Jaggi

ICML 2021 Consensus Control for Decentralized Deep Learning Lingjing Kong, Tao Lin, Anastasia Koloskova, Martin Jaggi, Sebastian Stich

ICML 2021 Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data Tao Lin, Sai Praneeth Karimireddy, Sebastian Stich, Martin Jaggi

ICML 2020 A Unified Theory of Decentralized SGD with Changing Topology and Local Updates Anastasia Koloskova, Nicolas Loizou, Sadra Boreiri, Martin Jaggi, Sebastian Stich

ICML 2020 Extrapolation for Large-Batch Training in Deep Learning Tao Lin, Lingjing Kong, Sebastian Stich, Martin Jaggi

ICML 2020 Is Local SGD Better than Minibatch SGD? Blake Woodworth, Kumar Kshitij Patel, Sebastian Stich, Zhen Dai, Brian Bullins, Brendan Mcmahan, Ohad Shamir, Nathan Srebro

ICML 2020 SCAFFOLD: Stochastic Controlled Averaging for Federated Learning Sai Praneeth Karimireddy, Satyen Kale, Mehryar Mohri, Sashank Reddi, Sebastian Stich, Ananda Theertha Suresh

ICML 2019 Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication Anastasia Koloskova, Sebastian Stich, Martin Jaggi

ICML 2019 Error Feedback Fixes SignSGD and Other Gradient Compression Schemes Sai Praneeth Karimireddy, Quentin Rebjock, Sebastian Stich, Martin Jaggi

ICML 2018 On Matching Pursuit and Coordinate Descent Francesco Locatello, Anant Raj, Sai Praneeth Karimireddy, Gunnar Raetsch, Bernhard Schölkopf, Sebastian Stich, Martin Jaggi