Islamov, Rustem

14 publications

ICLR 2025 Adaptive Methods Through the Lens of SDEs: Theoretical Insights on the Role of Noise Enea Monzio Compagnoni, Tianlin Liu, Rustem Islamov, Frank Norbert Proske, Antonio Orvieto, Aurelien Lucchi

NeurIPS 2025 Enhancing Optimizer Stability: Momentum Adaptation of the NGN Step-Size Rustem Islamov, Niccolò Ajroldi, Antonio Orvieto, Aurelien Lucchi

TMLR 2025 Partially Personalized Federated Learning: Breaking the Curse of Data Heterogeneity Konstantin Mishchenko, Rustem Islamov, Eduard Gorbunov, Samuel Horváth

ICML 2025 Safe-EF: Error Feedback for Non-Smooth Constrained Optimization Rustem Islamov, Yarden As, Ilyas Fatkhullin

ICLR 2025 Towards Faster Decentralized Stochastic Optimization with Communication Compression Rustem Islamov, Yuan Gao, Sebastian U Stich

AISTATS 2025 Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs Enea Monzio Compagnoni, Rustem Islamov, Frank Norbert Proske, Aurelien Lucchi

AISTATS 2024 AsGrad: A Sharp Unified Analysis of Asynchronous-SGD Algorithms Rustem Islamov, Mher Safaryan, Dan Alistarh

ICLR 2024 EControl: Fast Distributed Optimization with Compression and Error Control Yuan Gao, Rustem Islamov, Sebastian U Stich

NeurIPS 2024 Loss Landscape Characterization of Neural Networks Without Over-Parametrization Rustem Islamov, Niccoló Ajroldi, Antonio Orvieto, Aurelien Lucchi

TMLR 2023 Adaptive Compression for Communication-Efficient Distributed Training Maksim Makarenko, Elnur Gasanov, Abdurakhmon Sadiev, Rustem Islamov, Peter Richtárik

TMLR 2023 Distributed Newton-Type Methods with Communication Compression and Bernoulli Aggregation Rustem Islamov, Xun Qian, Slavomir Hanzely, Mher Safaryan, Peter Richtárik

AISTATS 2022 Basis Matters: Better Communication-Efficient Second Order Methods for Federated Learning Xun Qian, Rustem Islamov, Mher Safaryan, Peter Richtarik

ICML 2022 FedNL: Making Newton-Type Methods Applicable to Federated Learning Mher Safaryan, Rustem Islamov, Xun Qian, Peter Richtarik

ICML 2021 Distributed Second Order Methods with Fast Rates and Compressed Communication Rustem Islamov, Xun Qian, Peter Richtarik