Banner, Ron

19 publications

NeurIPS 2025 FP4 All the Way: Fully Quantized Training of Large Language Models Brian Chmiel, Maxim Fishman, Ron Banner, Daniel Soudry

ICLR 2025 Scaling FP8 Training to Trillion-Token LLMs Maxim Fishman, Brian Chmiel, Ron Banner, Daniel Soudry

NeurIPSW 2024 EXAQ: Exponent Aware Quantization for LLMs Acceleration Moran Shkolnik, Maxim Fishman, Brian Chmiel, Hilla Ben-Yaacov, Ron Banner, Kfir Yehuda Levy

ICLR 2023 Accurate Neural Training with 4-Bit Matrix Multiplications at Standard Formats Brian Chmiel, Ron Banner, Elad Hoffer, Hilla Ben-Yaacov, Daniel Soudry

NeurIPS 2023 DropCompute: Simple and More Robust Distributed Synchronous Training via Compute Variance Reduction Niv Giladi, Shahar Gottlieb, Moran Shkolnik, Asaf Karnieli, Ron Banner, Elad Hoffer, Kfir Y. Levy, Daniel Soudry

ICLR 2023 Minimum Variance Unbiased N:M Sparsity for the Neural Gradients Brian Chmiel, Itay Hubara, Ron Banner, Daniel Soudry

ICLRW 2022 On Recoverability of Graph Neural Network Representations Maxim Fishman, Chaim Baskin, Evgenii Zheltonozhskii, Ron Banner, Avi Mendelson

ECCVW 2022 Power Awareness in Low Precision Neural Networks Nurit Spingarn-Eliezer, Ron Banner, Hilla Ben-Yaacov, Elad Hoffer, Tomer Michaeli

NeurIPS 2021 Accelerated Sparse Neural Training: A Provable and Efficient Method to Find N:M Transposable Masks Itay Hubara, Brian Chmiel, Moshe Island, Ron Banner, Joseph Naor, Daniel Soudry

ICML 2021 Accurate Post Training Quantization with Small Calibration Sets Itay Hubara, Yury Nahshan, Yair Hanani, Ron Banner, Daniel Soudry

JMLR 2021 CAT: Compression-Aware Training for Bandwidth Reduction Chaim Baskin, Brian Chmiel, Evgenii Zheltonozhskii, Ron Banner, Alex M. Bronstein, Avi Mendelson

ICLR 2021 GAN "Steerability" Without Optimization Nurit Spingarn, Ron Banner, Tomer Michaeli

MLJ 2021 Loss Aware Post-Training Quantization Yury Nahshan, Brian Chmiel, Chaim Baskin, Evgenii Zheltonozhskii, Ron Banner, Alex M. Bronstein, Avi Mendelson

ICLR 2021 Neural Gradients Are Near-Lognormal: Improved Quantized and Sparse Training Brian Chmiel, Liad Ben-Uri, Moran Shkolnik, Elad Hoffer, Ron Banner, Daniel Soudry

NeurIPS 2020 Robust Quantization: One Model to Rule Them All Moran Shkolnik, Brian Chmiel, Ron Banner, Gil Shomron, Yury Nahshan, Alex Bronstein, Uri Weiser

ECCV 2020 Thanks for Nothing: Predicting Zero-Valued Activations with Lightweight Convolutional Neural Networks Gil Shomron, Ron Banner, Moran Shkolnik, Uri Weiser

NeurIPS 2019 Post Training 4-Bit Quantization of Convolutional Networks for Rapid-Deployment Ron Banner, Yury Nahshan, Daniel Soudry

NeurIPS 2018 Norm Matters: Efficient and Accurate Normalization Schemes in Deep Networks Elad Hoffer, Ron Banner, Itay Golan, Daniel Soudry

NeurIPS 2018 Scalable Methods for 8-Bit Training of Neural Networks Ron Banner, Itay Hubara, Elad Hoffer, Daniel Soudry