Mazumder, Rahul

34 publications

NeurIPS 2025 3BASiL: An Algorithmic Framework for Sparse Plus Low-Rank Compression of LLMs Mehdi Makni, Xiang Meng, Rahul Mazumder

CPAL 2025 A Unified Framework for Sparse Plus Low-Rank Matrix Decomposition for LLMs Mehdi Makni, Kayhan Behdin, Zheng Xu, Natalia Ponomareva, Rahul Mazumder

NeurIPS 2025 Differentially Private High-Dimensional Variable Selection via Integer Programming Petros Prastakos, Kayhan Behdin, Rahul Mazumder

ICLR 2025 Preserving Deep Representations in One-Shot Pruning: A Hessian-Free Second-Order Optimization Framework Ryan Lucas, Rahul Mazumder

JMLR 2025 Randomization Can Reduce Both Bias and Variance: A Case Study in Random Forests Brian Liu, Rahul Mazumder

NeurIPS 2025 TSENOR: Highly-Efficient Algorithm for Finding Transposable N:M Sparse Masks Xiang Meng, Mehdi Makni, Rahul Mazumder

NeurIPS 2024 ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models Xiang Meng, Kayhan Behdin, Haoyue Wang, Rahul Mazumder

ICLRW 2024 Differentially Private Best Subset Selection via Integer Programming Kayhan Behdin, Peter Prastakos, Rahul Mazumder

AISTATS 2024 End-to-End Feature Selection Approach for Learning Skinny Trees Shibal Ibrahim, Kayhan Behdin, Rahul Mazumder

AISTATS 2024 FALCON: FLOP-Aware Combinatorial Optimization for Neural Network Pruning Xiang Meng, Wenyu Chen, Riade Benbaki, Rahul Mazumder

ICML 2024 OSSCAR: One-Shot Structured Pruning in Vision and Language Models with Combinatorial Optimization Xiang Meng, Shibal Ibrahim, Kayhan Behdin, Hussein Hazimeh, Natalia Ponomareva, Rahul Mazumder

JMLR 2024 Sparse NMF with Archetypal Regularization: Computational and Robustness Properties Kayhan Behdin, Rahul Mazumder

ICML 2023 Fast as CHITA: Neural Network Pruning with Combinatorial Optimization Riade Benbaki, Wenyu Chen, Xiang Meng, Hussein Hazimeh, Natalia Ponomareva, Zhe Zhao, Rahul Mazumder

AISTATS 2023 ForestPrune: Compact Depth-Pruned Tree Ensembles Brian Liu, Rahul Mazumder

NeurIPS 2023 GRAND-SLAMIN’ Interpretable Additive Modeling with Structural Constraints Shibal Ibrahim, Gabriel Afriat, Kayhan Behdin, Rahul Mazumder

MLOSS 2023 L0Learn: A Scalable Package for Sparse Learning Using L0 Regularization Hussein Hazimeh, Rahul Mazumder, Tim Nonet

NeurIPS 2023 On the Convergence of CART Under Sufficient Impurity Decrease Condition Rahul Mazumder, Haoyue Wang

NeurIPSW 2022 A Light-Speed Linear Program Solver for Personalized Recommendation with Diversity Constraints Haoyue Wang, Miao Cheng, Kinjal Basu, Aman Gupta, Sathiya Keerthi, Rahul Mazumder

NeurIPSW 2022 Improved Deep Neural Network Generalization Using M-Sharpness-Aware Minimization Kayhan Behdin, Qingquan Song, Aman Gupta, David Durfee, Ayan Acharya, Sathiya Keerthi, Rahul Mazumder

NeurIPSW 2022 Network Pruning at Scale: A Discrete Optimization Approach Wenyu Chen, Riade Benbaki, Xiang Meng, Rahul Mazumder

ECML-PKDD 2022 Newer Is Not Always Better: Rethinking Transferability Metrics, Their Peculiarities, Stability and Performance Shibal Ibrahim, Natalia Ponomareva, Rahul Mazumder

NeurIPS 2022 Pushing the Limits of Fairness Impossibility: Who's the Fairest of Them All? Brian Hsu, Rahul Mazumder, Preetam Nandy, Kinjal Basu

ICML 2022 Quant-BnB: A Scalable Branch-and-Bound Method for Optimal Decision Trees with Continuous Features Rahul Mazumder, Xiang Meng, Haoyue Wang

JMLR 2022 Solving L1-Regularized SVMs and Related Linear Programs: Revisiting the Effectiveness of Column and Constraint Generation Antoine Dedieu, Rahul Mazumder, Haoyue Wang

NeurIPS 2021 DSelect-K: Differentiable Selection in the Mixture of Experts with Applications to Multi-Task Learning Hussein Hazimeh, Zhe Zhao, Aakanksha Chowdhery, Maheswaran Sathiamoorthy, Yihua Chen, Rahul Mazumder, Lichan Hong, Ed Chi

JMLR 2021 Learning Sparse Classifiers: Continuous and Mixed Integer Optimization Perspectives Antoine Dedieu, Hussein Hazimeh, Rahul Mazumder

NeurIPSW 2021 Newer Is Not Always Better: Rethinking Transferability Metrics, Their Peculiarities, Stability and Performance Shibal Ibrahim, Natalia Ponomareva, Rahul Mazumder

ICML 2020 ECLIPSE: An Extreme-Scale Linear Program Solver for Web-Applications Kinjal Basu, Amol Ghoting, Rahul Mazumder, Yao Pan

AISTATS 2020 Learning Hierarchical Interactions at Scale: A Convex Optimization Approach Hussein Hazimeh, Rahul Mazumder

ICML 2020 The Tree Ensemble Layer: Differentiability Meets Conditional Computation Hussein Hazimeh, Natalia Ponomareva, Petros Mol, Zhenyu Tan, Rahul Mazumder

JMLR 2017 Certifiably Optimal Low Rank Factor Analysis Dimitris Bertsimas, Martin S. Copenhaver, Rahul Mazumder

JMLR 2015 Matrix Completion and Low-Rank SVD via Fast Alternating Least Squares Trevor Hastie, Rahul Mazumder, Jason D. Lee, Reza Zadeh

JMLR 2012 Exact Covariance Thresholding into Connected Components for Large-Scale Graphical Lasso Rahul Mazumder, Trevor Hastie

JMLR 2010 Spectral Regularization Algorithms for Learning Large Incomplete Matrices Rahul Mazumder, Trevor Hastie, Robert Tibshirani