Likhosherstov, Valerii

18 publications

AISTATS 2024 Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers Krzysztof Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamas Sarlos, Thomas Weingarten, Adrian Weller

ICLR 2024 Scalable Neural Network Kernels Arijit Sehanobish, Krzysztof Marcin Choromanski, Yunfan Zhao, Kumar Avinava Dubey, Valerii Likhosherstov

ICML 2023 Adaptive Computation with Elastic Input Sequence Fuzhao Xue, Valerii Likhosherstov, Anurag Arnab, Neil Houlsby, Mostafa Dehghani, Yang You

NeurIPS 2023 Dense-Exponential Random Features: Sharp Positive Estimators of the Gaussian Kernel Valerii Likhosherstov, Krzysztof M Choromanski, Kumar Avinava Dubey, Frederick Liu, Tamas Sarlos, Adrian Weller

ICML 2023 Efficient Graph Field Integrators Meet Point Clouds Krzysztof Marcin Choromanski, Arijit Sehanobish, Han Lin, Yunfan Zhao, Eli Berger, Tetiana Parshakova, Alvin Pan, David Watkins, Tianyi Zhang, Valerii Likhosherstov, Somnath Basu Roy Chowdhury, Kumar Avinava Dubey, Deepali Jain, Tamas Sarlos, Snigdha Chaturvedi, Adrian Weller

AAAI 2023 On the Expressive Flexibility of Self-Attention Matrices Valerii Likhosherstov, Krzysztof Choromanski, Adrian Weller

TMLR 2023 PolyViT: Co-Training Vision Transformers on Images, Videos and Audio Valerii Likhosherstov, Anurag Arnab, Krzysztof Marcin Choromanski, Mario Lucic, Yi Tay, Mostafa Dehghani

ICML 2023 Simplex Random Features Isaac Reid, Krzysztof Marcin Choromanski, Valerii Likhosherstov, Adrian Weller

NeurIPS 2022 Chefs' Random Tables: Non-Trigonometric Random Features Valerii Likhosherstov, Krzysztof M Choromanski, Kumar Avinava Dubey, Frederick Liu, Tamas Sarlos, Adrian Weller

ICML 2022 From Block-Toeplitz Matrices to Differential Equations on Graphs: Towards a General Theory for Scalable Masked Transformers Krzysztof Choromanski, Han Lin, Haoxian Chen, Tianyi Zhang, Arijit Sehanobish, Valerii Likhosherstov, Jack Parker-Holder, Tamas Sarlos, Adrian Weller, Thomas Weingarten

ICLR 2022 Hybrid Random Features Krzysztof Marcin Choromanski, Han Lin, Haoxian Chen, Arijit Sehanobish, Yuanzhe Ma, Deepali Jain, Jake Varley, Andy Zeng, Michael S Ryoo, Valerii Likhosherstov, Dmitry Kalashnikov, Vikas Sindhwani, Adrian Weller

AISTATS 2021 CWY Parametrization: A Solution for Parallelized Optimization of Orthogonal and Stiefel Matrices Valerii Likhosherstov, Jared Davis, Krzysztof Choromanski, Adrian Weller

ICML 2021 Debiasing a First-Order Heuristic for Approximate Bi-Level Optimization Valerii Likhosherstov, Xingyou Song, Krzysztof Choromanski, Jared Q Davis, Adrian Weller

ICLR 2021 Rethinking Attention with Performers Krzysztof Marcin Choromanski, Valerii Likhosherstov, David Dohan, Xingyou Song, Andreea Gane, Tamas Sarlos, Peter Hawkins, Jared Quincy Davis, Afroz Mohiuddin, Lukasz Kaiser, David Benjamin Belanger, Lucy J Colwell, Adrian Weller

NeurIPS 2021 Sub-Linear Memory: How to Make Performers SLiM Valerii Likhosherstov, Krzysztof M Choromanski, Jared Quincy Davis, Xingyou Song, Adrian Weller

NeurIPS 2020 Ode to an ODE Krzysztof M Choromanski, Jared Quincy Davis, Valerii Likhosherstov, Xingyou Song, Jean-Jacques Slotine, Jacob Varley, Honglak Lee, Adrian Weller, Vikas Sindhwani

ICML 2020 Stochastic Flows and Geometric Optimization on the Orthogonal Group Krzysztof Choromanski, David Cheikhi, Jared Davis, Valerii Likhosherstov, Achille Nazaret, Achraf Bahamou, Xingyou Song, Mrugank Akarte, Jack Parker-Holder, Jacob Bergquist, Yuan Gao, Aldo Pacchiano, Tamas Sarlos, Adrian Weller, Vikas Sindhwani

ICML 2019 Inference and Sampling of $k_33$-Free Ising Models Valerii Likhosherstov, Yury Maximov, Misha Chertkov