Kerg, Giancarlo

5 publications

ICLR 2022 Continuous-Time Meta-Learning with Forward Mode Differentiation Tristan Deleu, David Kanaa, Leo Feng, Giancarlo Kerg, Yoshua Bengio, Guillaume Lajoie, Pierre-Luc Bacon

ICLRW 2022 Inductive Biases for Relational Tasks Giancarlo Kerg, Sarthak Mittal, David Rolnick, Yoshua Bengio, Blake Aaron Richards, Guillaume Lajoie

NeurIPS 2020 Untangling Tradeoffs Between Recurrence and Self-Attention in Artificial Neural Networks Giancarlo Kerg, Bhargav Kanuparthi, Anirudh Goyal ALIAS PARTH Goyal, Kyle Goyette, Yoshua Bengio, Guillaume Lajoie

ICLR 2019 H-Detach: Modifying the LSTM Gradient Towards Better Optimization Bhargav Kanuparthi, Devansh Arpit, Giancarlo Kerg, Nan Rosemary Ke, Ioannis Mitliagkas, Yoshua Bengio

NeurIPS 2019 Non-Normal Recurrent Neural Network (nnRNN): Learning Long Time Dependencies While Improving Expressivity with Transient Dynamics Giancarlo Kerg, Kyle Goyette, Maximilian Puelma Touzel, Gauthier Gidel, Eugene Vorontsov, Yoshua Bengio, Guillaume Lajoie