A Cookbook for Hardware-Friendly Implicit Learning on Static Data

Abstract

The following aims to be a pragmatic introduction to hardware-friendly learning of implicit models, which encompass a broad class of models from feedforward nets to physical systems, taking static data as inputs. Starting from first principles, we present a minimal hierarchy of independent concepts to circumvent some problems inherent to the hardware implementation of standard differentiation. This way, we avoid entangling essential ingredients with arbitrary design choices by naively listing existing algorithms and instead propose the draft of a “cookbook” to help the exploration of many possible combinations of these independent mechanisms.

Cite

Text

Ernoult et al. "A Cookbook for Hardware-Friendly Implicit Learning on Static Data." NeurIPS 2024 Workshops: MLNCP, 2024.

Markdown

[Ernoult et al. "A Cookbook for Hardware-Friendly Implicit Learning on Static Data." NeurIPS 2024 Workshops: MLNCP, 2024.](https://mlanthology.org/neuripsw/2024/ernoult2024neuripsw-cookbook/)

BibTeX

@inproceedings{ernoult2024neuripsw-cookbook,
  title     = {{A Cookbook for Hardware-Friendly Implicit Learning on Static Data}},
  author    = {Ernoult, Maxence and Høier, Rasmus and Kendall, Jack},
  booktitle = {NeurIPS 2024 Workshops: MLNCP},
  year      = {2024},
  url       = {https://mlanthology.org/neuripsw/2024/ernoult2024neuripsw-cookbook/}
}