ML Anthology

Weight Banding

Michael Petrov, Chelsea Voss, Ludwig Schubert, Nick Cammarata, Gabriel Goh, Chris Olah
Distill 2021
doi:10.23915/distill.00024.009 /distill/2021/petrov2021distill-weight/

Abstract

Distill articles are interactive publications and do not include traditional abstracts. This summary was written for the ML Anthology. Investigates the horizontal banding patterns that appear in the final layer weights of common vision models using global average pooling, explaining the structural cause of this phenomenon.

Distill Code Semantic Scholar

Cite

Text

Petrov et al. "Weight Banding." Distill, 2021. doi:10.23915/distill.00024.009

Markdown

[Petrov et al. "Weight Banding." Distill, 2021.](https://mlanthology.org/distill/2021/petrov2021distill-weight/) doi:10.23915/distill.00024.009

BibTeX

@article{petrov2021distill-weight,
  title     = {{Weight Banding}},
  author    = {Petrov, Michael and Voss, Chelsea and Schubert, Ludwig and Cammarata, Nick and Goh, Gabriel and Olah, Chris},
  journal   = {Distill},
  year      = {2021},
  doi       = {10.23915/distill.00024.009},
  url       = {https://mlanthology.org/distill/2021/petrov2021distill-weight/}
}