Identifying and Interpreting Tuning Dimensions in Deep Networks

Abstract

In neuroscience, a tuning dimension is a stimulus attribute that accounts for much of the activation variance of a group of neurons. These are commonly used to decipher the responses of such groups. While researchers have attempted to manually identify an analogue to these tuning dimensions in deep neural networks, we are unaware of an automatic way to discover them. This work contributes an unsupervised framework for identifying and interpreting "tuning dimensions" in deep networks. Our method correctly identifies the tuning dimensions of a synthetic Gabor filter bank and tuning dimensions of the first two layers of InceptionV1 trained on ImageNet.

Cite

Text

Dey et al. "Identifying and Interpreting Tuning Dimensions in Deep Networks." NeurIPS 2020 Workshops: SVRHM, 2020.

Markdown

[Dey et al. "Identifying and Interpreting Tuning Dimensions in Deep Networks." NeurIPS 2020 Workshops: SVRHM, 2020.](https://mlanthology.org/neuripsw/2020/dey2020neuripsw-identifying/)

BibTeX

@inproceedings{dey2020neuripsw-identifying,
  title     = {{Identifying and Interpreting Tuning Dimensions in Deep Networks}},
  author    = {Dey, Nolan Simran and Taylor, Eric and Tripp, Bryan P. and Wong, Alexander and Taylor, Graham W},
  booktitle = {NeurIPS 2020 Workshops: SVRHM},
  year      = {2020},
  url       = {https://mlanthology.org/neuripsw/2020/dey2020neuripsw-identifying/}
}