Gradient Driven Learning for Pooling in Visual Pipeline Feature Extraction Models
Abstract
Hyper-parameter selection remains a daunting task when building a pattern recognition architecture which performs well, particularly in recently constructed visual pipeline models for feature extraction. We re-formulate pooling in an existing pipeline as a function of adjustable pooling map weight parameters and propose the use of supervised error signals from gradient descent to tune the established maps within the model. This technique allows us to learn what would otherwise be a design choice within the model and specialize the maps to aggregate areas of invariance for the task presented. Preliminary results show moderate potential gains in classification accuracy and highlight areas of importance within the intermediate feature representation space.
Cite
Text
Rose and Arel. "Gradient Driven Learning for Pooling in Visual Pipeline Feature Extraction Models." International Conference on Learning Representations, 2013.Markdown
[Rose and Arel. "Gradient Driven Learning for Pooling in Visual Pipeline Feature Extraction Models." International Conference on Learning Representations, 2013.](https://mlanthology.org/iclr/2013/rose2013iclr-gradient/)BibTeX
@inproceedings{rose2013iclr-gradient,
title = {{Gradient Driven Learning for Pooling in Visual Pipeline Feature Extraction Models}},
author = {Rose, Derek C. and Arel, Itamar},
booktitle = {International Conference on Learning Representations},
year = {2013},
url = {https://mlanthology.org/iclr/2013/rose2013iclr-gradient/}
}