ML Anthology

Learning Efficient Deep Feature Representations via Transgenerational Genetic Transmission of Environmental Information During Evolutionary Synthesis of Deep Neural Networks

M. J. Shafiee, Elnaz Barshan, Francis Li, Brendan Chwyl, Michelle Karg, Christian Scharfenberger, Alexander Wong
ICCVW 2017 pp. 979-986
doi:10.1109/ICCVW.2017.120 /iccvw/2017/shafiee2017iccvw-learning/

Abstract

The computational complexity of deep neural networks for extracting deep features is a significant barrier to widespread adoption, particularly for use in embedded devices. One strategy to addressing the complexity issue is the evolutionary deep intelligence framework, which has been demonstrated to enable the synthesis of highly efficient deep neural networks that retain modeling performance. Here, we introduce the notion of trans-generational genetic transmission into the evolutionary deep intelligence framework, where the intra-generational environmental traumatic stresses are imposed to synapses during training to favor the synthesis of more efficient deep neural networks over successive generations. Results demonstrate the efficacy of the proposed framework for synthesizing networks with significant decreases in synapses (e.g., for SVHN dataset, a 230-fold increase in architectural efficiency) while maintaining modeling accuracy and a significantly more efficient feature representation.

ICCVW Semantic Scholar

Cite

Text

Shafiee et al. "Learning Efficient Deep Feature Representations via Transgenerational Genetic Transmission of Environmental Information During Evolutionary Synthesis of Deep Neural Networks." IEEE/CVF International Conference on Computer Vision Workshops, 2017. doi:10.1109/ICCVW.2017.120

Markdown

[Shafiee et al. "Learning Efficient Deep Feature Representations via Transgenerational Genetic Transmission of Environmental Information During Evolutionary Synthesis of Deep Neural Networks." IEEE/CVF International Conference on Computer Vision Workshops, 2017.](https://mlanthology.org/iccvw/2017/shafiee2017iccvw-learning/) doi:10.1109/ICCVW.2017.120

BibTeX

@inproceedings{shafiee2017iccvw-learning,
  title     = {{Learning Efficient Deep Feature Representations via Transgenerational Genetic Transmission of Environmental Information During Evolutionary Synthesis of Deep Neural Networks}},
  author    = {Shafiee, M. J. and Barshan, Elnaz and Li, Francis and Chwyl, Brendan and Karg, Michelle and Scharfenberger, Christian and Wong, Alexander},
  booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
  year      = {2017},
  pages     = {979-986},
  doi       = {10.1109/ICCVW.2017.120},
  url       = {https://mlanthology.org/iccvw/2017/shafiee2017iccvw-learning/}
}