ML Anthology

An FPGA-Based Stream Processor for Embedded Real-Time Vision with Convolutional Networks

Clément Farabet, Cyril Poulet, Yann LeCun
ICCVW 2009 pp. 878-885
doi:10.1109/ICCVW.2009.5457611 /iccvw/2009/farabet2009iccvw-fpgabased/

Abstract

Many recent visual recognition systems can be seen as being composed of multiple layers of convolutional filter banks, interspersed with various types of non-linearities. This includes Convolutional Networks, HMAX-type architectures, as well as systems based on dense SIFT features or Histogram of Gradients. This paper describes a highly-compact and low power embedded system that can run such vision systems at very high speed. A custom board built around a Xilinx Virtex-4 FPGA was built and tested. It measures 70 × 80 mm, and the complete system-FPGA, camera, memory chips, flash-consumes 15 watts in peak, and is capable of more than 4 × 10 <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">9</sup> multiply-accumulate operations per second in real vision application. This enables real-time implementations of object detection, object recognition, and vision-based navigation algorithms in small-size robots, micro-UAVs, and hand-held devices. Real-time face detection is demonstrated, with speeds of 10 frames per second at VGA resolution.

ICCVW Semantic Scholar

Cite

Text

Farabet et al. "An FPGA-Based Stream Processor for Embedded Real-Time Vision with Convolutional Networks." IEEE/CVF International Conference on Computer Vision Workshops, 2009. doi:10.1109/ICCVW.2009.5457611

Markdown

[Farabet et al. "An FPGA-Based Stream Processor for Embedded Real-Time Vision with Convolutional Networks." IEEE/CVF International Conference on Computer Vision Workshops, 2009.](https://mlanthology.org/iccvw/2009/farabet2009iccvw-fpgabased/) doi:10.1109/ICCVW.2009.5457611

BibTeX

@inproceedings{farabet2009iccvw-fpgabased,
  title     = {{An FPGA-Based Stream Processor for Embedded Real-Time Vision with Convolutional Networks}},
  author    = {Farabet, Clément and Poulet, Cyril and LeCun, Yann},
  booktitle = {IEEE/CVF International Conference on Computer Vision Workshops},
  year      = {2009},
  pages     = {878-885},
  doi       = {10.1109/ICCVW.2009.5457611},
  url       = {https://mlanthology.org/iccvw/2009/farabet2009iccvw-fpgabased/}
}