Interpolation-Based Object Detection Using Motion Vectors for Embedded Real-Time Tracking Systems

Takayuki Ujiie, Masayuki Hiromoto, Takashi Sato

CVPRW 2018 pp. 616-624

doi:10.1109/CVPRW.2018.00104 /cvprw/2018/ujiie2018cvprw-interpolationbased/

Abstract

Deep convolutional neural networks (CNNs) have achieved outstanding performance in object detection, a crucial task in computer vision. With the computational intensiveness due to repeated convolutions, they consume large amount of power, making them difficult to apply in power-constrained embedded platforms. In this work, we present MVint, a power-efficient detection and tracking framework. MVint combines motion-vector-based interpolator and CNN-based detector to simultaneously achieve high accuracy and energy efficiency by utilizing motion vectors obtained inexpensively in the environments wherein encoding is conducted at the cameras. Through evaluations using MOT16 benchmark that evaluates multiple object tracking, we show MVint maintains 88% MOTA while reducing detection frequency down to 1/12. An implemention of MVint as a system prototype on Xilinx Zynq Ultra-Scale+ MPSoC ZCU102 confirmed that MVint achieves an ideal 12x FPS compared with a vanilla detection approach.

CVPRW Semantic Scholar

Cite

Text

Ujiie et al. "Interpolation-Based Object Detection Using Motion Vectors for Embedded Real-Time Tracking Systems." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018. doi:10.1109/CVPRW.2018.00104

Markdown

[Ujiie et al. "Interpolation-Based Object Detection Using Motion Vectors for Embedded Real-Time Tracking Systems." IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, 2018.](https://mlanthology.org/cvprw/2018/ujiie2018cvprw-interpolationbased/) doi:10.1109/CVPRW.2018.00104

BibTeX

@inproceedings{ujiie2018cvprw-interpolationbased,
  title     = {{Interpolation-Based Object Detection Using Motion Vectors for Embedded Real-Time Tracking Systems}},
  author    = {Ujiie, Takayuki and Hiromoto, Masayuki and Sato, Takashi},
  booktitle = {IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops},
  year      = {2018},
  pages     = {616-624},
  doi       = {10.1109/CVPRW.2018.00104},
  url       = {https://mlanthology.org/cvprw/2018/ujiie2018cvprw-interpolationbased/}
}