ML Anthology

Video Super-Resolution with Temporal Group Attention

Takashi Isobe, Songjiang Li, Xu Jia, Shanxin Yuan, Gregory Slabaugh, Chunjing Xu, Ya-Li Li, Shengjin Wang, Qi Tian
CVPR 2020
doi:10.1109/CVPR42600.2020.00803 /cvpr/2020/isobe2020cvpr-video/

Abstract

Video super-resolution, which aims at producing a high-resolution video from its corresponding low-resolution version, has recently drawn increasing attention. In this work, we propose a novel method that can effectively incorporate temporal information in a hierarchical way. The input sequence is divided into several groups, with each one corresponding to a kind of frame rate. These groups provide complementary information to recover missing details in the reference frame, which is further integrated with an attention module and a deep intra-group fusion module. In addition, a fast spatial alignment is proposed to handle videos with large motion. Extensive results demonstrate the capability of the proposed model in handling videos with various motion. It achieves favorable performance against state-of-the-art methods on several benchmark datasets.

PDF CVPR Semantic Scholar

Cite

Text

Isobe et al. "Video Super-Resolution with Temporal Group Attention." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020. doi:10.1109/CVPR42600.2020.00803

Markdown

[Isobe et al. "Video Super-Resolution with Temporal Group Attention." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2020.](https://mlanthology.org/cvpr/2020/isobe2020cvpr-video/) doi:10.1109/CVPR42600.2020.00803

BibTeX

@inproceedings{isobe2020cvpr-video,
  title     = {{Video Super-Resolution with Temporal Group Attention}},
  author    = {Isobe, Takashi and Li, Songjiang and Jia, Xu and Yuan, Shanxin and Slabaugh, Gregory and Xu, Chunjing and Li, Ya-Li and Wang, Shengjin and Tian, Qi},
  booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  year      = {2020},
  doi       = {10.1109/CVPR42600.2020.00803},
  url       = {https://mlanthology.org/cvpr/2020/isobe2020cvpr-video/}
}