Demystifying Multi-Faceted Video Summarization: Tradeoff Between Diversity, Representation, Coverage and Importance

Vishal Kaushal, Rishabh K. Iyer, Khoshrav Doctor, Anurag Sahoo, Pratik Dubal, Suraj Kothawade, Rohan Mahadev, Kunal Dargan, Ganesh Ramakrishnan

WACV 2019 pp. 452-461

doi:10.1109/WACV.2019.00054 /wacv/2019/kaushal2019wacv-demystifying/

Abstract

This paper addresses automatic summarization of videos in a unified manner. In particular, we propose a framework for multi-faceted summarization for extractive, query base and entity summarization (summarization at the level of entities like objects, scenes, humans and faces in the video). We investigate several summarization models which capture notions of diversity, coverage, representation and importance, and argue the utility of these different models depending on the application. While most of the prior work on submodular summarization approaches has focused on combining several models and learning weighted mixtures, we focus on the explainability of different models and featurizations, and how they apply to different domains. We also provide implementation details on summarization systems and the different modalities involved. We hope that the study from this paper will give insights into practitioners to appropriately choose the right summarization models for the problems at hand.

WACV Semantic Scholar

Cite

Text

Kaushal et al. "Demystifying Multi-Faceted Video Summarization: Tradeoff Between Diversity, Representation, Coverage and Importance." IEEE/CVF Winter Conference on Applications of Computer Vision, 2019. doi:10.1109/WACV.2019.00054

Markdown

[Kaushal et al. "Demystifying Multi-Faceted Video Summarization: Tradeoff Between Diversity, Representation, Coverage and Importance." IEEE/CVF Winter Conference on Applications of Computer Vision, 2019.](https://mlanthology.org/wacv/2019/kaushal2019wacv-demystifying/) doi:10.1109/WACV.2019.00054

BibTeX

@inproceedings{kaushal2019wacv-demystifying,
  title     = {{Demystifying Multi-Faceted Video Summarization: Tradeoff Between Diversity, Representation, Coverage and Importance}},
  author    = {Kaushal, Vishal and Iyer, Rishabh K. and Doctor, Khoshrav and Sahoo, Anurag and Dubal, Pratik and Kothawade, Suraj and Mahadev, Rohan and Dargan, Kunal and Ramakrishnan, Ganesh},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision},
  year      = {2019},
  pages     = {452-461},
  doi       = {10.1109/WACV.2019.00054},
  url       = {https://mlanthology.org/wacv/2019/kaushal2019wacv-demystifying/}
}