AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies
Abstract
Visual correspondence of 2D animation is the core of many applications and deserves careful study. Existing correspondence datasets for 2D cartoon suffer from simple frame composition and monotonic movements, making them insufficient to simulate real animations. In this work, we present a new 2D animation visual correspondence dataset, AnimeRun, by converting open source 3D movies to full scenes in 2D style, including simultaneous moving background and interactions of multiple subjects. Statistics show that our proposed dataset not only resembles real anime more in image composition, but also possesses richer and more complex motion patterns compared to existing datasets. With this dataset, we establish a comprehensive benchmark by evaluating several existing optical flow and segment matching methods, and analyze shortcomings of these methods on animation data. Data are available at https://lisiyao21.github.io/projects/AnimeRun.
Cite
Text
Siyao et al. "AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies." Neural Information Processing Systems, 2022.Markdown
[Siyao et al. "AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies." Neural Information Processing Systems, 2022.](https://mlanthology.org/neurips/2022/siyao2022neurips-animerun/)BibTeX
@inproceedings{siyao2022neurips-animerun,
title = {{AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies}},
author = {Siyao, Li and Li, Yuhang and Li, Bo and Dong, Chao and Liu, Ziwei and Loy, Chen Change},
booktitle = {Neural Information Processing Systems},
year = {2022},
url = {https://mlanthology.org/neurips/2022/siyao2022neurips-animerun/}
}