CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions
Abstract
Recent advances in Artificial Intelligence and deep learning have revived the interest in studying the gap between the reasoning capabilities of humans and machines. In this ongoing work, we introduce CRAFT, a new visual question answering dataset that requires causal reasoning about physical forces and object interactions. It contains 38K video and question pairs that are generated from 3K videos from 10 different virtual environments, containing different number of objects in motion that interact with each other. Two question categories from CRAFT include previously studied descriptive and counterfactual questions. Besides, inspired by the theory of force dynamics from the field of human cognitive psychology, we introduce new question categories that involve understanding the intentions of objects through the notions of cause, enable, and prevent. Our preliminary results demonstrate that even though these tasks are very intuitive for humans, the implemented baselines could not cope with the underlying challenges.
Cite
Text
Ates et al. "CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions." NeurIPS 2020 Workshops: SVRHM, 2020.Markdown
[Ates et al. "CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions." NeurIPS 2020 Workshops: SVRHM, 2020.](https://mlanthology.org/neuripsw/2020/ates2020neuripsw-craft/)BibTeX
@inproceedings{ates2020neuripsw-craft,
title = {{CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractions}},
author = {Ates, Tayfun and Atesoglu, Muhammed Samil and Yigit, Cagatay and Kesen, Ilker and Kobas, Mert and Erdem, Erkut and Erdem, Aykut and Goksun, Tilbe and Yuret, Deniz},
booktitle = {NeurIPS 2020 Workshops: SVRHM},
year = {2020},
url = {https://mlanthology.org/neuripsw/2020/ates2020neuripsw-craft/}
}