TallyQA: Answering Complex Counting Questions

Abstract

Most counting questions in visual question answering (VQA) datasets are simple and require no more than object detection. Here, we study algorithms for complex counting questions that involve relationships between objects, attribute identification, reasoning, and more. To do this, we created TallyQA, the world’s largest dataset for open-ended counting. We propose a new algorithm for counting that uses relation networks with region proposals. Our method lets relation networks be efficiently used with high-resolution imagery. It yields stateof-the-art results compared to baseline and recent systems on both TallyQA and the HowMany-QA benchmark.

Cite

Text

Acharya et al. "TallyQA: Answering Complex Counting Questions." AAAI Conference on Artificial Intelligence, 2019. doi:10.1609/AAAI.V33I01.33018076

Markdown

[Acharya et al. "TallyQA: Answering Complex Counting Questions." AAAI Conference on Artificial Intelligence, 2019.](https://mlanthology.org/aaai/2019/acharya2019aaai-tallyqa/) doi:10.1609/AAAI.V33I01.33018076

BibTeX

@inproceedings{acharya2019aaai-tallyqa,
  title     = {{TallyQA: Answering Complex Counting Questions}},
  author    = {Acharya, Manoj and Kafle, Kushal and Kanan, Christopher},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {2019},
  pages     = {8076-8084},
  doi       = {10.1609/AAAI.V33I01.33018076},
  url       = {https://mlanthology.org/aaai/2019/acharya2019aaai-tallyqa/}
}