Ask'nSeek: A New Game for Object Detection and Labeling

Abstract

This paper proposes a novel approach to detect and label objects within images and describes a two-player web-based guessing game – Ask’nSeek – that supports these tasks in a fun and interactive way. Ask’nSeek asks users to guess the location of a hidden region within an image with the help of semantic and topological clues. The information collected from game logs is combined with results from content analysis algorithms and used to feed a machine learning algorithm that outputs the outline of the most relevant regions within the image and their names. Two noteworthy aspects of the proposed game are: (i) it solves two computer vision problems – object detection and labeling – in a single game; and (ii) it learns spatial relations within the image from game logs. The game has been evaluated through user studies, which confirmed that it was easy to understand, intuitive, and fun to play.