PhotoSlap: A Multi-Player Online Game for Semantic Annotation

Abstract

Multimedia content presents special challenges for the search engines, and could benefit from semantic anno-tation of images. Unfortunately, manual labeling is too tedious and time-consuming for humans, whereas au-tomatic image annotation is too difficult for the com-puters. In this paper, we explore the power of human computation by designing a multi-player online game, PhotoSlap, to achieve the task of annotating metadata for a collection of digital photos. PhotoSlap engages users in an interactive game that capitalizes on human ability in deciphering quickly whether the same person shows up in two consecutive images presented by the computer. The game mechanism supports the objection and trap actions to encourage truthful input from the players. This research extends human computation re-search in two aspects: game-theoretic design principles and quantitative evaluation metrics. In particular, Pho-to Slap can be shown to reach subgame perfect equilib-rium with the target strategy when players are rational and without collusion. Experiments involving four fo-cus groups have been conducted, and the preliminary results demonstrated the game to be fun and effective in annotating people metadata for photo collections.