CoRefi: A Crowd Sourcing Suite for Coreference Annotation

Abstract

Coreference annotation is an important, yet expensive and time consuming, task, which often involved expert annotators trained on complex decision guidelines. To enable cheaper and more efficient annotation, we present CoRefi, a web-based coreference annotation suite, oriented for crowdsourcing. Beyond the core coreference annotation tool, CoRefi provides guided onboarding for the task as well as a novel algorithm for a reviewing phase. CoRefi is open source and directly embeds into any website, including popular crowdsourcing platforms.

Cite

Text

Bornstein et al. "CoRefi: A Crowd Sourcing Suite for Coreference Annotation." NeurIPS 2020 Workshops: HAMLETS, 2020.

Markdown

[Bornstein et al. "CoRefi: A Crowd Sourcing Suite for Coreference Annotation." NeurIPS 2020 Workshops: HAMLETS, 2020.](https://mlanthology.org/neuripsw/2020/bornstein2020neuripsw-corefi/)

BibTeX

@inproceedings{bornstein2020neuripsw-corefi,
  title     = {{CoRefi: A Crowd Sourcing Suite for Coreference Annotation}},
  author    = {Bornstein, Aaron and Cattan, Arie and Dagan, Ido},
  booktitle = {NeurIPS 2020 Workshops: HAMLETS},
  year      = {2020},
  url       = {https://mlanthology.org/neuripsw/2020/bornstein2020neuripsw-corefi/}
}