Reagent: Converting Ordinary Webpages into Interactive Software Agents

Matthew Peveler, Jeffrey O. Kephart, Hui Su

IJCAI 2019 pp. 6560-6562

doi:10.24963/IJCAI.2019/956 /ijcai/2019/peveler2019ijcai-reagent/

Abstract

We introduce Reagent, a technology that can be used in conjunction with automated speech recognition to allow users to query and manipulate ordinary webpages via speech and pointing. Reagent can be used out-of-the-box with third-party websites, as it requires neither special instrumentation from website developers nor special domain knowledge to capture semantically-meaningful mouse interactions with structured elements such as tables and plots. When it is unable to infer mappings between domain vocabulary and visible webpage content on its own, Reagent proactively seeks help by engaging in a voice-based interaction with the user.

PDF IJCAI Semantic Scholar

Cite

Text

Peveler et al. "Reagent: Converting Ordinary Webpages into Interactive Software Agents." International Joint Conference on Artificial Intelligence, 2019. doi:10.24963/IJCAI.2019/956

Markdown

[Peveler et al. "Reagent: Converting Ordinary Webpages into Interactive Software Agents." International Joint Conference on Artificial Intelligence, 2019.](https://mlanthology.org/ijcai/2019/peveler2019ijcai-reagent/) doi:10.24963/IJCAI.2019/956

BibTeX

@inproceedings{peveler2019ijcai-reagent,
  title     = {{Reagent: Converting Ordinary Webpages into Interactive Software Agents}},
  author    = {Peveler, Matthew and Kephart, Jeffrey O. and Su, Hui},
  booktitle = {International Joint Conference on Artificial Intelligence},
  year      = {2019},
  pages     = {6560-6562},
  doi       = {10.24963/IJCAI.2019/956},
  url       = {https://mlanthology.org/ijcai/2019/peveler2019ijcai-reagent/}
}