A Conversational Model of Multimodal Interaction in Information Systems

Abstract

We propose a comprehensive framework for modeling and specifying multimodal interactions. To this end, we employ an extended notion of 'dialogue acts' which can be realized by linguistic and non-linguistic means. First, a set of constraints is presented that describes the temporal structure and all patterns of exchange during a cooperative informationseeking dialogue. Second, we introduce a strategic level of description which allows the specification of the topical structure according to an information-seeking strategy. The model was used to design and implement the MERIT system, and led to a reduction in the complexity of the user interface while preserving most of the useful, but sometimes confusing, dialogue options of advanced direct manipulation interfaces

Cite

Text

Stein and Thiel. "A Conversational Model of Multimodal Interaction in Information Systems." AAAI Conference on Artificial Intelligence, 1993.

Markdown

[Stein and Thiel. "A Conversational Model of Multimodal Interaction in Information Systems." AAAI Conference on Artificial Intelligence, 1993.](https://mlanthology.org/aaai/1993/stein1993aaai-conversational/)

BibTeX

@inproceedings{stein1993aaai-conversational,
  title     = {{A Conversational Model of Multimodal Interaction in Information Systems}},
  author    = {Stein, Adelheit and Thiel, Ulrich},
  booktitle = {AAAI Conference on Artificial Intelligence},
  year      = {1993},
  pages     = {283-288},
  url       = {https://mlanthology.org/aaai/1993/stein1993aaai-conversational/}
}