Understanding Natural Language with Diagrams
Abstract
We describe a program, BEATRIX, that can understand textbook physics problems specified by a combination of English text and a diagram. The result of the understanding process is a unified internal model that represents the problem, including information derived from both the English text and the diagram. The system is implemented as two opportunistic coparsers, one for English and one for diagrams, within a blackboard architecture. A central problem is establishing coreference, that is, determining when parts of the text and diagram refer to the same object. Constraints supplied by the text and diagram mutually reduce ambiguity in interpretation of the other modality.
Cite
Text
Novak and Bulko. "Understanding Natural Language with Diagrams." AAAI Conference on Artificial Intelligence, 1990.Markdown
[Novak and Bulko. "Understanding Natural Language with Diagrams." AAAI Conference on Artificial Intelligence, 1990.](https://mlanthology.org/aaai/1990/novak1990aaai-understanding/)BibTeX
@inproceedings{novak1990aaai-understanding,
title = {{Understanding Natural Language with Diagrams}},
author = {Novak, Gordon S. and Bulko, William C.},
booktitle = {AAAI Conference on Artificial Intelligence},
year = {1990},
pages = {465-470},
url = {https://mlanthology.org/aaai/1990/novak1990aaai-understanding/}
}