Situated Verbal Interaction in Virtual Design and Assembly

Abstract

The video demonstrates research accomplishments in interactive design and assembly with 3D computer graphics environments. Agent techniques and dynamic knowledge representation techniques are used to process qualitative verbal instructions to quantitative scene changes. A key idea is to exploit situated `perceptive' information by inspecting the computer graphics scene models. Computer-based presentations of synthetic geometry data, transformed to visual surface structures by way of rendering techniques, are of growing importance in the design and construction areas. To make better profit of this new technology, new ways of human-computer interaction are called for. Previous work has concentrated on gesturing and pointing, for instance, by using the data glove. An alternative way we explore at the AI & Computer Graphics Lab is to use verbal interaction to communicate alterations. These are put in effect by a mediating system which changes the arrangement or assemblage of scene objects....