VIDIAM: Dialogue management and the visual channel

The project will contribute to the specification of the various versions of a dialogue system for multimodal information seeking dialogues within the IMIX programme. Based on these specifications the project will develop in a number of steps and incrementally the dialogue manager that is the central component responsible for a natural interaction between the user and the system. Special attention will be paid to: the interaction protocol and timing in interaction, multimodal reference resolution, dialogue act recognition, clarification and verification (sub)dialogues and the interaction via the visual channel - talking about pictures, and indirect or mixed referring to objects using properties of the visualisation.

Project leader: Dr. ir. H.J.A. op den Akker (UT)

Post doc: Dr. Boris van Schooten

Project website: http://wwwhome.cs.utwente.nl/~schooten/vidiam/