Latest News

• We just updated our Abstract Interactor Model specification today! Access here: http://t.co/KWIETqdl #MINT #mbui #scxml (15.5.2012)

• CFP for upcoming german workshop on model-based user interface development online http://t.co/z6zBXoC9 #mbui #mddui (7.5.2012)

• Just updated the MINT framework homepage to include an overview about all components. http://t.co/4HbZULnR #MINT #mbui #multimodal #hci (30.4.2012)

• Mobile Lorm Glove – A communication device for deaf-blind people.: http://t.co/WUZARxFP (11.4.2012)

• The proposals and results of the #W3C working group meeting on #mbui are collected here: http://t.co/7lPT0DtH (10.2.2012)

Download and Install

We have just released the first version of the MINT-framework as Open Source on Github. Please check there for installation instructions. We are happy about every comment or bug report or message on GitHub. Please note that the development of the framework is an ongoing approach tightly coupled with our effort to research about modelling of multimodal interfaces.

The Multimodal Interaction Framework

Multimodal systems realizing a combination of speech, gesture and graphical-driven interaction are getting part of our everyday life. Examples are in-car assistance systems or recent game consoles. Future interaction will be embedded into smart environments offering the user to choose and to combine a heterogeneous set of interaction devices and modalities based on his preferences realizing an ubiquitous and multimodal access.

This project is concerned with (1) designing and implementing a dialogue modeling editor to support the realization of multimodal applications, that (2) supports the design for various multimodal setups and that (3) is specifically targeted to be used by interaction designers.

While the dialogue model editor is embeddable into existing model-based design approaches and focused on describing multimodal setups as well as the applications dialogues in the same graphical notation to enable easy redesign of the dialogues to support executing an application in various multimodal setups.

The evaluation focuses on the suitability and efficiency of the dialogue modeling editor and will be performed by following an interdisciplinary approach involving both, interaction designers and domain experts that will design a multimodal teaching application based by applying the dialog modeling notation.