We give a survey of the research project REAL, where we investigate how a system can proactively assist its user in solving different tasks in an instrumented environment by sensing implicit interaction and utilising distributed presentation media. First we introduce the architecture of our instrumented environment, which uses a blackboard to coordinate the components of the environment, such as the sensing and positioning services and interaction devices. A ubiquitous user model provides contextual information on the users characteristics, actions and locations. The user may access and control their profile via a web interface. In the following, we present two mobile applications to employ the environmental support for situated dialogues, a shopping assistant and a pedestrian navigation system. Both applications allow for multi-modal interaction through a combination of speech, gesture and sensed actions such as motion.

Item Type:	Refereed Conference Paper
Keywords:	Multi-modal speech and gestural interface, transparent user modelling, instrumented environment, pedestrian navigation
Research Division:	Information and Computing Sciences
Research Group:	Library and information studies
Research Field:	Human information interaction and retrieval
Objective Division:	Information and Communication Services
Objective Group:	Information systems, technologies and services
Objective Field:	Application software packages
UTAS Author:	Wasinger, R (Dr Rainer Wasinger)
ID Code:	90171
Year Published:	2004
Deposited By:	Information and Communication Technology
Deposited On:	2014-03-27
Last Modified:	2022-09-01
Downloads:	0