Intelligent multi-modal systems

Tsui, KC; Azvine, B; Djian, D; Voudouris, C; Xu, LQ

dc.contributor.author	Tsui, KC	en
dc.contributor.author	Azvine, B	en
dc.contributor.author	Djian, D	en
dc.contributor.author	Voudouris, C	en
dc.contributor.author	Xu, LQ	en
dc.date.accessioned	2014-03-01T01:47:14Z
dc.date.available	2014-03-01T01:47:14Z
dc.date.issued	1998	en
dc.identifier.issn	13583948	en
dc.identifier.uri	https://dspace.lib.ntua.gr/xmlui/handle/123456789/25182
dc.relation.uri	http://www.scopus.com/inward/record.url?eid=2-s2.0-0032114549&partnerID=40&md5=a72a51ca5c87338db8dc8275c33414b4	en
dc.subject.other	Artificial intelligence	en
dc.subject.other	Human computer interaction	en
dc.subject.other	Interfaces (computer)	en
dc.subject.other	Man machine systems	en
dc.subject.other	Intelligent multi-modal systems	en
dc.subject.other	Smart work manager	en
dc.subject.other	Learning systems	en
dc.title	Intelligent multi-modal systems	en
heal.type	journalArticle	en
heal.publicationDate	1998	en
heal.abstract	Research in human/computer interaction has mainly focused on natural language, text, speech and vision primarily in isolation. Recently there have been a number of research projects that have concentrated on the integration of such modalities using intelligent reasoners. The rationale is that many inherent ambiguities in single modes of communication can be resolved if extra information is available. This paper describes an intelligent multi-modal system called the Smart Work Manager. The main characteristics of the Smart Work Manager are that it can process speech, text, face images, gaze information and simulated gestures using the mouse as input modalities, and its output is in the form of speech, text or graphics. The main components of the system are the reasoner, a speech system, a vision system, an integration platform and the application interface. The overall architecture of the system will be described together with the integration platform and the components of the system which include a non-intrusive neural network based gaze-tracking system. The paper concludes with a discussion on the applicability of such systems to intelligent human/computer interaction and lessons learnt in terms of reliability and efficiency.	en
heal.journalName	BT Technology Journal	en
dc.identifier.volume	16	en
dc.identifier.issue	3	en
dc.identifier.spage	134	en
dc.identifier.epage	144	en