SmartKomOne of the great challenges in modern information society is at the moment
the creation of intelligent, multimodal user interfaces. These interfaces
should
be able to deal with the natural manner of communication used by `naive´
people;
such an interaction will thus be intuitive and adapted to the needs of the
prospective users. Computer applications are getting more and more
important, and simultaneously, the systems are getting more and more
complicated. Moreover, users will have even less time than now to
get acquainted with new concepts, and at the same time, the costs
for developing intelligent user interfaces have to be cut down to
a large extent.In the SmartKom project, concepts for novel types of
human-machine-interaction
are being developed. Such concepts make the acceptance of information
technology much easier. It is a vision of the SmartKom project to combine
the advantages of speech communication with those of graphic user
interfaces
and tactile interaction; by that, a so-called multimodal user paradigm
will be created. In SmartKom, the Chair for Pattern Recognition (Informatik 5) implements
modules
for a multimodal processing of speech, facial expression, and gesture.
On the one hand, these modules should recognize automatically semantic
information encoded in speech and gesture (in speech, accentuation and
syntactic-prosodic boundaries, in gesture, deictic gestures); on the other
hand, they are intended to detect emotional user states in all three
modalities. In co-operation with other SmartKom partners,
so-called use cases (representative constellations for applicatons) are
being developed; by that, the usefulness of the processing of emotional
user
states in such systems can be demonstrated. | Project manager: Prof. em. Dr.-Ing. Dr.-Ing. h.c. Heinrich Niemann, Prof. Dr.-Ing. Elmar Nöth
Project participants: Dr. phil. Anton Batliner, Dipl.-Inf. Carmen Frank, Dipl.-Inf. Johann Adelhardt, Ruiping Shi, M.S., Dr.-Ing. Viktor Zeissler
Keywords: Dialog; Mensch-Maschine-Interaktion; Sprachverarbeitung; Prosodie; Mimik; Gestik
Duration: 1.9.1999 - 31.12.2003
Sponsored by: Bundesministerium für Bildung und Forschung
Mitwirkende Institutionen: DaimlerChrysler AG European Media Lab ICSI Universität Stuttgart Universität München MediaInterface Dresden GmbH Philips GmbH Siemens AG ZT Sony International GmbH Sympalog AG DFKI
Contact: Nöth, Elmar Phone +49 9131 85 27888, Fax +49 9131 85 27270, E-Mail: elmar.noeth@fau.de
|