Keywords
UIST2.0 Archive - 20 years of UIST
Back
Back to keywords index

multimodal

multimodal

In Proceedings of UIST 2000
Article Picture

The AHI: an audio and haptic interface for contact interactions (p. 149-158)

In Proceedings of UIST 2006
Article Picture

Pen-top feedback for paper-based interfaces (p. 201-210)

In Proceedings of UIST 2008
Article Picture

Search Vox: leveraging multimodal refinement and partial knowledge for mobile voice search (p. 141-150)

Abstract plus

Internet usage on mobile devices continues to grow as users seek anytime, anywhere access to information. Because users frequently search for businesses, directory assistance has been the focus of many voice search applications utilizing speech as the primary input modality. Unfortunately, mobile settings often contain noise which degrades performance. As such, we present Search Vox, a mobile search interface that not only facilitates touch and text refinement whenever speech fails, but also allows users to assist the recognizer via text hints. Search Vox can also take advantage of any partial knowledge users may have about the business listing by letting them express their uncertainty in an intuitive way using verbal wildcards. In simulation experiments conducted on real voice search data, leveraging multimodal refinement resulted in a 28% relative reduction in error rate. Providing text hints along with the spoken utterance resulted in even greater relative reduction, with dramatic gains in recovery for each additional character.

multimodal architecture

In Proceedings of UIST 2000
Article Picture

Multimodal system processing in mobile environments (p. 21-30)

multimodal interaction

In Proceedings of UIST 1992
Article Picture

Two-handed gesture in multi-modal natural dialog (p. 7-14)

In Proceedings of UIST 1994
Article Picture

Extending a graphical toolkit for two-handed interaction (p. 195-204)

In Proceedings of UIST 2001
Article Picture

Join and capture: a model for nomadic interaction (p. 131-140)

In Proceedings of UIST 2005
Article Picture

Dial and see: tackling the voice menu navigation problem with cross-device user experience integration (p. 187-190)

multimodal interface

In Proceedings of UIST 1992
Article Picture

Some virtues and limitations of action inferring interfaces (p. 79-88)

In Proceedings of UIST 1994
Article Picture

An architecture for transforming graphical interfaces (p. 39-47)

In Proceedings of UIST 1994
Article Picture

ENO: synthesizing structured sound spaces (p. 49-57)

In Proceedings of UIST 1999
Article Picture

Multimodal agent interface based on dynamical dialogue model: MAICO: multimodal agent interface for communication (p. 69-70)

multimodal user interface

In Proceedings of UIST 1998
Article Picture

A user interface using fingerprint recognition: holding commands and data objects on fingers (p. 71-79)