Faster Responses Are Better Responses: Introducing Incrementality into Sociable Virtual Personal Assistants
- Speech-based interactive systems, such as virtual personal assistants, inevitably use complex architectures, with a multitude of modules working in series (or less often in parallel) to perform a task (e.g., giving personalized movie recommendations via dialog). Add modules for evoking and sustaining sociability with the user and the accumulation of processing latencies through the modules results in considerable turn-taking delays. We introduce incremental speech processing into the generation pipeline of the system to overcome this challenge with only minimal changes to the system architecture, through partial underspecification that is resolved as necessary. A user study with a sociable movie recommendation agent objectively diminishes turn-taking delays; furthermore, users not only rate the incremental system as more responsive, but also rate its recommendation performance as higher.
Author: | Vivian Tsai, Timo BaumannORCiDGND, Florian Pecune, Justine Cassell |
---|---|
DOI: | https://doi.org/10.1007/978-981-13-9443-0_10 |
ISBN: | 978-981-13-9442-3 |
ISBN: | 978-981-13-9445-4 |
ISBN: | 978-981-13-9443-0 |
ISSN: | 1876-1119 |
ISSN: | 1876-1100 |
Parent Title (English): | 9th International Workshop on Spoken Dialogue System Technology |
Publisher: | Springer Singapore |
Place of publication: | Singapore |
Editor: | Luis Fernando D'Haro, Rafael E. Banchs, Haizhou Li |
Document Type: | conference proceeding (article) |
Language: | English |
Year of first Publication: | 2019 |
Release Date: | 2022/04/09 |
Volume: | 579 |
First Page: | 111 |
Last Page: | 118 |
Konferenzangabe: | International Workshop on Spoken Dialog System Technology, 9,2018, Singapore 14.-16.05.2018 |
Andere Schriftenreihe: | Lecture Notes in Electrical Engineering (LNEE) ; 579 |
Institutes: | Fakultät Informatik und Mathematik |
Begutachtungsstatus: | peer-reviewed |
Publication: | Externe Publikationen |
research focus: | Information und Kommunikation |
Licence (German): | Keine Lizenz - Es gilt das deutsche Urheberrecht: § 53 UrhG |