TY - CHAP A1 - Kousidis, Spyros A1 - Kennington, Casey A1 - Baumann, Timo A1 - Buschmeier, Hendrik A1 - Kopp, Stefan A1 - Schlangen, David T1 - Situationally Aware In-Car Information Presentation Using Incremental Speech Generation: Safer, and More Effective T2 - Proceedings of the EACL 2014 Workshop on Dialogue in Motion, Gothenburg, Sweden N2 - Holding non-co-located conversationswhile driving is dangerous (Horrey and- Wickens, 2006; Strayer et al., 2006), much more so than conversations with physically present, “situated” interlocutors (Drews et al., 2004). In-car dialogue systems typically resemble non-co-located conversations more, and share their negative impact (Strayer et al., 2013). We implemented and tested a simple strategy for making in-car dialogue systems aware of the driving situation, by giving them the capability to interrupt themselves when a dangerous situation is detected,and resume when over. We show that this improves both driving performance and recall of system-presented information, compared to a non-adaptive strategy. KW - in-car information presentation KW - incremental speech generation KW - situation awareness Y1 - 2014 U6 - https://doi.org/10.3115/v1/W14-0212 SP - 68 EP - 72 PB - Association for Computational Linguistics ER - TY - CHAP A1 - Baumann, Timo A1 - Kennington, Casey A1 - Hough, Julian A1 - Schlangen, David ED - Jokinen, Kristiina ED - Wilcock, Graham T1 - Recognising Conversational Speech: What an Incremental ASR Should Do for a Dialogue System and How to Get There T2 - Dialogues with social robots: Enablements analyses and evaluation T2 - Lecture Notes in Electrical Engineering: Bd. 427 N2 - Automatic speech recognition (ASR) is not only becoming increasingly accurate, but also increasingly adapted for producing timely, incremental output. However, overall accuracy and timeliness alone are insufficient when it comes to interactive dialogue systems which require stability in the output and responsivity to the utterance as it is unfolding. Furthermore, for a dialogue system to deal with phenomena such as disfluencies, to achieve deep understanding of user utterances these should be preserved or marked up for use by downstream components, such as language understanding, rather than be filtered out. Similarly, word timing can be informative for analyzing deictic expressions in a situated environment and should be available for analysis. Here we investigate the overall accuracy and incremental performance of three widely used systems and discuss their suitability for the aforementioned perspectives. From the differing performance along these measures we provide a picture of the requirements for incremental ASR in dialogue systems and describe freely available tools for using and evaluating incremental ASR. KW - Incremental ASR KW - Conversational speech KW - System requirements KW - Evaluation Y1 - 2017 SN - 978-981-10-2584-6 U6 - https://doi.org/10.1007/978-981-10-2585-3_35 SP - 421 EP - 432 PB - Springer CY - Singapore ER - TY - CHAP A1 - Kennington, Casey A1 - Kousidis, Spyros A1 - Baumann, Timo A1 - Buschmeier, Hendrik A1 - Kopp, Stefan A1 - Schlangen, David ED - Miller, Erika ED - Wu, Yuqing T1 - Better Driving and Recall When In-car Information Presentation Uses Situationally-Aware Incremental Speech Output Generation T2 - Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, AutomotiveUI '14, Seattle WA, USA, September 17 - 19, 2014 N2 - It is established that driver distraction is the result of sharing cognitive resources between the primary task (driving) and any other secondary task. In the case of holding conversations, a human passenger who is aware of the driving conditions can choose to interrupt his speech in situations potentially requiring more attention from the driver, but in-car information systems typically do not exhibit such sensitivity. We have designed and tested such a system in a driving simulation environment. Unlike other systems, our system delivers information via speech (calendar entries with scheduled meetings) but is able to react to signals from the environment to interrupt when the driver needs to be fully attentive to the driving task and subsequently resume its delivery. Distraction is measured by a secondary short-term memory task. In both tasks, drivers perform significantly worse when the system does not adapt its speech, while they perform equally well to control conditions (no concurrent task) when the system intelligently interrupts and resumes. Y1 - 2014 UR - 978-1-4503-3212-5 U6 - https://doi.org/10.1145/2667317.2667332 SP - 1 EP - 7 PB - ACM CY - New York, NY ER - TY - CHAP A1 - Kousidis, Spyros A1 - Kennington, Casey A1 - Baumann, Timo A1 - Buschmeier, Hendrik A1 - Kopp, Stefan A1 - Schlangen, David ED - Ali Salah, Albert T1 - A Multimodal In-Car Dialogue System That Tracks The Driver's Attention T2 - Proceedings of the 16th International Conference on Multimodal Interaction, ICMI '14, November 12 - 16 2014, Istanbul N2 - When a passenger speaks to a driver, he or she is co-located with the driver, is generally aware of the situation, and can stop speaking to allow the driver to focus on the driving task. In-car dialogue systems ignore these important aspects, making them more distracting than even cell-phone conversations. We developed and tested a "situationally-aware" dialogue system that can interrupt its speech when a situation which requires more attention from the driver is detected, and can resume when driving conditions return to normal. Furthermore, our system allows driver-controlled resumption of interrupted speech via verbal or visual cues (head nods). Over two experiments, we found that the situationally-aware spoken dialogue system improves driving performance and attention to the speech content, while driver-controlled speech resumption does not hinder performance in either of these two tasks Y1 - 2014 SN - 9781450328852 U6 - https://doi.org/10.1145/2663204.2663244 SP - 26 EP - 33 PB - ACM CY - New York, NY ER - TY - CHAP A1 - Baumann, Timo A1 - Kennington, Casey A1 - Hough, Julian A1 - Schlangen, David T1 - Recognising Conversational Speech: What an Incremental ASR Should Do for a Dialogue System and How to Get There T2 - Proceedings of the International Workshop Series on Spoken Dialogue Systems Technology (IWSDS) 2016 N2 - Automatic speech recognition (ASR) is not only becoming increasingly accurate, but also increasingly adapted for producing timely, incremental output. However, overall accuracy and timeliness alone are insufficient when it comes to interactive dialogue systems which require stability in the output and responsivity to the utterance as it is unfolding. Furthermore, for a dialogue system to deal with phenomena such as disfluencies, to achieve deep understanding of user utterances these should be preserved or marked up for use by downstream components, such as language understanding, rather than be filtered out. Similarly, word timing can be informative for analyzing deictic expressions in a situated environment and should be available for analysis. Here we investigate the overall accuracy and incremental performance of three widely used systems and discuss their suitability for the aforementioned perspectives. From the differing performance along these measures we provide a picture of the requirements for incremental ASR in dialogue systems and describe freely available tools for using and evaluating incremental ASR. Y1 - 2016 ER -