We report on research conducted as part of the Universal Cognitive User Interface (UCUI) project, which aims at developing a universal, autarkic module for intuitive interaction with technical devices. First, we present an empirical study of image schemas as basic building blocks of human knowledge. Image schemas have been studied extensively in cognitive linguistics, but insufficiently in the context of human-computer-interaction (HCI). Some image
schemas are developed early at pre-verbal stages (e.g., up-down) and may, thus, exert greater influence on human knowledge than later developed image schemas (e.g., centre-periphery). To investigate this for HCI contexts, we applied a speech interaction task using a Wizard of Oz paradigm. Our results show that users apply early image schemas more frequently than late image schemas. They should, therefore, be given preference in interface designs. In the second
part of this contribution we therefore focus on the appropriate representation and processing of semantics. We introduce novel theoretical work including feature-values-relations and Petri net
transducers, and discuss their impact on behaviour control of cognitive systems. In addition, we illustrate some details of the implementation regarding learning strategies and the graphical
user interface.
In this contribution, we want to summarize recent development steps of theembeddedcognitive user interfaceUCUI, which enables auser-adaptive scenario inhuman-machine or even human-robot interactions by considering sophisticated cognitive andsemantic modelling.The interface prototype is developed by differentGerman institutes and companies with their steering teams at Fraunhofer IKTS and Brandenburg University of Technology. The interface prototype is able to communicate with users viaspeech andgesture recognition, speech synthesis and a touch display. The device includes an autarkic semantic processing and beyond a cognitive behavior control, which supportsan intuitive interaction to controldifferent kindsof electronic devices,e.g. in a smart home environment or in interactive respectively collaborative robotics.Contraryto available speech assistance systems such as Amazon Echo or Google Home, the introduced cognitive user interface UCUIensuresthe user privacy by processing all necessary informationwithout any network access ofthe interface device.
Using unified automatic speech recognition and synthesis system for cross-language acoustic modeling
(2012)
ucuikt2015