TY - CHAP A1 - Wirsching, Günther A1 - Huber, Markus A1 - Kölbl, Christian A1 - Lorenz, Robert A1 - Römer, Ronald T1 - Semantic Dialogue Modeling T2 - Cognitive behavioural systems, COST 2102 International Training School, Dresden, Germany, February 21 - 26, 2011 Y1 - 2012 SN - 978-3-642-34583-8 SP - 104 EP - 113 PB - Springer CY - Berlin ER - TY - CHAP A1 - Huber, Markus A1 - Römer, Ronald ED - Wirsching, Günther T1 - Modellierung des Semantik-Syntax Grenzübergangs kognitiver Systeme am Beispiel des "Mouse-Maze"-Problems T2 - Tagungsband, 26. Konferenz Elektronische Sprachsignalverarbeitung, 25.-27.03.2015, Eichstätt Y1 - 2015 SN - 978-3-95908-000-2 SP - 232 EP - 239 PB - TUDpress CY - Dresden ER - TY - GEN A1 - Huber, Markus A1 - Meyer, Werner A1 - Nowack, Kati A1 - Geßler, Peter ED - Jokisch, Oliver T1 - WoOF: Ein Framework für Wizard of Oz Experimente T2 - Tagungsband, 27. Konferenz Elektronische Sprachsignalverarbeitung, 02.-04.03.2016, Leipzig N2 - ucuikt2015 Y1 - 2016 SN - 978-3-95908-040-8 SP - 127 EP - 134 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Huber, Markus A1 - Römer, Ronald A1 - Wolff, Matthias ED - Trouvain, Jürgen ED - Steiner, Ingmar ED - Möbius, Bernd T1 - Little Drop of Mulligatawny Soup, Miss Sophie? Automatic Speech Understanding provided by Petri Nets T2 - Tagungsband der 28. Konferenz Elektronische Sprachsignalverarbeitung (ESSV), 15.-17.03.2017, Saarbrücken Y1 - 2017 SN - 978-3-95908-094-1 SP - 122 EP - 129 PB - TUDpress CY - Dresden ER - TY - CHAP A1 - Huber, Markus A1 - Wolff, Matthias ED - Aalst, Wil van der ED - Bergenthum, Robin ED - Carmona, Josep T1 - Segmenting Sequences Semantically. Using Petri Net Transducers for the Translation from Sequential Data to Non-Sequential Models T2 - Proceedings of the International Workshop on Algorithms & Theories for the Analysis of Event Data 2017 (ATAED 2017), June 26-27, Zaragoza, Spain Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0074-1847-5 UR - http://ceur-ws.org/Vol-1847/ N1 - Satellite event of the conferences: 38th International Conference on Application and Theory of Petri Nets and Concurrency Petri Nets 2017 and 17th International Conference on Application of Concurrency to System Design ACSD 2017, June 26-30, 2017 SP - 139 EP - 157 PB - RWTH CY - Aachen ER - TY - CHAP A1 - Huber, Markus A1 - Römer, Ronald ED - Berton, André ED - Haiber, Udo ED - Minker, Wolfgang T1 - Agenten in höheren Sphären – Quantenmechanische Situationsmodellierung kognitiver Systeme am Beispiel des Mouse-Maze-Problems T2 - Elektronische Sprachsignalverarbeitung, Tagungsband der 29. Konferenz, Ulm, 7.-9. März 2018 Y1 - 2018 UR - http://essv2018.de/de/programm/#poster_session SN - 978-3-95908-128-3 SP - 127 EP - 134 PB - TUDpress CY - Dresden ER - TY - GEN A1 - Meyer, Werner A1 - Huber, Markus A1 - Wolff, Matthias ED - Berton, André ED - Haiber, Udo ED - Minker, Wolfgang T1 - Verhaltenssteuerung einer universellen kognitiven Benutzerschnittstelle anhand einer Heizungssteuerung T2 - Elektronische Sprachsignalverarbeitung, Tagungsband der 29. Konferenz, Ulm, 7.-9. März 2018 N2 - ucuikt2015 Y1 - 2018 UR - http://essv2018.de/de/programm/#poster_session SN - 978-3-95908-128-3 SP - 301 EP - 308 PB - TUDpress CY - Dresden ER - TY - GEN A1 - Huber, Markus A1 - Wolff, Matthias A1 - Meyer, Werner A1 - Jokisch, Oliver A1 - Nowack, Kati T1 - Some Design Aspects of a Cognitive User Interface T2 - Online Journal of Applied Knowledge Management N2 - We report on research conducted as part of the Universal Cognitive User Interface (UCUI) project, which aims at developing a universal, autarkic module for intuitive interaction with technical devices. First, we present an empirical study of image schemas as basic building blocks of human knowledge. Image schemas have been studied extensively in cognitive linguistics, but insufficiently in the context of human-computer-interaction (HCI). Some image schemas are developed early at pre-verbal stages (e.g., up-down) and may, thus, exert greater influence on human knowledge than later developed image schemas (e.g., centre-periphery). To investigate this for HCI contexts, we applied a speech interaction task using a Wizard of Oz paradigm. Our results show that users apply early image schemas more frequently than late image schemas. They should, therefore, be given preference in interface designs. In the second part of this contribution we therefore focus on the appropriate representation and processing of semantics. We introduce novel theoretical work including feature-values-relations and Petri net transducers, and discuss their impact on behaviour control of cognitive systems. In addition, we illustrate some details of the implementation regarding learning strategies and the graphical user interface. N2 - ucuikt2015 KW - Cognitive system KW - intuitive interaction KW - image schema theory KW - feature-valuesrelation KW - Petri net transducer and behaviour control Y1 - 2018 UR - http://www.iiakm.org/ojakm/articles/2018/volume6_1.php SN - 2325-4688 N1 - Best Research Paper Award VL - 6 IS - 1 SP - 15 EP - 29 ER - TY - GEN A1 - Kupferberg, Aleksandra A1 - Iacoboni, Marco A1 - Flanagin, Virginia A1 - Huber, Markus A1 - Kasparbauer, Anna A1 - Baumgartner, Thomas A1 - Hasler, Gregor A1 - Schmidt, Florian A1 - Borst, Christoph A1 - Glasauer, Stefan T1 - Fronto-parietal coding of goal-directed actions performed by artificial agents T2 - Human Brain Mapping Y1 - 2018 U6 - https://doi.org/10.1002/hbm.23905 SN - 1097-0193 SN - 1065-9471 VL - 39 IS - 3 SP - 1145 EP - 1162 ER - TY - GEN A1 - Römer, Ronald A1 - beim Graben, Peter A1 - Huber, Markus A1 - Wolff, Matthias A1 - Wirsching, Günther A1 - Schmitt, Ingo T1 - Behavioral Control of Cognitive Agents Using Database Semantics and Minimalist Grammars T2 - Proceedings 10th IEEE International Conference on Cognitive Infocommunications, CogInfoCom 2019, Oct. 23-25 Y1 - 2019 SN - 978-1-7281-4793-2 SN - 978-1-7281-4792-5 U6 - https://doi.org/10.1109/CogInfoCom47531.2019.9089947 SN - 2380-7350 SP - 73 EP - 78 CY - Naples, Italy ER - TY - GEN A1 - Beim Graben, Peter A1 - Huber, Markus A1 - Meyer, Werner A1 - Römer, Ronald A1 - Wolff, Matthias T1 - Vector Symbolic Architectures for Context-Free Grammars T2 - Cognitive Computation N2 - Vector symbolic architectures (VSA) are a viable approach for the hyperdimensional representation of symbolic data, such as documents, syntactic structures, or semantic frames. We present a rigorous mathematical framework for the representation of phrase structure trees and parse trees of context-free grammars (CFG) in Fock space, i.e. infinite-dimensional Hilbert space as being used in quantum field theory. We define a novel normal form for CFG by means of term algebras. Using a recently developed software toolbox, called FockBox, we construct Fock space representations for the trees built up by a CFG left-corner (LC) parser. We prove a universal representation theorem for CFG term algebras in Fock space and illustrate our findings through a low-dimensional principal component projection of the LC parser state. Our approach could leverage the development of VSA for explainable artificial intelligence (XAI) by means of hyperdimensional deep neural computation. Y1 - 2021 U6 - https://doi.org/10.1007/s12559-021-09974-y SN - 1866-9964 VL - 14 IS - 2 SP - 733 EP - 748 ER - TY - GEN A1 - Römer, Ronald A1 - beim Graben, Peter A1 - Huber-Liebl, Markus A1 - Wolff, Matthias T1 - Unifying Physical Interaction, Linguistic Communication, and Language Acquisition of Cognitive Agents by Minimalist Grammars T2 - Frontiers in Computer Science N2 - Cognitive agents that act independently and solve problems in their environment on behalf of a user are referred to as autonomous. In order to increase the degree of autonomy, advanced cognitive architectures also contain higher-level psychological modules with which needs and motives of the agent are also taken into account and with which the behavior of the agent can be controlled. Regardless of the level of autonomy, successful behavior is based on interacting with the environment and being able to communicate with other agents or users. The agent can use these skills to learn a truthful knowledge model of the environment and thus predict the consequences of its own actions. For this purpose, the symbolic information received during the interaction and communication must be converted into representational data structures so that they can be stored in the knowledge model, processed logically and retrieved from there. Here, we firstly outline a grammar-based transformation mechanism that unifies the description of physical interaction and linguistic communication and on which the language acquisition is based. Specifically, we use minimalist grammar (MG) for this aim, which is a recent computational implementation of generative linguistics. In order to develop proper cognitive information and communication technologies, we are using utterance meaning transducers (UMT) that are based on semantic parsers and a mental lexicon, comprising syntactic and semantic features of the language under consideration. This lexicon must be acquired by a cognitive agent during interaction with its users. To this aim we outline a reinforcement learning algorithm for the acquisition of syntax and semantics of English utterances. English declarative sentences are presented to the agent by a teacher in form of utterance meaning pairs (UMP) where the meanings are encoded as formulas of predicate logic. Since MG codifies universal linguistic competence through inference rules, thereby separating innate linguistic knowledge from the contingently acquired lexicon, our approach unifies generative grammar and reinforcement learning, hence potentially resolving the still pending Chomsky-Skinner controversy. btuktuminglear, btuktsptech, btuktcogsys Y1 - 2022 UR - https://www.frontiersin.org/article/10.3389/fcomp.2022.733596 U6 - https://doi.org/10.3389/fcomp.2022.733596 SN - 2624-9898 IS - 4 ER - TY - GEN A1 - Beim Graben, Peter A1 - Huber-Liebl, Markus A1 - Klimczak, Peter A1 - Wirsching, Günther T1 - Machine Semiotics T2 - arXiv N2 - Recognizing a basic difference between the semiotics of humans and machines presents a possibility to overcome the shortcomings of current speech assistive devices. For the machine, the meaning of a (human) utterance is defined by its own scope of actions. Machines, thus, do not need to understand the conventional meaning of an utterance. Rather, they draw conversational implicatures in the sense of (neo-)Gricean pragmatics. For speech assistive devices, the learning of machine-specific meanings of human utterances, i.e. the fossilization of conversational implicatures into conventionalized ones by trial and error through lexicalization appears to be sufficient. Using the quite trivial example of a cognitive heating | device, we show that — based on dynamic semantics — this process can be formalized as the reinforcement learning of utterance-meaning pairs (UMP). KW - Semiotics KW - machine learning KW - dynamic semantics KW - pragmatic implicatures KW - fossilization Y1 - 2023 UR - https://arxiv.org/abs/2008.10522v2 SP - 1 EP - 48 ER - TY - CHAP A1 - Wolff, Matthias A1 - Huber, Markus A1 - Wirsching, Günther A1 - Römer, Ronald A1 - Beim Graben, Peter A1 - Schmitt, Ingo T1 - Towards a Quantum Mechanical Model of the Inner Stage of Cognitive Agents T2 - 9th IEEE International Conference on Cognitive Infocommunications (CogInfoCom 2018), proceedings, Aug. 22-24, 2018, Budapest, Hungary N2 - We present a model, inspired by quantum field theory, of the so-called inner stage of technical cognitive agents. The inner stage represents all knowledge of the agent. It allows for planning of actions and for higher cognitive functions like coping and fantasy. By the example of a cognitive mouse agent living in a maze wold, we discuss learning, action planning, and attention in a fully deterministic setting and assuming a totally observable world. We explain the relevance of our approach to cognitive infocommunications. KW - cognitive systems KW - cognitive agents KW - quantum field theory KW - machine learning KW - inner stage KW - veridicality KW - attention modeling KW - ontology inference Y1 - 2018 UR - https://ieeexplore.ieee.org/document/8639892 SN - 978-1-5386-7094-1 U6 - https://doi.org/10.1109/CogInfoCom.2018.8639892 N1 - Best Paper Award SP - 147 EP - 152 PB - IEEE CY - Piscataway, NJ ER - TY - CHAP A1 - Tschöpe, Constanze A1 - Duckhorn, Frank A1 - Huber, Markus A1 - Meyer, Werner A1 - Wolff, Matthias ED - Karpov, Alexey ED - Jokisch, Oliver ED - Potapova, Rodmonga T1 - A Cognitive User Interface for a Multi-Modal Human-Machine Interaction T2 - Speech and computer : 20th International Conference, SPECOM 2018, Leipzig, Germany, September 18-22, 2018, proceedings Y1 - 2018 UR - https://link.springer.com/chapter/10.1007/978-3-319-99579-3_72 SN - 978-3-319-99578-6 U6 - https://doi.org/10.1007/978-3-319-99579-3 SP - 707 EP - 717 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Jokisch, Oliver A1 - Huber, Markus T1 - Advances in the development of a cognitive user interface T2 - 13th International Scientific-Technical Conference on Electromechanics and Robotics "Zavalishin’s Readings", St. Petersburg, April 2018 N2 - In this contribution, we want to summarize recent development steps of theembeddedcognitive user interfaceUCUI, which enables auser-adaptive scenario inhuman-machine or even human-robot interactions by considering sophisticated cognitive andsemantic modelling.The interface prototype is developed by differentGerman institutes and companies with their steering teams at Fraunhofer IKTS and Brandenburg University of Technology. The interface prototype is able to communicate with users viaspeech andgesture recognition, speech synthesis and a touch display. The device includes an autarkic semantic processing and beyond a cognitive behavior control, which supportsan intuitive interaction to controldifferent kindsof electronic devices,e.g. in a smart home environment or in interactive respectively collaborative robotics.Contraryto available speech assistance systems such as Amazon Echo or Google Home, the introduced cognitive user interface UCUIensuresthe user privacy by processing all necessary informationwithout any network access ofthe interface device. Y1 - 2018 UR - http://www.matec-conferences.org/articles/matecconf/pdf/2018/20/matecconf_erzr2018_01003.pdf U6 - https://doi.org/10.1051/matecconf/201816101003 PB - EDP Sciences CY - Les Ulis ER - TY - CHAP A1 - Wolff, Matthias A1 - Wirsching, Günther A1 - Huber, Markus A1 - Beim Graben, Peter A1 - Römer, Ronald A1 - Schmitt, Ingo ED - Karpov, Alexey ED - Jokisch, Oliver ED - Potapova, Rodmonga T1 - A Fock Space Toolbox and Some Applications in Computational Cognition T2 - Speech and computer : 20th International Conference, SPECOM 2018, Leipzig, Germany, September 18-22, 2018, proceedings N2 - We present a Matlab toolbox, called “FockBox”, handling Fock spaces and objects associated with Fock spaces: scalars, ket and bra vectors, and linear operators. We give brief application examples from computational linguistics, semantics processing, and quantum logic,demonstrating the use of the toolbox. KW - Fock space KW - Matlab KW - Computational linguistics KW - Semantics processing KW - Cognitive systems KW - Quantum logic KW - Computational cognition Y1 - 2018 SN - 978-3-319-99578-6 U6 - https://doi.org/10.1007/978-3-319-99579-3 PB - Springer International Publishing CY - Cham ER - TY - CHAP A1 - Beim Graben, Peter A1 - Huber, Markus A1 - Römer, Ronald A1 - Schmitt, Ingo A1 - Wolff, Matthias ED - Berton, André ED - Haiber, Udo ED - Minker, Wolfgang T1 - Der Fockraum als Labyrinth: Wissensrepräsentation und Problemlösungen am Beispiel des Mouse-Maze-Problems T2 - Elektronische Sprachsignalverarbeitung, Tagungsband der 29. Konferenz, Ulm, 7.-9. März 2018 Y1 - 2018 UR - http://essv2018.de/de/programm/ SN - 978-3-95908-128-3 SP - 167 EP - 174 PB - TUDpress CY - Dresden ER - TY - GEN A1 - Meyer, Werner A1 - Borislavov, Borislav A1 - Eckert, Friedrich A1 - Richter, Christian A1 - Römer, Ronald A1 - Beim Graben, Peter A1 - Huber, Markus A1 - Wolff, Matthias ED - Hillmann, Stefan ED - Weiss, Benjamin ED - Michael, Thilo ED - Möller, Sebastian T1 - Formalisierung und Implementierung einer adaptiven kognitiven Architektur unter Verwendung von Strukturdiagrammen T2 - Elektronische Sprachsignalverarbeitung 2021 : Tagungsband der 32. Konferenz Berlin, 3.-5. März 2021 N2 - Das Fachgebiet der Kognitiven Technischen Systeme zeichnet sich durch einen hohen Grad an Interdisziplinarität (z. B. Kenntnisse auf den Gebieten Biologie, Psychologie, Informatik und den Ingenieurwissenschaften) aus. Nach wie vor besteht Bedarf an einer methodischen Darstellung des Fachgebietes, bei der die theoretische Durchdringung von Zusammenhängen zwischen den verschiedenen Wissensgebieten zusätzlich durch Anschaulichkeit unterstützt wird. Die vorliegende Arbeit stellt einen Fortschrittsbericht zur Realisierung eines Forschungs- und Experimentiersystems dar, mit dem wir dieses Anliegen unterstützen und über das wir erstmals konzeptionell in [1] berichtet haben. In diesem Beitrag folgen wir einem integrativen Ansatz zur Entwicklung einer kognitiven Architektur, mit der unter Verwendung repräsentationaler Datenstrukturen adaptives Verhalten auf verschiedenen Zeitskalen sowie zwei wichtige Verhaltensprogramme für das Problemlösen (Objektfindung, Exploration) auf der gemeinsamen Grundlage von Markov-Entscheidungsprozessen umgesetzt werden. Mit einem Kurzbericht zum Entwicklungsstand der physikalischen Experimentierumgebung und einer Zusammenfassung der bislang erreichten Ergebnisse beschließen wir den diesjährigen Beitrag. Y1 - 2021 UR - https://www.essv.de/?year=2021 SN - 978-3-959082-27-3 SN - 0940-6832 SP - 67 EP - 76 PB - TUDpress CY - Dresden ER - TY - RPRT A1 - Huber, Markus A1 - Klimczak, Peter T1 - Nix g'sagt is' g'lobt g'nua : Kybernetisches Lehren und Lernen mit Petri-Netzen N2 - In diesem Text wird das in „Maschinensemiotik“ [12] vorgestellte Verfahren zur Verknüpfung von Äußerungen mit deren Bedeutung weiterentwickelt und in Form von Algebraischen Petri-Netzen [20] modelliert. Gleichzeitig wird der Formalismus der Petri-Netze nebenbei eingeführt, wobei die Vorstellung nicht auf formale Vollständigkeit abzielt, sondern nur das für die Anwendung nötige Wissen Erwähnung findet. Die Modellierung umfasst dabei sowohl die Systemkomponente, die Verknüpfungen zwischen sprachlichen Äußerungen und Handlungen herstellt – das Lernermodell –, als auch die Komponente, die sprachliche Äußerungen tätigt, bis die gewünschte Verknüpfung hergestellt wurde – das Lehrermodell samt Lernzielkontrolle. Die Umsetzung des Modells per Software [19] erlaubt die weitere Diskussion anhand einer Simulation mit einigen Testdaten. Eine ausführliche mathematische Analyse zeigt beweisbare Eigenschaften des Modells auf. Knappe Vergleiche mit der kybernetischen Didaktik nach von Cube [26] sowie der Suggestopädie Lozanovs [16] ordnen das Modell darüber hinaus noch in einen pädagogischen Kontext ein. Y1 - 2020 U6 - https://doi.org/10.13140/RG.2.2.12056.83209 ER -