TY - CHAP A1 - Ritz, Fabian A1 - Ratke, Daniel A1 - Phan, Thomy A1 - Belzner, Lenz A1 - Linnhoff-Popien, Claudia T1 - A sustainable ecosystem through emergent cooperation in multi-agent reinforcement learning T2 - Proceedings of the Artificial Life Conference 2021 UR - https://doi.org/10.1162/isal_a_00399 Y1 - 2021 UR - https://doi.org/10.1162/isal_a_00399 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-12975 VL - 2021 PB - MIT Press CY - Cambridge ER - TY - CHAP A1 - Phan, Thomy A1 - Ritz, Fabian A1 - Belzner, Lenz A1 - Altmann, Philipp A1 - Gabor, Thomas A1 - Linnhoff-Popien, Claudia T1 - VAST: Value Function Factorization with Variable Agent Sub-Teams T2 - Advances in Neural Information Processing Systems 34 (NeurIPS 2021) KW - Multi-Agent Learning KW - Reinforcement Learning KW - Value Function Factorization Y1 - 2021 UR - https://proceedings.neurips.cc/paper/2021/hash/c97e7a5153badb6576d8939469f58336-Abstract.html PB - Neural Information Processing Systems Foundation, Inc. (NIPS) ER - TY - CHAP A1 - Phan, Thomy A1 - Sommer, Felix A1 - Altmann, Philipp A1 - Ritz, Fabian A1 - Belzner, Lenz A1 - Linnhoff-Popien, Claudia T1 - Emergent Cooperation from Mutual Acknowledgment Exchange T2 - AAMAS '22: Proceedings of the 21st International Conference on Autonomous Agents and Multiagent Systems UR - https://dl.acm.org/doi/10.5555/3535850.3535967 KW - multi-agent learning KW - reinforcement learning KW - mutual acknowledgments KW - peer incentivization KW - emergent cooperation Y1 - 2022 UR - https://dl.acm.org/doi/10.5555/3535850.3535967 SN - 978-1-4503-9213-6 SP - 1047 EP - 1055 PB - International Foundation for Autonomous Agents and Multiagent Systems CY - Richland ER - TY - CHAP A1 - Phan, Thomy A1 - Belzner, Lenz A1 - Kiermeier, Marie A1 - Friedrich, Markus A1 - Schmid, Kyrill A1 - Linnhoff-Popien, Claudia T1 - Memory Bounded Open-Loop Planning in Large POMDPs Using Thompson Sampling T2 - AAAI-19 / IAAI-19 / EAAI-20 Proceedings UR - https://doi.org/10.1609/aaai.v33i01.33017941 Y1 - 2019 UR - https://doi.org/10.1609/aaai.v33i01.33017941 SN - 2374-3468 VL - 33 IS - 1 SP - 7941 EP - 7948 PB - AAAI Press CY - Palo Alto ER - TY - CHAP A1 - Hahn, Carsten A1 - Phan, Thomy A1 - Gabor, Thomas A1 - Belzner, Lenz A1 - Linnhoff-Popien, Claudia T1 - Emergent Escape-based Flocking behavior using Multi-Agent Reinforcement Learning T2 - Artificial Life Conference Proceedings UR - https://doi.org/10.1162/isal_a_00226 Y1 - 2019 UR - https://doi.org/10.1162/isal_a_00226 SP - 598 EP - 605 PB - MIT Press CY - Cambridge ER - TY - CHAP A1 - Phan, Thomy A1 - Schmid, Kyrill A1 - Belzner, Lenz A1 - Gabor, Thomas A1 - Feld, Sebastian A1 - Linnhoff-Popien, Claudia T1 - Distributed Policy Iteration for Scalable Approximation of Cooperative Multi-Agent Policies T2 - AAMAS '19: Proceedings of the 18th International Conference on Autonomous Agents and MultiAgent Systems KW - multi-agent planning KW - multi-agent learning KW - policy iteration Y1 - 2019 UR - https://www.ifaamas.org/Proceedings/aamas2019/forms/contents.htm SN - 978-1-4503-6309-9 SP - 2162 EP - 2164 PB - International Foundation for Autonomous Agents and Multiagent Systems CY - Richland ER - TY - JOUR A1 - Sedlmeier, Andreas A1 - Gabor, Thomas A1 - Phan, Thomy A1 - Belzner, Lenz T1 - Uncertainty-Based Out-of-Distribution Detection in Deep Reinforcement Learning JF - Digitale Welt UR - https://doi.org/10.1007/s42354-019-0238-z Y1 - 2019 UR - https://doi.org/10.1007/s42354-019-0238-z SN - 2569-1996 VL - 4 IS - 1 SP - 74 EP - 78 PB - Digitale Welt Academy CY - München ER - TY - CHAP A1 - Phan, Thomy A1 - Belzner, Lenz A1 - Gabor, Thomas A1 - Sedlmeier, Andreas A1 - Ritz, Fabian A1 - Linnhoff-Popien, Claudia T1 - Resilient multi-agent reinforcement learning with adversarial value decomposition T2 - AAAI-21 / IAAI-21 / EAAI-21 Proceedings UR - https://ojs.aaai.org/index.php/AAAI/article/view/17348 KW - Multiagent Learning KW - Adversarial Learning & Robustness KW - Adversarial Agents KW - Reinforcement Learning Y1 - 2021 UR - https://ojs.aaai.org/index.php/AAAI/article/view/17348 SN - 978-1-57735-866-4 SN - 2374-3468 VL - 35 IS - 13 SP - 11308 EP - 11316 PB - AAAI Press CY - Palo Alto (CA) ER - TY - JOUR A1 - Gabor, Thomas A1 - Sedlmeier, Andreas A1 - Phan, Thomy A1 - Ritz, Fabian A1 - Kiermeier, Marie A1 - Belzner, Lenz A1 - Kempter, Bernhard A1 - Klein, Cornel A1 - Sauer, Horst A1 - Schmid, Reiner A1 - Wieghardt, Jan A1 - Zeller, Marc A1 - Linnhoff-Popien, Claudia T1 - The scenario coevolution paradigm BT - adaptive quality assurance for adaptive systems JF - International Journal on Software Tools for Technology Transfer N2 - Systems are becoming increasingly more adaptive, using techniques like machine learning to enhance their behavior on their own rather than only through human developers programming them. We analyze the impact the advent of these new techniques has on the discipline of rigorous software engineering, especially on the issue of quality assurance. To this end, we provide a general description of the processes related to machine learning and embed them into a formal framework for the analysis of adaptivity, recognizing that to test an adaptive system a new approach to adaptive testing is necessary. We introduce scenario coevolution as a design pattern describing how system and test can work as antagonists in the process of software evolution. While the general pattern applies to large-scale processes (including human developers further augmenting the system), we show all techniques on a smaller-scale example of an agent navigating a simple smart factory. We point out new aspects in software engineering for adaptive systems that may be tackled naturally using scenario coevolution. This work is a substantially extended take on Gabor et al. (International symposium on leveraging applications of formal methods, Springer, pp 137–154, 2018). UR - https://doi.org/10.1007/s10009-020-00560-5 Y1 - 2020 UR - https://doi.org/10.1007/s10009-020-00560-5 UR - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:573-13929 SN - 1433-2787 VL - 22 IS - 4 SP - 457 EP - 476 PB - Springer CY - Berlin ER - TY - CHAP A1 - Gabor, Thomas A1 - Sünkel, Leo A1 - Ritz, Fabian A1 - Phan, Thomy A1 - Belzner, Lenz A1 - Roch, Christoph A1 - Feld, Sebastian A1 - Linnhoff-Popien, Claudia T1 - The Holy Grail of Quantum Artificial Intelligence: Major Challenges in Accelerating the Machine Learning Pipeline T2 - ICSEW'20 : Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops UR - https://doi.org/10.1145/3387940.3391469 KW - quantum computing KW - artificial intelligence KW - software engineering Y1 - 2020 UR - https://doi.org/10.1145/3387940.3391469 SN - 978-1-4503-7963-2 SP - 456 EP - 461 PB - ACM CY - New York ER -