TY - CONF A1 - Kister, Alexander A1 - Wrobel, S. A1 - Wirtz, T. A1 - Paul, N. T1 - Multi-Agent Neural Rewriter for Vehicle Routing with Limited Disclosure of Costs N2 - We interpret solving the multi-vehicle routing problem as a team Markov game with partially observable costs. For a given set of customers to serve, the playing agents (vehicles) have the common goal to determine the team-optimal agent routes with minimal total cost. Each agent thereby observes only its own cost. Our multi-agent reinforcement learning approach, the so-called multi-agent Neural Rewriter, builds on the single-agent Neural Rewriter to solve the problem by iteratively rewriting solutions. Parallel agent action execution and partial observability require new rewriting rules for the game. We propose the introduction of a so-called pool in the system which serves as a collection point for unvisited nodes. It enables agents to act simultaneously and exchange nodes in a conflict-free manner. We realize limited disclosure of agent-specific costs by only sharing them during learning. During inference, each agents acts decentrally, solely based on its own cost. First empirical results on small problem sizes demonstrate that we reach a performance close to the employed OR-Tools benchmark which operates in the perfect cost information setting. T2 - Gamification and Multiagent Solutions Workshop (ICLR 2022) CY - Online meeting DA - 29.04.2022 KW - Reinforcement learning KW - Deep Learning KW - Vehicle Routing PY - 2022 AN - OPUS4-56687 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Weichert, Dorina A1 - Kister, Alexander A1 - Volbach, Peter A1 - Houben, Sebastian A1 - Trost, Marcus A1 - Wrobel, Stefan T1 - Explainable production planning under partial observability in high-precision manufacturing JF - Journal of Manufacturing Systems N2 - Conceptually, high-precision manufacturing is a sequence of production and measurement steps, where both kinds of steps require to use non-deterministic models to represent production and measurement tolerances. This paper demonstrates how to effectively represent these manufacturing processes as Partially Observable Markov Decision Processes (POMDP) and derive an offline strategy with state-of-the-art Monte Carlo Tree Search (MCTS) approaches. In doing so, we face two challenges: a continuous observation space and explainability requirements from the side of the process engineers. As a result, we find that a tradeoff between the quantitative performance of the solution and its explainability is required. In a nutshell, the paper elucidates the entire process of explainable production planning: We design and validate a white-box simulation from expert knowledge, examine state-of-the-art POMDP solvers, and discuss our results from both the perspective of machine learning research and as an illustration for high-precision manufacturing practitioners. KW - Explainability KW - Manufacturing KW - Reinforcement Learning KW - Monte Carlo tree search KW - Partially observable Markov decision process PY - 2023 DO - https://doi.org/10.1016/j.jmsy.2023.08.009 SN - 0278-6125 VL - 70 SP - 514 EP - 524 PB - Elsevier Ltd. CY - Southfield AN - OPUS4-58963 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER - TY - JOUR A1 - Albakri, Bashar A1 - Turski Silva Diniz, Analice A1 - Benner, Philipp A1 - Muth, Thilo A1 - Nakajima, Shinichi A1 - Favaro, Marco A1 - Kister, Alexander ED - Hillman, Robert T1 - Machine learning-assisted equivalent circuit identification for dielectric spectroscopy of polymers JF - Electrochimica Acta N2 - Polymers have become indispensable across fields of application, and understanding their structure–property relationships and dynamic behaviour is essential for performance optimization. Polymer membranes, particularly ion exchange membranes, play a crucial role in renewable energy conversion technologies, fuel cells, solar energy conversion, and energy storage. In this context, broadband dielectric spectroscopy (BDS) offers a powerful, non-destructive approach to investigate the electrical response and relaxation dynamics of polymers. These properties are investigated by parametrizing the system’s impedance response in terms of a network of circuit elements, i.e. the electrical equivalent circuit (EEC), whose impedance resembles the one of the system under investigation. However, the determination of the EEC from BDS data is challenging due to system complexity, interdependencies of circuit elements, and researcher biases. In this work, we propose a novel approach that incorporates a convolutional neural network (CNN) model to predict the EEC topology. By reducing user bias and enhancing data analysis, this approach aims to make BDS accessible to both experienced users and those with limited expertise. We show that the combination of machine learning and BDS provides valuable insights into the dynamic behaviour of polymer membranes, thus facilitating the design and characterization of tailored polymers for various applications. We also show that our model outperforms state-of-the-art machine learning methods with a top-5 accuracy of around 80% for predicting the circuit topology and a parameter fitting error as low as 0.05%. KW - Polymer membranes KW - Electrochemical impedance spectroscopy KW - Broadband dielectric spectroscopy KW - Deep learning KW - Machine learning KW - Equivalent circuit PY - 2024 UR - https://nbn-resolving.org/urn:nbn:de:kobv:b43-602138 DO - https://doi.org/10.1016/j.electacta.2024.144474 VL - 496 SP - 1 EP - 13 PB - Elsevier Ltd. AN - OPUS4-60213 LA - eng AD - Bundesanstalt fuer Materialforschung und -pruefung (BAM), Berlin, Germany ER -