TY - CHAP A1 - Hadjidimitriou, Natalia Selini A1 - Lippi, Marco A1 - Nastro, Raffaele A1 - Koch, Thorsten A1 - Mamei, Marco T1 - Short-Term Forecasting of Energy Consumption and Production in Local Energy Communities T2 - 2024 32nd International Conference on Enabling Technologies: Infrastructure for Collaborative Enterprises (WETICE) Y1 - 2024 U6 - https://doi.org/10.1109/WETICE64632.2024.00022 SP - 74 EP - 79 PB - IEEE ER - TY - JOUR A1 - Rehfeldt, Daniel A1 - Koch, Thorsten T1 - Implications, Conflicts, and Reductions for Steiner Trees JF - Mathematical Programming Y1 - 2023 U6 - https://doi.org/10.1007/s10107-021-01757-5 VL - 197 SP - 903 EP - 966 PB - Springer ER - TY - GEN A1 - Kempke, Nils-Christian A1 - Rehfeldt, Daniel A1 - Koch, Thorsten T1 - A Massively Parallel Interior-Point-Method for Arrowhead Linear Programs N2 - In practice, non-specialized interior point algorithms often cannot utilize the massively parallel compute resources offered by modern many- and multi-core compute platforms. However, efficient distributed solution techniques are required, especially for large-scale linear programs. This article describes a new decomposition technique for systems of linear equations implemented in the parallel interior-point solver PIPS-IPM++. The algorithm exploits a matrix structure commonly found in optimization problems: a doubly-bordered block-diagonal or arrowhead structure. This structure is preserved in the linear KKT systems solved during each iteration of the interior-point method. We present a hierarchical Schur complement decomposition that distributes and solves the linear optimization problem; it is designed for high-performance architectures and scales well with the availability of additional computing resources. The decomposition approach uses the border constraints’ locality to decouple the factorization process. Our approach is motivated by large-scale unit-commitment problems. We demonstrate the performance of our method on a set of mid-to large-scale instances, some of which have more than 10^9 nonzeros in their constraint matrix. T3 - ZIB-Report - 24-13 KW - direct methods for linear systems KW - mathematical programming KW - parallel computation KW - linear programming KW - large-scale problems KW - interior-point methods Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-98829 SN - 1438-0064 ER - TY - JOUR A1 - Abbas, Amira A1 - Ambainis, Andris A1 - Augustino, Brandon A1 - Bärtschi, Andreas A1 - Buhrman, Harry A1 - Coffrin, Carleton A1 - Cortiana, Giorgio A1 - Dunjko, Vedran A1 - Egger, Daniel J. A1 - Elmegreen, Bruce G. A1 - Franco, Nicola A1 - Fratini, Filippo A1 - Fuller, Bryce A1 - Gacon, Julien A1 - Gonciulea, Constantin A1 - Gribling, Sander A1 - Gupta, Swati A1 - Hadfield, Stuart A1 - Heese, Raoul A1 - Kircher, Gerhard A1 - Kleinert, Thomas A1 - Koch, Thorsten A1 - Korpas, Georgios A1 - Lenk, Steve A1 - Marecek, Jakub A1 - Markov, Vanio A1 - Mazzola, Guglielmo A1 - Mensa, Stefano A1 - Mohseni, Naeimeh A1 - Nannicini, Giacomo A1 - O’Meara, Corey A1 - Tapia, Elena Peña A1 - Pokutta, Sebastian A1 - Proissl, Manuel A1 - Rebentrost, Patrick A1 - Sahin, Emre A1 - Symons, Benjamin C. B. A1 - Tornow, Sabine A1 - Valls, Víctor A1 - Woerner, Stefan A1 - Wolf-Bauwens, Mira L. A1 - Yard, Jon A1 - Yarkoni, Sheir A1 - Zechiel, Dirk A1 - Zhuk, Sergiy A1 - Zoufal, Christa T1 - Challenges and opportunities in quantum optimization JF - Nature Reviews Physics Y1 - 2024 U6 - https://doi.org/10.1038/s42254-024-00770-9 SN - 2522-5820 VL - 6 SP - 718 EP - 735 PB - Springer Science and Business Media LLC ER - TY - GEN A1 - Vu, Thi Huong A1 - Koch, Thorsten A1 - Xu, Hong-Kun T1 - The gradient projection method: Is the Polyak adaptive stepsize rule optimal? N2 - Not always! This is our answer to the question of whether the Polyak adaptive stepsize rule in the gradient projection method is optimal. The answer is based on revisiting the subgradient projection method by Polyak [USSR Computational Mathematics and Mathematical Physics 9 (1969)] for smooth and convex minimization problems where the objective function possesses a geometric property called flatness. Our results show that the method can be more flexible (the effective range for the parameter controlling the stepsize can be wider) and have sharper convergence rates. Applications to split feasibility/equality problems are presented, deriving for the first time the O(1/k) rate of convergence for the adaptive CQ method. A theoretical guarantee of the linear convergence of the gradient descent method with adaptive stepsizes for Google PageRank is provided. At the same time, numerical experiments are designed to spot the ``optimal" stepsize and to compare with other basic gradient methods. Y1 - 2024 ER - TY - CHAP A1 - Hadjidimitriou, Natalia Selini A1 - Koch, Thorsten A1 - Lippi, Marco A1 - Petkovic, Milena A1 - Mamei, Marco T1 - Analysis of the Impact of COVID-19 and Russo-Ukraine War on Natural Gas Flow Using Time Series Forecasting T2 - Preceedings of the 16th International Conference on Management of Digital Ecosystems Y1 - 2024 ER - TY - JOUR A1 - Pedersen, Jaap A1 - Le, Thi Thai A1 - Koch, Thorsten A1 - Zittel, Janina T1 - Optimal discrete pipe sizing for tree-shaped CO2 networks JF - OR Spectrum N2 - For industries like the cement industry, switching to a carbon-neutral production process is impossible. They must rely on carbon capture, utilization and storage (CCUS) technologies to reduce their production processes’ inevitable carbon dioxide (CO2) emissions. For transporting continuously large amounts of CO2, utilizing a pipeline network is the most effective solution; however, building such a network is expensive. Therefore minimizing the cost of the pipelines to be built is extremely important to make the operation financially feasible. In this context, we investigate the problem of finding optimal pipeline diameters from a discrete set of diameters for a tree-shaped network transporting captured CO2 from multiple sources to a single sink. The general problem of optimizing arc capacities in potential-based fluid networks is already a challenging mixed-integer nonlinear optimization problem. The problem becomes even more complex when adding the highly sensitive nonlinear behavior of CO2 regarding temperature and pressure changes. We propose an iterative algorithm splitting the problem into two parts: a) the pipe-sizing problem under a fixed supply scenario and temperature distribution and b) the thermophysical modeling, including mixing effects, the Joule-Thomson effect, and heat exchange with the surrounding environment. We demonstrate the effectiveness of our approach by applying our algorithm to a real-world network planning problem for a CO2 network in Western Germany. Further, we show the robustness of the algorithm by solving a large artificially created set of network instances. Y1 - 2024 U6 - https://doi.org/10.1007/s00291-024-00773-z VL - 46 SP - 1163 EP - 1187 ER - TY - GEN A1 - Yueksel-Erguen, Inci A1 - Koch, Thorsten A1 - Zittel, Janina T1 - Mathematical optimization based flow scenario generation for operational analysis of European gas transport networks based on open data N2 - The decarbonization of the European energy system demands a rapid and comprehensive transformation while securing energy supplies at all times. Still, natural gas plays a crucial role in this process. Recent unexpected events forced drastic changes in gas routes throughout Europe. Therefore, operational-level analysis of the gas transport networks and technical capacities to cope with these transitions using unconventional scenarios has become essential. Unfortunately, data limitations often hinder such analyses. To overcome this challenge, we propose a mathematical model-based scenario generator that enables operational analysis of the European gas network using open data. Our approach focuses on the consistent analysis of specific partitions of the gas transport network, whose network topology data is readily available. We generate reproducible and consistent node-based gas in/out-flow scenarios for these defined network partitions to enable feasibility analysis and data quality assessment. Our proposed method is demonstrated through several applications that address the feasibility analysis and data quality assessment of the German gas transport network. By using open data and a mathematical modeling approach, our method allows for a more comprehensive understanding of the gas transport network's behavior and assists in decision-making during the transition to decarbonization. T3 - ZIB-Report - 24-03 Y1 - 2024 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-95789 SN - 1438-0064 ER - TY - JOUR A1 - Petkovic, Milena A1 - Chen, Ying A1 - Gamrath, Inken A1 - Gotzes, Uwe A1 - Hadjidimitrou, Natalia Selini A1 - Zittel, Janina A1 - Xu, Xiaofei A1 - Koch, Thorsten T1 - A hybrid approach for high precision prediction of gas flows JF - Energy Systems N2 - About 23% of the German energy demand is supplied by natural gas. Additionally, for about the same amount Germany serves as a transit country. Thereby, the German network represents a central hub in the European natural gas transport network. The transport infrastructure is operated by transmissions system operators (TSOs). The number one priority of the TSOs is to ensure the security of supply. However, the TSOs have only very limited knowledge about the intentions and planned actions of the shippers (traders). Open Grid Europe (OGE), one of Germany’s largest TSO, operates a high-pressure transport network of about 12,000 km length. With the introduction of peak-load gas power stations, it is of great importance to predict in- and out-flow of the network to ensure the necessary flexibility and security of supply for the German Energy Transition (“Energiewende”). In this paper, we introduce a novel hybrid forecast method applied to gas flows at the boundary nodes of a transport network. This method employs an optimized feature selection and minimization. We use a combination of a FAR, LSTM and mathematical programming to achieve robust high-quality forecasts on real-world data for different types of network nodes. Y1 - 2022 U6 - https://doi.org/10.1007/s12667-021-00466-4 VL - 13 SP - 383 EP - 408 ER - TY - CHAP A1 - Pedersen, Jaap A1 - Hoppmann-Baum, Kai A1 - Zittel, Janina A1 - Koch, Thorsten T1 - Blending hydrogen into natural gas: An assessment of the capacity of the German gas grid T2 - Operations Research Proceedings 2021 N2 - In the transition towards a pure hydrogen infrastructure, repurposing the existing natural gas infrastructure is considered. In this study, the maximal technically feasible injection of hydrogen into the existing German natural gas transmission network is analysed with respect to regulatory limits regarding the gas quality. We propose a transient tracking model based on the general pooling problem including linepack. The analysis is conducted using real-world hourly gas flow data on a network of about 10,000 km length. Y1 - 2022 U6 - https://doi.org/https://doi.org/10.1007/978-3-031-08623-6_28 SP - 182 EP - 187 ER - TY - CHAP A1 - Grötschel, Martin A1 - Koch, Thorsten A1 - Hoang, Nam-Dung ED - Biermann, Katja ED - Grötschel, Martin ED - Lutz-Westphal, Brigitte T1 - Lagenwechsel minimieren – oder das Bohren von Löchern in Leiterplatten T2 - Besser als Mathe Y1 - 2010 U6 - https://doi.org/10.1007/978-3-658-01004-1_19 SP - 161 EP - 174 PB - Vieweg+Teubner ER - TY - JOUR A1 - Berthold, Timo A1 - Koch, Thorsten A1 - Shinano, Yuji T1 - MILP. Try. Repeat. JF - Proceedings of the 13th International Conference on the Practice and Theory of Automated Timetabling - PATAT 2021 Y1 - 2021 VL - 2 ER - TY - JOUR A1 - Petkovic, Milena A1 - Koch, Thorsten A1 - Zittel, Janina T1 - Deep learning for spatio-temporal supply anddemand forecasting in natural gas transmission networks JF - Energy Science and Engineering N2 - Germany is the largest market for natural gas in the European Union, with an annual consumption of approx. 95 billion cubic meters. Germany's high-pressure gas pipeline network is roughly 40,000 km long, which enables highly fluctuating quantities of gas to be transported safely over long distances. Considering that similar amounts of gas are also transshipped through Germany to other EU states, it is clear that Germany's gas transport system is essential to the European energy supply. Since the average velocity of gas in a pipeline is only 25km/h, an adequate high-precision, high-frequency forecasting of supply and demand is crucial for efficient control and operation of such a transmission network. We propose a deep learning model based on spatio-temporal convolutional neural networks (DLST) to tackle the problem of gas flow forecasting in a complex high-pressure transmission network. Experiments show that our model effectively captures comprehensive spatio-temporal correlations through modeling gas networks and consistently outperforms state-of-the-art benchmarks on real-world data sets by at least 21%. The results demonstrate that the proposed model can deal with complex nonlinear gas network flow forecasting with high accuracy and effectiveness. Y1 - 2021 U6 - https://doi.org/https://doi.org/10.1002/ese3.932 ER - TY - GEN A1 - Koch, Thorsten A1 - Berthold, Timo A1 - Pedersen, Jaap A1 - Vanaret, Charlie T1 - Progress in Mathematical Programming Solvers from 2001 to 2020 N2 - This study investigates the progress made in LP and MILP solver performance during the last two decades by comparing the solver software from the beginning of the millennium with the codes available today. On average, we found out that for solving LP/MILP, computer hardware got about 20 times faster, and the algorithms improved by a factor of about nine for LP and around 50 for MILP, which gives a total speed-up of about 180 and 1,000 times, respectively. However, these numbers have a very high variance and they considerably underestimate the progress made on the algorithmic side: many problem instances can nowadays be solved within seconds, which the old codes are not able to solve within any reasonable time. T3 - ZIB-Report - 21-20 Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-82779 SN - 1438-0064 ER - TY - GEN A1 - Pedersen, Jaap A1 - Hoppmann-Baum, Kai A1 - Zittel, Janina A1 - Koch, Thorsten T1 - Blending hydrogen into natural gas: An assessment of the capacity of the German gas grid; Technical Report N2 - In the transition towards a pure hydrogen infrastructure, utilizing the existing natural gas infrastructure is a necessity. In this study, the maximal technically feasible injection of hydrogen into the existing German natural gas transmission network is analysed with respect to regulatory limits regarding the gas quality. We propose a transient tracking model based on the general pooling problem including linepack. The analysis is conducted using real-world hourly gas flow data on a network of about 10,000 km length. T3 - ZIB-Report - 21-21 Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-82838 SN - 1438-0064 ER - TY - JOUR A1 - Le, Thi Thai A1 - Koch, Thorsten T1 - Interface stability of compressible fluids in porous media JF - Physics of Fluids N2 - The stability of flows in porous media plays a vital role in transiting energy supply from natural gas to hydrogen, especially for estimating the usability of existing underground gas storage infrastructures. Thus, this research aims to analyze the interface stability of the tangential-velocity discontinuity between two compressible gases by using Darcy's model to include the porosity effect. The results shown in this research will be a basis for considering whether underground gas storages in porous material can be used to store hydrogen. We show the relation between the Mach number M, the viscosity \mu, and the porosity \epsilon on the stability of the interface. This interface stability affects gases' withdrawal and injection processes, thus will help us to determine the velocity which with gas can be extracted and injected into the storage effectively. By imposing solid walls along the flow direction, the critical values of these parameters regarding the stability of the interface are smaller than when considering no walls. The consideration of bounded flows approaches the problem more realistically. In particular, this analysis plays a vital role when considering two-dimensional gas flows in storages and pipes. Y1 - 2021 U6 - https://doi.org/10.1063/5.0059336 VL - 33 IS - 8 SP - 084102 PB - AIP Publishing ER - TY - JOUR A1 - Rehfeldt, Daniel A1 - Hobbie, Hannes A1 - Schönheit, David A1 - Koch, Thorsten A1 - Möst, Dominik A1 - Gleixner, Ambros T1 - A massively parallel interior-point solver for LPs with generalized arrowhead structure, and applications to energy system models JF - European Journal of Operational Research N2 - Linear energy system models are a crucial component of energy system design and operations, as well as energy policy consulting. If detailed enough, such models lead to large-scale linear programs, which can be intractable even for the best state-of-the-art solvers. This article introduces an interior-point solver that exploits common structures of energy system models to efficiently run in parallel on distributed-memory systems. The solver is designed for linear programs with doubly-bordered block-diagonal constraint matrix and makes use of a Schur complement based decomposition. In order to handle the large number of linking constraints and variables commonly observed in energy system models, a distributed Schur complement preconditioner is used. In addition, the solver features a number of more generic techniques such as parallel matrix scaling and structure-preserving presolving. The implementation is based on the solver PIPS-IPM. We evaluate the computational performance on energy system models with up to four billion nonzero entries in the constraint matrix—and up to one billion columns and one billion rows. This article mainly concentrates on the energy system model ELMOD, which is a linear optimization model representing the European electricity markets by the use of a nodal pricing market-clearing. It has been widely applied in the literature on energy system analyses in recent years. However, it will be demonstrated that the new solver is also applicable to other energy system models. Y1 - 2022 U6 - https://doi.org/10.1016/j.ejor.2021.06.063 VL - 296 IS - 1 SP - 60 EP - 71 ER - TY - CHAP A1 - Rehfeldt, Daniel A1 - Koch, Thorsten T1 - Implications, conflicts, and reductions for Steiner trees T2 - Integer Programming and Combinatorial Optimization: 22th International Conference, IPCO 2021 Y1 - 2021 U6 - https://doi.org/10.1007/978-3-030-73879-2_33 SP - 473 EP - 487 ER - TY - JOUR A1 - Anderson, Lovis A1 - Turner, Mark A1 - Koch, Thorsten T1 - Generative deep learning for decision making in gas networks JF - Mathematical Methods of Operations Research N2 - A decision support system relies on frequent re-solving of similar problem instances. While the general structure remains the same in corresponding applications, the input parameters are updated on a regular basis. We propose a generative neural network design for learning integer decision variables of mixed-integer linear programming (MILP) formulations of these problems. We utilise a deep neural network discriminator and a MILP solver as our oracle to train our generative neural network. In this article, we present the results of our design applied to the transient gas optimisation problem. With the trained network we produce a feasible solution in 2.5s, use it as a warm-start solution, and thereby decrease global optimal solution solve time by 60.5%. Y1 - 2022 U6 - https://doi.org/10.1007/s00186-022-00777-x VL - 95 SP - 503 EP - 532 PB - Springer Nature ER - TY - JOUR A1 - Rehfeldt, Daniel A1 - Koch, Thorsten T1 - On the exact solution of prize-collecting Steiner tree problems JF - INFORMS Journal on Computing Y1 - 2021 U6 - https://doi.org/10.1287/ijoc.2021.1087 ER -