TY - GEN A1 - Tateiwa, Nariaki A1 - Shinano, Yuji A1 - Yasuda, Masaya A1 - Kaji, Shizuo A1 - Yamamura, Keiichiro A1 - Fujisawa, Katsuki T1 - Massively parallel sharing lattice basis reduction N2 - For cryptanalysis in lattice-based schemes, the performance evaluation of lattice basis reduction using high-performance computers is becoming increasingly important for the determination of the security level. We propose a distributed and asynchronous parallel reduction algorithm based on randomization and DeepBKZ, which is an improved variant of the block Korkine-Zolotarev (BKZ) reduction algorithm. Randomized copies of a lattice basis are distributed to up to 103,680 cores and independently reduced in parallel, while some basis vectors are shared asynchronously among all processes via MPI. There is a trade-off between randomization and information sharing; if a substantial amount of information is shared, all processes will work on the same problem, thereby diminishing the benefit of parallelization. To monitor this balance between randomness and sharing, we propose a metric to quantify the variety of lattice bases. We empirically find an optimal parameter of sharing for high-dimensional lattices. We demonstrate the efficacy of our proposed parallel algorithm and implementation with respect to both performance and scalability through our experiments. T3 - ZIB-Report - 21-38 KW - Discrete optimization KW - Lattice problem KW - Lattice-based cryptography KW - Shortest vector problem KW - Parallel algorithms KW - Ubiquity Generator Framework Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-85209 SN - 1438-0064 N1 - under review ER - TY - GEN A1 - Hosoda, Junko A1 - Maher, Stephen J. A1 - Shinano, Yuji A1 - Villumsen, Jonas Christoffer T1 - A parallel branch-and-bound heuristic for the integrated long-haul and local vehicle routing problem on an adaptive transportation network N2 - Consolidation of commodities and coordination of vehicle routes are fundamental features of supply chain management problems. While locations for consolidation and coordination are typically known a priori, in adaptive transportation networks this is not the case. The identification of such consolidation locations forms part of the decision making process. Supply chain management problems integrating the designation of consolidation locations with the coordination of long haul and local vehicle routing is not only challenging to solve, but also very difficult to formulate mathematically. In this paper, the first mathematical model integrating location clustering with long haul and local vehicle routing is proposed. This mathematical formulation is used to develop algorithms to find high quality solutions. A novel parallel framework is developed that combines exact and heuristic methods to improve the search for high quality solutions and provide valid bounds. The results demonstrate that using exact methods to guide heuristic search is an effective approach to find high quality solutions for difficult supply chain management problems. T3 - ZIB-Report - 23-02 Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-89700 SN - 1438-0064 ER - TY - GEN A1 - Fujii, Koichi A1 - Ito, Naoki A1 - Kim, Sunyoung A1 - Kojima, Masakazu A1 - Shinano, Yuji A1 - Toh, Kim-Chuan T1 - Solving Challenging Large Scale QAPs N2 - We report our progress on the project for solving larger scale quadratic assignment problems (QAPs). Our main approach to solve large scale NP-hard combinatorial optimization problems such as QAPs is a parallel branch-and-bound method efficiently implemented on a powerful computer system using the Ubiquity Generator(UG) framework that can utilize more than 100,000 cores. Lower bounding procedures incorporated in the branch-and-bound method play a crucial role in solving the problems. For a strong lower bounding procedure, we employ the Lagrangian doubly nonnegative (DNN) relaxation and the Newton-bracketing method developed by the authors’ group. In this report, we describe some basic tools used in the project including the lower bounding procedure and branching rules, and present some preliminary numerical results. Our next target problem is QAPs with dimension at least 50, as we have succeeded to solve tai30a and sko42 from QAPLIB for the first time. T3 - ZIB-Report - 21-02 KW - QAP KW - Parallel Branch-and-Bound Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-81303 SN - 1438-0064 ER - TY - GEN A1 - Fujii, Koichi A1 - Kim, Sunyoung A1 - Kojima, Masakazu A1 - Mittelmann, Hans D. A1 - Shinano, Yuji T1 - An Exceptionally Difficult Binary Quadratic Optimization Problem with Symmetry: a Challenge for The Largest Unsolved QAP Instance Tai256c N2 - Tai256c is the largest unsolved quadratic assignment problem (QAP) instance in QAPLIB. It is known that QAP tai256c can be converted into a 256 dimensional binary quadratic optimization problem (BQOP) with a single cardinality constraint which requires the sum of the binary variables to be 92. As the BQOP is much simpler than the original QAP, the conversion increases the possibility to solve the QAP. Solving exactly the BQOP, however, is still very difficult. Indeed, a 1.48% gap remains between the best known upper bound (UB) and lower bound (LB) of the unknown optimal value. This paper shows that the BQOP admits a nontrivial symmetry, a property that makes the BQOP very hard to solve. The symmetry induces equivalent subproblems in branch and bound (BB) methods. To effectively improve the LB, we propose an efficient BB method that incorporates a doubly nonnegative relaxation, the standard orbit branching and a technique to prune equivalent subproblems. With this BB method, a new LB with 1.25% gap is successfully obtained, and computing an LB with 1.0% gap is shown to be still quite difficult. T3 - ZIB-Report - 23-27 Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-93072 SN - 1438-0064 ER - TY - GEN A1 - Fujii, Koichi A1 - Ito, Naoki A1 - Kim, Sunyoung A1 - Kojima, Masakazu A1 - Shinano, Yuji A1 - Toh, Kim-Chuan T1 - 大規模二次割当問題への挑戦 T2 - 統計数理研究所共同研究リポート 453 最適化:モデリングとアルゴリズム33 2022年3月 「大規模二次割当問題への挑戦」 p.84-p.92 N2 - 二次割当問題は線形緩和が弱いことが知られ,強化のため多様な緩和手法が考案されているが,その一つである二重非負値計画緩和( DNN 緩和)及びその解法として近年研究が進んでいるニュートン・ブラケット法を紹介し,それらに基づく分枝限定法の実装及び数値実験結果について報告する. T2 - Solving Large Scale QAPs with DNN-based Branch-and-bound : a progress report T3 - ZIB-Report - 22-11 Y1 - 2022 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-86779 SN - 1438-0064 ER - TY - JOUR A1 - Yokoyama, Ryohei A1 - Kamada, Hiroki A1 - Shinano, Yuji A1 - Wakui, Tetsuya T1 - A hierarchical optimization approach to robust design of energy supply systems based on a mixed-integer linear model JF - Energy N2 - In designing energy supply systems, designers should heighten the robustness in performance criteria against the uncertainty in energy demands. In this paper, a robust optimal design method using a hierarchical mixed-integer linear programming (MILP) method is proposed to maximize the robustness of energy supply systems under uncertain energy demands based on a mixed-integer linear model. A robust optimal design problem is formulated as a three-level min-max-min MILP one by expressing uncertain energy demands by intervals, evaluating the robustness in a performance criterion based on the minimax regret criterion, and considering relationships among integer design variables, uncertain energy demands, and integer and continuous operation variables. This problem is solved by evaluating upper and lower bounds for the minimum of the maximum regret of the performance criterion repeatedly outside, and evaluating lower and upper bounds for the maximum regret repeatedly inside. Different types of optimization problems are solved by applying a hierarchical MILP method developed for ordinary optimal design problems without and with its modifications. In a case study, the proposed approach is applied to the robust optimal design of a cogeneration system. Through the study, its validity and effectiveness are ascertained, and some features of the obtained robust designs are clarified. Y1 - 2021 U6 - https://doi.org/https://doi.org/10.1016/j.energy.2021.120343 VL - 229 ER - TY - JOUR A1 - Fujii, Koichi A1 - Kim, Sunyoung A1 - Kojima, Masakazu A1 - Mittelmann, Hans D. A1 - Shinano, Yuji T1 - An exceptionally difficult binary quadratic optimization problem with symmetry: a challenge for the largest unsolved QAP instance Tai256c JF - Optimization Letters N2 - Tai256c is the largest unsolved quadratic assignment problem (QAP) instance in QAPLIB. It is known that QAP tai256c can be converted into a 256 dimensional binary quadratic optimization problem (BQOP) with a single cardinality constraint which requires the sum of the binary variables to be 92. As the BQOP is much simpler than the original QAP, the conversion increases the possibility to solve the QAP. Solving exactly the BQOP, however, is still very difficult. Indeed, a 1.48% gap remains between the best known upper bound (UB) and lower bound (LB) of the unknown optimal value. This paper shows that the BQOP admits a nontrivial symmetry, a property that makes the BQOP very hard to solve. Despite this difficulty, it is imperative to decrease the gap in order to ultimately solve the BQOP exactly. To effectively improve the LB, we propose an efficient BB method that incorporates a doubly nonnegative relaxation, the orbit branching and the isomorphism pruning. With this BB method, a new LB with 1.25% gap is successfully obtained, and computing an LB with gap is shown to be still quite difficult. Y1 - 2024 U6 - https://doi.org/10.1007/s11590-024-02157-2 SN - 1862-4472 PB - Springer Science and Business Media LLC ER - TY - JOUR A1 - Hosoda, Junko A1 - Maher, Stephen J. A1 - Shinano, Yuji A1 - Villumsen, Jonas Christoffer T1 - A parallel branch-and-bound heuristic for the integrated long-haul and local vehicle routing problem on an adaptive transportation network JF - Computers & Operations Research N2 - Consolidation of commodities and coordination of vehicle routes are fundamental features of supply chain management problems. While locations for consolidation and coordination are typically known a priori, in adaptive transportation networks this is not the case. The identification of such consolidation locations forms part of the decision making process. Supply chain management problems integrating the designation of consolidation locations with the coordination of long haul and local vehicle routing is not only challenging to solve, but also very difficult to formulate mathematically. In this paper, the first mathematical model integrating location clustering with long haul and local vehicle routing is proposed. This mathematical formulation is used to develop algorithms to find high quality solutions. A novel parallel framework is developed that combines exact and heuristic methods to improve the search for high quality solutions and provide valid bounds. The results demonstrate that using exact methods to guide heuristic search is an effective approach to find high quality solutions for difficult supply chain management problems. Y1 - 2024 U6 - https://doi.org/10.1016/j.cor.2024.106570 SN - 0305-0548 VL - 165 PB - Elsevier BV ER - TY - GEN A1 - Le, Thi Thai T1 - Effect of viscous forces on the interface stability of a tangential-velocity discontinuity in compressible fluids T2 - Journal N2 - Compressible flows are prevalent in natural and technological processes, particularly in the energy transition to renewable energy systems. Consequently, extensive research has focused on understanding the stability of tangential--velocity discontinuity in compressible media. Despite recent advancements that address industrial challenges more realistically, many studies have ignored viscous stress tensors' impact, leading to inaccuracies in predicting interface stability. This omission becomes critical, especially in high Reynolds or low Mach number flows, where viscous forces dissipate kinetic energy across interfaces, affect total energy dissipation, and dampen flow instabilities. Our work is thus motivated to analyze the viscosity force effect by including the viscous stress tensor terms in the motion equations. Our results show that by considering the effect of viscous forces, the tangential-velocity discontinuity interface is constantly destabilized for the entire range of the Mach number. T3 - ZIB-Report - 24-04 Y1 - 2024 ER - TY - CHAP A1 - Kiessling, David A1 - Vanaret, Charlie A1 - Astudillo, Alejandro A1 - Decré, Wilm A1 - Swevers, Jan T1 - An Almost Feasible Sequential Linear Programming Algorithm T2 - 2024 European Control Conference (ECC), Stockholm, Sweden N2 - This paper proposes an almost feasible Sequential Linear Programming (afSLP) algorithm. In the first part, the practical limitations of previously proposed Feasible Sequential Linear Programming (FSLP) methods are discussed along with illustrative examples. Then, we present a generalization of FSLP based on a tolerance-tube method that addresses the shortcomings of FSLP. The proposed algorithm afSLP consists of two phases. Phase I starts from random infeasible points and iterates towards a relaxation of the feasible set. Once the tolerance-tube around the feasible set is reached, phase II is started and all future iterates are kept within the tolerance-tube. The novel method includes enhancements to the originally proposed tolerance-tube method that are necessary for global convergence. afSLP is shown to outperform FSLP and the state-of-the-art solver IPOPT on a SCARA robot optimization problem. Y1 - 2024 U6 - https://doi.org/10.23919/ECC64448.2024.10590864 SP - 2328 EP - 2335 ER - TY - GEN A1 - Petkovic, Milena A1 - Zakiyeva, Nazgul A1 - Zittel, Janina T1 - Statistical analysis and modeling for detecting regime changes in gas nomination time series N2 - As a result of the legislation for gas markets introduced by the European Union in 2005, separate independent companies have to conduct the transport and trading of natural gas. The current gas market of Germany, which has a market value of more than 54 billion USD, consists of Transmission System Operators (TSO), network users, and traders. Traders can nominate a certain amount of gas anytime and anywhere in the network. Such unrestricted access for the traders, on the other hand, increase the uncertainty in the gas supply management. Some customers’ behaviors may cause abrupt structural changes in gas flow time series. In particular, it is a challenging task for the TSO operators to predict gas nominations 6 to 10 hours ahead. In our study, we aim to investigate the regime changes in the time series of nominations to predict the 6 to 10 hours ahead of gas nominations. T3 - ZIB-Report - 21-22 KW - Time series Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-82988 SN - 1438-0064 ER - TY - JOUR A1 - Le, Thi Thai A1 - Fukumoto, Yasuhide T1 - Effect of depth discontinuity on interfacial stability of tangential-velocity discontinuity in shallow-water flow JF - Physics Letters A N2 - It is well known as the Kelvin-Helmholtz instability (KHI) that an interface of tangential velocity discontinuity is necessarily unstable, regardless of the velocity difference's strength. However, the KHI is suppressed for shallow water flows if the Froude number, defined by the ratio of the velocity difference to the gravity wave's speed, is sufficiently large. In this investigation, we examine the effect of the depth difference of two fluid layers on the KHI. The depth difference enhances instability. Given the Froude number in the instability range, the growth rate sensitively depends on the depth ratio and increases monotonically with the depth ratio difference from unity. The critical value of the Froude number for stabilization varies with the depth ratio and attains the minimum value √8 for equal depth. This behavior is verified by asymptotic analysis. Y1 - 2022 U6 - https://doi.org/10.1016/j.physleta.2022.128073 VL - 436 SP - 128073 PB - ELSEVIER ER - TY - GEN A1 - Zakiyeva, Nazgul A1 - Petkovic, Milena T1 - Modeling and forecasting gas network flows with multivariate time series and mathematical programming approach N2 - With annual consumption of approx. 95 billion cubic me-ters and similar amounts of gas just transshipped through Germany toother EU states, Germany’s gas transport system plays a vital role inEuropean energy supply. The complex, more than 40,000 km long high-pressure transmission network is controlled by several transmission sys-tem operators (TSOs) whose main task is to provide security of supplyin a cost-efficient way. Given the slow speed of gas flows through the gastransmission network pipelines, it has been an essential task for the gasnetwork operators to enhance the forecast tools to build an accurate andeffective gas flow prediction model for the whole network. By incorpo-rating the recent progress in mathematical programming and time seriesmodeling, we aim to model natural gas network and predict gas in- andout-flows at multiple supply and demand nodes for different forecastinghorizons. Our model is able to describe the dynamics in the network bydetecting the key nodes, which may help to build an optimal manage-ment strategy for transmission system operators. T3 - ZIB-Report - 21-23 Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-82966 SN - 1438-0064 ER - TY - JOUR A1 - Petkovic, Milena A1 - Koch, Thorsten A1 - Zittel, Janina T1 - Deep learning for spatio-temporal supply anddemand forecasting in natural gas transmission networks JF - Energy Science and Engineering N2 - Germany is the largest market for natural gas in the European Union, with an annual consumption of approx. 95 billion cubic meters. Germany's high-pressure gas pipeline network is roughly 40,000 km long, which enables highly fluctuating quantities of gas to be transported safely over long distances. Considering that similar amounts of gas are also transshipped through Germany to other EU states, it is clear that Germany's gas transport system is essential to the European energy supply. Since the average velocity of gas in a pipeline is only 25km/h, an adequate high-precision, high-frequency forecasting of supply and demand is crucial for efficient control and operation of such a transmission network. We propose a deep learning model based on spatio-temporal convolutional neural networks (DLST) to tackle the problem of gas flow forecasting in a complex high-pressure transmission network. Experiments show that our model effectively captures comprehensive spatio-temporal correlations through modeling gas networks and consistently outperforms state-of-the-art benchmarks on real-world data sets by at least 21%. The results demonstrate that the proposed model can deal with complex nonlinear gas network flow forecasting with high accuracy and effectiveness. Y1 - 2021 U6 - https://doi.org/https://doi.org/10.1002/ese3.932 ER - TY - CHAP A1 - Schwarz, R. A1 - Lacalandra, F. A1 - Schewe, L. A1 - Bettinelli, A. A1 - Vigo, D. A1 - Bischi, A. A1 - Parriani, T. A1 - Martelli, E. A1 - Vuik, K. A1 - Lenz, R. A1 - Madsen, H. A1 - Blanco, I. A1 - Guericke, D. A1 - Yüksel-Ergün, I. A1 - Zittel, J. T1 - Network and Storage T2 - Mathematical Optimization for Efficient and Robust Energy Networks N2 - Natural gas is considered by many to be the most important energy source for the future. The objectives of energy commodities strategic problems can be mainly related to natural gas and deal with the definition of the “optimal” gas pipelines design which includes a number of related sub problems such as: Gas stations (compression) location and Gas storage locations, as well as compression station design and optimal operation. Y1 - 2020 SN - 978-3-030-57442-0 U6 - https://doi.org/https://doi.org/10.1007/978-3-030-57442-0_6 VL - 4 PB - Springer ER - TY - GEN A1 - Tateiwa, Nariaki A1 - Shinano, Yuji A1 - Yamamura, Keiichiro A1 - Yoshida, Akihiro A1 - Kaji, Shizuo A1 - Yasuda, Masaya A1 - Fujisawa, Katsuki T1 - CMAP-LAP: Configurable Massively Parallel Solver for Lattice Problems N2 - Lattice problems are a class of optimization problems that are notably hard. There are no classical or quantum algorithms known to solve these problems efficiently. Their hardness has made lattices a major cryptographic primitive for post-quantum cryptography. Several different approaches have been used for lattice problems with different computational profiles; some suffer from super-exponential time, and others require exponential space. This motivated us to develop a novel lattice problem solver, CMAP-LAP, based on the clever coordination of different algorithms that run massively in parallel. With our flexible framework, heterogeneous modules run asynchronously in parallel on a large-scale distributed system while exchanging information, which drastically boosts the overall performance. We also implement full checkpoint-and-restart functionality, which is vital to high-dimensional lattice problems. Through numerical experiments with up to 103,680 cores, we evaluated the performance and stability of our system and demonstrated its high capability for future massive-scale experiments. T3 - ZIB-Report - 21-16 KW - Discrete optimization KW - Lattice problem KW - Lattice-based cryptography KW - Shortest vector problem KW - Parallel algorithms KW - Ubiquity Generator Framework Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-82802 SN - 1438-0064 N1 - Revised version is accepted to HiPC 2021 ER - TY - GEN A1 - Pedersen, Jaap A1 - Hoppmann-Baum, Kai A1 - Zittel, Janina A1 - Koch, Thorsten T1 - Blending hydrogen into natural gas: An assessment of the capacity of the German gas grid; Technical Report N2 - In the transition towards a pure hydrogen infrastructure, utilizing the existing natural gas infrastructure is a necessity. In this study, the maximal technically feasible injection of hydrogen into the existing German natural gas transmission network is analysed with respect to regulatory limits regarding the gas quality. We propose a transient tracking model based on the general pooling problem including linepack. The analysis is conducted using real-world hourly gas flow data on a network of about 10,000 km length. T3 - ZIB-Report - 21-21 Y1 - 2021 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-82838 SN - 1438-0064 ER - TY - JOUR A1 - Alzaatreh, Ayman A1 - Aljarrah, Mohammad A1 - Almagambetova, Ayanna A1 - Zakiyeva, Nazgul T1 - On the Regression Model for Generalized Normal Distributions JF - Entropy N2 - The traditional linear regression model that assumes normal residuals is applied extensively in engineering and science. However, the normality assumption of the model residuals is often ineffective. This drawback can be overcome by using a generalized normal regression model that assumes a non-normal response. In this paper, we propose regression models based on generalizations of the normal distribution. The proposed regression models can be used effectively in modeling data with a highly skewed response. Furthermore, we study in some details the structural properties of the proposed generalizations of the normal distribution. The maximum likelihood method is used for estimating the parameters of the proposed method. The performance of the maximum likelihood estimators in estimating the distributional parameters is assessed through a small simulation study. Applications to two real datasets are given to illustrate the flexibility and the usefulness of the proposed distributions and their regression models. Y1 - 2021 U6 - https://doi.org/https://doi.org/10.3390/e23020173 VL - 23 IS - 2 SP - 173 ER - TY - JOUR A1 - Jin, Liangbing A1 - Le, Thi Thai A1 - Fukumoto, Yasuhide T1 - Frictional effect on stability of discontinuity interface in tangential velocity of a shallow-water flow JF - Physics Letters A N2 - We examine a frictional effect on the linear stability of an interface of discontinuity in tangential velocity. The fluid is moving with uniform velocity U in a region but is at rest in the other, and the bottom surface is assumed to exert drag force, quadratic in velocity, on the thin fluid layer. In the absence of the drag, the instability of the Kelvin-Helmholtz type is suppressed for U>√8 c, with c being the propagating speed of the gravity wave. We find by asymptotic analyses for both small and large values of the drag strength that the drag, regardless of its strength, makes the flow unstable for the whole range of the Froude number U/c. Y1 - 2019 U6 - https://doi.org/10.1016/j.physleta.2019.125839 VL - 383 IS - 26 SP - 125839 ER - TY - JOUR A1 - Le, Thi Thai T1 - Effect of water depth on Kelvin - Helmholtz instability in a shallow-water flow JF - Journal of Mathematical Physics N2 - It is well known that the interface between two regions of an incompressible ideal fluid flow moving in a relative motion is necessarily destabilized, regardless of the velocity difference's strength. This phenomenon is the so-called Kelvin-Helmholtz instability (KHI). However, a large number of works demonstrated a surprising result that the instability is suppressed for shallow water flows; the interface is stabilized if the Froude number, defined by the velocity difference's ratio to the gravity wave's speed, is sufficiently large. In a limited way, these authors have been used the shallow-water equations without the higher-order effect of the dispersive terms. Thus, this investigation aims to examine these higher-order dispersive effects to analyze the interface stability problem of tangential-velocity discontinuity in shallow-water flows. In particular, we use the Green-Naghdi equations to introduce the dispersive terms related to the depth and the depth-averaged horizontal velocities of the fluid. We show that the interface stability depends on the Froude number (i.e., the velocity difference's strength) and the water depth. A critical value of the Froude number to stabilize the interface is smaller than the case of no dispersive terms, and the flow in a deeper region is more stable than in a shallower one. We also consider the distribution of kinetic and potential energy to clarify a feature characteristic of a large class of instabilities in shallow water flow. The instability of flows is caused by the decrease in the kinetic energy during the perturbation of waves. This phenomenon is known as negative energy modes and plays a vital role in applying the model to industrial equipment. A conclusion is that the equipartition of energies occurs if and only if the velocity difference is zero and the water depth is shallow enough to ignore the dispersive terms. Y1 - 2021 U6 - https://doi.org/10.1063/1.5145060 VL - 62 IS - 10 PB - AIP Publishing ER -