TY - JOUR A1 - Bittracher, Andreas A1 - Klus, Stefan A1 - Hamzi, Boumediene A1 - Schütte, Christof T1 - Dimensionality Reduction of Complex Metastable Systems via Kernel Embeddings of Transition Manifolds JF - Journal of Nonlinear Science N2 - We present a novel kernel-based machine learning algorithm for identifying the low-dimensional geometry of the effective dynamics of high-dimensional multiscale stochastic systems. Recently, the authors developed a mathematical framework for the computation of optimal reaction coordinates of such systems that is based on learning a parameterization of a low-dimensional transition manifold in a certain function space. In this article, we enhance this approach by embedding and learning this transition manifold in a reproducing kernel Hilbert space, exploiting the favorable properties of kernel embeddings. Under mild assumptions on the kernel, the manifold structure is shown to be preserved under the embedding, and distortion bounds can be derived. This leads to a more robust and more efficient algorithm compared to the previous parameterization approaches. Y1 - 2021 U6 - https://doi.org/10.1007/s00332-020-09668-z VL - 31 ER - TY - JOUR A1 - Bittracher, Andreas A1 - Koltai, Péter A1 - Klus, Stefan A1 - Banisch, Ralf A1 - Dellnitz, Michael A1 - Schütte, Christof T1 - Transition manifolds of complex metastable systems: Theory and data-driven computation of effective dynamics JF - Jounal of Nonlinear Science N2 - We consider complex dynamical systems showing metastable behavior but no local separation of fast and slow time scales. The article raises the question of whether such systems exhibit a low-dimensional manifold supporting its effective dynamics. For answering this question, we aim at finding nonlinear coordinates, called reaction coordinates, such that the projection of the dynamics onto these coordinates preserves the dominant time scales of the dynamics. We show that, based on a specific reducibility property, the existence of good low-dimensional reaction coordinates preserving the dominant time scales is guaranteed. Based on this theoretical framework, we develop and test a novel numerical approach for computing good reaction coordinates. The proposed algorithmic approach is fully local and thus not prone to the curse of dimension with respect to the state space of the dynamics. Hence, it is a promising method for data-based model reduction of complex dynamical systems such as molecular dynamics. Y1 - 2018 U6 - https://doi.org/10.1007/s00332-017-9415-0 VL - 28 IS - 2 SP - 471 EP - 512 ER - TY - GEN A1 - Bittracher, Andreas A1 - Koltai, Péter A1 - Klus, Stefan A1 - Banisch, Ralf A1 - Dellnitz, Michael A1 - Schütte, Christof T1 - Transition manifolds of complex metastable systems: Theory and data-driven computation of effective dynamics N2 - We consider complex dynamical systems showing metastable behavior but no local separation of fast and slow time scales. The article raises the question of whether such systems exhibit a low-dimensional manifold supporting its effective dynamics. For answering this question, we aim at finding nonlinear coordinates, called reaction coordinates, such that the projection of the dynamics onto these coordinates preserves the dominant time scales of the dynamics. We show that, based on a specific reducibility property, the existence of good low-dimensional reaction coordinates preserving the dominant time scales is guaranteed. Based on this theoretical framework, we develop and test a novel numerical approach for computing good reaction coordinates. The proposed algorithmic approach is fully local and thus not prone to the curse of dimension with respect to the state space of the dynamics. Hence, it is a promising method for data-based model reduction of complex dynamical systems such as molecular dynamics. T3 - ZIB-Report - 17-22 KW - metastability KW - slow dynamics KW - effective dynamics KW - transition manifold KW - embedding KW - transfer operator KW - reaction coordinate Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-63822 SN - 1438-0064 ER - TY - JOUR A1 - Gelss, Patrick A1 - Klus, Stefan A1 - Schuster, Ingmar A1 - Schütte, Christof T1 - Feature space approximation for kernel-based supervised learning JF - Knowledge-Based Sytems Y1 - 2021 U6 - https://doi.org/https://doi.org/10.1016/j.knosys.2021.106935 VL - 221 PB - Elsevier ER - TY - JOUR A1 - Gelß, Patrick A1 - Klus, Stefan A1 - Eisert, Jens A1 - Schütte, Christof T1 - Multidimensional Approximation of Nonlinear Dynamical Systems JF - Journal of Computational and Nonlinear Dynamics N2 - A key task in the field of modeling and analyzing nonlinear dynamical systems is the recovery of unknown governing equations from measurement data only. There is a wide range of application areas for this important instance of system identification, ranging from industrial engineering and acoustic signal processing to stock market models. In order to find appropriate representations of underlying dynamical systems, various data-driven methods have been proposed by different communities. However, if the given data sets are high-dimensional, then these methods typically suffer from the curse of dimensionality. To significantly reduce the computational costs and storage consumption, we propose the method multidimensional approximation of nonlinear dynamical systems (MANDy) which combines data-driven methods with tensor network decompositions. The efficiency of the introduced approach will be illustrated with the aid of several high-dimensional nonlinear dynamical systems. Y1 - 2019 U6 - https://doi.org/10.1115/1.4043148 VL - 14 IS - 6 ER - TY - JOUR A1 - Gelß, Patrick A1 - Klus, Stefan A1 - Knebel, Sebastian A1 - Shakibaei, Zarin A1 - Pokutta, Sebastian T1 - Low-Rank Tensor Decompositions of Quantum Circuits JF - Journal of Computational Physics N2 - Quantum computing is arguably one of the most revolutionary and disruptive technologies of this century. Due to the ever-increasing number of potential applications as well as the continuing rise in complexity, the development, simulation, optimization, and physical realization of quantum circuits is of utmost importance for designing novel algorithms. We show how matrix product states (MPSs) and matrix product operators (MPOs) can be used to express certain quantum states, quantum gates, and entire quantum circuits as low-rank tensors. This enables the analysis and simulation of complex quantum circuits on classical computers and to gain insight into the underlying structure of the system. We present different examples to demonstrate the advantages of MPO formulations and show that they are more efficient than conventional techniques if the bond dimensions of the wave function representation can be kept small throughout the simulation. Y1 - 2022 ER - TY - JOUR A1 - Klus, Stefan A1 - Bittracher, Andreas A1 - Schuster, Ingmar A1 - Schütte, Christof T1 - A kernel-based approach to molecular conformation analysis JF - Journal of Chemical Physics N2 - We present a novel machine learning approach to understanding conformation dynamics of biomolecules. The approach combines kernel-based techniques that are popular in the machine learning community with transfer operator theory for analyzing dynamical systems in order to identify conformation dynamics based on molecular dynamics simulation data. We show that many of the prominent methods like Markov State Models, EDMD, and TICA can be regarded as special cases of this approach and that new efficient algorithms can be constructed based on this derivation. The results of these new powerful methods will be illustrated with several examples, in particular the alanine dipeptide and the protein NTL9. Y1 - 2018 U6 - https://doi.org/10.1063/1.5063533 VL - 149 IS - 24 ER - TY - JOUR A1 - Klus, Stefan A1 - Djurdjevac Conrad, Natasa T1 - Koopman-based spectral clustering of directed and time-evolving graphs JF - Journal of Nonlinear Science N2 - While spectral clustering algorithms for undirected graphs are well established and have been successfully applied to unsupervised machine learning problems ranging from image segmentation and genome sequencing to signal processing and social network analysis, clustering directed graphs remains notoriously difficult. Two of the main challenges are that the eigenvalues and eigenvectors of graph Laplacians associated with directed graphs are in general complex-valued and that there is no universally accepted definition of clusters in directed graphs. We first exploit relationships between the graph Laplacian and transfer operators and in particular between clusters in undirected graphs and metastable sets in stochastic dynamical systems and then use a generalization of the notion of metastability to derive clustering algorithms for directed and time-evolving graphs. The resulting clusters can be interpreted as coherent sets, which play an important role in the analysis of transport and mixing processes in fluid flows. Y1 - 2022 U6 - https://doi.org/10.1007/s00332-022-09863-0 VL - 33 ER - TY - JOUR A1 - Klus, Stefan A1 - Gelß, Patrick A1 - Peitz, Sebastian A1 - Schütte, Christof T1 - Tensor-based dynamic mode decomposition JF - Nonlinearity Y1 - 2018 U6 - https://doi.org/10.1088/1361-6544/aabc8f VL - 31 IS - 7 PB - IOP Publishing Ltd & London Mathematical Society ER - TY - JOUR A1 - Klus, Stefan A1 - Husic, Brooke E. A1 - Mollenhauer, Mattes A1 - Noe, Frank T1 - Kernel methods for detecting coherent structures in dynamical data JF - Chaos: An Interdisciplinary Journal of Nonlinear Science Y1 - 2019 U6 - https://doi.org/10.1063/1.5100267 VL - 29 IS - 12 ER -