Refine
Document Type
- Article (4)
Language
- English (4)
Has Fulltext
- no (4) (remove)
Is part of the Bibliography
- no (4) (remove)
Keywords
- GenPCCA (1)
- Markov chain (1)
- Non-reversible (1)
- Schur decomposition (1)
- Spectral clustering (1)
Institute
- Numerical Mathematics (4) (remove)
The Augmented Jump Chain
(2021)
Modern methods of simulating molecular systems are based on the mathematical theory of Markov operators with a focus on autonomous equilibrated systems. However, non-autonomous physical systems or non-autonomous simulation processes are becoming more and more important. A representation of non-autonomous Markov jump processes is presented as autonomous Markov chains on space-time. Augmenting the spatial information of the embedded Markov chain by the temporal information of the associated jump times, the so-called augmented jump chain is derived. The augmented jump chain inherits the sparseness of the infinitesimal generator of the original process and therefore provides a useful tool for studying time-dependent dynamics even in high dimensions. Furthermore, possible generalizations and applications to the computation of committor functions and coherent sets in the non-autonomous setting are discussed. After deriving the theoretical foundations, the concepts with a proof-of-concept Galerkin discretization of the transfer operator of the augmented jump chain applied to simple examples are illustrated.
Spectral clustering methods are based on solving eigenvalue problems for the identification of clusters, e.g., the identification of metastable subsets of a Markov chain. Usually, real-valued eigenvectors are mandatory for this type of algorithms. The Perron Cluster Analysis (PCCA+) is a well-known spectral clustering method of Markov chains. It is applicable for reversible Markov chains, because reversibility implies a real-valued spectrum. We also extend this spectral clustering method to non-reversible Markov chains and give some illustrative examples. The main idea is to replace the eigenvalue problem by a real-valued Schur decomposition. By this extension non-reversible Markov chains can be analyzed. Furthermore, the chains do not need to have a positive stationary distribution. In addition to metastabilities, dominant cycles and sinks can also be identified. This novel method is called GenPCCA (i.e., generalized PCCA), since it includes the case of non-reversible processes. We also apply the method to real-world eye-tracking data.
When dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data-driven solution to this problem by estimating the prior itself from an ensemble of data. In the nonparametric case, the maximum likelihood estimate is known to overfit the data, an issue that is commonly tackled by regularization. However, the majority of regularizations are ad hoc choices which lack invariance under reparametrization of the model and result in inconsistent estimates for equivalent models. We introduce a nonparametric, transformation-invariant estimator for the prior distribution. Being defined in terms of the missing information similar to the reference prior, it can be seen as an extension of the latter to the data-driven setting. This implies a natural interpretation as a trade-off between choosing the least informative prior and incorporating the information provided by the data, a symbiosis between the objective and empirical Bayes methodologies.
This article addresses the problem of estimating the Koopman generator of a Markov process. The direct computation of the infinitesimal generator is not easy because of the discretization of the state space, in particular because of the trade-off inherent in the choice of the best lag time to study the process. Short lag times implies a strong discretization of the state space and a consequent loss of Markovianity. Large lag times bypass events on fast timescales. We propose a method to approximate the generator with the computation of the Newton polynomial extrapolation. This technique is a multistep approach which uses as its input Koopman transfer operators evaluated for a series of lag times. Thus, the estimated infinitesimal generator combines information from different time resolutions and does not bias only fast- or slow-decaying dynamics. We show that the multi-scale Newton method can improve the estimation of the generator in comparison to the computation using finite difference or matrix logarithm methods.