Refine
Year of publication
Document Type
- Article (113)
- ZIB-Report (40)
- In Proceedings (6)
- Book chapter (4)
- In Collection (3)
- Other (3)
- Research data (3)
- Doctoral Thesis (2)
- Poster (2)
- Book (1)
Is part of the Bibliography
- no (178)
Keywords
- Markov State Models (5)
- metastability (5)
- cluster analysis (4)
- molecular dynamics (4)
- rare events (4)
- Conformation Dynamics (3)
- MSM (3)
- Perron cluster analysis (3)
- Schur decomposition (3)
- dynamical systems (3)
Institute
- Numerical Mathematics (136)
- Computational Molecular Design (117)
- Modeling and Simulation of Complex Processes (41)
- ZIB Allgemein (15)
- Computational Systems Biology (13)
- Mathematics for Life and Materials Science (7)
- Parallel and Distributed Computing (3)
- Mathematical Algorithmic Intelligence (2)
- Mathematical Optimization (2)
- Mathematical Optimization Methods (2)
Recently, a novel approach for the analysis of molecular dynamics on the basis of a transfer operator has been introduced. Therein conformations are considered to be disjoint metastable clusters within position space of a molecule. These clusters are defined by almost invariant characteristic functions that can be computed via {\em Perron Cluster} analysis. The present paper suggests to replace crisp clusters with {\em fuzzy} clusters, i.e. to replace characteristic functions with membership functions. This allows a more sufficient characterization of transiton states between different confor conformations and therefore leads to a better understanding of molecular dynamics. Fur thermore, an indicator for the uniqueness of metastable fuzzy clusters and a fast algorithm for the computation of these clusters are described. Numerical examples are included.
Decomposition of the high dimensional conformational space of bio-molecules into metastable subsets is used for data reduction of long molecular trajectories in order to facilitate chemical analysis and to improve convergence of simulations within these subsets. The metastability is identified by the Perron-cluster cluster analysis of a Markov process that generates the thermodynamic distribution. A necessary prerequisite of this analysis is the discretization of the conformational space. A combinatorial approach via discretization of each degree of freedom will end in the so called ''curse of dimension''. In the following paper we analyze Hybrid Monte Carlo simulations of small, drug-like biomolecules and focus on the dihedral degrees of freedom as indicators of conformational changes. To avoid the ''curse of dimension'', the projection of the underlying Markov operator on each dihedral is analyzed according to its metastability. In each decomposition step of a recursive procedure, those significant dihedrals, which indicate high metastability, are used for further decomposition. The procedure is introduced as part of a hierarchical protocol of simulations at different temperatures. The convergence of simulations within metastable subsets is used as an ''a posteriori'' criterion for a successful identification of metastability. All results are presented with the visualization program AmiraMol.
The problem of clustering data can often be transformed into the problem of finding a hidden block diagonal structure in a stochastic matrix. Deuflhard et al. have proposed an algorithm that state s the number $k$ of clusters and uses the sign structure of $k$ eigenvectors of the stochastic matrix to solve the cluster problem. Recently Weber and Galliat discovered that this system of eigenvectors can easily be transformed into a system of $k$ membership functions or soft characteristic functions describing the clusters. In this article we explain the corresponding cluster algorithm and point out the underlying theory. By means of numerical examples we explain how the grade of membership can be interpreted.
The key to molecular conformation dynamics is the direct identification of metastable conformations, which are almost invariant sets of molecular dynamical systems. Once some reversible Markov operator has been discretized, a generalized symmetric stochastic matrix arises. This matrix can be treated by Perron cluster analysis, a rather recent method involving a Perron cluster eigenproblem. The paper presents an improved Perron cluster analysis algorithm, which is more robust than earlier suggestions. Numerical examples are included.
In this paper we interpret clustering as a mapping of data into a simplex. If the data itself has simplicial struture this mapping becomes linear. Spectral analysis is an often used tool for clustering data. We will show that corresponding singular vectors or eigenvectors comprise simplicial structure. Therefore they lead to a cluster algorithm, which consists of a simple linear mapping. An example for this kind of algorithms is the Perron cluster analysis (PCCA). We have applied it in practice to identify metastable sets of molecular dynamical systems. In contrast to other algorithms, this kind of approach provides an a priori criterion to determine the number of clusters. In this paper we extend the ideas to more general problems like clustering of bipartite graphs.
The problem of clustering data can be formulated as a graph partitioning problem. Spectral methods for obtaining optimal solutions have reveceived a lot of attention recently. We describe Perron Cluster Cluster Analysis (PCCA) and, for the first time, establish a connection to spectral graph partitioning. We show that in our approach a clustering can be efficiently computed using a simple linear map of the eigenvector data. To deal with the prevalent problem of noisy and possibly overlapping data we introduce the min Chi indicator which helps in selecting the number of clusters and confirming the existence of a partition of the data. This gives a non-probabilistic alternative to statistical mixture-models. We close with showing favorable results on the analysis of gene expressi on data for two different cancer types.
This paper introduces a new algorithm of conformational analysis based on mesh-free methods as described in [M. Weber. Mehless methods in Conformation Dynamics.(2005)]. The adaptive decomposition of the conformational space by softly limiting functions avoids trapping effects and allows adaptive refinement strategies. These properties of the algorithm makes ZIBgridfree particularly suitable for the complete exploration of high-dimensional conformational space. The adaptive control of the algorithm benefits from the tight integration of molecular simulation and conformational analysis. An emphasized part of the analysis is the Robust Perron Cluster Analysis (PCCA+) based on the work of Peter Deuflhard and Marcus Weber. PCCA+ supports an almost-characteristic cluster definition with an outstanding mapping of transition states. The outcome is expressed by the metastable sets of conformations, their thermodynamic weights and flexibility.
The complexity of molecular kinetics can be reduced significantly by a restriction to metastable conformations which are almost invariant sets of molecular dynamical systems. With the Robust Perron Cl uster Analysis PCCA+, developed by Weber and Deuflhard, we have a tool available which can be used to identify these conformations from a transition probability matrix. This method can also be applied to the corresponding transition rate matrix which provides important information concerning transition pathways of single molecules. In the present paper, we explain the relationship between these tw o concepts and the extraction of conformation kinetics from transition rates. Moreover, we show how transition rates can be approximated and conclude with numerical examples.
The identification of metastable conformations of molecules plays an important role in computational drug design. One main difficulty is the fact that the underlying dynamic processes take place in high dimensional spaces. Although the restriction of degrees of freedom to a few dihedral angles significantly reduces the complexity of the problem, the existing algorithms are time-consuming. They are based on the approximation of transition probabilities by an extensive sampling of states according to the Boltzmann distribution. We present a method which can identify metastable conformations without sampling the complete distribution. Our algorithm is based on local transition rates and uses only pointwise information about the potential energy surface. In order to apply the cluster algorithm PCCA+, we compute a few eigenvectors of the rate matrix by the Jacobi-Davidson method. Interpolation techniques are applied to approximate the thermodynamical weights of the clusters. The concluding example illustrates our approach for epigallocatechine, a molecule which can be described by seven dihedral angles.
Biochemical interactions are determined by the 3D-structure of the involved components - thus the identification of conformations is a key for many applications in rational drug design. {\sf ConFlow} is a new multilevel approach to conformational analysis with main focus on completeness in investigation of conformational space. In contrast to known conformational analysis, the starting point for design is a space-based description of conformational areas. A tight integration of sampling and analysis leads to an identification of conformational areas simultaneously during sampling. An incremental decomposition of high-dimensional conformational space is used to guide the analysis. A new concept for the description of conformations and their path connected components based on convex hulls and {\em Hypercubes}is developed. The first results of the {\sf ConFlow} application constitute a 'proof of concept' and are further more highly encouraging. In comparison to conventional industrial applications, {\sf ConFlow} achieves higher accuracy and a specified degree of completeness with comparable effort.
The dynamic behavior of molecules can often be described by Markov processes. From computational molecular simulations one can derive transition rates or transition probabilities between subsets of the discretized conformational space. On the basis of this dynamic information, the spatial subsets are combined into a small number of so-called metastable molecular conformations. This is done by clustering methods like the Robust Perron Cluster Analysis (PCCA+). Up to now it is an open question how this coarse graining in space can be transformed to a coarse graining of the Markov chain while preserving the essential dynamic information. In the following article we aim at a consistent coarse graining of transition probabilities or rates on the basis of metastable conformations such that important physical and mathematical relations are preserved. This approach is new because PCCA+ computes molecular conformations as linear combinations of the dominant eigenvectors of the transition matrix which does not hold for other clustering methods.
Whenever the invariant stationary density of metastable dynamical systems decomposes into almost invariant partial densities, its computation as eigenvector of some transition probability matrix is an ill-conditioned problem. In order to avoid this computational difficulty, we suggest to apply an aggregation/disaggregation method which only addresses wellconditioned sub-problems and thus results in a stable algorithm. In contrast to existing methods, the aggregation step is done via a sampling algorithm which covers only small patches of the sampling space. Finally, the theoretical analysis is illustrated by two biomolecular examples.
In this article we aim at an efficient sampling of the stationary distribution of dynamical systems in the presence of metastabilities. In the past decade many sophisticated algorithms have been inven ted in this field. We do not want to simply add a further one. We address the problem that one has applied a sampling algorithm for a dynamical system many times. This leads to different samplings which more or less represent the stationary distribution partially very well, but which are still far away from ergodicity or from the global stationary distribution. We will show how these samplings can be joined together in order to get one global sampling of the stationary distribution.
In order to compute the thermodynamic weights of the different metastable conformations of a molecule, we want to approximate the molecule's Boltzmann distribution in a reasonable time. This is an essential issue in computational drug design. The energy landscape of active biomolecules is generally very rough with a lot of high barriers and low regions. Many of the algorithms that perform such samplings (e.g. the hybrid Monte Carlo method) have difficulties with such landscapes. They are trapped in low-energy regions for a very long time and cannot overcome high barriers. Moving from one low-energy region to another is a very rare event. For these reasons, the distribution of the generated sampling points converges very slowly against the thermodynamically correct distribution of the molecule. The idea of ConfJump is to use $a~priori$ knowledge of the localization of low-energy regions to enhance the sampling with artificial jumps between these low-energy regions. The artificial jumps are combined with the hybrid Monte Carlo method. This allows the computation of some dynamical properties of the molecule. In ConfJump, the detailed balance condition is satisfied and the mathematically correct molecular distribution is sampled.
Wigner transformation provides a one-to-one correspondence between functions on position space (wave functions) and functions on phase space (Wigner functions). Weighted integrals of Wigner functions yield quadratic quantities of wave functions like position and momentum densities or expectation values. For molecular quantum systems, suitably modified classical transport of Wigner functions provides an asymptotic approximation of the dynamics in the high energy regime. The article addresses the computation of Wigner functions by Monte Carlo quadrature. An ad aption of the Metropolis algorithm for the approximation of signed measures with disconnected support is systematically tested in combination with a surface hopping algorithm for non-adiabatic quantum dynamics. The numerical experiments give expectation values and level populations with an error of two to three percent, which agrees with the theoretically expected accuracy.
In this paper, we investigate the interconversion processes of the major flame retardant -- 1,2,5,6,9,10-hexabromocyclododecane (HBCD) -- by the means of statistical thermodynamics based on classical force-fields. Three ideas will be presented. First, the application of classical hybrid Monte-Carlo simulations for quantum mechanical processes will be justified. Second, the problem of insufficient convergence properties of hybrid Monte-Carlo methods for the generation of low temperature canonical ensembles will be solved by an interpolation approach. Furthermore, it will be shown how free energy differences can be used for a rate matrix computation. The results of our numerical simulations will be compared to experimental results.
For the treatment of equilibrated molecular systems in a heat bath we propose a transition state theory that is based on conformation dynamics. In general, a set-based discretization of a Markov operator ${\cal P}^\tau$ does not preserve the Markov property. In this article, we propose a discretization method which is based on a Galerkin approach. This discretization method preserves the Markov property of the operator and can be interpreted as a decomposition of the state space into (fuzzy) sets. The conformation-based transition state theory presented here can be seen as a first step in conformation dynamics towards the computation of essential dynamical properties of molecular systems without time-consuming molecular dynamics simulations.
A Coarse Graining Method for the Identification of Transition rates between Molecular Conformations
(2007)
For an analysis of a molecular system from a computational statistical thermodynamics point of view, extensive molecular dynamics simulations are very inefficient. During this procedure, at lot of redundant data is generated. Whereas the algorithms spend most of the computing time for a sampling of configurations within the basins of the potential energy landscape of the molecular system, the important information about the long-time behaviour of the molecules is given by transition regions and barriers between the basins, which are sampled rarely only. Thinking of molecular dynamics trajectories, researchers try to figure out which kind of dynamical model is suitable for an efficient simulation. This article suggests to change the point of view from extensive simulation of molecular dynamics trajectories to more efficient sampling strategies of the conformation dynamics approach.
Supercomputers can simulate complex molecular systems. However, there is a very large gap between the fastest oscillations of covalent bonds of a molecule and the time-scale of the dominant processes. In order to extract the dominant time-scales and to identify the dominant processes, a clustering of information is needed. This thesis shows that only the subspace-based Robust Perron Cluster Analysis (PCCA+) can solve this problem correctly by the construction of a Markov State Model. PCCA+ allows for time-extrapolation in molecular kinetics. This thesis shows the difference between molecular dynamics and molecular kinetics. Only in the molecular kinetics framework a definition of transition rates is possible. In this context, the existence of an infinitesimal generator of the dynamical processes is discussed. If the existence is assumed, the Theorem of Gauß can be applied in order to compute transition rates efficiently. Molecular dynamics, however, is not able to provide a suitable statistical basis for the determination of the transition pattern.
Efficient Simulation of Ligand-Receptor Binding Processes Using the Conformation Dynamics Approach
(2009)
Supercomputers can simulate complex molecular systems. However, there is a very large gap between the fastest oscillations of covalent bonds of a molecule and the time-scale of the dominant processes. In order to extract the dominant time-scales and to identify the dominant processes, a clustering of information is needed. This thesis shows that only the subspace-based Robust Perron Cluster Analysis (PCCA+) can solve this problem correctly by the construction of a Markov State Model. PCCA+ allows for time-extrapolation in molecular kinetics. This thesis shows the difference between molecular dynamics and molecular kinetics. Only in the molecular kinetics framework a definition of transition rates is possible. In this context, the existence of an infinitesimal generator of the dynamical processes is discussed. If the existence is assumed, the Theorem of Gauß can be applied in order to compute transition rates efficiently. Molecular dynamics, however, is not able to provide a suitable statistical basis for the determination of the transition pattern.
Particle methods have become indispensible in conformation dynamics to
compute transition rates in protein folding, binding processes and
molecular design, to mention a few.
Conformation dynamics requires at a decomposition of a molecule's position
space into metastable conformations.
In this paper, we show how this decomposition
can be obtained via the design of either ``soft'' or ``hard''
molecular conformations.
We show, that the soft approach results in a larger metastabilitiy of
the decomposition and is thus more advantegous. This is illustrated
by a simulation of Alanine Dipeptide.
The funnel trap paradox
(2012)
In this article, an illustrative example is given for the coarse-graining of a
Markov process which leads to a shift in the statistical weights of a two-states-system.
The example is based on a 2D-funnel trap. The funnel trap is constructed in such a
way, that the area inside and outside of the trap is identical. However, observing the
flight of the insect as a Markov process, the probability for being “in the trap” is higher.
This example can be transferred to several kinds of processes (like receptor-ligandbinding
processes in chemistry) and describes the influence of “re-entering events”.
This work aims to develop a new algorithm to calculate the free energy of water molecules by using a deterministic way.
For this purpose, we assume a closed system confined to a physical volume, having water molecules in gas phase.
To calculate the free energy of this sytem we utilized Mayer cluster expansion and the fluctuation free integration
method.
A hands-off linear interaction energy approach to binding mode and affinity estimation of estrogens
(2013)
Fuzzy spectral clustering by PCCA+: application to Markov state models and data classification
(2013)
Obtaining a sufficient sampling of conformational space is a common problem in molecular simulation. We present the implementation of an umbrella-like adaptive sampling approach based on function-based meshless discretization of conformational space that is compatible with state of the art molecular dynamics code and that integrates an eigenvector-based clustering approach for conformational analysis and the computation of inter-conformational transition rates. The approach is applied to three example systems, namely n-pentane, alanine dipeptide, and a small synthetic host-guest system, the latter two including explicitly modeled solvent.
The rebinding effect is a phenomenon which occurs when observing a ligand-receptor binding process.
On the macro scale this process comprises the Markov property.
This Makovian view is spoiled when switching to the atomistic scale of a binding process.
We therefore suggest a model which accurately describes the rebinding effect on the atomistic scale by allowing ''intermediate'' bound states.
This allows us to define an indicator for the magnitude of rebinding and to formulate an optimization problem.
The results form our examples show good agreement with data form laboratory.
We introduce a generalized operator for arbitrary stochastic processes by using a pre-kernel, which is a generalization of the Markov kernel. For deterministic processes, such an operator is already known as the Frobenius-Perron operator, which is defined for a large class of measures. For Markov processes, there exists transfer operators being only well defined for stationary measures in $L^2$. Our novel generalized transfer operator is well defined for arbitrary stochastic processes, in particular also for deterministic ones. We can show that this operator is acting on $L^1$. For stationary measures, this operator is also an endomorphism of $L^2$ and, therefore, allows for a mathematical analysis in Hilbert spaces.
Trajectory- or mesh-based methods for analyzing the dynamical behavior of large molecules tend to be impractical due to the curse of dimensionality - their computational cost increases exponentially with the size of the molecule. We propose a method to break the curse by a novel square root approximation of transition rates, Monte Carlo quadrature and a discretization approach based on solving linear programs. With randomly sampled points on the molecular energy landscape and randomly generated discretizations of the molecular configuration space as our initial data, we construct a matrix describing the transition rates between adjacent discretization regions. This transition rate matrix yields a Markov State Model of the molecular dynamics. We use Perron cluster analysis and coarse-graining techniques in order to identify metastable sets in configuration space and approximate the transition rates between the metastable sets. Application of our method to a simple energy landscape on a two-dimensional configuration space provides proof of concept and an example for which we compare the performance of different discretizations. We show that the computational cost of our method grows only polynomially with the size of the molecule. However, finding discretizations of higher-dimensional configuration spaces in which metastable sets can be identified remains a challenge.
Medizin aus dem Computer
(2013)
In recent years Markov State Models (MSMs) have attracted a consid-
erable amount of attention with regard to modelling conformation changes
and associated function of biomolecular systems. They have been used
successfully, e.g., for peptides including time-resolved spectroscopic ex-
periments, protein function and protein folding , DNA and RNA, and
ligand-receptor interaction in drug design and more complicated multi-
valent scenarios. In this article a novel reweighting scheme is introduced
that allows to construct an MSM for certain molecular system out of an
MSM for a similar system. This permits studying how molecular proper-
ties on long timescales differ between similar molecular systems without
performing full molecular dynamics simulations for each system under con-
sideration. The performance of the reweighting scheme is illustrated for
simple test cases including one where the main wells of the respective en-
ergy landscapes are located differently and an alchemical transformation
of butane to pentane where the dimension of the state space is changed.
Reversible Markov chains are the basis of many applications. However, computing transition probabilities by a finite sampling of a Markov chain can lead to truncation errors. Even if the original Markov chain is reversible, the approximated Markov chain might be non-reversible and will lose important properties, like the real valued spectrum. In this paper, we show how to find the closest reversible Markov chain to a given transition matrix. It turns out that this matrix can be computed by solving a convex minimization problem.
Mathematics without pain
(2014)
The rebinding effect is a phenomenon which occurs when observing a ligand-receptor binding process. On the macro scale this process comprises the Markov property. This Makovian view is spoiled when switching to the atomistic scale of a binding process. We therefore suggest a model which accurately describes the rebinding effect on the atomistic scale by allowing ''intermediate'' bound states. This allows us to define an indicator for the magnitude of rebinding and to formulate an optimization problem. The results form our examples show good agreement with data form laboratory.
Ergopeptides, like ergocornine and a-ergocryptine, exist in an S- and in an R-configuration. Kinetic experiments imply that certain configurations are preferred depending on the solvent. The experimental methods are explained in this article. Furthermore, computational methods are used to understand this configurational preference. Standard quantum chemical methods can predict the favored configurations by using minimum energy calculations on the potential energy landscape. However, the explicit role of the solvent is not revealed by this type of methods. In order to better understand its influence, classical mechanical molecular simulations are applied. It appears from our research that “folding” the ergopeptide molecules into an intermediate state (between the S- and the R-configuration) is mechanically hindered for the preferred configurations.
Applications of the cross-entropy method to importance sampling and optimal control of diffusions
(2014)
We study the cross-entropy method for diffusions. One of the results is a versatile cross-entropy algorithm that can be used to design efficient importance sampling strategies for rare events or to solve optimal control problems. The approach is based on the minimization of a suitable cross-entropy functional, with a parametric family of exponentially tilted probability distributions. We illustrate the new algorithm with several numerical examples and discuss algorithmic issues and possible extensions of the method.
Applications of the cross-entropy method to importance sampling and optimal control of diffusions
(2014)
In recent years Markov State Models (MSMs) have attracted a consid-
erable amount of attention with regard to modelling conformation changes and associated function of biomolecular systems. They have been used successfully, e.g., for peptides including time-resolved spectroscopic experiments, protein function and protein folding , DNA and RNA, and ligand-receptor interaction in drug design and more complicated multivalent scenarios. In this article a novel reweighting scheme is introduced that allows to construct an MSM for certain molecular system out of an MSM for a similar system. This permits studying how molecular properties on long timescales differ between similar molecular systems without performing full molecular dynamics simulations for each system under con-
sideration. The performance of the reweighting scheme is illustrated for simple test cases including one where the main wells of the respective energy landscapes are located differently and an alchemical transformation of butane to pentane where the dimension of the state space is changed.
Multivalent sugar/protein interactions are well-known to proceed through different binding modes 1-5 which in turn can be described by their binding kinetics 3-5. This study provides additional insight into the association and dissociation reaction rates of complex multivalent sugar/protein interactions. Binding kinetics of recently introduced multivalent precision glycomacromolecules 6-8 to Concanavalin A (Con A) were studied by " kinetic Isothermal Titration Calorimetry " (kinITC) 9-11. The effect of multivalency is evaluated by comparing rate constants of glycomacromolecules obtaining the same and different valency of mannose ligands and by variation of the overall backbone properties, such as hydrophilic/ hydrophoboc. In addition, binding kinetics were studied using different conformations of Con A (homodimer vs.-tetramer) and thus a different protein valency. Our results show that precision glycomacromolecule/Con A binding proceeds non-cooperatively. Further, association and dissociation rates are mainly described by intermolecular complex formation. Together with the so-called functional valency, we can discriminate between " bound " and " unbound " states for macroscopic on-and off-rates, even for such complex glycooligomer/protein systems. By comparing e.g. a mono-to a divalent glycomacromolecule for their binding to dimeric Con A, we see a lower dissociation rate for the latter. As both bind monovalently to Con A, this is a strong indication for a statistical rebinding event. Further, there is a strong dependence of multivalent binding kinetics on the ligand density of glycomacromolecules as well as the Con A conformation and thus the overall on-and off-rates.
Molecular processes such as protein folding or ligand-receptor-binding can be understood by analyzing the free energy landscape. Those processes are often metastable, i.e. the molecular systems remain in basins around local minima of the free energy landscape, and in rare cases undergo gauche transitions between metastable states by passing saddle-points of this landscape. By discretizing the configuration space, this can be modeled as a discrete Markov process. One way to compute the transition rates between conformations of a molecular system is by utilizing Transition Path Theory and the concept of committor functions. A fundamental problem from the computational point of view is that many time-scales are involved, ranging from 10^(-14) sec for the fastest motion to 10^(-6) sec or more for conformation changes that cause biological effects.
The goal of our work is to provide a better understanding of such transitions in configuration space on various time-scales by analyzing characteristic scalar functions topologically and geometrically. We are developing suitable visualization and interaction techniques to support our analysis. For example, we are analyzing a transition rate indicator function by computing and visualizing its Reeb graph together with the sets of molecular states corresponding to maxima of the transition rate indicator function. A particular challenge is the high dimensionality of the domain which does not allow for a straightforward visualization of the function.
The computational topology approach to the analysis of the transition rate indicator functions for a molecular system allows to explore different time scales of the system by utilizing coarser or finer topological partitioning of the function. A specific goal is the development of tools for analyzing the hierarchy of these partitionings. This approach tackles the analysis of a complex and sparse dataset from a different angle than the well-known spectral analysis of Markov State Models.
Finding metastable sets as dominant structures of Markov processes has been shown to be especially useful in modeling interesting slow dynamics of various real world complex processes. Furthermore, coarse graining of such processes based on their dominant structures leads to better understanding and dimension reduction of observed systems. However, in many cases, e.g. for nonreversible Markov processes, dominant structures are often not formed by metastable sets but by important cycles or mixture of both. This paper aims at understanding and identifying these different types of dominant structures for reversible as well as nonreversible ergodic Markov processes. Our algorithmic approach generalizes spectral based methods for reversible process by using Schur decomposition techniques which can tackle also nonreversible cases. We illustrate the mathematical construction of our new approach by numerical experiments.
Reversible Markov chains are the basis of many applications. However, computing transition probabilities by a finite sampling of a Markov chain can lead to truncation errors. Even if the original Markov chain is reversible, the approximated Markov chain might be non-reversible and will lose important properties, like the real valued spectrum. In this paper, we show how to find the closest reversible Markov chain to a given transition matrix. It turns out that this matrix can be computed by solving a convex minimization problem.
In this article we present a new idea for approximating exit rates for diffusion processes living in a craggy landscape. We are especially interested in the exit rates of a process living in a metastable regions. Due to the fact that Monte Carlo simulations perform quite poor and are very computational expensive in this setting we create several similar situations with a smoothed potential. For this we introduce a new parameter $\lambda \in [0,1]$ ($\lambda = 1$ very smoothed potential, $\lambda=0$ original potential) into the potential which controls the influence the smoothing. We then sample the exit rate for different parameters $\lambda$ the exit rate from a given region. Due to the fact that $\lambda$ is connected to the exit rate we can use this dependency to approximate the real exit rate. The method can be seen as something between hyperdynamics and temperature accelerated MC.
Spectral clustering methods are based on solving eigenvalue problems for the identification of clusters, e.g., the identification of metastable subsets of a Markov chain. Usually, real-valued eigenvectors are mandatory for this type of algorithms. The Perron Cluster Analysis (PCCA+) is a well-known spectral clustering method of Markov chains. It is applicable for reversible Markov chains, because reversibility implies a real-valued spectrum. We extend this spectral clustering method also to non-reversible Markov chains and give some illustrative examples. The main idea is to replace the eigenvalue problem by a real-valued Schur decomposition. By this extension, non-reversible Markov chains can be analyzed. Furthermore, the chains need not have a positive stationary distribution. And additionally to metastabilities, dominant cycles and sinks can be identified, too.