TY - JOUR A1 - Winkelmann, Stefanie A1 - Schütte, Christof A1 - von Kleist, Max T1 - Markov Control with Rare State Observation JF - International Journal of Biomathematics and Biostatistics Y1 - 2012 UR - http://publications.mi.fu-berlin.de/1177/ ER - TY - JOUR A1 - Duwal, Sulav A1 - Winkelmann, Stefanie A1 - Schütte, Christof A1 - von Kleist, Max T1 - Optimal Treatment Strategies in the Context of 'Treatment for Prevention' against HIV/1 in Resource-Poor Settings JF - PloS Computational Biology N2 - An estimated 2.7 million new HIV-1 infections occurred in 2010. `Treatment-for-prevention’ may strongly prevent HIV-1 transmission. The basic idea is that immediate treatment initiation rapidly decreases virus burden, which reduces the number of transmittable viruses and thereby the probability of infection. However, HIV inevitably develops drug resistance, which leads to virus rebound and nullifies the effect of `treatment-for-prevention’ for the time it remains unrecognized. While timely conducted treatment changes may avert periods of viral rebound, necessary treatment options and diagnostics may be lacking in resource-constrained settings. Within this work, we provide a mathematical platform for comparing different treatment paradigms that can be applied to many medical phenomena. We use this platform to optimize two distinct approaches for the treatment of HIV-1: (i) a diagnostic-guided treatment strategy, based on infrequent and patient-specific diagnostic schedules and (ii) a pro-active strategy that allows treatment adaptation prior to diagnostic ascertainment. Both strategies are compared to current clinical protocols (standard of care and the HPTN052 protocol) in terms of patient health, economic means and reduction in HIV-1 onward transmission exemplarily for South Africa. All therapeutic strategies are assessed using a coarse-grained stochastic model of within-host HIV dynamics and pseudo-codes for solving the respective optimal control problems are provided. Our mathematical model suggests that both optimal strategies (i)-(ii) perform better than the current clinical protocols and no treatment in terms of economic means, life prolongation and reduction of HIV-transmission. The optimal diagnostic-guided strategy suggests rare diagnostics and performs similar to the optimal pro-active strategy. Our results suggest that ‘treatment-for-prevention’ may be further improved using either of the two analyzed treatment paradigms. Y1 - 2015 U6 - https://doi.org/10.1371/journal.pcbi.1004200 VL - 11 IS - 4 ER - TY - JOUR A1 - Gupta, Pooja A1 - Gramatke, Annika A1 - Einspanier, Ralf A1 - Schütte, Christof A1 - von Kleist, Max A1 - Sharbati, Jutta T1 - In silico cytotoxicity assessment on cultured rat intestinal cells deduced from cellular impedance measurements JF - Toxicology in Vitro N2 - Early and reliable identification of chemical toxicity is of utmost importance. At the same time, reduction of animal testing is paramount. Therefore, methods that improve the interpretability and usability of in vitro assays are essential. xCELLigence’s real-time cell analyzer (RTCA) provides a novel, fast and cost effective in vitro method to probe compound toxicity. We developed a simple mathematical framework for the qualitative and quantitative assessment of toxicity for RTCA measurements. Compound toxicity, in terms of its 50% inhibitory concentration IC50 on cell growth, and parameters related to cell turnover were estimated on cultured IEC-6 cells exposed to 10 chemicals at varying concentrations. Our method estimated IC50 values of 113.05, 7.16, 28.69 and 725.15 μM for the apparently toxic compounds 2-acetylamino-fluorene, aflatoxin B1, benzo-[a]-pyrene and chloramphenicol in the tested cell line, in agreement with literature knowledge. IC50 values of all apparent in vivo non-toxic compounds were estimated to be non-toxic by our method. Corresponding estimates from RTCA’s in-built model gave false positive (toxicity) predictions in 5/10 cases. Taken together, our proposed method reduces false positive predictions and reliably identifies chemical toxicity based on impedance measurements. The source code for the developed method including instructions is available at https://git.zib.de/bzfgupta/toxfit/tree/master. KW - Real-time cell analyzer KW - Toxicity KW - Mathematical modeling Y1 - 2017 SN - 1438-0064 VL - 41 SP - 179 EP - 188 ER - TY - JOUR A1 - von Kleist, Max A1 - Schütte, Christof A1 - Zhang, Wei T1 - Statistical analysis of the first passage path ensemble of jump processes JF - Journal of Statistical Physics N2 - The transition mechanism of jump processes between two different subsets in state space reveals important dynamical information of the processes and therefore has attracted considerable attention in the past years. In this paper, we study the first passage path ensemble of both discrete-time and continuous-time jump processes on a finite state space. The main approach is to divide each first passage path into nonreactive and reactive segments and to study them separately. The analysis can be applied to jump processes which are non-ergodic, as well as continuous-time jump processes where the waiting time distributions are non-exponential. In the particular case that the jump processes are both Markovian and ergodic, our analysis elucidates the relations between the study of the first passage paths and the study of the transition paths in transition path theory. We provide algorithms to numerically compute statistics of the first passage path ensemble. The computational complexity of these algorithms scales with the complexity of solving a linear system, for which efficient methods are available. Several examples demonstrate the wide applicability of the derived results across research areas. Y1 - 2018 U6 - https://doi.org/10.1007/s10955-017-1949-x VL - 170 SP - 809 EP - 843 ER - TY - JOUR A1 - Winkelmann, Stefanie A1 - Schütte, Christof A1 - von Kleist, Max T1 - Markov Control Processes with Rare State Observation: Sensitivity Analysis with Respect to Optimal Treatment Strategies against HIV-1 JF - International Journal of Biomathematics and Biostatistics N2 - We present the theory of “Markov decision processes (MDP) with rare state observation” and apply it to optimal treatment scheduling and diagnostic testing to mitigate HIV-1 drug resistance development in resource-poor countries. The developed theory assumes that the state of the process is hidden and can only be determined by making an examination. Each examination produces costs which enter into the considered cost functional so that the resulting optimization problem includes finding optimal examination times. This is a realistic ansatz: In many real world applications, like HIV-1 treatment scheduling, the information about the disease evolution involves substantial costs, such that examination and control are intimately connected. However, a perfect compliance with the optimal strategy can rarely be achieved. This may be particularly true for HIV-1 resistance testing in resource-constrained countries. In the present work, we therefore analyze the sensitivity of the costs with respect to deviations from the optimal examination times both analytically and for the considered application. We discover continuity in the cost-functional with respect to the examination times. For the HIV-application, moreover, sensitivity towards small deviations from the optimal examination rule depends on the disease state. Furthermore, we compare the optimal rare-control strategy to (i) constant control strategies (one action for the remaining time) and to (ii) the permanent control of the original, fully observed MDP. This comparison is done in terms of expected costs and in terms of life-prolongation. The proposed rare-control strategy offers a clear benefit over a constant control, stressing the usefulness of medical testing and informed decision making. This indicates that lower-priced medical tests could improve HIV treatment in resource-constrained settings and warrants further investigation. Y1 - 2013 VL - 2 IS - 1 ER - TY - JOUR A1 - Wang, Han A1 - Schütte, Christof A1 - Ciccotti, Giovanni A1 - von Kleist, Max T1 - Exploring the conformational dynamics of alanine dipeptide in solution subjected to an external electric field: A nonequilibrium molecular dynamics simulation JF - Journal of Chemical Theory and Computation N2 - In this paper, we investigate the conformational dynamics of alanine dipeptide under an external electric field by nonequilibrium molecular dynamics simulation. We consider the case of a constant and of an oscillatory field. In this context, we propose a procedure to implement the temperature control, which removes the irrelevant thermal effects of the field. For the constant field different time-scales are identified in the conformational, dipole moment, and orientational dynamics. Moreover, we prove that the solvent structure only marginally changes when the external field is switched on. In the case of oscillatory field, the conformational changes are shown to be as strong as in the previous case, and nontrivial nonequilibrium circular paths in the conformation space are revealed by calculating the integrated net probability fluxes. Y1 - 2014 U6 - https://doi.org/10.1021/ct400993e VL - 10 IS - 4 SP - 1376 EP - 1386 ER - TY - JOUR A1 - Winkelmann, Stefanie A1 - Schütte, Christof A1 - von Kleist, Max T1 - Markov Control Processes with Rare State Observation: Theory and Application to Treatment Scheduling in HIV-1 JF - Communications in Mathematical Sciences N2 - Markov Decision Processes (MDP) or Partially Observable MDPs (POMDP) are used for modelling situations in which the evolution of a process is partly random and partly controllable. These MDP theories allow for computing the optimal control policy for processes that can continuously or frequently be observed, even if only partially. However, they cannot be applied if state observation is very costly and therefore rare (in time). We present a novel MDP theory for rare, costly observations and derive the corresponding Bellman equation. In the new theory, state information can be derived for a particular cost after certain, rather long time intervals. The resulting information costs enter into the total cost and thus into the optimization criterion. This approach applies to many real world problems, particularly in the medical context, where the medical condition is examined rather rarely because examination costs are high. At the same time, the approach allows for efficient numerical realization. We demonstrate the usefulness of the novel theory by determining, from the national economic perspective, optimal therapeutic policies for the treatment of the human immunodeficiency virus (HIV) in resource-rich and resource-poor settings. Based on the developed theory and models, we discover that available drugs may not be utilized efficiently in resource-poor settings due to exorbitant diagnostic costs. Y1 - 2014 U6 - https://doi.org/10.4310/CMS.2014.v12.n5.a4 VL - 12 IS - 5 SP - 859 EP - 877 ER - TY - JOUR A1 - Haase, Tobias A1 - Sunkara, Vikram A1 - Kohl, Benjamin A1 - Meier, Carola A1 - Bußmann, Patricia A1 - Becker, Jessica A1 - Jagielski, Michal A1 - von Kleist, Max A1 - Ertel, Wolfgang T1 - Discerning the spatio-temporal disease patterns of surgically induced OA mouse models JF - PLOS One N2 - Osteoarthritis (OA) is the most common cause of disability in ageing societies, with no effective therapies available to date. Two preclinical models are widely used to validate novel OA interventions (MCL-MM and DMM). Our aim is to discern disease dynamics in these models to provide a clear timeline in which various pathological changes occur. OA was surgically induced in mice by destabilisation of the medial meniscus. Analysis of OA progression revealed that the intensity and duration of chondrocyte loss and cartilage lesion formation were significantly different in MCL-MM vs DMM. Firstly, apoptosis was seen prior to week two and was narrowly restricted to the weight bearing area. Four weeks post injury the magnitude of apoptosis led to a 40–60% reduction of chondrocytes in the non-calcified zone. Secondly, the progression of cell loss preceded the structural changes of the cartilage spatio-temporally. Lastly, while proteoglycan loss was similar in both models, collagen type II degradation only occurred more prominently in MCL-MM. Dynamics of chondrocyte loss and lesion formation in preclinical models has important implications for validating new therapeutic strategies. Our work could be helpful in assessing the feasibility and expected response of the DMM- and the MCL-MM models to chondrocyte mediated therapies. Y1 - 2019 U6 - https://doi.org/10.1371/journal.pone.0213734 VL - 14 IS - 4 PB - PLOS One ER - TY - JOUR A1 - Gupta, Pooja A1 - Peter, Sarah A1 - Jung, Markus A1 - Lewin, Astrid A1 - Hemmrich-Stanisak, Georg A1 - Franke, Andre A1 - von Kleist, Max A1 - Schütte, Christof A1 - Einspanier, Ralf A1 - Sharbati, Soroush A1 - zur Bruegge, Jennifer T1 - Analysis of long non-coding RNA and mRNA expression in bovine macrophages brings up novel 2 aspects of Mycobacterium avium subspecies paratuberculosis infections JF - Scientific Reports in Nature N2 - Paratuberculosis is a major disease in cattle that severely affects animal welfare and causes huge economic losses worldwide. Development of alternative diagnostic methods is of urgent need to control the disease. Recent studies suggest that long non-coding RNAs (lncRNAs) play a crucial role in regulating immune function and may confer valuable information about the disease. However, their role has not yet been investigated in cattle with respect to infection towards Paratuberculosis. Therefore, we investigated the alteration in genomic expression profiles of mRNA and lncRNA in bovine macrophages in response to Paratuberculosis infection using RNA-Seq. We identified 397 potentially novel lncRNA candidates in macrophages of which 38 were differentially regulated by the infection. A total of 820 coding genes were also significantly altered by the infection. Co-expression analysis of lncRNAs and their neighbouring coding genes suggest regulatory functions of lncRNAs in pathways related to immune response. For example, this included protein coding genes such as TNIP3, TNFAIP3 and NF-κB2 that play a role in NF-κB2 signalling, a pathway associated with immune response. This study advances our understanding of lncRNA roles during Paratuberculosis infection. Y1 - 2019 U6 - https://doi.org/10.1038/s41598-018-38141-x VL - 9 ER - TY - JOUR A1 - Raharinirina, Alexia N. A1 - Peppert, Felix A1 - von Kleist, Max A1 - Schütte, Christof A1 - Sunkara, Vikram T1 - Inferring gene regulatory networks from single-cell RNA-seq temporal snapshot data requires higher-order moments JF - Patterns N2 - Single-cell RNA sequencing (scRNA-seq) has become ubiquitous in biology. Recently, there has been a push for using scRNA-seq snapshot data to infer the underlying gene regulatory networks (GRNs) steering cellular function. To date, this aspiration remains unrealized due to technical and computational challenges. In this work we focus on the latter, which is under-represented in the literature. We took a systemic approach by subdividing the GRN inference into three fundamental components: data pre-processing, feature extraction, and inference. We observed that the regulatory signature is captured in the statistical moments of scRNA-seq data and requires computationally intensive minimization solvers to extract it. Furthermore, current data pre-processing might not conserve these statistical moments. Although our moment-based approach is a didactic tool for understanding the different compartments of GRN inference, this line of thinking—finding computationally feasible multi-dimensional statistics of data—is imperative for designing GRN inference methods. Y1 - 2021 U6 - https://doi.org/10.1016/j.patter.2021.100332 VL - 2 IS - 9 ER - TY - JOUR A1 - Ozel, Mehmet Neset A1 - Kulkarni, Abhishek A1 - Hasan, Amr A1 - Brummer, Josephine A1 - Moldenhauer, Marian A1 - Daumann, Ilsa-Maria A1 - Wolfenberg, Heike A1 - Dercksen, Vincent J. A1 - Kiral, Ferdi Ridvan A1 - Weiser, Martin A1 - Prohaska, Steffen A1 - von Kleist, Max A1 - Hiesinger, Peter Robin T1 - Serial synapse formation through filopodial competition for synaptic seeding factors JF - Developmental Cell N2 - Following axon pathfinding, growth cones transition from stochastic filopodial exploration to the formation of a limited number of synapses. How the interplay of filopodia and synapse assembly ensures robust connectivity in the brain has remained a challenging problem. Here, we developed a new 4D analysis method for filopodial dynamics and a data-driven computational model of synapse formation for R7 photoreceptor axons in developing Drosophila brains. Our live data support a 'serial synapse formation' model, where at any time point only a single 'synaptogenic' filopodium suppresses the synaptic competence of other filopodia through competition for synaptic seeding factors. Loss of the synaptic seeding factors Syd-1 and Liprin-α leads to a loss of this suppression, filopodial destabilization and reduced synapse formation, which is sufficient to cause the destabilization of entire axon terminals. Our model provides a filopodial 'winner-takes-all' mechanism that ensures the formation of an appropriate number of synapses. Y1 - 2019 U6 - https://doi.org/10.1016/j.devcel.2019.06.014 VL - 50 IS - 4 SP - 447 EP - 461 ER - TY - JOUR A1 - Peppert, Felix A1 - von Kleist, Max A1 - Schütte, Christof A1 - Sunkara, Vikram T1 - On the Sufficient Condition for Solving the Gap-Filling Problem Using Deep Convolutional Neural Networks JF - IEEE Transactions on Neural Networks and Learning Systems N2 - Deep convolutional neural networks (DCNNs) are routinely used for image segmentation of biomedical data sets to obtain quantitative measurements of cellular structures like tissues. These cellular structures often contain gaps in their boundaries, leading to poor segmentation performance when using DCNNs like the U-Net. The gaps can usually be corrected by post-hoc computer vision (CV) steps, which are specific to the data set and require a disproportionate amount of work. As DCNNs are Universal Function Approximators, it is conceivable that the corrections should be obsolete by selecting the appropriate architecture for the DCNN. In this article, we present a novel theoretical framework for the gap-filling problem in DCNNs that allows the selection of architecture to circumvent the CV steps. Combining information-theoretic measures of the data set with a fundamental property of DCNNs, the size of their receptive field, allows us to formulate statements about the solvability of the gap-filling problem independent of the specifics of model training. In particular, we obtain mathematical proof showing that the maximum proficiency of filling a gap by a DCNN is achieved if its receptive field is larger than the gap length. We then demonstrate the consequence of this result using numerical experiments on a synthetic and real data set and compare the gap-filling ability of the ubiquitous U-Net architecture with variable depths. Our code is available at https://github.com/ai-biology/dcnn-gap-filling. Y1 - 2022 U6 - https://doi.org/10.1109/TNNLS.2021.3072746 VL - 33 IS - 11 SP - 6194 EP - 6205 ER - TY - JOUR A1 - Conrad, Tim A1 - Rath, Barbara A1 - Tief, Franziska A1 - Karsch, K. A1 - Muehlhans, S. A1 - Obermeier, Patrick A1 - Adamou, E. A1 - Chen, X. A1 - Seeber, L. A1 - Peiser, Ch. A1 - Hoppe, Christian A1 - von Kleist, Max A1 - Schweiger, Brunhilde T1 - Towards a personalized approach to managing of influenza infections in infants and children - food for thought and a note on oseltamivir JF - Infectious Disorders - Drug Targets Y1 - 2013 VL - 13 IS - 1 SP - 25 EP - 33 ER - TY - JOUR A1 - Rath, Barbara A1 - Yousef, Kaveh A1 - Katzenstein, D. A1 - Shafer, R. A1 - Schütte, Christof A1 - von Kleist, Max A1 - Merigan, T. T1 - HIV-1 Evolution in Response to Triple Reverse Transcriptase Inhibitor Induced Selective Pressure in vitro JF - PLoS ONE Y1 - 2013 UR - http://publications.imp.fu-berlin.de/1178/ U6 - https://doi.org/10.1371/journal.pone.0061102 VL - 8 IS - 4 PB - Public Library of Science ER - TY - JOUR A1 - Duwal, Sulav A1 - Schütte, Christof A1 - von Kleist, Max T1 - Pharmacokinetics and Pharmacodynamics of the Reverse Transcriptase Inhibitor Tenofovir & Prophylactic Efficacy against HIV-1 Infection. JF - PLoS One Y1 - 2012 UR - http://publications.imp.fu-berlin.de/1130/ U6 - https://doi.org/10.1371/journal.pone.0040382 VL - 7 IS - 7 SP - e40382 ER - TY - JOUR A1 - Frank, M. A1 - von Kleist, Max A1 - Kunz, A. A1 - Harms, G. A1 - Schütte, Christof A1 - Kloft, Ch. T1 - Quantifying the impact of nevirapine-based prophylaxis strategies to prevent mother-to-child transmission of HIV-1 JF - Antimicrob. Agents Chemother. Y1 - 2011 UR - http://publications.imp.fu-berlin.de/1093/ VL - 55 IS - 12 SP - 5529 EP - 5540 ER - TY - JOUR A1 - von Kleist, Max A1 - Menz, Stephan A1 - Stocker, Hartmut A1 - Arasteh, Keikawus A1 - Huisinga, Wilhelm A1 - Schütte, Christof T1 - HIV Quasispecies Dynamics during Pro-active Treatment Switching JF - Plos One Y1 - 2011 UR - http://publications.imp.fu-berlin.de/1051/ U6 - https://doi.org/10.1371/journal.pone.0018204 VL - 6 IS - 3 SP - e18204 PB - Public Library of Science ER - TY - JOUR A1 - von Kleist, Max A1 - Metzner, Ph. A1 - Marquet, R. A1 - Schütte, Christof T1 - Polymerase Inhibition by Nucleoside Analogs JF - Plos Computational Biology Y1 - 2012 UR - http://publications.imp.fu-berlin.de/1087/ U6 - https://doi.org/10.1371/journal.pcbi.1002359 VL - 8 IS - 1 SP - e1002359 ER - TY - JOUR A1 - Winkelmann, Stefanie A1 - Schütte, Christof A1 - von Kleist, Max T1 - Markov Control Processes with Rare State Observation JF - Communications in Mathematical Sciences Y1 - 2012 UR - http://publications.imp.fu-berlin.de/1176/ VL - 12 IS - 859 ER - TY - JOUR A1 - Zhang, Wei A1 - Hartmann, Carsten A1 - von Kleist, Max T1 - Optimal control of Markov jump processes: Asymptotic analysis, algorithms and applications to the modeling of chemical reaction systems JF - Communications in Mathematical Sciences N2 - Markov jump processes are widely used to model natural and engineered processes. In the context of biological or chemical applications one typically refers to the chemical master equation (CME), which models the evolution of the probability mass of any copy-number combination of the interacting particles. When many interacting particles (“species”) are considered, the complexity of the CME quickly increases, making direct numerical simulations impossible. This is even more problematic when one aims at controlling the Markov jump processes defined by the CME. In this work, we study both open loop and feedback optimal control problems of the Markov jump processes in the case that the controls can only be switched at fixed control stages. Based on Kurtz’s limit theorems, we prove the convergence of the respective control value functions of the underlying Markov decision problem as the copy numbers of the species go to infinity. In the case of the optimal control problem on a finite time-horizon, we propose a hybrid control policy algorithm to overcome the difficulties due to the curse of dimensionality when the copy number of the involved species is large. Two numerical examples demonstrate the suitability of both the analysis and the proposed algorithms. Y1 - 2018 U6 - https://doi.org/10.4310/CMS.2018.v16.n2.a1 SP - 293 EP - 331 ER -