TY - JOUR A1 - Udvary, Daniel A1 - Harth, Philipp A1 - Macke, Jakob H. A1 - Hege, Hans-Christian A1 - de Kock, Christiaan P. J. A1 - Sakmann, Bert A1 - Oberlaender, Marcel T1 - A Theory for the Emergence of Neocortical Network Architecture JF - BioRxiv Y1 - 2020 U6 - https://doi.org/https://doi.org/10.1101/2020.11.13.381087 ER - TY - CHAP A1 - Harth, Philipp A1 - Bast, Arco A1 - Troidl, Jakob A1 - Meulemeester, Bjorge A1 - Pfister, Hanspeter A1 - Beyer, Johanna A1 - Oberlaender, Marcel A1 - Hege, Hans-Christian A1 - Baum, Daniel T1 - Rapid Prototyping for Coordinated Views of Multi-scale Spatial and Abstract Data: A Grammar-based Approach T2 - Eurographics Workshop on Visual Computing for Biology and Medicine (VCBM) N2 - Visualization grammars are gaining popularity as they allow visualization specialists and experienced users to quickly create static and interactive views. Existing grammars, however, mostly focus on abstract views, ignoring three-dimensional (3D) views, which are very important in fields such as natural sciences. We propose a generalized interaction grammar for the problem of coordinating heterogeneous view types, such as standard charts (e.g., based on Vega-Lite) and 3D anatomical views. An important aspect of our web-based framework is that user interactions with data items at various levels of detail can be systematically integrated and used to control the overall layout of the application workspace. With the help of a concise JSON-based specification of the intended workflow, we can handle complex interactive visual analysis scenarios. This enables rapid prototyping and iterative refinement of the visual analysis tool in collaboration with domain experts. We illustrate the usefulness of our framework in two real-world case studies from the field of neuroscience. Since the logic of the presented grammar-based approach for handling interactions between heterogeneous web-based views is free of any application specifics, it can also serve as a template for applications beyond biological research. Y1 - 2023 U6 - https://doi.org/10.2312/vcbm.20231218 ER - TY - JOUR A1 - Harth, Philipp A1 - Udvary, Daniel A1 - Boelts, Jan A1 - Baum, Daniel A1 - Macke, Jakob H. A1 - Hege, Hans-Christian A1 - Oberlaender, Marcel T1 - Dissecting origins of wiring specificity in dense cortical connectomes JF - bioRxiv N2 - Wiring specificity in the cortex is observed across scales from the subcellular to the network level. It describes the deviations of connectivity patterns from those expected in randomly connected networks. Understanding the origins of wiring specificity in neural networks remains difficult as a variety of generative mechanisms could have contributed to the observed connectome. To take a step forward, we propose a generative modeling framework that operates directly on dense connectome data as provided by saturated reconstructions of neural tissue. The computational framework allows testing different assumptions of synaptic specificity while accounting for anatomical constraints posed by neuron morphology, which is a known confounding source of wiring specificity. We evaluated the framework on dense reconstructions of the mouse visual and the human temporal cortex. Our template model incorporates assumptions of synaptic specificity based on cell type, single-cell identity, and subcellular compartment. Combinations of these assumptions were sufficient to model various connectivity patterns that are indicative of wiring specificity. Moreover, the identified synaptic specificity parameters showed interesting similarities between both datasets, motivating further analysis of wiring specificity across species. Y1 - 2024 U6 - https://doi.org/10.1101/2024.12.14.628490 ER - TY - JOUR A1 - Boelts, Jan A1 - Harth, Philipp A1 - Gao, Richard A1 - Udvary, Daniel A1 - Yanez, Felipe A1 - Baum, Daniel A1 - Hege, Hans-Christian A1 - Oberlaender, Marcel A1 - Macke, Jakob H. T1 - Simulation-based inference for efficient identification of generative models in computational connectomics JF - PLOS Computational Biology N2 - Recent advances in connectomics research enable the acquisition of increasing amounts of data about the connectivity patterns of neurons. How can we use this wealth of data to efficiently derive and test hypotheses about the principles underlying these patterns? A common approach is to simulate neuronal networks using a hypothesized wiring rule in a generative model and to compare the resulting synthetic data with empirical data. However, most wiring rules have at least some free parameters, and identifying parameters that reproduce empirical data can be challenging as it often requires manual parameter tuning. Here, we propose to use simulation-based Bayesian inference (SBI) to address this challenge. Rather than optimizing a fixed wiring rule to fit the empirical data, SBI considers many parametrizations of a rule and performs Bayesian inference to identify the parameters that are compatible with the data. It uses simulated data from multiple candidate wiring rule parameters and relies on machine learning methods to estimate a probability distribution (the 'posterior distribution over parameters conditioned on the data') that characterizes all data-compatible parameters. We demonstrate how to apply SBI in computational connectomics by inferring the parameters of wiring rules in an in silico model of the rat barrel cortex, given in vivo connectivity measurements. SBI identifies a wide range of wiring rule parameters that reproduce the measurements. We show how access to the posterior distribution over all data-compatible parameters allows us to analyze their relationship, revealing biologically plausible parameter interactions and enabling experimentally testable predictions. We further show how SBI can be applied to wiring rules at different spatial scales to quantitatively rule out invalid wiring hypotheses. Our approach is applicable to a wide range of generative models used in connectomics, providing a quantitative and efficient way to constrain model parameters with empirical connectivity data. Y1 - 2023 U6 - https://doi.org/10.1371/journal.pcbi.1011406 VL - 19 IS - 9 ER - TY - JOUR A1 - Shewarega, Michael A1 - Troidl, Jakob A1 - Alvarado Rodriguez, Oliver A1 - Dindoost, Mohammad A1 - Harth, Philipp A1 - Haberkern, Hannah A1 - Stegmaier, Johannes A1 - Bader, David A1 - Pfister, Hanspeter T1 - MoMo - Combining Neuron Morphology and Connectivity for Interactive Motif Analysis in Connectomes JF - IEEE Transactions on Visualization and Computer Graphics N2 - Connectomics, a subfield of neuroscience, reconstructs structural and functional brain maps at synapse-level resolution. These complex spatial maps consist of tree-like neurons interconnected by synapses. Motif analysis is a widely used method for identifying recurring subgraph patterns in connectomes. These motifs, thus, potentially represent fundamental units of information processing. However, existing computational tools often oversimplify neurons as mere nodes in a graph, disregarding their intricate morphologies. In this paper, we introduce MoMo, a novel interactive visualization framework for analyzing neuron morphology-aware motifs in large connectome graphs. First, we propose an advanced graph data structure that integrates both neuronal morphology and synaptic connectivity. This enables highly efficient, parallel subgraph isomorphism searches, allowing for interactive morphological motif queries. Second, we develop a sketch-based interface that facilitates the intuitive exploration of morphology-based motifs within our new data structure. Users can conduct interactive motif searches on state-of-the-art connectomes and visualize results as interactive 3D renderings. We present a detailed goal and task analysis for motif exploration in connectomes, incorporating neuron morphology. Finally, we evaluate MoMo through case studies with four domain experts, who asses the tool’s usefulness and effectiveness in motif exploration, and relevance to real-world neuroscience research. The source code for MoMo is available here: https://github.com/VCG/momo. Y1 - 2025 U6 - https://doi.org/10.1109/TVCG.2025.3634808 ER - TY - JOUR A1 - Boelts, Jan A1 - Harth, Philipp A1 - Gao, Richard A1 - Udvary, Daniel A1 - Yanez, Felipe A1 - Baum, Daniel A1 - Hege, Hans-Christian A1 - Oberlaender, Marcel A1 - Macke, Jakob H T1 - Simulation-based inference for efficient identification of generative models in connectomics JF - bioRxiv N2 - Recent advances in connectomics research enable the acquisition of increasing amounts of data about the connectivity patterns of neurons. How can we use this wealth of data to efficiently derive and test hypotheses about the principles underlying these patterns? A common approach is to simulate neural networks using a hypothesized wiring rule in a generative model and to compare the resulting synthetic data with empirical data. However, most wiring rules have at least some free parameters and identifying parameters that reproduce empirical data can be challenging as it often requires manual parameter tuning. Here, we propose to use simulation-based Bayesian inference (SBI) to address this challenge. Rather than optimizing a single rule to fit the empirical data, SBI considers many parametrizations of a wiring rule and performs Bayesian inference to identify the parameters that are compatible with the data. It uses simulated data from multiple candidate wiring rules and relies on machine learning methods to estimate a probability distribution (the `posterior distribution over rule parameters conditioned on the data') that characterizes all data-compatible rules. We demonstrate how to apply SBI in connectomics by inferring the parameters of wiring rules in an in silico model of the rat barrel cortex, given in vivo connectivity measurements. SBI identifies a wide range of wiring rule parameters that reproduce the measurements. We show how access to the posterior distribution over all data-compatible parameters allows us to analyze their relationship, revealing biologically plausible parameter interactions and enabling experimentally testable predictions. We further show how SBI can be applied to wiring rules at different spatial scales to quantitatively rule out invalid wiring hypotheses. Our approach is applicable to a wide range of generative models used in connectomics, providing a quantitative and efficient way to constrain model parameters with empirical connectivity data. Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-89890 ER - TY - JOUR A1 - Vohra, Sumit Kumar A1 - Harth, Philipp A1 - Isoe, Yasuko A1 - Bahl, Armin A1 - Fotowat, Haleh A1 - Engert, Florian A1 - Hege, Hans-Christian A1 - Baum, Daniel T1 - A Visual Interface for Exploring Hypotheses about Neural Circuits JF - IEEE Transactions on Visualization and Computer Graphics N2 - One of the fundamental problems in neurobiological research is to understand how neural circuits generate behaviors in response to sensory stimuli. Elucidating such neural circuits requires anatomical and functional information about the neurons that are active during the processing of the sensory information and generation of the respective response, as well as an identification of the connections between these neurons. With modern imaging techniques, both morphological properties of individual neurons as well as functional information related to sensory processing, information integration and behavior can be obtained. Given the resulting information, neurobiologists are faced with the task of identifying the anatomical structures down to individual neurons that are linked to the studied behavior and the processing of the respective sensory stimuli. Here, we present a novel interactive tool that assists neurobiologists in the aforementioned task by allowing them to extract hypothetical neural circuits constrained by anatomical and functional data. Our approach is based on two types of structural data: brain regions that are anatomically or functionally defined, and morphologies of individual neurons. Both types of structural data are interlinked and augmented with additional information. The presented tool allows the expert user to identify neurons using Boolean queries. The interactive formulation of these queries is supported by linked views, using, among other things, two novel 2D abstractions of neural circuits. The approach was validated in two case studies investigating the neural basis of vision-based behavioral responses in zebrafish larvae. Despite this particular application, we believe that the presented tool will be of general interest for exploring hypotheses about neural circuits in other species, genera and taxa. Y1 - 2024 U6 - https://doi.org/10.1109/TVCG.2023.3243668 VL - 30 IS - 7 SP - 3945 EP - 3958 ER - TY - GEN A1 - Vohra, Sumit Kumar A1 - Harth, Philipp A1 - Isoe, Yasuko A1 - Bahl, Armin A1 - Fotowat, Haleh A1 - Engert, Florian A1 - Hege, Hans-Christian A1 - Baum, Daniel T1 - A Visual Interface for Exploring Hypotheses about Neural Circuits N2 - One of the fundamental problems in neurobiological research is to understand how neural circuits generate behaviors in response to sensory stimuli. Elucidating such neural circuits requires anatomical and functional information about the neurons that are active during the processing of the sensory information and generation of the respective response, as well as an identification of the connections between these neurons. With modern imaging techniques, both morphological properties of individual neurons as well as functional information related to sensory processing, information integration and behavior can be obtained. Given the resulting information, neurobiologists are faced with the task of identifying the anatomical structures down to individual neurons that are linked to the studied behavior and the processing of the respective sensory stimuli. Here, we present a novel interactive tool that assists neurobiologists in the aforementioned task by allowing them to extract hypothetical neural circuits constrained by anatomical and functional data. Our approach is based on two types of structural data: brain regions that are anatomically or functionally defined, and morphologies of individual neurons. Both types of structural data are interlinked and augmented with additional information. The presented tool allows the expert user to identify neurons using Boolean queries. The interactive formulation of these queries is supported by linked views, using, among other things, two novel 2D abstractions of neural circuits. The approach was validated in two case studies investigating the neural basis of vision-based behavioral responses in zebrafish larvae. Despite this particular application, we believe that the presented tool will be of general interest for exploring hypotheses about neural circuits in other species, genera and taxa. T3 - ZIB-Report - 23-07 Y1 - 2023 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:0297-zib-89932 SN - 1438-0064 ER - TY - CHAP A1 - Harth, Philipp A1 - Vohra, Sumit A1 - Udvary, Daniel A1 - Oberlaender, Marcel A1 - Hege, Hans-Christian A1 - Baum, Daniel T1 - A Stratification Matrix Viewer for Analysis of Neural Network Data T2 - Eurographics Workshop on Visual Computing for Biology and Medicine (VCBM) N2 - The analysis of brain networks is central to neurobiological research. In this context the following tasks often arise: (1) understand the cellular composition of a reconstructed neural tissue volume to determine the nodes of the brain network; (2) quantify connectivity features statistically; and (3) compare these to predictions of mathematical models. We present a framework for interactive, visually supported accomplishment of these tasks. Its central component, the stratification matrix viewer, allows users to visualize the distribution of cellular and/or connectional properties of neurons at different levels of aggregation. We demonstrate its use in four case studies analyzing neural network data from the rat barrel cortex and human temporal cortex. Y1 - 2022 U6 - https://doi.org/10.2312/vcbm.20221194 CY - Vienna, Austria ER - TY - JOUR A1 - Udvary, Daniel A1 - Harth, Philipp A1 - Macke, Jakob H. A1 - Hege, Hans-Christian A1 - de Kock, Christiaan P. J. A1 - Sakmann, Bert A1 - Oberlaender, Marcel T1 - The Impact of Neuron Morphology on Cortical Network Architecture JF - Cell Reports N2 - The neurons in the cerebral cortex are not randomly interconnected. This specificity in wiring can result from synapse formation mechanisms that connect neurons depending on their electrical activity and genetically defined identity. Here, we report that the morphological properties of the neurons provide an additional prominent source by which wiring specificity emerges in cortical networks. This morphologically determined wiring specificity reflects similarities between the neurons’ axo-dendritic projections patterns, the packing density and cellular diversity of the neuropil. The higher these three factors are the more recurrent is the topology of the network. Conversely, the lower these factors are the more feedforward is the network’s topology. These principles predict the empirically observed occurrences of clusters of synapses, cell type-specific connectivity patterns, and nonrandom network motifs. Thus, we demonstrate that wiring specificity emerges in the cerebral cortex at subcellular, cellular and network scales from the specific morphological properties of its neuronal constituents. Y1 - 2022 U6 - https://doi.org/10.1016/j.celrep.2022.110677 VL - 39 IS - 2 ER -