Refine
Year of publication
Document Type
- In Proceedings (152)
- Article (131)
- ZIB-Report (32)
- Book chapter (15)
- Other (14)
- In Collection (9)
- Book (3)
- Poster (3)
Keywords
- DVR (2)
- 3D neural network (1)
- Cultural Heritage (1)
- DNA (1)
- Dense connectome (1)
- GPU acceleration (1)
- Gaussian Process (1)
- HCI (1)
- Hierarchical (1)
- Interaction Techniques (1)
Institute
- Visual and Data-centric Computing (359) (remove)
A great amount of material properties is strongly influenced by dislocations, the carriers of plastic deformation. It is therefore paramount to have appropriate tools to quantify dislocation substructures with regard to their features, e.g., dislocation density, Burgers vectors or line direction. While the transmission electron microscope (TEM) has been the most widely-used equipment implemented to investigate dislocations, it usually is limited to the two-dimensional (2D) observation of three-dimensional (3D) structures. We reconstruct, visualize and quantify 3D dislocation substructure models from only two TEM images (stereo-pairs) and assess the results. The reconstruction is based on the manual interactive tracing of filiform objects on both images of the stereo-pair. The reconstruction and quantification method are demonstrated on dark field (DF) scanning (S)TEM micrographs of dislocation substructures imaged under diffraction contrast conditions. For this purpose, thick regions (> 300 nm) of TEM foils are analyzed, which are extracted from a Ni-base superalloy single crystal after high temperature creep deformation. It is shown how the method allows 3D quantification from stereo-pairs in a wide range of tilt conditions, achieving line length and orientation uncertainties of 3 % and 7°, respectively. Parameters that affect the quality of such reconstructions are discussed.
We propose a novel GPU-based approach to render virtual X-ray projections of deformable tetrahedral meshes. These meshes represent the shape and the internal density distribution of a particular anatomical structure and are derived from statistical shape and intensity models (SSIMs). We apply our method to improve the geometric reconstruction of 3D anatomy (e.g.\ pelvic bone) from 2D X-ray images. For that purpose, shape and density of a tetrahedral mesh are varied and virtual X-ray projections are generated within an optimization process until the similarity between the computed virtual X-ray and the respective anatomy depicted in a given clinical X-ray is maximized. The OpenGL implementation presented in this work deforms and projects tetrahedral meshes of high resolution (200.000+ tetrahedra) at interactive rates. It generates virtual X-rays that accurately depict the density distribution of an anatomy of interest. Compared to existing methods that accumulate X-ray attenuation in deformable meshes, our novel approach significantly boosts the deformation/projection performance. The proposed projection algorithm scales better with respect to mesh resolution and complexity of the density distribution, and the combined deformation and projection on the GPU scales better with respect to the number of deformation parameters. The gain in performance allows for a larger number of cycles in the optimization process. Consequently, it reduces the risk of being stuck in a local optimum. We believe that our approach contributes in orthopedic surgery, where 3D anatomy information needs to be extracted from 2D X-rays to support surgeons in better planning joint replacements.
For Kendall’s shape space we determine analytically Jacobi fields and parallel transport, and compute geodesic regression. Using the derived expressions, we can fully leverage the geometry via Riemannian optimization and reduce the computational expense by several orders of magnitude. The methodology is demonstrated by performing a longitudinal statistical analysis of epidemiological shape data.
As application example we have chosen 3D shapes of knee bones, reconstructed from image data of the Osteoarthritis Initiative. Comparing subject groups with incident and developing osteoarthritis versus normal controls, we find clear differences in the temporal development of femur shapes. This paves the way for early prediction of incident knee osteoarthritis, using geometry data only.
Traditionally, Lagrangian fields such as finite-time Lyapunov exponents (FTLE)
are precomputed on a discrete grid and are ray casted afterwards. This, however,
introduces both grid discretization errors and sampling errors during ray marching.
In this work, we apply a progressive, view-dependent Monte Carlo-based approach
for the visualization of such Lagrangian fields in time-dependent flows. Our ap-
proach avoids grid discretization and ray marching errors completely, is consistent,
and has a low memory consumption. The system provides noisy previews that con-
verge over time to an accurate high-quality visualization. Compared to traditional
approaches, the proposed system avoids explicitly predefined fieldline seeding
structures, and uses a Monte Carlo sampling strategy named Woodcock tracking
to distribute samples along the view ray. An acceleration of this sampling strategy
requires local upper bounds for the FTLE values, which we progressively acquire
during the rendering. Our approach is tailored for high-quality visualizations of
complex FTLE fields and is guaranteed to faithfully represent detailed ridge surface
structures as indicators for Lagrangian coherent structures (LCS). We demonstrate
the effectiveness of our approach by using a set of analytic test cases and real-world numerical simulations.
Many scientific applications deal with data from a multitude of different sources, e.g., measurements, imaging and simulations. Each source provides an additional perspective on the phenomenon of interest, but also comes with specific limitations, e.g. regarding accuracy, spatial and temporal availability. Effectively combining and analyzing such multimodal and partially incomplete data of limited accuracy in an integrated way is challenging. In this work, we outline an approach for an integrated analysis and visualization of the atmospheric impact of volcano eruptions. The data sets comprise observation and imaging data from satellites as well as results from numerical particle simulations. To analyze the clouds from the volcano eruption in the spatiotemporal domain we apply topological methods. Extremal structures reveal structures in the data that support clustering and comparison. We further discuss the robustness of those methods with respect to different properties of the data and different parameter setups. Finally we outline open challenges for the effective integrated visualization using topological methods.
Radiologists from all application areas are trained to read slice-based visualizations of 3D medical image data. Despite the numerous
examples of sophisticated three-dimensional renderings, especially all variants of direct volume rendering, such methods are
often considered not very useful by radiologists who prefer slice-based visualization. Just recently there have been attempts to bridge this
gap between 2D and 3D renderings. These attempts include specialized techniques for volume picking that result in repositioning slices.
In this paper, we present a new volume picking technique that, in contrast to previous work, does not require pre-segmented data or metadata. The positions picked by our method are solely based on the data itself, the transfer function and,
most importantly, on the way the volumetric rendering is perceived by viewers. To demonstrate the usefulness of the proposed method
we apply it for automatically
repositioning slices in an abdominal MRI
scan, a data set from a flow simulation and a number of other volumetric scalar fields. Furthermore we discuss how the method can be implemented in combination with various different volumetric rendering techniques.
Ancient Egyptian papyri are often folded, rolled up or kept as small packages, sometimes even sealed. Physically unrolling or unfolding these packages might severely damage them. We demonstrate a way to get access to the hidden script without physical unfolding by employing computed tomography and mathematical algorithms for virtual unrolling and unfolding. Our algorithmic approaches are combined with manual interaction. This provides the necessary flexibility to enable the unfolding of even complicated and partly damaged papyrus packages. In addition, it allows us to cope with challenges posed by the structure of ancient papyrus, which is rather irregular, compared to other writing substrates like metallic foils or parchment. Unfolding of packages is done in two stages. In the first stage, we virtually invert the physical folding process step by step until the partially unfolded package is topologically equivalent to a scroll or a papyrus sheet folded only along one fold line. To minimize distortions at this stage, we apply the method of moving least squares. In the second stage, the papyrus is simply flattened, which requires the definition of a medial surface. We have applied our software framework to several papyri. In this work, we present the results of applying our approaches to mockup papyri that were either rolled or folded along perpendicular fold lines. In the case of the folded papyrus, our approach represents the first attempt to address the unfolding of such complicated folds.
In this paper, we propose a new method for optimizing the blue noise characteristics of point sets. It is based on Procrustes analysis, a technique for adjusting shapes to each other by applying optimal elements of an appropriate transformation group. We adapt this technique to the problem at hand and introduce a very simple, efficient and provably convergent point set optimizer.
We present iCon.text, a kiosk platform for the iPad centered around artefacts, whose content and layout can be tailored without programming skills for specific museum exhibitions. The central metaphor to access information is a virtual postcard with one front and a customizable number of back sides that provide details about exhibits to museum visitors in textual and image form. Back sides can link to others cards. Access to these postcards is possible through one or more navigation views that can be navigated to from a navigation bar.
The entry point to the application is designed as a multitouch interactive pile of cards in a playful manner that allows visitors of any age an easy approach to the presentation and interaction metaphor. To directly access a certain postcard, a mosaic view can be uitilized to provide an overview about all available exhibits. A category view groups postcards into themes. Locating artefacts on a zoomable map or exhibition floor plan allows for conveying information about spatial contexts between different objects and their location. Furthermore, contexts can be illustrated with a two stage view comprising an overview and corresponding detail views to provide further insights into the spatial, temporal, and thematic contexts of artefacts. The application scaffolding allows the design of bilingual presentations to support exhibitions with an international audience. The logo of the presenting institution or exhibition can be incorporated to display the the kiosk's corporate design branding and to access an imprint or further informations. Usage is logged into files to provide a basis for extracting statistical information about the usage.
The details about the exhibits are presented as images and as such impose no limit to the design choices made by the content provider or exhibition designer.
The application (enhanced with a panoramic view) has been integrated successfully into a large special exhibition about the ancient city of Pergamon 2011/2012 at the Pergamon Museum Berlin within the interdisciplinary project "Berlin Sculpture Network".
Sensory-evoked signal flow, at cellular and network levels, is primarily determined by the synaptic wiring of the underlying neuronal circuitry. Measurements of synaptic innervation, connection probabilities and sub-cellular organization of synaptic inputs are thus among the most active fields of research in contemporary neuroscience. Methods to measure these quantities range from electrophysiological recordings over reconstructions
of dendrite-axon overlap at light-microscopic levels to dense circuit reconstructions of small volumes at electron-microscopic resolution. However, quantitative and complete measurements at subcellular resolution and mesoscopic scales to obtain all local and long-range synaptic in/outputs for any neuron within an entire brain region are beyond present methodological limits. Here, we present a novel concept, implemented within an interactive software environment called NeuroNet, which allows (i) integration of sparsely sampled (sub)cellular morphological data into an accurate anatomical reference frame of the brain region(s) of interest, (ii) up-scaling to generate an average dense model of the neuronal circuitry within the respective brain region(s) and (iii) statistical measurements of synaptic innervation between all neurons within the model. We illustrate our approach by generating a dense average model of the entire rat vibrissal cortex, providing the required anatomical data, and illustrate how to measure synaptic innervation statistically. Comparing our results with data from paired recordings in vitro and in vivo, as well as with reconstructions of synaptic contact sites at light- and electron-microscopic levels, we find that our in silico measurements are in line with previous results.
Neuroanatomical analysis, such as classification of cell types, depends on reliable reconstruction of large numbers of complete 3D dendrite and axon morphologies. At present, the majority of neuron reconstructions are obtained from preparations in a single tissue slice in vitro, thus suffering from cut off dendrites and, more dramatically, cut off axons. In general, axons can innervate volumes of several cubic millimeters and may reach path lengths of tens of centimeters. Thus, their complete reconstruction requires in vivo labeling, histological sectioning and imaging of large fields of view. Unfortunately, anisotropic background conditions across such large tissue volumes, as well as faintly labeled thin neurites, result in incomplete or erroneous automated tracings and even lead experts to make annotation errors during manual reconstructions. Consequently, tracing reliability renders the major bottleneck for reconstructing complete 3D neuron morphologies. Here, we present a novel set of tools, integrated into a software environment named ‘Filament Editor’, for creating reliable neuron tracings from sparsely labeled in vivo datasets. The Filament Editor allows for simultaneous visualization of complex neuronal tracings and image data in a 3D viewer, proof-editing of neuronal tracings, alignment and interconnection across sections, and morphometric analysis in relation to 3D anatomical reference structures. We illustrate the functionality of the Filament Editor on the example of in vivo labeled axons and demonstrate that for the exemplary dataset the final tracing results after proof-editing are independent of the expertise of the human operator.
This paper presents an algorithm called surfseek for selecting surfaces
on the most visible features in direct volume rendering (DVR). The
algorithm is based on a previously published technique (WYSIWYP) for
picking 3D locations in DVR. The new algorithm projects a surface patch
on the DVR image, consisting of multiple rays. For each ray the algorithm
uses WYSIWYP or a variant of it to find the candidates for the
most visible locations along the ray. Using these candidates the algorithm
constructs a graph and computes a minimum cut on this graph. The minimum
cut represents a very visible but relatively smooth surface. In the
last step the selected surface is displayed. We provide examples for the
results in real-world dataset as well as in artificially generated datasets.
In this paper we describe VisiTrace, a novel technique to
draw 3D lines in 3D volume rendered images. It allows to
draw strokes in the 2D space of the screen to produce 3D
lines that run on top or in the center of structures actually
visible in the volume rendering. It can handle structures
that only shortly occlude the structure that has been visible at the starting point of the stroke and is able to ignore
such structures. For this purpose a shortest path algorithm
finding the optimal curve in a specially designed graph
data structure is employed. We demonstrate the usefulness of the technique by applying it to MRI data from
medicine and engineering, and show how the method can
be used to mark or analyze structures in the example data
sets, and to automatically obtain good views toward the
selected structures.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
The historical importance of ancient manuscripts is unique since they provide information about the heritage of ancient cultures. Often texts are hidden in rolled or folded documents. Due to recent impro- vements in sensitivity and resolution, spectacular disclosures of rolled hidden texts were possible by X-ray tomography. However, revealing text on folded manuscripts is even more challenging. Manual unfolding is often too risky in view of the fragile condition of fragments, as it can lead to the total loss of the document. X-ray tomography allows for virtual unfolding and enables non-destructive access to hid- den texts. We have recently demonstrated the procedure and tested unfolding algorithms on a mockup sample. Here, we present results on unfolding ancient papyrus packages from the papyrus collection of the Musée du Louvre, among them objects folded along approximately orthogonal folding lines. In one of the packages, the first identification of a word was achieved, the Coptic word for “Lord”.
Purpose/Aims of the Study: Bone’s hierarchical structure can be visualized using a variety of methods. Many techniques, such as light and electron microscopy generate two-dimensional (2D) images, while micro computed tomography (μCT) allows a direct representation of the three-dimensional (3D) structure. In addition, different methods provide complementary structural information, such as the arrangement of organic or inorganic compounds. The overall aim of the present study is to answer bone research questions by linking information of different 2D and 3D imaging techniques. A great challenge in combining different methods arises from the fact that they usually reflect different characteristics of the real structure.
Materials and Methods: We investigated bone during healing by means of μCT and a couple of 2D methods. Backscattered electron images were used to qualitatively evaluate the tissue’s calcium content and served as a position map for other experimental data. Nanoindentation and X-ray scattering experiments were performed to visualize mechanical and structural properties. Results: We present an approach for the registration of 2D data in a 3D μCT reference frame, where scanning electron microscopies serve as a methodic link. Backscattered electron images are perfectly suited for registration into μCT reference frames, since both show structures based on the same physical principles. We introduce specific registration tools that have been developed to perform the registration process in a semi-automatic way.
Conclusions: By applying this routine, we were able to exactly locate structural information (e.g. mineral particle properties) in the 3D bone volume. In bone healing studies this will help to better understand basic formation, remodeling and mineralization processes.
Intakte Gelenke sind eine Voraussetzung für das Funktionieren des Skeletts und die Mobilität im Lebensalltag. Ein gesunder Bewegungsapparat ist die Grundlage für die Funktionsfähigkeit des Herz-Kreislauf-Systems wie auch der Immunabwehr. Bewegungs- und Physiotherapie sowie verschiedene Formen der Patientenaktivität stellen essenzielle klinische Ansätze in der Behandlung von neurodegenerativen Erkrankungen, Schlaganfall, Diabetes und Krebs dar. Kommt es zu degenerativen Veränderungen von Gelenken, bedeutet dies eine wesentliche Beeinträchtigung der Mobilität. Nächtliche Schmerzen und Schlafstörungen treten in fortgeschrittenen Stadien auf und sind besonders belastend. Arthrose wird auch als degenerative Gelenkerkrankung bezeichnet. Sie geht mit Veränderungen in der Struktur und Zusammensetzung des Gelenkknorpels wie auch des verkalkten Knorpels, der subchondralen Kortikalis, der subchondralen Spongiosa, des Meniskus, der Gelenkkapsel und der Synovialis einher, was schließlich zur Degeneration dieser Gewebe führt, aus denen sich die Synovialgelenke zusammensetzen.
Intact joints are necessary for skeletal function and mobility in daily life. A healthy musculoskeletal system is the basis for a functional cardiovascular
system as well as an intact immune system. Locomotion, physiotherapy, and various forms of patient activity are essential clinical therapies used in the treatment of neurodegeneration, stroke, diabetes, and cancer. Mobility is substantially impaired with degeneration of joints and, in advanced stages, nighttime pain and sleep disturbance are particularly cumbersome.
Osteoarthritis (OA) is also known as degenerative joint disease. OA involves structural and compositional changes in the articular cartilage, as well as in the calcified cartilage, subchondral cortical bone, subchondral cancellous bone, meniscus, joint capsular tissue, and synovium; which eventually lead to degeneration of these tissues comprising synovial joints.