Overview Statistic: PDF-Downloads (blue) and Frontdoor-Views (gray)
  • Treffer 4 von 12
Zurück zur Trefferliste

Progressive Retrieval and Hierarchical Visualization of Large Remote Data

Zitieren Sie bitte immer diese URN: urn:nbn:de:0297-zib-7623
  • \noindent The size of data sets produced on remote supercomputer facilities frequently exceeds the processing capabilities of local visualization workstations. This phenomenon increasingly limits scientists when analyzing results of large-scale scientific simulations. That problem gets even more prominent in scientific collaborations, spanning large virtual organizations, working on common shared sets of data distributed in Grid environments. In the visualization community, this problem is addressed by distributing the visualization pipeline. In particular, early stages of the pipeline are executed on resources closer to the initial (remote) locations of the data sets. \noindent This paper presents an efficient technique for placing the first two stages of the visualization pipeline (data access and data filter) onto remote resources. This is realized by exploiting the ``extended retrieve'' feature of GridFTP for flexible, high performance access to very large HDF5 files. We reduce the number of network transactions for filtering operations by utilizing a server side data processing plugin, and hence reduce latency overhead compared to GridFTP partial file access. The paper further describes the application of hierarchical rendering techniques on remote uniform data sets, which make use of the remote data filtering stage.

Volltext Dateien herunterladen

Metadaten exportieren

Weitere Dienste

Teilen auf Twitter Suche bei Google Scholar Statistik - Anzahl der Zugriffe auf das Dokument
Metadaten
Verfasserangaben:Hans-Christian HegeORCiDGND, Andrei Hutanu, Ralf Kähler, André Merzky, Thomas Radke, Edward Seidel, Brygg Ullmer
Dokumentart:ZIB-Report
Freies Schlagwort / Tag:grid; hdf5; large files; remote data access; visualization pipeline
CCS-Klassifikation:C. Computer Systems Organization / C.2 COMPUTER-COMMUNICATION NETWORKS / C.2.4 Distributed Systems
I. Computing Methodologies / I.4 IMAGE PROCESSING AND COMPUTER VISION (REVISED) / I.4.m Miscellaneous
I. Computing Methodologies / I.6 SIMULATION AND MODELING (G.3) / I.6.6 Simulation Output Analysis
PACS-Klassifikation:00.00.00 GENERAL / 07.00.00 Instruments, apparatus, and components common to several branches of physics and astronomy (see also each subdiscipline for specialized instrumentation and techniques) / 07.05.-t Computers in experimental physics; Computers in education, see 01.50.H- and 01.50.Lc; Computational techniques, see 02.70.-c; Quantum computation architectures and implementations, see 03.67.Lx; Optical computers, see 42.79.Ta / 07.05.Kf Data analysis: algorithms and implementation; data management (for data analysis in nuclear physics, see 29.85.-c)
Datum der Erstveröffentlichung:26.11.2003
Schriftenreihe (Bandnummer):ZIB-Report (03-40)
ZIB-Reportnummer:03-40
Verlagspublikation:Appeared in: Proc. 2003 Workshop on Adaptive Grid Middleware, September 2003, pp. 60-72
Accept ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.