Overview Statistic: PDF-Downloads (blue) and Frontdoor-Views (gray)
  • Treffer 1 von 1
Zurück zur Trefferliste

Efficient Distributed File I/O for Visualization in Grid Environments

Zitieren Sie bitte immer diese URN: urn:nbn:de:0297-zib-4326
  • Large scale simulations running in metacomputing environments face the problem of efficient file I/O. For efficiency it is desirable to write data locally, distributed across the computing environment, and then to minimize data transfer, i.e.\ reduce remote file access. Both aspects require I/O approaches which differ from existing paradigms. For the data output of distributed simulations, one wants to use fast local parallel I/O for all participating nodes, producing a single distributed logical file, while keeping changes to the simulation code as small as possible. For reading the data file as in postprocessing and file based visualization, one wants to have efficient partial access to remote and distributed files, using a global naming scheme and efficient data caching, and again keeping the changes to the postprocessing code small. However, all available software solutions require the entire data to be staged locally (involving possible data recombination and conversion), or suffer from the performance problems of remote or distributed file systems. In this paper we show how to interface the HDF5 I/O library via its flexible Virtual File Driver layer to the Globus Data Grid. We show, that combining these two toolkits in a suitable way provides us with a new I/O framework, which allows efficient, secure, distributed and parallel file I/O in a metacomputing environment.

Volltext Dateien herunterladen

Metadaten exportieren

Weitere Dienste

Teilen auf Twitter Suche bei Google Scholar Statistik - Anzahl der Zugriffe auf das Dokument
Metadaten
Verfasserangaben:Werner Benger, Hans-Christian HegeORCiDGND, Andre Merzky, Thomas Radke, Edward Seidel
Dokumentart:ZIB-Report
Freies Schlagwort / Tag:Amira; CCTK; Cactus; Data Grid; Globus; Grid; HDF5; Storage Systems; VFD
CCS-Klassifikation:C. Computer Systems Organization / C.2 COMPUTER-COMMUNICATION NETWORKS / C.2.4 Distributed Systems
Datum der Erstveröffentlichung:10.12.1999
Schriftenreihe (Bandnummer):ZIB-Report (SC-99-43)
ZIB-Reportnummer:SC-99-43
Verlagspublikation:Appeared in: B. Engquist, et.al., (eds.), Simulation and Visualization on the Grid, LNCSE, Vol. 13, Springer, 2000, 1-16
Accept ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.