Overview Statistic: PDF-Downloads (blue) and Frontdoor-Views (gray)
  • Treffer 5 von 5
Zurück zur Trefferliste

Scheduling Data Streams for Low Latency and High Throughput on a Cray XC40 Using Libfabric

  • Achieving efficient many-to-many communication on a given network topology is a challenging task when many data streams from different sources have to be scattered concurrently to many destinations with low variance in arrival times. In such scenarios, it is critical to saturate but not to congest the bisectional bandwidth of the network topology in order to achieve a good aggregate throughput. When there are many concurrent point-to-point connections, the communication pattern needs to be dynamically scheduled in a fine-grained manner to avoid network congestion (links, switches), overload in the node’s incoming links, and receive buffer overflow. Motivated by the use case of the Compressed Baryonic Matter experiment (CBM), we study the performance and variance of such communication patterns on a Cray XC40 with different routing schemes and scheduling approaches. We present a distributed Data Flow Scheduler (DFS) that reduces the variance of arrival times from all sources at least 30 times and increases the achieved aggregate bandwidth by up to 50%.

Metadaten exportieren

Weitere Dienste

Teilen auf Twitter Suche bei Google Scholar Statistik - Anzahl der Zugriffe auf das Dokument
Metadaten
Verfasserangaben:Farouk Salem, Thorsten SchüttORCiD, Florian SchintkeORCiD, Alexander Reinefeld
Dokumentart:Konferenzbeitrag
Titel des übergeordneten Werkes (Englisch):CUG Conference Proceedings
Volltext-Url:https://cug.org/proceedings/cug2019_proceedings/includes/files/pap117s2-file1.pdf
Jahr der Erstveröffentlichung:2019
Accept ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.