• search hit 79 of 84
Back to Result List

Tell-Tale Tail Latencies: Pitfalls and Perils in Database Benchmarking

  • The performance of database systems is usually characterised by their average-case (i.e., throughput) behaviour in standardised or de-facto standard benchmarks like TPC-X or YCSB. While tails of the latency (i.e., response time) distribution receive considerably less attention, they have been identified as a threat to the overall system performance: In large-scale systems, even a fraction of requests delayed can build up into delays perceivable by end users. To eradicate large tail latencies from database systems, the ability to faithfully record them, and likewise pinpoint them to the root causes, is imminently required. In this paper, we address the challenge of measuring tail latencies using standard benchmarks, and identify subtle perils and pitfalls. In particular, we demonstrate how Java-based benchmarking approaches can substantially distort tail latency observations, and discuss how the discovery of such problems is inhibited by the common focus on throughput performance. We make a case for purposefully re-designing database benchmarking harnesses based on these observations to arrive at faithful characterisations of database performance from multiple important angles.

Export metadata

Additional Services

Share in Twitter Search Google Scholar Statistics
Metadaten
Author:Michael Fruth, Stefanie ScherzingerORCiD, Wolfgang MauererORCiDGND, Ralf Ramsauer
DOI:https://doi.org/10.1007/978-3-030-94437-7_8
ISBN:9783030944377
Parent Title (English):Performance evaluation and benchmarking, 13th TPC Technology Conference (TPCTC 2021): Copenhagen, Denmark, August 20, 2021, Revised Selected Papers
Publisher:Springer
Place of publication:Cham, Switzerland
Editor:Raghunath Nambiar, Meikel Poess
Document Type:conference proceeding (article)
Language:English
Year of first Publication:2022
Release Date:2022/04/11
Tag:Benchmark harness; Database benchmarks; Tail latencies
First Page:119
Last Page:134
Andere Schriftenreihe:Lecture Notes in Computer Science; vol 13169
Institutes:Fakultät Informatik und Mathematik
Fakultät Informatik und Mathematik / Labor für Digitalisierung (LFD)
Begutachtungsstatus:peer-reviewed
research focus:Digitalisierung
Licence (German):Keine Lizenz - Es gilt das deutsche Urheberrecht: § 53 UrhG