• search hit 4 of 7
Back to Result List

Nullius in Verba: Reproducibility for Database Systems Research, Revisited

  • Over the last decade, reproducibility of experimental results has been a prime focus in database systems research, and many high-profile conferences award results that can be independently verified. Since database systems research involves complex software stacks that non-trivially interact with hardware, sharing experimental setups is anything but trivial: Building a working reproduction package goes far beyond providing a DOI to some repository hosting data, code, and setup instructions.This tutorial revisits reproducible engineering in the face of state-of-the-art technology, and best practices gained in other computer science research communities. In particular, in the hands-on part, we demonstrate how to package entire system software stacks for dissemination. To ascertain long-term reproducibility over decades (or ideally, forever), we discuss why relying on open source technologies massively employed in industry has essential advantages over approaches crafted specifically for research. Supplementary material shows how version control systems that allow for non-linearly rewriting recorded history can document the structured genesis behind experimental setups in a way that is substantially easier to understand, without involvement of the original authors, compared to detour-ridden, strictly historic evolution.

Export metadata

Additional Services

Share in Twitter Search Google Scholar Statistics
Metadaten
Author:Wolfgang MauererORCiDGND, Stefanie ScherzingerORCiD
DOI:https://doi.org/10.1109/ICDE51399.2021.00270
ISBN:978-1-7281-9184-3
Parent Title (English):2021 IEEE 37th International Conference on Data Engineering (ICDE 2021): 19-22 April 2021, Chania, Greece
Publisher:IEEE
Place of publication:Piscataway, NJ
Editor:Anastasia Ailamaki
Document Type:conference proceeding (article)
Language:English
Year of first Publication:2021
Release Date:2022/04/11
Tag:Control systems; Data engineering; Database systems; Hardware; Industries; Reproducibility of results; Tutorials; docker; git; reproducible science; reproduction, reproduction package; scientific attribution; scientific method
First Page:2377
Last Page:2380
Institutes:Fakultät Informatik und Mathematik
Fakultät Informatik und Mathematik / Labor für Digitalisierung (LFD)
Begutachtungsstatus:peer-reviewed
research focus:Digitalisierung
Licence (German):Keine Lizenz - Es gilt das deutsche Urheberrecht: § 53 UrhG