TY - CONF A1 - Mauerer, Wolfgang A1 - Scherzinger, Stefanie A2 - Ailamaki, Anastasia T1 - Nullius in Verba: Reproducibility for Database Systems Research, Revisited T2 - 2021 IEEE 37th International Conference on Data Engineering (ICDE 2021): 19-22 April 2021, Chania, Greece N2 - Over the last decade, reproducibility of experimental results has been a prime focus in database systems research, and many high-profile conferences award results that can be independently verified. Since database systems research involves complex software stacks that non-trivially interact with hardware, sharing experimental setups is anything but trivial: Building a working reproduction package goes far beyond providing a DOI to some repository hosting data, code, and setup instructions.This tutorial revisits reproducible engineering in the face of state-of-the-art technology, and best practices gained in other computer science research communities. In particular, in the hands-on part, we demonstrate how to package entire system software stacks for dissemination. To ascertain long-term reproducibility over decades (or ideally, forever), we discuss why relying on open source technologies massively employed in industry has essential advantages over approaches crafted specifically for research. Supplementary material shows how version control systems that allow for non-linearly rewriting recorded history can document the structured genesis behind experimental setups in a way that is substantially easier to understand, without involvement of the original authors, compared to detour-ridden, strictly historic evolution. KW - Control systems KW - Data engineering KW - Database systems KW - docker KW - git KW - Hardware KW - Industries KW - Reproducibility of results KW - reproducible science KW - reproduction, reproduction package KW - scientific attribution KW - scientific method KW - Tutorials Y1 - 2021 UR - https://opus4.kobv.de/opus4-oth-regensburg/frontdoor/index/index/docId/3462 SN - 978-1-7281-9184-3 SP - 2377 EP - 2380 PB - IEEE CY - Piscataway, NJ ER -