In for a Surprise When Migrating NoSQL Data
- Schema-flexible NoSQL data stores lend themselves nicely for storing versioned data, a product of schema evolution. In this lightning talk, we apply pending schema changes to records that have been persisted several schema versions back. We present first experiments with MongoDB and Cassandra, where we explore the trade-off between applying chains of pending changes stepwise (one after the other), and as composite operations. Contrary to intuition, composite migration is not necessarily faster. The culprit is the computational overhead for deriving the compositions. However, caching composition formulae achieves a speed up: For Cassandra, we can cut the runtime by nearly 80%. Surprisingly, the relative speedup seems to be system-dependent. Our take away message is that in applying pending schema changes in NoSQL data stores, we need to base our design decisions on experimental evidence rather than on intuition alone.
Author: | Uta StörlORCiDGND, Alexander Tekleab, Meike Klettke, Stefanie ScherzingerORCiD, Uta StorlORCiDGND |
---|---|
DOI: | https://doi.org/10.1109/ICDE.2018.00202 |
Parent Title (English): | 2018 IEEE 34th International Conference on Data Engineering (ICDE), 16-19 April 2018, Paris, France |
Publisher: | IEEE |
Document Type: | conference proceeding (article) |
Language: | English |
Year of first Publication: | 2018 |
Release Date: | 2022/05/03 |
Tag: | Conferences; Data engineering; Indexes; Lightning; NoSQL databases; Runtime; Tools; composite migration; data migration; schema evolution |
First Page: | 1662 |
Institutes: | Fakultät Informatik und Mathematik |
Begutachtungsstatus: | peer-reviewed |
research focus: | Digitalisierung |
Licence (German): | Keine Lizenz - Es gilt das deutsche Urheberrecht: § 53 UrhG |