TY - CHAP A1 - Klettke, Meike A1 - Störl, Uta A1 - Shenavai, Manuel A1 - Scherzinger, Stefanie A1 - Storl, Uta T1 - NoSQL schema evolution and big data migration at scale T2 - 2016 IEEE International Conference on Big Data (Big Data), 5-8 Dec. 2016, Washington, DC N2 - This paper explores scalable implementation strategies for carrying out lazy schema evolution in NoSQL data stores. For decades, schema evolution has been an evergreen in database research. Yet new challenges arise in the context of cloud-hosted data backends: With all database reads and writes charged by the provider, migrating the entire data instance eagerly into a new schema can be prohibitively expensive. Thus, lazy migration may be more cost-efficient, as legacy entities are only migrated in case they are actually accessed by the application. Related work has shown that the overhead of migrating data lazily is affordable when a single evolutionary change is carried out, such as adding a new property. In this paper, we focus on long-term schema evolution, where chains of pending schema evolution operations may have to be applied. Chains occur when legacy entities written several application releases back are finally accessed by the application. We discuss strategies for dealing with chains of evolution operations, in particular, the composition into a single, equivalent composite migration that performs the required version jump. Our experiments with MongoDB focus on scalable implementation strategies. Our lineup further compares the number of write operations, and thus, the operational costs of different data migration strategies. KW - Big data KW - Context KW - Data Migration Strategies KW - Data models KW - Databases KW - Incremental Migration KW - Lazy Composite Migration KW - Lazy Migration KW - NoSQL databases KW - Predictive Migration KW - Production KW - Runtime KW - schema evolution KW - Software Y1 - 2016 U6 - https://doi.org/10.1109/BigData.2016.7840924 SP - 2764 EP - 2774 PB - IEEE ER - TY - CHAP A1 - Störl, Uta A1 - Tekleab, Alexander A1 - Klettke, Meike A1 - Scherzinger, Stefanie A1 - Storl, Uta T1 - In for a Surprise When Migrating NoSQL Data T2 - 2018 IEEE 34th International Conference on Data Engineering (ICDE), 16-19 April 2018, Paris, France N2 - Schema-flexible NoSQL data stores lend themselves nicely for storing versioned data, a product of schema evolution. In this lightning talk, we apply pending schema changes to records that have been persisted several schema versions back. We present first experiments with MongoDB and Cassandra, where we explore the trade-off between applying chains of pending changes stepwise (one after the other), and as composite operations. Contrary to intuition, composite migration is not necessarily faster. The culprit is the computational overhead for deriving the compositions. However, caching composition formulae achieves a speed up: For Cassandra, we can cut the runtime by nearly 80%. Surprisingly, the relative speedup seems to be system-dependent. Our take away message is that in applying pending schema changes in NoSQL data stores, we need to base our design decisions on experimental evidence rather than on intuition alone. KW - composite migration KW - Conferences KW - Data engineering KW - data migration KW - Indexes KW - Lightning KW - NoSQL databases KW - Runtime KW - schema evolution KW - Tools Y1 - 2018 U6 - https://doi.org/10.1109/ICDE.2018.00202 SP - 1662 PB - IEEE ER - TY - CHAP A1 - Störl, Uta A1 - Müller, Daniel A1 - Tekleab, Alexander A1 - Tolale, Stephane A1 - Stenzel, Julian A1 - Klettke, Meike A1 - Scherzinger, Stefanie A1 - Storl, Uta A1 - Muller, Daniel T1 - Curating Variational Data in Application Development T2 - 2018 IEEE 34th International Conference on Data Engineering, 16-19 April 2018, Paris, France N2 - Building applications for processing data lakes is a software engineering challenge. We present Darwin, a middleware for applications that operate on variational data. This concerns data with heterogeneous structure, usually stored within a schema-flexible NoSQL database. Darwin assists application developers in essential data and schema curation tasks: Upon request, Darwin extracts a schema description, discovers the history of schema versions, and proposes mappings between these versions. Users of Darwin may interactively choose which mappings are most realistic. Darwin is further capable of rewriting queries at runtime, to ensure that queries also comply with legacy data. Alternatively, Darwin can migrate legacy data to reduce the structural heterogeneity. Using Darwin, developers may thus evolve their data in sync with their code. In our hands-on demo, we curate synthetic as well as real-life datasets. KW - data migration KW - Data mining KW - Evolution (biology) KW - history KW - NoSQL databases KW - query rewriting KW - schema evolution KW - schema management KW - Software KW - Task analysis KW - variational data Y1 - 2018 U6 - https://doi.org/10.1109/ICDE.2018.00187 SP - 1605 EP - 1608 PB - IEEE ER - TY - CHAP A1 - Klettke, Meike A1 - Awolin, Hannes A1 - Störl, Uta A1 - Müller, Daniel A1 - Scherzinger, Stefanie A1 - Storl, Uta A1 - Muller, Daniel T1 - Uncovering the evolution history of data lakes T2 - 2017 IEEE International Conference on Big Data (Big Data),,11-14 Dec. 2017, Boston, MA, USA N2 - Data accumulating in data lakes can become inaccessible in the long run when its semantics are not available. The heterogeneity of data formats and the sheer volumes of data collections prohibit cleaning and unifying the data manually. Thus, tools for automated data lake analysis are of great interest. In this paper, we target the particular problem of reconstructing the schema evolution history from data lakes. Knowing how the data is structured, and how this structure has evolved over time, enables programmatic access to the lake. By deriving a sequence of schema versions, rather than a single schema, we take into account structural changes over time. Moreover, we address the challenge of detecting inclusion dependencies. This is a prerequisite for mapping between succeeding schema versions, and in particular, detecting nontrivial changes such as a property having been moved or copied. We evaluate our approach for detecting inclusion dependencies using the MovieLens dataset, as well an adaption of a dataset containing botanical descriptions, to cover specific edge cases. KW - Data mining KW - evolution operations KW - Grippers KW - history KW - inclusion dependencies KW - integrity constraints KW - Lakes KW - NoSQL databases KW - Protocols KW - schema version extraction Y1 - 2017 U6 - https://doi.org/10.1109/BigData.2017.8258204 SP - 2462 EP - 2471 PB - IEEE ER - TY - JOUR A1 - Scharfenberg, Georg A1 - Mottok, Jürgen A1 - Artmann, Christina A1 - Hobelsberger, Martin A1 - Paric, Ivan A1 - Großmann, Benjamin A1 - Pohlt, Clemens A1 - Wackerbarth, Alena A1 - Pausch, Uli A1 - Heidrich, Christiane A1 - Fadanelli, Martin A1 - Elsner, Michael A1 - Pöcher, Daniel A1 - Pittroff, Lenz A1 - Beer, Stefan A1 - Brückl, Oliver A1 - Haslbeck, Matthias A1 - Sterner, Michael A1 - Thema, Martin A1 - Muggenthaler, Nicole A1 - Lenck, Thorsten A1 - Götz, Philipp A1 - Eckert, Fabian A1 - Deubzer, Michael A1 - Stingl, Armin A1 - Simsek, Erol A1 - Krämer, Stefan A1 - Großmann, Benjamin A1 - Schlegl, Thomas A1 - Niedersteiner, Sascha A1 - Berlehner, Thomas A1 - Joblin, Mitchell A1 - Mauerer, Wolfgang A1 - Apel, Sven A1 - Siegmund, Janet A1 - Riehle, Dirk A1 - Weber, Joachim A1 - Palm, Christoph A1 - Zobel, Martin A1 - Al-Falouji, Ghassan A1 - Prestel, Dietmar A1 - Scharfenberg, Georg A1 - Mandl, Roland A1 - Deinzer, Arnulf A1 - Halang, W. A1 - Margraf-Stiksrud, Jutta A1 - Sick, Bernhard A1 - Deinzer, Renate A1 - Scherzinger, Stefanie A1 - Klettke, Meike A1 - Störl, Uta A1 - Wiech, Katharina A1 - Kubata, Christoph A1 - Sindersberger, Dirk A1 - Monkman, Gareth J. A1 - Dollinger, Markus A1 - Dembianny, Sven A1 - Kölbl, Andreas A1 - Welker, Franz A1 - Meier, Matthias A1 - Thumann, Philipp A1 - Swidergal, Krzysztof A1 - Wagner, Marcus A1 - Haug, Sonja A1 - Vernim, Matthias A1 - Seidenstücker, Barbara A1 - Weber, Karsten A1 - Arsan, Christian A1 - Schone, Reinhold A1 - Münder, Johannes A1 - Schroll-Decker, Irmgard A1 - Dillinger, Andrea Elisabeth A1 - Fuchshofer, Rudolf A1 - Monkman, Gareth J. A1 - Shamonin (Chamonine), Mikhail A1 - Geith, Markus A. A1 - Koch, Fabian A1 - Ühlin, Christian A1 - Schratzenstaller, Thomas A1 - Saßmannshausen, Sean Patrick A1 - Auchter, Eberhard A1 - Kriz, Willy A1 - Springer, Othmar A1 - Thumann, Maria A1 - Kusterle, Wolfgang A1 - Obermeier, Andreas A1 - Udalzow, Anton A1 - Schmailzl, Anton A1 - Hierl, Stefan A1 - Langer, Christoph A1 - Schreiner, Rupert ED - Baier, Wolfgang T1 - Forschungsbericht / Ostbayerische Technische Hochschule Regensburg T3 - Forschungsberichte der OTH Regensburg - 2015 Y1 - 2015 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-13867 SN - 978-3-00-048589-3 CY - Regensburg ER - TY - JOUR A1 - Beimler, Josef A1 - Leißl, Caroline A1 - Ebner, Lena A1 - Elsner, Michael A1 - Mühlbauer, Gerhard A1 - Kohlert, Dieter A1 - Schubert, Martin J. W. A1 - Weiß, Andreas P. A1 - Sterner, Michael A1 - Raith, Thomas A1 - Afranseder, Martin A1 - Krapf, Tobias A1 - Mottok, Jürgen A1 - Siemers, Christian A1 - Großmann, Benjamin A1 - Höcherl, Johannes A1 - Schlegl, Thomas A1 - Schneider, Ralph A1 - Milaev, Johannes A1 - Rampelt, Christina A1 - Roduner, Christian A1 - Glowa, Christoph A1 - Bachl, Christoph A1 - Schliekmann, Claus A1 - Gnan, Alfons A1 - Grill, Martin A1 - Ruhland, Karl A1 - Piehler, Thomas A1 - Friers, Daniel A1 - Wels, Harald A1 - Pflug, Kenny A1 - Kucera, Markus A1 - Waas, Thomas A1 - Schlachetzki, Felix A1 - Boy, Sandra A1 - Pemmerl, Josef A1 - Leis, Alexander A1 - Welsch, Andreas F.X. A1 - Graf, Franz A1 - Zenger, Gerhard A1 - Volbert, Klaus A1 - Waas, Thomas A1 - Scherzinger, Stefanie A1 - Klettke, Meike A1 - Störl, Uta A1 - Heyl, C. A1 - Boldenko, A. A1 - Monkman, Gareth J. A1 - Kujat, Richard A1 - Briem, Ulrich A1 - Hierl, Stefan A1 - Talbot, Sebastian A1 - Schmailzl, Anton A1 - Ławrowski, Robert Damian A1 - Prommesberger, Christian A1 - Langer, Christoph A1 - Dams, Florian A1 - Schreiner, Rupert A1 - Valentino, Piergiorgio A1 - Romano, Marco A1 - Ehrlich, Ingo A1 - Furgiuele, Franco A1 - Gebbeken, Norbert A1 - Eisenried, Michael A1 - Jungbauer, Bastian A1 - Hutterer, Albert A1 - Bauhuber, Michael A1 - Mikrievskij, Andreas A1 - Argauer, Monika A1 - Hummel, Helmut A1 - Lechner, Alfred A1 - Liebetruth, Thomas A1 - Schumm, Michael A1 - Joseph, Saskia A1 - Reschke, Michael A1 - Soska, Alexander A1 - Schroll-Decker, Irmgard A1 - Putzer, Michael A1 - Rasmussen, John A1 - Dendorfer, Sebastian A1 - Weber, Tim A1 - Al-Munajjed, Amir Andreas A1 - Verkerke, Gijsbertus Jacob A1 - Renkawitz, Tobias A1 - Haug, Sonja A1 - Rudolph, Clarissa A1 - Zeitler, Annika A1 - Schaubeck, Simon A1 - Steffens, Oliver A1 - Rechenauer, Christian A1 - Schulz-Brize, Thekla A1 - Fleischmann, Florian A1 - Kusterle, Wolfgang A1 - Beer, Anne A1 - Wagner, Bernd A1 - Neidhart, Thomas ED - Baier, Wolfgang T1 - Forschungsbericht 2013 T3 - Forschungsberichte der OTH Regensburg - 2013 Y1 - 2014 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-7990 CY - Regensburg ER - TY - JOUR A1 - Weber, Karsten A1 - Dendorfer, Sebastian A1 - Süß, Franz A1 - Kubowitsch, Simone A1 - Schratzenstaller, Thomas A1 - Haug, Sonja A1 - Mohr, Christa A1 - Kiesl, Hans A1 - Drechsler, Jörg A1 - Westner, Markus A1 - Kobus, Jörn A1 - Schubert, Martin J. W. A1 - Zenger, Stefan A1 - Pietsch, Alexander A1 - Weiß, Josef A1 - Hinterseer, Sebastian A1 - Schieck, Roland A1 - Scherzinger, Stefanie A1 - Klettke, Meike A1 - Ringlstetter, Andreas A1 - Störl, Uta A1 - Bissyandé, Tegawendé F. A1 - Seeburger, Achim A1 - Schindler, Timo A1 - Ramsauer, Ralf A1 - Kiszka, Jan A1 - Kölbl, Andreas A1 - Lohmann, Daniel A1 - Mauerer, Wolfgang A1 - Maier, Johannes A1 - Scorna, Ulrike A1 - Palm, Christoph A1 - Soska, Alexander A1 - Mottok, Jürgen A1 - Ellermeier, Andreas A1 - Vögele, Daniel A1 - Hierl, Stefan A1 - Briem, Ulrich A1 - Buschmann, Knut A1 - Ehrlich, Ingo A1 - Pongratz, Christian A1 - Pielmeier, Benjamin A1 - Tyroller, Quirin A1 - Monkman, Gareth J. A1 - Gut, Franz A1 - Roth, Carina A1 - Hausler, Peter A1 - Bierl, Rudolf A1 - Prommesberger, Christian A1 - Ławrowski, Robert Damian A1 - Langer, Christoph A1 - Schreiner, Rupert A1 - Huang, Yifeng A1 - She, Juncong A1 - Ottl, Andreas A1 - Rieger, Walter A1 - Kraml, Agnes A1 - Poxleitner, Thomas A1 - Hofer, Simon A1 - Heisterkamp, Benjamin A1 - Lerch, Maximilian A1 - Sammer, Nike A1 - Golde, Olivia A1 - Wellnitz, Felix A1 - Schmid, Sandra A1 - Muntschick, Claudia A1 - Kusterle, Wolfgang A1 - Paric, Ivan A1 - Brückl, Oliver A1 - Haslbeck, Matthias A1 - Schmidt, Ottfried A1 - Schwanzer, Peter A1 - Rabl, Hans-Peter A1 - Sterner, Michael A1 - Bauer, Franz A1 - Steinmann, Sven A1 - Eckert, Fabian A1 - Hofrichter, Andreas ED - Baier, Wolfgang T1 - Forschungsbericht 2017 T3 - Forschungsberichte der OTH Regensburg - 2017 KW - Forschung KW - Forschungsbericht Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-13835 SN - 978-3-9818209-3-5 CY - Regensburg ER - TY - CHAP A1 - Hillenbrand, Andrea A1 - Levchenko, Maksym A1 - Störl, Uta A1 - Scherzinger, Stefanie A1 - Klettke, Meike ED - Boncz, Peter ED - Manegold, Stefan ED - Ailamaki, Anastasia ED - Deshpande, Amol ED - Kraska, Tim T1 - MigCast : Putting a Price Tag on Data Model Evolution in NoSQL Data Stores T2 - Proceedings of the 2019 International Conference on Management of Data (SIGMOD/PODS '19) June 2019, Amsterdam, Netherlands N2 - We demonstrate MigCast, a tool-based advisor for exploring data migration strategies in the context of developing NoSQL-backed applications. Users of MigCast can consider their options for evolving their data model along with legacy data already persisted in the cloud-hosted production data-base. They can explore alternative actions as the financial costs are predicted respective to the cloud provider chosen. Thereby they are better equipped to assess potential consequences of imminent data migration decisions. To this end, MigCast maintains an internal cost model, taking into account characteristics of the data instance, expected work-load, data model changes, and cloud provider pricing models. Hence, MigCast enables software project stakeholders to remain in control of the operative costs and to make informed decisions evolving their applications. KW - Data Migration Strategies KW - latency KW - migration costs KW - NoSQL databases KW - Predictive Migration KW - schema evolution Y1 - 2019 SN - 9781450356435 U6 - https://doi.org/10.1145/3299869.3320223 SP - 1925 EP - 1928 PB - ACM CY - New York, NY, USA ER - TY - JOUR A1 - Störl, Uta A1 - Klettke, Meike A1 - Scherzinger, Stefanie T1 - Kurz erklärt: Objekt-NoSQL-Mapping JF - Datenbank-Spektrum Y1 - 2016 U6 - https://doi.org/10.1007/s13222-016-0212-y VL - 16 IS - 1 SP - 83 EP - 87 PB - Springer ER - TY - CHAP A1 - Störl, Uta A1 - Müller, Daniel A1 - Klettke, Meike A1 - Scherzinger, Stefanie ED - Mitschang, Bernhard T1 - Enabling Efficient Agile Software Development of NoSQL-backed Applications T2 - Datenbanksysteme für Business, Technologie und Web (BTW 2017) : 17. Fachtagung des GI-Fachbereichs "Datenbanken und Informationssyteme" (DBIS) : 06.-10.03.2017 in Stuttgart Deutschland N2 - NoSQL databases are popular in agile software development, where a frequently changing database schema imposes challenges for the production database. In this demo, we present Darwin, a middleware for systematic, tool-based support specifically designed for NoSQL database systems. Darwin carries out schema evolution and data migration tasks. To the best of our knowledge, Darwin is the first tool of its kind that supports both eager and lazy NoSQL data migration. Y1 - 2017 SN - 978-3-88579-659-6 PB - Gesellschaft für Informatik e.V. (GI) CY - Bonn ER -