TY - CHAP A1 - Klettke, Meike A1 - Awolin, Hannes A1 - Störl, Uta A1 - Müller, Daniel A1 - Scherzinger, Stefanie A1 - Storl, Uta A1 - Muller, Daniel T1 - Uncovering the evolution history of data lakes T2 - 2017 IEEE International Conference on Big Data (Big Data),,11-14 Dec. 2017, Boston, MA, USA N2 - Data accumulating in data lakes can become inaccessible in the long run when its semantics are not available. The heterogeneity of data formats and the sheer volumes of data collections prohibit cleaning and unifying the data manually. Thus, tools for automated data lake analysis are of great interest. In this paper, we target the particular problem of reconstructing the schema evolution history from data lakes. Knowing how the data is structured, and how this structure has evolved over time, enables programmatic access to the lake. By deriving a sequence of schema versions, rather than a single schema, we take into account structural changes over time. Moreover, we address the challenge of detecting inclusion dependencies. This is a prerequisite for mapping between succeeding schema versions, and in particular, detecting nontrivial changes such as a property having been moved or copied. We evaluate our approach for detecting inclusion dependencies using the MovieLens dataset, as well an adaption of a dataset containing botanical descriptions, to cover specific edge cases. KW - Data mining KW - evolution operations KW - Grippers KW - history KW - inclusion dependencies KW - integrity constraints KW - Lakes KW - NoSQL databases KW - Protocols KW - schema version extraction Y1 - 2017 U6 - https://doi.org/10.1109/BigData.2017.8258204 SP - 2462 EP - 2471 PB - IEEE ER - TY - CHAP A1 - Haubold, Florian A1 - Schildgen, Johannes A1 - Scherzinger, Stefanie A1 - Deßloch, Stefan ED - Mitschang, Bernhard T1 - ControVol Flex: Flexible Schema Evolution for NoSQL Application Development T2 - Datenbanksysteme für Business, Technologie und Web (BTW 2017) : 17. Fachtagung des GI-Fachbereichs "Datenbanken und Informationssyteme" (DBIS) : 06.-10.03.2017 in Stuttgart Deutschland N2 - We demonstrate ControVol Flex, an Eclipse plugin for controlled schema evolution in Java applications backed by NoSQL document stores. The sweet spot of our tool are applications that are deployed continuously against the same production data store: Each new release may bring about schema changes that conflict with legacy data already stored in production. The type system internal to the predecessor tool ControVol is able to detect common schema conflicts, and enables developers to resolve them with the help of object-mapper annotations. Our new tool ControVol Flex lets developers choose their schema-migration strategy, whether all legacy data is to be migrated eagerly by means of NotaQL transformation scripts, or lazily, as declared by object-mapper annotations. Our tool is even capable of carrying out both strategies in combination, eagerly migrating data in the background, while lazily migrating data that is meanwhile accessed by the application. From the viewpoint of the application, it remains transparent how legacy data is migrated: Every read access yields an entity that matches the structure that the current application code expects. Our live demo shows how ControVol Flex gracefully solves a broad range of common schema-evolution tasks. KW - Schema evolution KW - NotaQL KW - NoSQL Y1 - 2017 PB - Gesellschaft für Informatik e.V. (GI) CY - Bonn ER - TY - CHAP A1 - Störl, Uta A1 - Müller, Daniel A1 - Klettke, Meike A1 - Scherzinger, Stefanie ED - Mitschang, Bernhard T1 - Enabling Efficient Agile Software Development of NoSQL-backed Applications T2 - Datenbanksysteme für Business, Technologie und Web (BTW 2017) : 17. Fachtagung des GI-Fachbereichs "Datenbanken und Informationssyteme" (DBIS) : 06.-10.03.2017 in Stuttgart Deutschland N2 - NoSQL databases are popular in agile software development, where a frequently changing database schema imposes challenges for the production database. In this demo, we present Darwin, a middleware for systematic, tool-based support specifically designed for NoSQL database systems. Darwin carries out schema evolution and data migration tasks. To the best of our knowledge, Darwin is the first tool of its kind that supports both eager and lazy NoSQL data migration. Y1 - 2017 SN - 978-3-88579-659-6 PB - Gesellschaft für Informatik e.V. (GI) CY - Bonn ER - TY - JOUR A1 - Weber, Karsten A1 - Dendorfer, Sebastian A1 - Süß, Franz A1 - Kubowitsch, Simone A1 - Schratzenstaller, Thomas A1 - Haug, Sonja A1 - Mohr, Christa A1 - Kiesl, Hans A1 - Drechsler, Jörg A1 - Westner, Markus A1 - Kobus, Jörn A1 - Schubert, Martin J. W. A1 - Zenger, Stefan A1 - Pietsch, Alexander A1 - Weiß, Josef A1 - Hinterseer, Sebastian A1 - Schieck, Roland A1 - Scherzinger, Stefanie A1 - Klettke, Meike A1 - Ringlstetter, Andreas A1 - Störl, Uta A1 - Bissyandé, Tegawendé F. A1 - Seeburger, Achim A1 - Schindler, Timo A1 - Ramsauer, Ralf A1 - Kiszka, Jan A1 - Kölbl, Andreas A1 - Lohmann, Daniel A1 - Mauerer, Wolfgang A1 - Maier, Johannes A1 - Scorna, Ulrike A1 - Palm, Christoph A1 - Soska, Alexander A1 - Mottok, Jürgen A1 - Ellermeier, Andreas A1 - Vögele, Daniel A1 - Hierl, Stefan A1 - Briem, Ulrich A1 - Buschmann, Knut A1 - Ehrlich, Ingo A1 - Pongratz, Christian A1 - Pielmeier, Benjamin A1 - Tyroller, Quirin A1 - Monkman, Gareth J. A1 - Gut, Franz A1 - Roth, Carina A1 - Hausler, Peter A1 - Bierl, Rudolf A1 - Prommesberger, Christian A1 - Ławrowski, Robert Damian A1 - Langer, Christoph A1 - Schreiner, Rupert A1 - Huang, Yifeng A1 - She, Juncong A1 - Ottl, Andreas A1 - Rieger, Walter A1 - Kraml, Agnes A1 - Poxleitner, Thomas A1 - Hofer, Simon A1 - Heisterkamp, Benjamin A1 - Lerch, Maximilian A1 - Sammer, Nike A1 - Golde, Olivia A1 - Wellnitz, Felix A1 - Schmid, Sandra A1 - Muntschick, Claudia A1 - Kusterle, Wolfgang A1 - Paric, Ivan A1 - Brückl, Oliver A1 - Haslbeck, Matthias A1 - Schmidt, Ottfried A1 - Schwanzer, Peter A1 - Rabl, Hans-Peter A1 - Sterner, Michael A1 - Bauer, Franz A1 - Steinmann, Sven A1 - Eckert, Fabian A1 - Hofrichter, Andreas ED - Baier, Wolfgang T1 - Forschungsbericht 2017 T3 - Forschungsberichte der OTH Regensburg - 2017 KW - Forschung KW - Forschungsbericht Y1 - 2017 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:bvb:898-opus4-13835 SN - 978-3-9818209-3-5 CY - Regensburg ER -