Build your own SQL-on-Hadoop Query Engine A Report on a Term Project in a Master-level Database Course
- This is a report on a course taught at OTH Regensburg in the summer term of 2018. The students in this course built their own SQL-on-Hadoop engine as a term project in just 8 weeks. miniHive is written in Python and compiles SQL queries into MapReduce workflows. These are then executed on Hadoop. miniHive performs generic query optimizations (selection and projection pushdown, or cost-based join reordering), as well as MapReduce-specific optimizations. The course was taught in English, using a flipped classroom model. The course material was mainly compiled from third-party teaching videos. This report describes the course setup, the miniHive milestones, and gives a short review of the most successful student projects.
Author: | Stefanie ScherzingerORCiD |
---|---|
DOI: | https://doi.org/10.1145/3377330.3377336 |
Parent Title (English): | ACM SIGMOD Record |
Publisher: | ACM |
Document Type: | Article |
Language: | English |
Year of first Publication: | 2019 |
Release Date: | 2022/02/03 |
Volume: | 48 |
Issue: | 2 |
First Page: | 33 |
Last Page: | 38 |
Institutes: | Fakultät Informatik und Mathematik |
Begutachtungsstatus: | peer-reviewed |
research focus: | Lebenswissenschaften und Ethik |
Licence (German): |