0 Informatik, Informationswissenschaft, allgemeine Werke
Data engineering is an integral part of the data science process. It comprises tasks such as data ingestion, data transformation, and data quality assurance. In order to fulfill these tasks, schema inference is an important capability. Its goal is to detect the structure of a dataset and to derive metadata on hierarchies, data types, etc. Artificial intelligence (AI) has the potential to automate schema inference and thus increase the efficiency of the data science process. However, as government institutions are subject to special regulations, explainability of AI models can be a mandatory requirement. Goal of this research protocol is to plan a systematic review of literature on schema inference for tabular data with explainable AI (XAI). This third version was derived from two earlier review protocols.
Data engineering is an integral part of the data science process. It comprises tasks such as data ingestion, data transformation, and data quality assurance. In order to fulfill these tasks, schema inference is an important capability. Its goal is to detect the structure of a dataset and to derive metadata on hierarchies, data types, etc. Artificial intelligence (AI) has the potential to automate schema inference and thus increase the efficiency of the data science process. However, as government institutions are subject to special regulations, explainability of AI models can be a mandatory requirement. Goal of this research protocol is to plan a systematic review of literature on schema inference with explainable AI (XAI) for data engineering in government institutions.
In 2021, together with fellow scientists, we conducted a survey at the German Chaos Computer Club (CCC). Our goal was to find out which programming languages are most commonly used by hackers. This article follows up the survey and compares its findings with an analysis of the Exploit Database. Readers get step-by-step instructions on how to set up the analysis environment and a summary of the results. Thus, the article not only covers applied techniques, but also offers insights into the world of cybersecurity.