Refine
Document Type
- Other (5) (remove)
Language
- English (5)
Has Fulltext
- yes (5) (remove)
Keywords
- Data Engineering (4)
- Data Science (3)
- Explainable Artificial Intelligence (3)
- Government (3)
- Schema Inference (3)
- Python (2)
- ChatGPT (1)
- Computersicherheit (1)
- Cybersecurity (1)
- Encryption (1)
Institute
Data engineering is an integral part of the data science process. It comprises tasks such as data ingestion, data transformation, and data quality assurance. In order to fulfill these tasks, schema inference is an important capability. Its goal is to detect the structure of a dataset and to derive metadata on hierarchies, data types, etc. Artificial intelligence (AI) has the potential to automate schema inference and thus increase the efficiency of the data science process. However, as government institutions are subject to special regulations, explainability of AI models can be a mandatory requirement. Goal of this research protocol is to plan a systematic review of literature on schema inference for tabular data with explainable AI (XAI). This third version was derived from two earlier review protocols.
Data engineering is an integral part of the data science process. It comprises tasks such as data ingestion, data transformation, and data quality assurance. In order to fulfill these tasks, schema inference is an important capability. Its goal is to detect the structure of a dataset and to derive metadata on hierarchies, data types, etc. Artificial intelligence (AI) has the potential to automate schema inference and thus increase the efficiency of the data science process. However, as government institutions are subject to special regulations, explainability of AI models can be a mandatory requirement. Goal of this research protocol is to plan a systematic review of literature on schema inference with explainable AI (XAI) for data engineering in government institutions. This second version includes adjustments resulting from the first iteration of the review.
Data engineering is an integral part of the data science process. It comprises tasks such as data ingestion, data transformation, and data quality assurance. In order to fulfill these tasks, schema inference is an important capability. Its goal is to detect the structure of a dataset and to derive metadata on hierarchies, data types, etc. Artificial intelligence (AI) has the potential to automate schema inference and thus increase the efficiency of the data science process. However, as government institutions are subject to special regulations, explainability of AI models can be a mandatory requirement. Goal of this research protocol is to plan a systematic review of literature on schema inference with explainable AI (XAI) for data engineering in government institutions.
If we believe Edward Snowden, encryption is "the only true protection against surveillance". However, advances in quantum technology might endanger this safeguard. Our article discusses why quantum computing poses a threat to data security and what to do about it. Instead of a purely theoretical analysis, we build on code examples using Python, C, and Linux.
Data engineering makes up a large part of the data science process. In CRISP-DM this process stage is called "data preparation". It comprises tasks such as data ingestion, data transformation and data quality assurance. In our article we solve typical data engineering tasks using ChatGPT and Python. By doing so, we explore the link between data engineering and the new discipline of prompt engineering.