Institute for Web Science and Technologies
Refine
Year of publication
Document Type
- Master's Thesis (29)
- Part of a Periodical (15)
- Doctoral Thesis (11)
- Study Thesis (5)
- Bachelor Thesis (3)
- Diploma Thesis (3)
- Habilitation (1)
Has Fulltext
- yes (67)
Is part of the Bibliography
- no (67)
Keywords
- Semantic Web (3)
- ontology (3)
- Linked Open Data (2)
- Maschinelles Lernen (2)
- OWL (2)
- OWL <Informatik> (2)
- Ontology (2)
- RDF <Informatik> (2)
- SPARQL (2)
- mobile phone (2)
Institute
Generative AI tutoring tools predominantly refine the wording, structure, and feasibility of a student’s initial problem framing. Whether AI assistance that instead poses counter-proposals – alternative framings, stakeholder perspectives, and questioned assumptions – changes the originality of the resulting framing is an open empirical question for data science education. This thesis investigates that Question in an exploratory study with thirty postgraduate students at Universität Koblenz. Each participant interacted with a bespoke web platform that walked them through three fixed-order stages on a sharedWi-Fi-dormitory dataset description: an Editorstyle AI stage, a Challenger-style AI stage, and a final unassisted synthesis. The final synthesis topic was rated on four dimensions (originality, feasibility, reasoning quality, clarity) by a human expert rater and an LLM second rater (Anthropic Claude) blinded to group assignment.
Because the planned counterbalanced within-subjects crossover could not be implemented, participants were sorted post hoc into an Editor-influenced and a Challengerinfluenced group based on triangulated self-reported impact and preference. Topics from the Challenger-influenced group were rated substantially higher on originality (Cohen’s d = 3.67, 95% CI [2.50, 4.84], p < .001, ICC = 0.859); topics from the Editor-influenced group were rated higher on feasibility (d = −2.04, 95% CI [−2.92,−1.16]) and clarity (d = −1.07, 95% CI [−1.84,−0.30]); a secondary unexpected association favoured the Challenger-influenced group on reasoning Quality (d = 1.03, 95% CI [0.27, 1.79]). The latter three dimensions had inter-rater reliability below the pre-specified 0.70 threshold and their effect-size magnitudes are interpreted as exploratory estimates. Perception data and open-ended responses suggested participants treated the two AI styles as functional complements assigned to distinct task-contexts, and 94% indicated interest in an integrated switcher mode. Because the analytic groups were defined by self-report and because the stage order was fixed, these results should be read as associations rather than causal effects of prompt style. The thesis contributes (a) empirical evidence of large betweengroup differences in framing originality consistent with a counter-proposal mechanism; (b) a methodological case study of a hybrid human-LLM rating protocol with dimension-specific reliability documentation; and (c) design directions for educational AI tools that surface, rather than choose for the learner, the kind of cognitive assistance offered.
The rapid advancement of large language models (LLMs) has introduced powerful artificial intelligence (AI) tools into educational environments. While AI assistants offer potential benefits for learning, concerns about over-reliance, reduced critical thinking, and impaired skill development have emerged. This thesis investigates how the timing of AI support (Just-in-Time vs. Always-On) and reflective mandates (Rationale-Required vs. Rationale-Optional) influence creative performance, learner autonomy, and critical engagement in AI-assisted data-science problem framing. Through a controlled 2x2 within-subjects factorial experimental design with 66 postgraduate participants, the study examines expert-rated idea quality, semantic diversity, perceived agency, AI reliance, cognitive load, and reflective reasoning across four AI-assisted conditions. The results show that Just-in-Time support and required reflection are independently associated with higher idea quality, greater agency, lower AI dependence, and more selective engagement with AI suggestions. The study does not assess delayed or long-term learning transfer; future work with longitudinal designs is needed to determine whether the immediate benefits observed here translate into durable skill development.
The integration of Large Language Models (LLMs) into information retrieval sys tems has transformed the user experience by providing direct, conversational responses instead of traditional ranked lists of search results. This modification raises substantial concerns about user trust, behaviour, and the risk of misinformation, even as it improves accessibility and convenience. This thesis investigates the impact of generative information retrieval on the reliability of synthesized answers, particularly focusing on how hallucination rates and semantic drift influence trust dynamics and information-seeking behavior. By evaluating the performance of different LLMs on fact-checking benchmarks, the study seeks to quantify the advantages of model scaling against the inherent risks of factual inaccuracy.
The study evaluates hallucination and user trust in LLM-augmented information retrieval systems using three fact-checking datasets. Three well-known semantic similarity metrics are employed to assess the alignment between LLM responses and ground-truth references. Furthermore, the hallucination rate and factual consistency are assessed by aligning model-generated responses with verified annotations in fact-checking datasets. We utilise bias detection measures to evaluate implicit stereotype reinforcement in LLM outputs. This study applies a comprehensive framework for evaluating and auditing hallucinations by combining quantitative performance metrics with user-level reliability insights. The work aims to establish a baseline for the transparency and reliability of LLMs in search and retrieval contexts.
Along with the increased use of automation processes in every other task, job recommendations as well as hiring have also become partially automated. In the process of applying only to those jobs that are recommended by a system or choosing only from those candidates that are selected by an automated system, it becomes highly important to find out if the automated systems are trustworthy enough to provide fair decisions. There has been research on fairness in this sector, where the main focus has been on a single protected attribute, in most cases ’gender.’ That is why the aim of this research is to delve deeper into a deep learning transformer-based algorithm used for job matching with a text-based resume dataset containing several demographic attributes to investigate the fairness of the algorithm not only for gender but also for other demographic groups such as race, age group, and experience level. The fairness evaluation has been carried out using multiple fairness metrics, including demographic parity, conditional demographic parity, and equal opportunity. The transformer models that are pretrained language models are chosen for this study due to their ability to understand the meaning and context of words in resumes and job descriptions. The thesis further investigates bias using an alternative approach by working on a dataset containing varying protected attributes and then conducting a comparable analysis of several bias mitigation methods, including multiple layers of data resampling, along with sensitivity testing through data modification in the preprocessing step of the recommendation process. The research reveals that a system performing fairly when considering a single protected attribute can even hide intersectional unfairness and that the bias mitigation methods do not ensure a balanced improvement across each subgroup when considering multiple combinational demographic groups.
This thesis tackles a common bottleneck in data-science courses: students struggle
to turn a broad interest into a focused, workable project idea. This thesis set out to
design and evaluate a compact assistant—EduIDEAtor—that makes this first mile
simpler and more intentional. The tool uses a text-first interface with plain inputs,
a small set of clearly different directions, and quick, reversible edits so students can
steer ideas without losing momentum. After building and iterating the web appli-
cation, The thesis evaluated how students experienced it and how it compared with
familiar, non-AI brainstorming. The findings are consistent: navigation and input
clarity were strong; students felt more able to generate and shape ideas; overall sat-
isfaction and willingness to continue using the tool were high. Two practical refine-
ments emerged—make back navigation clearly visible and give users finer control
over how broad or specific the suggestions are both achievable without changing
the core design. The contribution is a concrete pattern for first-mile ideation and a
set of actionable guidelines for course-level adoption.
This thesis investigates the potential of LLMs to provide personalized and context aware feedback in data science education. Traditional automated feedback systems often face challenges related to adaptiveness, scalability, and pedagogical alignment. To address these limitations, an experimental study was conducted using a custom-built AI tutor based on GPT-4o, which guided students through six clustering assignments designed around k-means and DBSCAN concepts. Data were collected from pre- and post experiment questionnaires and 516 dialogue exchanges recorded across ten individual tutoring sessions. A mixed-methods approach was adopted. Quantitative analysis compared pre and post-survey results to measure normalized learning gain (g = 0.375), effect size (Cohen’s d = 0.321), and statistical significance (t(9) = 0.811, p > 0.05). Qualitative analysis involved manual coding of AI responses for feedback type, adaptiveness, and student engagement. Results showed that students generally perceived the AI tutor positively, emphasizing its clear explanations, step-by-step guidance, and timely feedback. While moderate conceptual improvement was observed, statistical effects remained small, suggesting that perceived learning gains may exceed measured performance improvements. Conversational analysis revealed that adaptive responses and interactive questioning supported engagement, though occasional inconsistencies and reliance on predefined solutions limited deeper adaptiveness. The study contributes to educational technology research by providing empirical insight into both the capabilities and current constraints of LLM-based tutoring. Although student satisfaction was high, findings highlight the need for more sophisticated scaffolding, enhanced contextual adaptiveness, and hybrid human-AI feedback frameworks. Overall, this research demonstrates the promise of LLMs in delivering scalable, personalized support in data science education, while emphasizing the importance of continued evaluation to ensure pedagogical reliability and meaningful learning outcomes.
This study examines student housing experiences in Koblenz through a mixed-methods approach that integrates surveys, geospatial analysis, and quantitative modeling to explore affordability, accessibility, satisfaction, and equity. By analyzing both objective factors—like rent, distance to campus, and travel times—and subjective measures such as satisfaction and sentiment, it identifies disparities across student groups, especially affecting international students. The findings suggest that housing outcomes stem from both structural conditions and lived experiences, revealing possible biases within the housing system. The study advocates for targeted interventions, including expanding affordable residences, enhancing transport connectivity, and promoting transparency in housing allocation to ensure equitable access in Germany’s higher education context.
Enhancing AI Telephony System with
Large Language Models: A Comparative
Study on ’Telegra KIT’
(2025)
Nowadays, artificial intelligence (AI) has been widely used in telephony systems. It
allows telephony systems to automate customer interactions without any human in-
tervention. However, traditional approaches used across various tasks in telephony
systems has some limitations. To address these limitations, this thesis investigates
the potential of Large Language Models (LLMs) to enhance AI-driven telephony
systems by improving intent recognition, entity extraction, inquiry question gener-
ation, and synthetic training data creation.
We have conducted a comparative study to evaluate the performance of LLM-
based methods and traditional methods across above mentioned tasks. This study
is conducted on Telegra-KIT, an AI-based telephony platform. We have used real-
world data of Telegra-KIT to assess the performance. The results show that LLMs
outperformed traditional approaches by improving intent recognition accuracy from
18.42% to 39.71% and entity extraction accuracy from 52.69% to 82.21%. LLM-based
approach was also able to create effective inquiry questions when a caller’s intent is
uncertain. The results also demonstrated the ability of LLM to create high-quality
synthetic training data to address data scarcity issues and enhance model general-
ization.
The findings of this thesis contribute to the advancement of AI telephony sys-
tems by offering a more context-aware, adaptable approach for important tasks in
telephony.
The findings of this study demonstrate that the Random Forest (RF) algorithm provided the most accurate predictions in comparison with other boosting machine learning algorithms. Key drivers of energy consumption identified through XAI techniques such as SHAP and LIME include energy star rating, facility type, and floor area. These XAI methods helped enhance the interpretability of the models, making them more accessible for non-expert users, such as building managers and policymakers. By leveraging machine learning and XAI, this research provides a transparent and actionable framework for optimizing building energy efficiency and supporting sustainable energy management.
In the realm of education, the timely identification of students who need further support to succeed in their respective courses, plays a pivotal role in fostering aca- demic success and preventing potential setbacks. This thesis thus aims to contribute to this critical area by focusing on the development of predictive models for the early detection of at-risk students in their academic journey. The primary dataset used for this thesis is provided by kaggle, encompassing diverse student informa- tion, including demographic, socio-economic factors, and academic performance categorized into three different classes, presenting an imbalanced nature that poses a significant challenge.
Thus the primary objectives of this thesis are to address the problem of imbal- anced data, explore and assess the performance of multiple classification methods such as, logistic regression, decision tress, random forests and support vector ma- chines (SVM), neural networks, and create a comprehensive end-to-end processing pipeline which includes the systematic steps of balancing the data, model training and evaluation. Additionally the developed pipeline is tested on two additional datasets to assess its generalizability and robustness. This research aims to provide a comprehensive understanding of addressing the challenges of imbalanced data and how different classification methods and regression can be optimally applied to early detection of at-risk students. The findings are expected to aid educational institutions in supporting their students and enhancing academic success through timely interventions.
Key findings demonstrates the robustness of SVM SMOTE balancing technique acro- ss the datasets used in this study, where it consistently achieved best results when combined with various models, particularly highlighting the success of the combi- nation of Random Forest model with SVM SMOTE, and Decision tree model with SVM SMOTE in achieving notable accuracy rates. This emphasizes the adaptability of the balancing techniques employed, providing a strong foundation for predictive intervention educational settings.