Zentrum für Künstliche Intelligenz (KIZ)
Refine
Document Type
- conference proceeding (article) (48)
- Article (15)
- Part of a Book (4)
- Report (4)
- Book (2)
- Working Paper (1)
Reviewed
- Begutachtet/Reviewed (60)
Keywords
Institute
Major cities worldwide experience problems with the performance of their road transportationnetworks, and the continuous increase in traffic demand presents a substantial challenge to theoptimal operation of urban road networks and the efficiency of traffic control strategies. The operation of transportation systems is widely considered to display fragile property, i.e., the loss inperformance increases exponentially with the linearly growing magnitude of disruptions. Meanwhile, the risk engineering community is embracing the novel concept of antifragility, enablingsystems to learn from past events and exhibit improved performance under disruptions of previously unseen magnitudes. In this study, based on established traffic flow theory knowledge,namely the Macroscopic Fundamental Diagram (MFD), we first conduct a rigorous mathematicalanalysis to theoretically prove the fragile nature of road transportation networks. Subsequently,we propose a skewness-based indicator that can be readily applied to cross-compare the degreeof fragility for different networks solely dependent on the MFD-related parameters. Finally, weimplement a numerical simulation calibrated with real-world network data to bridge the gapbetween the theoretical proof and the practical operations, with results showing the reinforcingeffect of higher-order statistics and stochasticity on the fragility of the networks. This work aimsto demonstrate the fragile nature of road transportation networks and guide researchers towardsadopting the methods of antifragile design for future networks and traffic control strategies.
This study investigates the capabilities of Large Language Models to simulate counselling clients in educational roleplays in comparison to human role-players. Initially, we recorded role-playing sessions, where novice counsellors interacted with human peers acting as clients, followed by role-plays between humans and clients simulated by Mistrals Mixtral 8x7b using 4-bit quantization. These interactions were analysed with a counselling communication pattern system at sentence level. We investigated two key questions: (1) to what extent LLM-generated responses replicate authentic conversational dynamics and (2) whether counsellors’ communication behaviour differs when interacting with human versus LLM-simulated clients. The findings highlight both similarities and differences in the application of counselling patterns across scenarios, showing the potential of LLM-based role-playing exercises to enhance counselling competencies and to identify areas for further refinement in virtual client simulations.
KI-Assistenz in der psychosozialen Onlineberatung – Erkenntnisse zur Akzeptanz bei Fachkräften
(2026)
Rising global demand for mental health support creates significant service delivery challenges, with asynchronous email counselling serving as a crucial low-threshold channel for accessing care. This paper presents CAIA, a co-designed AIbased tool suite that demonstrates responsible AI integration into counselling practice through seven LLM-driven functions enhanced by retrieval-augmented generation. A field evaluation involved 34 professional counsellors conducting authentic sessions with trained student counsellees (36 threads, 321 messages, 1,257 AI outputs). User behaviour analysis confirms substantial adoption, revealing that professional autonomy and information accuracy are decisive for sustained acceptance, with counsellors particularly valuing interpretive functionalities that provide new perspectives and stimulate professional reflection.
The expanding field of psychosocial online email counselling has created a demand for advanced tools to support counsellors in managing diverse client interactions. This paper introduces CAIA (Counsellor Artificial Intelligence Assistant), a comprehensive AI-driven system currently under active development, designed to condense and present information to counsellors in a structured manner. CAIA integrates several AI-based features, including Automatic Subject Generation, Case Summarisation, Timeline Management, Social Network Graph creation, and Case Classification. The features are designed to assist the counsellors, allowing them to engage more deeply with each case while ensuring that the client's needs remain paramount. Each feature presented in the paper addresses a specific problem in psychosocial online counselling, proposes a solution, discusses a technical implementation approach, and highlights the challenges encountered. Additionally, the paper discusses ethical considerations associated with an AI integration.
Large Language Models (LLMs) have the potential to enhance e-mental health and psychosocial e-mail counselling by automating tasks such as generating concise and relevant subject lines for client communications. However, concerns regarding accuracy, reliability, data privacy and resource efficiency persist. This study investigates the performance of several LLMs in generating subject lines for e-mail threads, yielding a total of 253 generated subjects. Each subject line was assessed by six raters, including five counselling professionals and one AI system, using a three-category quality scale (Good, Fair, Poor). The results show that LLMs can generally produce concise subject lines considered helpful by experts. While GPT-4o and GPT-3.5 Turbo outperformed other models, their use is restricted in mental health settings due to data protection concerns, making the evaluation of open-source models crucial. Among open-source models, SauerkrautLM LLama 3 70b (4-bit) and SauerkrautLM Mixtral 8x7b (both 8-bit and 4-bit versions) delivered promising results with potential for further development. In contrast, models with lower parameter counts produced predominantly poor outputs.
Deploying large language models (LLMs) in real-world applications requires robust safety guard models to detect and block harmful user prompts. While large safety guard models achieve strong performance, their computational
cost is substantial. To mitigate this, smaller distilled models are used, but they often underperform on “hard” examples where the larger model provides accurate predictions. We observe that many inputs can be reliablyhandled by the smaller model, while only a small fraction require the larger model’s capacity. Motivated by this, we propose SafeRoute, a binary router that distinguishes hard examples from easy ones. Our method selectively applies the larger safety guard model to the data that the router considers hard, improving efficiency while maintaining accuracy compared to solely using the larger safety guard model. Experimental results on multiple benchmark datasets demonstrate that our adaptive model selection significantly enhances the trade-off between computational cost and safety performance, outperforming relevant baselines.
Current work on speech-based dementia assessment focuses on either feature extraction to predict assessment scales, or on the automation of existing test procedures. Most research uses public data unquestioningly and rarely performs a detailed error analysis, focusing primarily on numerical performance. We perform an in-depth analysis of an automated standardized dementia assessment, the Syndrom-Kurz-Test. We find that while there is a high overall correlation with human annotators, due to certain artifacts, we observe high correlations for the severely impaired individuals, which is less true for the healthy or mildly impaired ones. Speech production decreases with cognitive decline, leading to overoptimistic correlations when test scoring
relies on word naming. Depending on the test design, fallback handling introduces further biases that favor certain groups. These pitfalls remain independent of group distributions in datasets and require differentiated analysis of target groups.
Automatic speech recognition (ASR) for pathologic speech remains a major challenge due to high variability in articulation, phonation, and prosody distortions. In this work, we propose a pathology-aware speech encoder based on BEST-RQ pre-training, which incorporates 46k hours of speech, including
pathologic and atypical speech. We continue pre-training for domain adaptation and experiment with etiology-specific codebooks. We achieve a 13.2% relative word error rate (WER) improvement using the pathology-aware speech encoder with etiology-specific continued pre-training. Additionally, we examine the impact of incorporating synthetic and out-of-domain (OOD) data to further enhance ASR performance. Synthetic data reduces WER by up to 8.7%, while OOD data improves WER by 12.2%. Finally, we introduce a semantic similaritybased data augmentation technique to optimize data selection, achieving a WER improvement of up to 9.7% while minimizing
the need for additional training data.