Understanding Human-AI Interaction Through Chat Logs: Linguistic Patterns, Breakdowns, and User Expectations in a RAG-Based Sales Assistant

  • Retrieval-augmented generation (RAG) is increasingly used across knowledge-intensive enterprise contexts, yet little is known about real-world interaction with such systems. We present a qualitative field study of a RAG-based assistant in B2B sales, analyzing 190 chat sessions and a complementary user survey. Drawing on conversational and HCI perspectives, we examine interaction patterns, breakdowns, and repair practices in authentic user-AI dialogues. Results show that interactions are short, directive, and shaped by search-like mental models. Breakdowns frequently occur due to underspecified input and incomplete system responses, with repair largely initiated by users. Survey findings indicate generally positive perceptions of usefulness and trust, though expectations of complete answers contrast with limited clarification behavior. We contribute an analysis of real-world RAG interaction and derive implications for proactive clarification and hybrid interaction.

Export metadata

Additional Services

Search Google Scholar
Metadaten
Author:Hannes SchneiderORCiD, Androniki MertsiotakiORCiD, Sven WinkelmannORCiD
DOI:https://doi.org/10.1145/3820253.3831375
Parent Title (English):Proceedings of Mensch und Computer 2026
Publisher:ACM
Place of publication:New York, NY, USA
Document Type:conference proceeding (article)
Language:English
Date of first Publication:2026/08/29
Reviewed:Begutachtet/Reviewed
Release Date:2026/08/24
Tag:DFG FIP SPEECHES
Pagenumber:7
First Page:466
Last Page:472
institutes:Ohm User Experience Center (Ohm-UX)
Research Themes:Digitalisierung & Künstliche Intelligenz
Licence (German):Creative Commons - CC BY - Namensnennung 4.0 International
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.