TY - CONF A1 - Steigerwald, Philipp A1 - Albrecht, Jens T1 - Comparing Large Language Models for Automated Subject Line Generation in e-Mental Health: A Performance Study T2 - Proceedings of the 11th International Conference on Information and Communication Technologies for Ageing Well and e-Health N2 - Large Language Models (LLMs) have the potential to enhance e-mental health and psychosocial e-mail counselling by automating tasks such as generating concise and relevant subject lines for client communications. However, concerns regarding accuracy, reliability, data privacy and resource efficiency persist. This study investigates the performance of several LLMs in generating subject lines for e-mail threads, yielding a total of 253 generated subjects. Each subject line was assessed by six raters, including five counselling professionals and one AI system, using a three-category quality scale (Good, Fair, Poor). The results show that LLMs can generally produce concise subject lines considered helpful by experts. While GPT-4o and GPT-3.5 Turbo outperformed other models, their use is restricted in mental health settings due to data protection concerns, making the evaluation of open-source models crucial. Among open-source models, SauerkrautLM LLama 3 70b (4-bit) and SauerkrautLM Mixtral 8x7b (both 8-bit and 4-bit versions) delivered promising results with potential for further development. In contrast, models with lower parameter counts produced predominantly poor outputs. Y1 - 2025 UR - https://opus4.kobv.de/opus4-ohm/frontdoor/index/index/docId/4391 VL - 2025 SP - 70 EP - 77 PB - SCITEPRESS - Science and Technology Publications ER -