TY - CONF A1 - Fuhrmann, Thomas A1 - Niemetz, Michael T1 - Analysis and Improvement of Engineering Exams Toward Competence Orientation by Using an AI Chatbot T2 - Towards a Hybrid, Flexible and Socially Engaged Higher Education: Proceedings of the 26th International Conference on Interactive Collaborative Learning (ICL2023), Volume 1 N2 - ChatGPT is currently one of the most advanced general chatbots. This development leads to diverse challenges in higher education, like new forms of teaching and learning, additional exam methods, new possibilities for plagiarism, and many more topics. On the other side with the development of advanced AI tools, pure knowledge will be less and less important, and demands from industry will change toward graduates with higher competencies. Education has therefore to be changed from knowledge-centered toward competence centered. The goal of this article is to use ChatGPT for analyzing and improving the competence orientation of exams in engineering education. The authors use ChatGPT to analyze exams from different engineering subjects to evaluate the performance of this chatbot and draw conclusions about the competence orientation of the tested exams. The obtained information is used to develop ideas for increasing the competence orientation of exams. From this analysis, it is visible that ChatGPT gives good performance mainly where knowledge is tested. It has, however, much more problems with transfer questions or tasks where students need creativity or complex insights for finding new solutions. Based on this result, exams and also lectures can be optimized toward competence orientation. KW - Engineering education KW - Competence orientation KW - Exam analysis KW - AI chatbot KW - ChatGPT Y1 - 2024 UR - https://opus4.kobv.de/opus4-oth-regensburg/frontdoor/index/index/docId/7015 SN - 9783031519789 SN - 2367-3370 SP - 403 EP - 411 PB - Springer Nature CY - Cham ER -