Refine
Document Type
- Conference Proceeding (3)
- Article (1)
Institute
Has Fulltext
- yes (4)
Is part of the Bibliography
- yes (4)
Keywords
This paper introduces aphaDIGITAL – a mobile application for speech and language therapy (SLT) support of German-speaking people with aphasia. The app includes automatic speech recognition and text analysis components, which allows giving detailed feedback to the users on different types of errors. Furthermore, the exercises are accompanied by an avatar-based SLT assistant, which is created for this specific purpose. The user performs the exercises, individually configured for her by the SLT practitioner, on a mobile device. Data collection and processing are carried out on the server.
Those who suffer from aphasia benefit from digital speech and language therapy solutions, and automatic speech recognition (ASR) has been already used for giving feedback on the correctness of the answers in naming exercises. AphaDIGITAL application is to provide German-speaking users with detailed feedback on phonemic/phonetic and semantic errors, based on automatic speech and language processing. For this purpose, open-source ASR solutions for German were evaluated on different corpora of atypical speech, including two small datasets with aphasic speech samples. Character error rate, the number of precisely recognized items and empty outputs served as evaluation metrics. The four selected models are generally robust to the deteriorated condition of speech and audio quality and consistently outperform commercial models in atypical speech recognition. Applying error acceptance threshold, additional use of phonemic error rate, and other valuable insights for ASR implementation in aphaDIGITAL are discussed.
Diese Studie analysiert, ob Gesichtsausdrücke in generierten Bildern genauso wahrgenommen werden wie in realen Bildern. Dabei werden die Wahrnehmung der Emotionsintensität und Sympathie, die Fähigkeit zur Emotionserkennung sowie die Unterscheidung zwischen echten und generierten Bildern untersucht. Zur Beantwortung dieser Fragen wurde eine Online-Umfrage mit mehr als 200 Teilnehmern durchgeführt. Die Ergebnisse zeigen geringfügige bis moderate Unterschiede in der Wahrnehmung zwischen generierten und realen Bildern, allerdings wird auch deutlich, dass die Unterscheidung zwischen beiden zunehmend schwieriger wird.
Linguistic and extralinguistic factors in automatic speech recognition of German atypical speech
(2024)
Automatic speech recognition (ASR) has been already used in speech and language therapy, including diagnostic tasks and practice exercises for people with aphasia (PWA). The lack of relevant data makes it difficult to evaluate the algorithms’ suitability for German-speaking PWA. For the current project, four open-source ASR models were selected based on their performance on other types of atypical speech, and the details of their evaluation are presented in this paper. The four selected models are generally robust to speakers’ gender and age. The one-word recognition yields better results for words of moderate length. Speech rate should be neither too slow nor too quick for lower error rates both in words and phrases, and the latter should be also of moderate length.

