Text-Guided Speech Representations for Language Acquisition Assessment

  • Assessing spoken language abilities in children is critical for early detection of developmental delays. We propose a two-stage framework for automatic pronunciation assessment, targeting classification of items in a language development screening. In the first stage, we fine-tune a sentence transformer using phonetic and label-informed losses to create a structured latent text space. In the second stage, we fine-tune an audio encoder to project spoken utterances into the text space. Our approach enables inference from audio alone while preserving alignment with phonetically meaningful structure. Compared to baseline systems, our method achieves the best classification performance and provides a latent space suitable for downstream analysis. This facilitates the identification of phonological or grammatical error patterns from cluster structure, paving the way for potentially interpretable assessment of early language acquisition.

Export metadata

Additional Services

Search Google Scholar
Metadaten
Author:Ilja BaumannORCiD, Dominik Wagner, Philipp SeebergerORCiD, Korbinian RiedhammerORCiD, Tobias BockletORCiD
DOI:https://doi.org/10.1109/ASRU65441.2025.11434732
Parent Title (English):2025 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)
Publisher:IEEE
Place of publication:Honolulu, HI, USA
Document Type:conference proceeding (article)
Language:English
Reviewed:Begutachtet/Reviewed
Release Date:2026/06/10
Tag:children’s speech; language assessment; text-guided speech representations
Volume:2025
Pagenumber:8
First Page:1
Last Page:8
institutes:Fakultät Informatik
Zentrum für Künstliche Intelligenz (KIZ)
Research Themes:Digitalisierung & Künstliche Intelligenz
Verstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.