TY - CHAP A1 - Wagner, Dominik A1 - Baumann, Ilja A1 - Engert, Natalie A1 - Lee, Seanie A1 - Nöth, Elmar A1 - Riedhammer, Korbinian A1 - Bocklet, Tobias T1 - Personalized Fine-Tuning with Controllable Synthetic Speech from LLM-Generated Transcripts for Dysarthric Speech Recognition T2 - Interspeech 2025 N2 - In this work, we present our submission to the Speech Accessibility Project challenge for dysarthric speech recognition. We integrate parameter-efficient fine-tuning with latent audio representations to improve an encoder-decoder ASR system. Synthetic training data is generated by fine-tuning Parler-TTS to mimic dysarthric speech, using LLM-generated prompts for corpus-consistent target transcripts. Personalization with x-vectors consistently reduces word error rates (WERs) over non-personalized fine-tuning. AdaLoRA adapters outperform full fine-tuning and standard low-rank adaptation, achieving relative WER reductions of ∼23% and ∼22%, respectively. Further improvements (∼5% WER reduction) come from incorporating wav2vec 2.0-based audio representations. Training with synthetic dysarthric speech yields up to ∼7% relative WER improvement over personalized fine-tuning alone. KW - speech recognition KW - dysarthric speech KW - personalization KW - low-rank adaptation KW - synthetic data Y1 - 2025 U6 - https://doi.org/10.21437/Interspeech.2025-2155 SN - 2958-1796 SP - 3294 EP - 3298 PB - ISCA CY - ISCA ER -