The Two Shades of Dubbing in Neural Machine Translation
- Dubbing has two shades; synchronisation constraints are applied only when the actor’s mouth is visible on screen, while the translation is unconstrained for off-screen dubbing. Consequently, different synchronisation requirements, and therefore translation strategies, are applied depending on the type of dubbing. In this work, we manually annotate an existing dubbing corpus (Heroes) for this dichotomy. We show that, even though we did not observe distinctive features between on- and off-screen dubbing at the textual level, on-screen dubbing is more difficult for MT (-4 BLEU points). Moreover, synchronisation constraints dramatically decrease translation quality for off-screen dubbing. We conclude that, distinguishing between on-screen and off-screen dubbing is necessary for determining successful strategies for dubbing-customised Machine Translation.
Author: | Alina Karakanta, Supratik Bhattacharya, Shravan Nayak, Timo BaumannORCiDGND, Matteo Negri, Marco Turchi |
---|---|
DOI: | https://doi.org/10.18653/v1/2020.coling-main.382 |
Parent Title (English): | Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020): Barcelona, Spain (Online) |
Publisher: | International Committee on Computational Linguistics |
Place of publication: | Stroudsburg, PA, USA |
Editor: | Donia Scott, Nuria Bel, Chengqing Zong |
Document Type: | conference proceeding (article) |
Language: | English |
Year of first Publication: | 2020 |
Release Date: | 2022/04/09 |
First Page: | 4327 |
Last Page: | 4333 |
Institutes: | Fakultät Informatik und Mathematik |
Begutachtungsstatus: | peer-reviewed |
Publication: | Externe Publikationen |
research focus: | Information und Kommunikation |
Licence (German): | Creative Commons - CC BY - Namensnennung 4.0 International |