Ranking and Comparing Speakers Based on Crowdsourced Pairwise Listener Ratings
- Speech quality and likability is a multi-faceted phenomenon consisting of a combination of perceptory features that cannot easily be computed nor weighed automatically. Yet, it is often easy to decide which of two voices one likes better, even though it would be hard to describe why, or to name the underlying basic perceptory features. Although likability is inherently subjective and individual preferences differ, generalizations are useful and there is often a broad intersubjective consensus about whether one speaker is more likeable than another. We present a methodology to efficiently create a likability ranking for many speakers from crowdsourced pairwise likability ratings which focuses manual rating effort on pairs of similar quality using an active sampling technique. Using this methodology, we collected pairwise likability ratings for many speakers (>220) from many raters (>160). We analyze listener preferences by correlating the resulting ranking with various acoustic and prosodic features. We also present a neural network that is able to model the complexity of listener preferences and the underlying temporal evolution of features. The recurrent neural network achieves remarkably high performance in estimating the pairwise decisions and an ablation study points toward the criticality of modeling temporal aspects in speech quality assessment.
Author: | Timo BaumannORCiDGND |
---|---|
DOI: | https://doi.org/10.1007/978-981-15-6627-1_14 |
ISBN: | 978-981-15-6626-4 |
ISBN: | 978-981-15-6627-1 |
Parent Title (English): | Voice attractiveness: Studies on Sexy, Likable, and Charismatic Speakers |
Publisher: | Springer |
Place of publication: | Singapore |
Editor: | Benjamin Weiss, Jürgen Trouvain, Mélissa Barkat-Defradas, John J. Ohala |
Document Type: | Part of a Book |
Language: | English |
Year of first Publication: | 2021 |
Release Date: | 2022/04/09 |
Tag: | Crowdsourcing; Found data; Likability ratings; Ranking; Sequence modelling; Speech quality |
First Page: | 263 |
Last Page: | 279 |
Andere Schriftenreihe: | Prosody, Phonology and Phonetics |
Institutes: | Fakultät Informatik und Mathematik |
Publication: | Externe Publikationen |
research focus: | Information und Kommunikation |
Licence (German): | Keine Lizenz - Es gilt das deutsche Urheberrecht: § 53 UrhG |