• search hit 7 of 133
Back to Result List

Deep neural learning on weighted datasets utilizing label disagreement from crowdsourcing

  • Experts and crowds can work together to generate high-quality datasets, but such collaboration is limited to a large-scale pool of data. In other words, training on a large-scale dataset depends more on crowdsourced datasets with aggregated labels than expert intensively checked labels. However, the limited amount of high-quality dataset can be used as an objective test dataset to build a connection between disagreement and aggregated labels. In this paper, we claim that the disagreement behind an aggregated label indicates more semantics (e.g. ambiguity or difficulty) of an instance than just spam or error assessment. We attempt to take advantage of the informativeness of disagreement to assist learning neural networks by computing a series of disagreement measurements and incorporating disagreement with distinct mechanisms. Experiments on two datasets demonstrate that the consideration of disagreement, treating training instances differently, can promisingly result in improved performance.

Export metadata

Additional Services

Search Google Scholar
Metadaten
Author: Ingo SchmittORCiDGND, Dongsheng Wang, Prayaq Tiwari, Mohammad Shorfuzzaman
DOI:https://doi.org/10.1016/j.comnet.2021.108227
ISSN:1389-1286
Title of the source (English):Computer Networks
Document Type:Scientific journal article peer-reviewed
Language:English
Year of publication:2021
Tag:Assessed dataset; Instance weight; Neural networks
Volume/Year:196
Number of pages:7
Article number:108227
Faculty/Chair:Fakultät 1 MINT - Mathematik, Informatik, Physik, Elektro- und Informationstechnik / FG Datenbank- und Informationssysteme
Einverstanden ✔
Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu. Unsere Datenschutzerklärung finden Sie hier.