arXiv 2012.04169
Improving Human-Labeled Data through Dynamic Automatic Conflict Resolution
By David Q. Sun, Hadas Kotek, et al.
Published 2020-12-08
Mindmap
Browse the paper's core ideas, clusters, and relationships in a structured outline.
This paper develops and implements a scalable methodology for (a) estimating the noisiness of labels produced by a typical crowdsourcing semantic annotation task, and (b) reducing the resulting error of the labeling process by as much as 20-30% in comparison to other common labeling strategies. Importantly, this new approach to the labeling process, which we name Dynamic Automatic Conflict Resolution (DACR), does no…