arXiv 2205.09209
"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Dataset
By Eric Michael Smith, Melissa Hall, et al.
Published 2022-05-18
Discussion
Read the public discussion and references gathered around this paper.
As language models grow in popularity, it becomes increasingly important to clearly measure all possible markers of demographic identity in order to avoid perpetuating existing societal harms. Many datasets for measuring bias currently exist, but they are restricted in their coverage of demographic axes and are commonly used with preset bias tests that presuppose which types of biases models can exhibit. In this wor…