CrowS-Pairs
Introduced by Nangia et al. in CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language Models
CrowS-Pairs has 1508 examples that cover stereotypes dealing with nine types of bias, like race, religion, and age. In CrowS-Pairs a model is presented with two sentences: one that is more stereotyping and another that is less stereotyping. The data focuses on stereotypes about historically disadvantaged groups and contrasts them with advantaged groups.
Source: CrowS-Pairs: A Challenge Dataset for Measuring Social Biases in Masked Language ModelsBenchmarks
| Trend | Task | Dataset Variant | Best Model | Paper | Code |
|---|---|---|---|---|---|
|
CrowS-Pairs
|
GAL 120B
|
Papers
| Paper | Code | Results | Date | Stars |
|---|
