CohereLabs/black-box-api-challenges

Dataset Card Paper: On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research Abstract: Perception of toxicity evolves over time and often differs between geographies and cultural backgrounds. Similarly, black-box commercially available APIs for detecting toxicity, such as the Perspective API, are not static, but frequently retrained to address any unattended weaknesses and biases. We evaluate the implications of these changes on the reproducibility of… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/black-box-api-challenges.